Scrapegraph Sdk
๐ง Install dependencies
๐ Import ScrapeGraph API key
You can find the Scrapegraph API key here
Scrapegraph API key: ยทยทยทยทยทยทยทยท
๐ Defining an Output Schema for Webpage Content Extraction
If you already know what you want to extract from a webpage, you can define an output schema using Pydantic. This schema acts as a "blueprint" that tells the AI how to structure the response.
Pydantic Schema Quick Guide
Types of Schemas
- Simple Schema
Use this when you want to extract straightforward information, such as a single piece of content.
from pydantic import BaseModel, Field
# Simple schema for a single webpage
class PageInfoSchema(BaseModel):
title: str = Field(description="The title of the webpage")
description: str = Field(description="The description of the webpage")
# Example Output JSON after AI extraction
{
"title": "ScrapeGraphAI: The Best Content Extraction Tool",
"description": "ScrapeGraphAI provides powerful tools for structured content extraction from websites."
}
- Complex Schema (Nested)
If you need to extract structured information with multiple related items (like a list of repositories), you can nest schemas.
from pydantic import BaseModel, Field
from typing import List
# Define a schema for a single repository
class RepositorySchema(BaseModel):
name: str = Field(description="Name of the repository (e.g., 'owner/repo')")
description: str = Field(description="Description of the repository")
stars: int = Field(description="Star count of the repository")
forks: int = Field(description="Fork count of the repository")
today_stars: int = Field(description="Stars gained today")
language: str = Field(description="Programming language used")
# Define a schema for a list of repositories
class ListRepositoriesSchema(BaseModel):
repositories: List[RepositorySchema] = Field(description="List of GitHub trending repositories")
# Example Output JSON after AI extraction
{
"repositories": [
{
"name": "google-gemini/cookbook",
"description": "Examples and guides for using the Gemini API",
"stars": 8036,
"forks": 1001,
"today_stars": 649,
"language": "Jupyter Notebook"
},
{
"name": "TEN-framework/TEN-Agent",
"description": "TEN Agent is a conversational AI powered by TEN, integrating Gemini 2.0 Multimodal Live API, OpenAI Realtime API, RTC, and more.",
"stars": 3224,
"forks": 311,
"today_stars": 361,
"language": "Python"
}
]
}
Key Takeaways
- Simple Schema: Perfect for small, straightforward extractions.
- Complex Schema: Use nesting to extract lists or structured data, like "a list of repositories."
Both approaches give the AI a clear structure to follow, ensuring that the extracted content matches exactly what you need.
๐ Initialize SGAI Client and start extraction
Initialize the client for scraping (an async version using AsyncScrapeGraphAI is available here).
Use the extract method to pull structured data from a URL with AI. The same method also accepts raw html= or markdown= if you already have the page content.
Print the response
Tokens used: prompt_tokens=45006 completion_tokens=36908
Trending Repositories:
{
"repositories": [
{
"name": "OMNeT++ NED",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OMNeT++ MSG",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "ooc",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Opa",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Opal",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Open Policy Agent",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenAPI Specification v2",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenAPI Specification v3",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenCL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenEdge ABL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenQASM",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenRC runscript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenSCAD",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenStep Property List",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OpenType Feature File",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Option List",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Org",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "OverpassQL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Ox",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Oxygene",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Oz",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "P4",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pact",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pan",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Papyrus",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Parrot",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Parrot Assembly",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Parrot Internal Representation",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pascal",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pawn",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PDDL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PEG.js",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pep8",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Perl",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PHP",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pic",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pickle",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PicoLisp",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PigLatin",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pike",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pip Requirements",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pkl",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PlantUML",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PLpgSQL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PLSQL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pod",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pod 6",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PogoScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Polar",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pony",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Portugol",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PostCSS",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PostScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "POV-Ray SDL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PowerBuilder",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PowerShell",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Praat",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Prisma",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Processing",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Procfile",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Proguard",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Prolog",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Promela",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Propeller Spin",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Protocol Buffer",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Protocol Buffer Text Format",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Public Key",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pug",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Puppet",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pure Data",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PureBasic",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "PureScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Pyret",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Python",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Python console",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Python traceback",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "q",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Q#",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "QMake",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "QML",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Qt Script",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Quake",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "QuakeC",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "QuickBASIC",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "R",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Racket",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Ragel",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Raku",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RAML",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Rascal",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RAScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Raw token data",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RBS",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RDoc",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Readline Config",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "REALbasic",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Reason",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "ReasonLIGO",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Rebol",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Record Jar",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Red",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Redcode",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Redirect Rules",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Regular Expression",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Ren'Py",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RenderScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "ReScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "reStructuredText",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "REXX",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Rez",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Rich Text Format",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Ring",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Riot",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RMarkdown",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RobotFramework",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "robots.txt",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Roc",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Rocq Prover",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Roff",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Roff Manpage",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RON",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "ROS Interface",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Rouge",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RouterOS Script",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RPC",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RPGLE",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RPM Spec",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Ruby",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "RUNOFF",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Rust",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Sage",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Sail",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SaltStack",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SAS",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Sass",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Scala",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Scaml",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Scenic",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Scheme",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Scilab",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SCSS",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "sed",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Self",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SELinux Policy",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "ShaderLab",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Shell",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "ShellCheck Config",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "ShellSession",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Shen",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Sieve",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Simple File Verification",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Singularity",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Slang",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Slash",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Slice",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Slim",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Slint",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Smali",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Smalltalk",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Smarty",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Smithy",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SmPL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SMT",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Snakemake",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Solidity",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Soong",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SourcePawn",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SPARQL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Spline Font Database",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SQF",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SQL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SQLPL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Squirrel",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SRecode Template",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SSH Config",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Stan",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Standard ML",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "STAR",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Starlark",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Stata",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "STL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "STON",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "StringTemplate",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Stylus",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SubRip Text",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SugarSS",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SuperCollider",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SurrealQL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Survex data",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Svelte",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SVG",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Sway",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Sweave",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Swift",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SWIG",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "SystemVerilog",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Tact",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Talon",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Tcl",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Tcsh",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Tea",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Teal",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "templ",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Terra",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Terraform Template",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TeX",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Texinfo",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Text",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TextGrid",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Textile",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TextMate Properties",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Thrift",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TI Program",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TL-Verilog",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TLA",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TMDL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Toit",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TOML",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Tor Config",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Tree-sitter Query",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TSPLIB data",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TSQL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TSV",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TSX",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Turing",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Turtle",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Twig",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TXL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Type Language",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TypeScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "TypeSpec",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Typst",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Unified Parallel C",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Unity3D Asset",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Unix Assembly",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Uno",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "UnrealScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Untyped Plutus Core",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "UrWeb",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "V",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Vala",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Valve Data Format",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "VBA",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "VBScript",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "vCard",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "VCL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Velocity Template Language",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Vento",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Verilog",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "VHDL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Vim Help File",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Vim Script",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Vim Snippet",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Visual Basic .NET",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Visual Basic 6.0",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Volt",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Vue",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Vyper",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Wavefront Material",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Wavefront Object",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "WDL",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "Web Ontology Language",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "WebAssembly",
"description": "No content available",
"stars": 0,
"forks": 0,
"today_stars": 0,
"language": "No content available"
},
{
"name": "bytedance/UI-TARS-desktop",
"description": "The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra",
"stars": 32540,
"forks": 3220,
"today_stars": 669,
"language": "TypeScript"
},
{
"name": "anthropics/financial-services",
"description": "No content available",
"stars": 19518,
"forks": 2533,
"today_stars": 1449,
"language": "Python"
},
{
"name": "addyosmani/agent-skills",
"description": "Production-grade engineering skills for AI coding agents.",
"stars": 38959,
"forks": 4307,
"today_stars": 1065,
"language": "Shell"
},
{
"name": "CloakHQ/CloakBrowser",
"description": "Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.",
"stars": 5220,
"forks": 393,
"today_stars": 496,
"language": "Python"
},
{
"name": "HKUDS/AI-Trader",
"description": "\"AI-Trader: 100% Fully-Automated Agent-Native Trading\"",
"stars": 15898,
"forks": 2553,
"today_stars": 163,
"language": "Python"
},
{
"name": "jundot/omlx",
"description": "LLM inference server with continuous batching & SSD caching for Apple Silicon -- managed from the macOS menu bar",
"stars": 13467,
"forks": 1144,
"today_stars": 185,
"language": "Python"
},
{
"name": "datawhalechina/easy-vibe",
"description": "\ud83d\udcbb vibe coding 2026 | Your first modern Coding course for beginners to master step by step.",
"stars": 9488,
"forks": 914,
"today_stars": 635,
"language": "JavaScript"
},
{
"name": "playcanvas/supersplat",
"description": "3D Gaussian Splat Editor",
"stars": 7001,
"forks": 778,
"today_stars": 579,
"language": "TypeScript"
},
{
"name": "lsdefine/GenericAgent",
"description": "Self-evolving agent: grows skill tree from 3.3K-line seed, achieving full system control with 6x less token consumption",
"stars": 10714,
"forks": 1205,
"today_stars": 174,
"language": "Python"
},
{
"name": "decolua/9router",
"description": "Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.",
"stars": 7644,
"forks": 1262,
"today_stars": 803,
"language": "JavaScript"
},
{
"name": "affaan-m/everything-claude-code",
"description": "The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.",
"stars": 178795,
"forks": 27573,
"today_stars": 1081,
"language": "JavaScript"
},
{
"name": "datawhalechina/hello-agents",
"description": "\ud83d\udcda \u300a\u4ece\u96f6\u5f00\u59cb\u6784\u5efa\u667a\u80fd\u4f53\u300b----\u4ece\u96f6\u5f00\u59cb\u7684\u667a\u80fd\u4f53\u539f\u7406\u4e0e\u5b9e\u8df5\u6559\u7a0b",
"stars": 47116,
"forks": 5669,
"today_stars": 748,
"language": "Python"
}
]
}
๐พ Save the output to a CSV file
Let's create a pandas dataframe and show the table with the extracted content
Save it to CSV
Data saved to trending_repositories.csv
๐ Resources
- ๐ Get your API Key: ScrapeGraphAI Dashboard
- ๐ GitHub: ScrapeGraphAI GitHub
- ๐ผ LinkedIn: ScrapeGraphAI LinkedIn
- ๐ฆ Twitter: ScrapeGraphAI Twitter
- ๐ฌ Discord: Join our Discord Community
Made with โค๏ธ by the ScrapeGraphAI Team