getobyte/NeuralScraper
Web scraping, analysis & content extraction for AI agents.
Platform-specific configuration:
{
"mcpServers": {
"NeuralScraper": {
"command": "npx",
"args": [
"-y",
"NeuralScraper"
]
}
}
}Add the config above to .claude/settings.json under the mcpServers key.
<div align="center">
Web scraping, analysis & content extraction for AI agents.
Scrape pages, crawl sites, extract UI/brand/SEO data. MCP server + CLI + HTTP API. Local-first, self-hosted.
</div>
---
> **Part of the Neural\* ecosystem. > NeuralScraper handles web scraping & analysis — but it doesn't work alone. > It pairs with NeuralVaultCore (persistent memory), NeuralVaultSkill (session automation), and NeuralVaultFlow** (dev workflow orchestration). > Each component has its own repository and documentation. See the Neural\* Ecosystem section at the bottom.
---
NeuralScraper gives AI agents (and humans) a clean, structured way to extract data from the web — no fluff, no cloud dependency.
| Capability | Description | |---|---| | Scrape | Scrape page — web + PDF | | Screenshot | Full-page PNG capture | | Crawl | Multi-page scraping with depth and limit control | | Map | Fast internal URL discovery | | UI Analysis | Layout structure, components, spacing, typography | | Brand Extraction | Dominant colors, fonts, logos | | SEO Audit | Meta tags, headings, OG, schema markup, scoring | | Analyze | Scrape + screenshot + UI + brand + SEO in one command | | Search | Web search via SearXNG + scrape results | | Extract | Structured data extraction with LLM (Ollama) and custom schema | | Interact | Browser actions (click, type, wait) + scrape | | Batch | Process a list of URLs from a file |
---
git clone https://github.com/getobyte/NeuralScraperLoading reviews...