WebReaper
View on GitHubAI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.
WebReaper is a self-hosted .NET scraper with a CLI and library for crawling sites, producing Markdown, and extracting structured data with optional LLM support. It also provides MCP servers and a Claude Code skill for agent-driven scraping.
Use Cases
Scrape web pages into Markdown for LLM workflowsCrawl sites and extract structured fieldsUse an MCP client to scrape or crawl websitesGive Claude Code a web-scraping skillExtract page data with LLM prompts or inferred schemasScrape JavaScript-rendered or bot-protected pages
Built With
- Language
- C#
- Frameworks
- .NET · Microsoft.Extensions.AI · Model Context Protocol · Playwright
Tags
web scraping · web crawling · LLM extraction · Markdown · MCP server · Claude Code skill · structured data · browser automation · C#