Vibe Coding DiscoverFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
fastCRW is a Rust web scraper, crawler and search API that outputs markdown or structured JSON and ships an MCP server plus CLI and Python/Node SDKs. Drop-in Firecrawl-compatible endpoints, single small binary, self-host or managed cloud.
Use Cases
Scrape URLs into clean markdown for LLM contextFeed RAG pipelines with crawled web pagesBounded site crawling and full-site content collectionDiscover/map site URLs without scraping every pageWeb search API for AI agents with optional result scrapingStructured schema JSON extraction from pagesInstall as MCP server in Claude Code, Cursor, Codex, Gemini CLI, WindsurfSelf-hosted Firecrawl/Tavily replacement for private networksCompetitor and price monitoring pipelinesAnswer-engine / Perplexity-style search over web data
Built With
- Language
- Rust
- Frameworks
- axum · tokio · reqwest · tower-http · MCP · Node.js SDK · Python SDK
Tags
web-scraping · crawler · rust · mcp-server · markdown · search-api · self-hosted · firecrawl-alternative · llm · rag · data-extraction · cli · docker · html-to-markdown · web-search · api