Vibe Coding Discoverdonsetch
View on GitHubWeb fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
Rust MCP server and CLI that gives agents web fetch, keyless search, crawl, and PDF/OCR extraction from one binary. It uses real Chrome BoringSSL TLS plus stealth and learning layers to get past bot walls, with no API keys required.
Use Cases
Give an AI agent web fetch, search, and crawl toolsKeyless web search fused across multiple enginesBypass bot walls and TLS fingerprint checks for one-shot readsCrawl documentation sites and return stitched articlesExtract text from PDFs including auto-OCR of scanned pagesVerify a claim against a fetched page with must_contain probe modeTrack page changes across re-fetches with section diffsResurrect dead links via Wayback snapshotsRestructure site-specific data (GitHub, npm, Stack Overflow, Wikipedia) for LLMsDrop-in tooling for Claude Code, Cursor, OpenCode, Pi, and DeepSeek HarnessSave agent context tokens with reference handles and compact snippetsProxy-pool egress management for research traffic
Built With
- Language
- Rust
- Frameworks
- MCP · Tokio · Axum · BoringSSL · quiche · ONNX Runtime · reqwest · clap
Tags
mcp-server · rust · web-fetch · web-search · crawling · ai-agents · anti-bot · tls-fingerprint · pdf · ocr · cli · stealth · keyless · mcp · web-scraper · byok