Vibe Coding DiscoversearxNcrawl
View on GitHubMCP server and CLI tools for web search and crawling, built on SearXNG and Crawl4AI
An MCP server, CLI, and Python API for web search and crawling. Uses SearXNG for search and Crawl4AI with Playwright for page extraction, including site crawls, Markdown cleanup, and authenticated sessions.
Use Cases
Let AI clients search the web through SearXNGCrawl web pages and return MarkdownCrawl documentation sites with depth and page limitsCapture authenticated browser sessions for crawling
Built With
- Language
- Python
- Frameworks
- FastMCP · Crawl4AI · SearXNG · Playwright
Tags
MCP server · web search · web crawling · Markdown extraction · SearXNG · CLI · site crawling · authenticated crawling