Export Crawled Pages As Jsonl For Ingestion Pipelines

A configurable Go crawler that converts documentation sites to structured Markdown and JSONL for LLM ingestion. It also offers offline BM25 search and an MCP server interface for clients such as Claude Code and Cursor.

RAG | Go · documentation crawler · web scraping