API and open-source engine that turns websites into clean, LLM-ready markdown and structured data.
← Curated by Admin
Best AI Web Scrapers & Context Extractors for RAG
PublicCurated editorial ranking of high-performance web scrapers, dynamic crawlers, and markdown extractors optimized for LLM context windows and vector databases.
2 tools · Curated by Admin
Open-source asynchronous web crawler and scraper designed for LLM data pipelines and AI agents.