Web Scraping & Crawling

Open source web scraping and crawling tools that turn websites into clean, structured, LLM-ready data — handling JavaScript rendering, markdown conversion, and structured extraction, so you can self-host instead of paying per request for a hosted scraping API.