category
Web Scraping & Crawling
Open source web scraping and crawling tools that turn websites into clean, structured, LLM-ready data — handling JavaScript rendering, markdown conversion, and structured extraction, so you can self-host instead of paying per request for a hosted scraping API.
Tools
4 in this category// tools tagged: web-scraping
monitoring
changedetection.io_
Self-hosted web page change monitoring — a Visualping alternative.
33.4k
stars
151
contributors
—
last commit
2k
forks
Python
language
5 yrs
age
web-scraping
Firecrawl_
Open source scraping API turning sites into LLM-ready data.
175k
stars
172
contributors
—
last commit
9.6k
forks
TypeScript
language
2 yrs
age
automation
Huginn_
Self-hosted IFTTT and Zapier alternative built on agents.
49.9k
stars
262
contributors
—
last commit
4.3k
forks
Ruby
language
13 yrs
age
feed-generators
RSSHub_
Generate RSS feeds for sites that have none.
Articles
// articles tagged: web-scraping
No articles tagged with this category yet.