category
Web Scraping & Crawling
Open source web scraping and crawling tools that turn websites into clean, structured, LLM-ready data — handling JavaScript rendering, markdown conversion, and structured extraction, so you can self-host instead of paying per request for a hosted scraping API.
Tools
4 in this category// tools tagged: web-scraping
monitoring
changedetection.io_
Self-hosted web page change monitoring — a Visualping alternative.
35.1k
stars
162
contributors
1d
last commit
2.2k
forks
Python
language
5 yrs
age
web-scraping
Firecrawl_
Open source scraping API turning sites into LLM-ready data.
192.6k
stars
175
contributors
today
last commit
10.2k
forks
TypeScript
language
2 yrs
age
automation
Huginn_
Self-hosted IFTTT and Zapier alternative built on agents.
50.1k
stars
267
contributors
today
last commit
4.3k
forks
Ruby
language
13 yrs
age
feed-generators
RSSHub_
Generate RSS feeds for sites that have none.
46.6k
stars
1.7k
contributors
today
last commit
10.3k
forks
TypeScript
language
8 yrs
age
Articles
// articles tagged: web-scraping
No articles tagged with this category yet.