Crawl4AI

Verdict: Open-source, LLM-friendly web crawler and scraper that turns pages into clean Markdown for RAG and agents. A free self-hosted alternative to Firecrawl.

Free (Apache-2.0 open source) · Official site: https://crawl4ai.com · source checked 2026-10-21 (HTTP 200)

GitHub repo · ★ 86.0k stars (as of 2026-10-21) · More open-source AI

Share: X · LinkedIn · Reddit · Hacker News · Copy link

🏅 Your tool? Get your badge

Featured on AI Agent Ideas badge

Makers: add this badge to your site. It links back with a ref code. More badge options (HTML & Markdown)

<a href="https://aiagentideas.ai/tool/crawl4ai/?ref=badge-crawl4ai"><img src="https://aiagentideas.ai/badge/crawl4ai.svg" alt="Crawl4AI featured on AI Agent Ideas" width="290" height="54"></a>

Is this your tool? Update the listing · Feature it