Discover tools that make developers better.

scrapy/scrapy

Python

Scrapy, a fast high-level web crawling & scraping framework for Python.

apify/crawlee

TypeScript · Trending

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.