Unreviewed

apify/crawlee

This page was generated from public catalogue listings and the GitHub API. SIAX has not reviewed it. Facts are shown as observed with their source and fetch time; catalogue texts are not reused.

From the repository

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Observed

GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)

Observed facts

Stars: 26,294
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Forks: 1,737
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Licence (detected by GitHub): Apache-2.0
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Language: TypeScript
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Last push: 2026-10-29
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Created: 2016-08-26
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Latest release: v3.18.2 (2026-09-29)
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Archived: No
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Default branch: master
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)
Topics: apify, automation, crawler, crawling, headless, headless-chrome, javascript, nodejs, npm, playwright, puppeteer, scraper, scraping, typescript, web-crawler, web-crawling, web-scraping
Observed
GitHub API, fetched 2026-10-29: github.com/apify/crawlee (api.github.com/repos/apify/crawlee)

Listed as an alternative to

Claims made by the catalogues that list this project. Proposed only: SIAX has not checked them.

Apify Proposed (awesome-open-source-alternatives)

Suggested categories

Inferred by a rule from a catalogue section name or a GitHub topic. Not confirmed by a person.

Developer tooling › Build and test › Browser automation and scraping Inferred (catalogue section: Browser Automation & Scraping)
Developer tooling › Libraries and frameworks › Backend frameworks Inferred (catalogue section: Backend & Frameworks)

Explore the full site · Svenska