Crawlab Open source · BSD-3-Clause
A distributed crawler management platform that supports crawlers written in any language
Introduction
A distributed crawler management platform that supports crawlers written in any language.
Distributed crawlingCrawler managementCrawler platformMulti-languageWeb crawling
Screenshots
Screenshot placeholder
Screenshot placeholder
Deployment
Docker
适合在单机环境快速启动 Crawlab，降低依赖安装和环境配置成本。
Docker Compose
适合在单机或小团队环境中同时编排 Crawlab 及 MongoDB 等依赖服务。
Kubernetes
适合在已有 K8s 集群中进行生产化、可扩展和易运维的部署。
Crawlab alternatives View all 爬虫系统 →
Scrapy Open source
Python 爬虫框架事实标准
Crawlee Open source
Node.js 采集框架，内置反爬与代理轮换
Decodo Proprietary
Decodo 提供住宅、移动、ISP 与数据中心代理网络，以及 Web Scraping API，面向需要大规模采集公开网页数据的团队，强调高可用性与代理资源覆盖。
Apify SDK Open source
You-Get Open source
You-Get
后羿采集器 Proprietary
后羿采集器是由前谷歌搜索技术团队基于人工智能技术研发的新一代网页采集软件，该软件功能强大，操作简单，可谓是居家旅行随身神器。
Apify SDK for JavaScript Open source
Apify SDK for JavaScript | SDK for JavaScript | Apify Documentation
Details
Type Open-source software
License BSD-3-Clause
Last verified 2026-07-18
In solutions
爬虫系统 · 3 candidates →Ad slot 300 × 250 Ad
About the data
Stars / commit times sync automatically from the GitHub API; pricing and features are human-verified.