Topics · Large Scale Web Crawling
Top companies for Large Scale Web Crawling
Ranked by AI mention frequency in Large Scale Web Crawling prompts · 291 observations · last seen Nov 22, 2026
Share of voice · top 10
Mention share across all brand mentions in this topic · remaining brands hold 65.3%
Leader
Playwright
6.7%
- 1
Playwright6.7% · 122
- 2
Scrapy4.9% · 89
- 3
Puppeteer3.5% · 65
- 4
Selenium3.3% · 61
- 5
Redis3.3% · 60
- 6
Apify3.2% · 59
- 7
Bright Data2.6% · 47
- 8
S32.5% · 45
- 9
Rabbitmq2.4% · 44
- 10
Kafka2.3% · 43
Full ranking
- 1.
Playwright6.7% SoV · 122 mentions · 108 prompts · Nov 21, 2026
- 2.
Scrapy4.9% SoV · 89 mentions · 78 prompts · Nov 21, 2026
- 3.
Puppeteer3.5% SoV · 65 mentions · 59 prompts · Nov 16, 2026
- 4.
Selenium3.3% SoV · 61 mentions · 54 prompts · Nov 21, 2026
- 5.
Redis3.3% SoV · 60 mentions · 57 prompts · Nov 21, 2026
- 6.
Apify3.2% SoV · 59 mentions · 52 prompts · Nov 12, 2026
- 7.
Bright Data2.6% SoV · 47 mentions · 42 prompts · Nov 12, 2026
- 8.
S32.5% SoV · 45 mentions · 42 prompts · Nov 12, 2026
- 9.
Rabbitmq2.4% SoV · 44 mentions · 44 prompts · Nov 21, 2026
- 10.
Kafka2.3% SoV · 43 mentions · 40 prompts · Nov 20, 2026
- 11.
PostgreSQL2.3% SoV · 43 mentions · 38 prompts · Nov 21, 2026
- 12.
Zyte2.3% SoV · 42 mentions · 36 prompts · Nov 20, 2026
- 13.
Beautifulsoup2.2% SoV · 40 mentions · 37 prompts · Nov 21, 2026
- 14.
Celery2.1% SoV · 38 mentions · 38 prompts · Nov 20, 2026
- 15.
Sqs1.9% SoV · 34 mentions · 33 prompts · Nov 21, 2026
- 16.
Airflow1.6% SoV · 29 mentions · 28 prompts · Nov 21, 2026
- 17.
Lxml1.5% SoV · 27 mentions · 25 prompts · Nov 15, 2026
- 18.
Diffbot1.4% SoV · 26 mentions · 23 prompts · Oct 26, 2026
- 19.
Python1.4% SoV · 26 mentions · 24 prompts · Nov 21, 2026
- 20.
Elasticsearch1.4% SoV · 25 mentions · 23 prompts · Nov 21, 2026
- 21.
Httpx1.3% SoV · 24 mentions · 23 prompts · Nov 15, 2026
- 22.
Requests1.2% SoV · 22 mentions · 20 prompts · Nov 21, 2026
- 23.
Browserless1.1% SoV · 21 mentions · 18 prompts · Nov 9, 2026
- 24.
Oxylabs1.1% SoV · 21 mentions · 21 prompts · Oct 26, 2026
- 25.
Gcs1.1% SoV · 20 mentions · 19 prompts · Nov 12, 2026
- 26.
Postgres1.1% SoV · 20 mentions · 20 prompts · Nov 12, 2026
- 27.
Scrapingbee1.1% SoV · 20 mentions · 17 prompts · Nov 9, 2026
- 28.
Prefect0.93% SoV · 17 mentions · 15 prompts · Nov 21, 2026
- 29.
Grafana0.76% SoV · 14 mentions · 14 prompts · Oct 19, 2026
- 30.
Kubernetes0.76% SoV · 14 mentions · 13 prompts · Nov 15, 2026
- 31.
Opensearch0.76% SoV · 14 mentions · 14 prompts · Nov 15, 2026
- 32.
Cheerio0.71% SoV · 13 mentions · 11 prompts · Nov 15, 2026
- 33.
Prometheus0.71% SoV · 13 mentions · 13 prompts · Oct 19, 2026
- 34.
Bullmq0.66% SoV · 12 mentions · 12 prompts · Oct 4, 2026
- 35.
Docker0.66% SoV · 12 mentions · 11 prompts · Nov 21, 2026
- 36.
GitHub Actions0.66% SoV · 12 mentions · 11 prompts · Nov 21, 2026
- 37.
Apache Nutch0.60% SoV · 11 mentions · 11 prompts · Oct 4, 2026
- 38.
Bigquery0.60% SoV · 11 mentions · 11 prompts · Nov 21, 2026
- 39.
Common Crawl0.60% SoV · 11 mentions · 9 prompts · Nov 12, 2026
- 40.
Distill0.60% SoV · 11 mentions · 9 prompts · Nov 16, 2026
- 41.
Aiohttp0.55% SoV · 10 mentions · 10 prompts · Oct 4, 2026
- 42.
Heritrix0.55% SoV · 10 mentions · 10 prompts · Oct 4, 2026
- 43.
Rq0.55% SoV · 10 mentions · 10 prompts · Oct 4, 2026
- 44.
Sqlite0.55% SoV · 10 mentions · 9 prompts · Nov 13, 2026
- 45.
Visualping0.55% SoV · 10 mentions · 9 prompts · Nov 16, 2026
- 46.
Dagster0.49% SoV · 9 mentions · 9 prompts · Oct 6, 2026
- 47.
Node Js0.49% SoV · 9 mentions · 9 prompts · Oct 4, 2026
- 48.
Azure Blob0.44% SoV · 8 mentions · 8 prompts · Nov 12, 2026
- 49.
Browse0.44% SoV · 8 mentions · 7 prompts · Nov 12, 2026
- 50.
Cassandra0.44% SoV · 8 mentions · 8 prompts · Oct 4, 2026