Where can I find SERP datasets?

SERP (search engine results page) datasets are available from specialized SEO data providers, SERP API vendors, and some data marketplaces. You can get them as bulk historical exports, ongoing feeds, or via APIs that return structured SERP data for specific queries.

---

1. Dedicated SERP data providers

These focus specifically on search results data and often offer both APIs and bulk datasets.

Serpstat

• What: Large SERP database and SEO platform.
• Data:
  • Top 100 Google results for billions of keywords across 230+ regions.
  • Rankings, ads, featured snippets, SERP features, historical snapshots.
• Formats:
  • Full SERP databases (bulk), custom exports, and API access.
  • Historical data (months to years, depending on plan).
• Best for: SEO research, rank tracking, AI training on SERPs, competitive analysis.

DataForSEO

• What: Comprehensive SEO and SERP data API.
• Data:
  • Live and historical SERPs for Google, Bing, Yahoo, Baidu, Naver, YouTube, etc.
  • Keyword metrics, backlinks, on-page data, AI Overview/AIO results.
• Formats:
  • Pay-as-you-go API; can export large volumes for dataset-style use.
• Best for: Engineering teams building SEO tools, AI models, and large-scale search analysis.

SerpApi, Serper, SearchAPI, Serpex, HasData, SOAX, Talordata

• What: SERP API providers returning structured JSON for search results.
• Data:
  • Organic results, paid ads, People Also Ask, local packs, images, videos, AI Overviews (for some).
  • Coverage across Google, Bing, DuckDuckGo, Yandex, Baidu, YouTube, Amazon, etc.
• Formats:
  • Real-time API; some offer historical SERPs or allow you to build your own dataset by querying at scale.
• Best for: AI agents, RAG systems, SEO tools, rank tracking, market research.

---

2. Historical SERP snapshots and time-series data

If you need SERPs over time (e.g., to study ranking volatility or AI search evolution):

Serpstat (again)

• Historical SERP database:
  • Time-series data going back years for many keywords and regions.
  • Daily or periodic snapshots of top results and SERP features.

DemandSphere (DemandMetrics / SERP Rewind)

• What: Platform focused on replaying past SERPs.
• Data:
  • 90+ days of daily Google SERP snapshots per keyword/market.
  • Programmatic access to snapshot data.
• Best for: Analyzing ranking changes, algorithm impacts, and AI Overview rollouts.

Custom builds via SERP APIs

• Many teams build their own historical SERP datasets by:
  • Running scheduled queries via SerpApi, DataForSEO, Serpex, etc.
  • Storing results in a database or data lake.
• This gives full control over keywords, locations, devices, and frequency.

---

3. SEO platforms with SERP data exports

Some all-in-one SEO tools provide SERP data as part of their datasets or exports.

Ahrefs, Semrush, Moz, Majestic

• What: SEO platforms with large search and backlink indexes.
• Data:
  • Keyword rankings, SERP features, top pages, competitors.
  • Some allow bulk exports or API access to SERP-related data.
• Best for: SEO teams that want SERP data alongside keyword and backlink analysis.

Bright Data, Oxylabs, Nimbleway

• What: Web data infrastructure with SERP scraping products.
• Data:
  • Structured SERP data from Google and other engines, often with historical options.
  • Can deliver as datasets or via APIs.
• Best for: Enterprise-scale search data pipelines, AI training, competitive monitoring.

---

4. AI search and “GEO” visibility datasets

Newer providers track not just traditional SERPs but also AI-generated answers and visibility in AI search.

cloro, AIclicks, Profound, Position.digital

• What: APIs/datasets tracking presence in:
  • Google AI Overviews / SGE.
  • ChatGPT, Perplexity, Copilot, Claude, etc.
• Data:
  • Whether and how your brand/content appears in AI answers.
  • Sometimes combined with traditional SERP data.
• Best for: Understanding AI search visibility, optimizing for generative search.

---

5. Data marketplaces and repositories

If you want prepackaged SERP datasets rather than building via APIs:

AWS Data Exchange, Snowflake Marketplace, Nasdaq Data Link

• Some vendors list SEO and SERP-related datasets (keyword rankings, SERP features, etc.).
• Good for discovering and trialing providers in a marketplace context.

Academic and research datasets

• Occasionally, research groups release SERP-related datasets (e.g., for bias, fairness, or ranking studies), but these are less common and usually smaller in scale.

---

How to choose

• If you need large-scale, historical SERP databases:
  → Serpstat, DemandSphere, or build your own via DataForSEO/SerpApi with scheduled queries.

• If you need real-time SERP data for AI/SEO tools:
  → SerpApi, DataForSEO, Serpex, SearchAPI, SOAX, Talordata.

• If you care about AI search visibility (AIO, SGE, LLM answers):
  → Add cloro, AIclicks, Profound, or similar GEO/AI visibility providers.

• If you want SERP data alongside broader SEO metrics:
  → Use Ahrefs, Semrush, or Moz plus a dedicated SERP API for raw results.

If you tell me your use case (e.g., “train an LLM on SERPs,” “track AI Overview visibility,” “build a rank tracker”), target search engines, and regions, I can suggest a minimal set of providers and access patterns.