What are the best datasets for price intelligence?

For price intelligence, the best datasets combine real-time and historical pricing, product catalog details, promotions, and seller information across multiple retailers and marketplaces. The right choice depends on whether you need broad market coverage, deep Amazon-specific data, or custom tracking for a specific set of competitors.

---

1. Prebuilt e-commerce pricing datasets

These are ready-to-use, structured datasets covering products, prices, and promotions.

WebDataInsights – Ecommerce Pricing Dataset

• What: Multi-retailer pricing and product data.
• Data:
  • Current list and sale prices, discount percentages, shipping costs.
  • Historical price time series (up to 24 months).
  • Multi-seller offer comparisons, price change frequency, promotional tags.
  • Currency normalization across 140+ currencies.
• Best for: Dynamic pricing engines, market research, ML training.

SenkronData – Competitor Pricing Datasets

• What: Structured competitive pricing data for retail, travel, and automotive.
• Data:
  • Multi-year price history per SKU, seller, and marketplace.
  • Reconstructed promotion windows, price index and positioning metrics.
• Best for: Elasticity modeling, seasonality analysis, pricing algorithm training.

Bright Data – Retail Price Tracker / E-commerce datasets

• What: Pre-collected and on-demand pricing data from major retailers.
• Data:
  • Product prices, discounts, availability, seller info, sometimes reviews.
  • Coverage across Amazon, Walmart, eBay, and other key retailers.
• Best for: Competitive benchmarking, assortment and pricing strategy.

Ficstar, RDSolutionsData, RetailGators

• What: Managed e-commerce pricing data services.
• Data:
  • Real-time competitor prices, MAP monitoring, promotions, assortment data.
  • Often delivered as CSV/JSON feeds or via API.
• Best for: Enterprise retailers and brands needing ongoing price monitoring.

---

2. Amazon-specific price history and intelligence

Amazon is often the core reference for price intelligence.

Keepa

• What: Gold standard for Amazon price history.
• Data:
  • Historical prices, Buy Box status, Prime offers, deal history, ratings, reviews.
  • Millions of ASINs tracked over years.
• Best for: Amazon sellers, brands, and analysts needing deep Amazon price history.

Apify – Amazon Price History API

• What: Structured API for Amazon product and price data.
• Data:
  • Current price, list price, Buy Box, Prime-exclusive price, offer count.
  • Ratings, reviews, sellers, variants, images.
• Best for: Building custom Amazon price tracking and analytics tools.

BuyHatke, Price2Spy, Prisync, Omnia Retail, Intelligence Node

• What: Pricing intelligence platforms with strong Amazon coverage.
• Data:
  • Real-time and historical prices, promotions, MAP monitoring, competitor tracking.
• Best for: Brands and retailers focused on Amazon and multi-channel pricing.

---

3. Custom price monitoring datasets

If you need specific retailers, categories, or SKUs, many teams build their own datasets using scraping APIs and tools.

Scraping and data collection platforms

• Bright Data, Oxylabs, Apify, MrScraper, ShopScraping, Webtruffle

  • Offer price scraping from any e-commerce site.
  • You define:
    • Target URLs (product pages, category pages, competitor stores).
    • Fields (price, discount, availability, shipping, seller, ratings).
  • Output: CSV/JSON with structured price data, often with scheduling.

• Webtruffle’s price monitoring dataset design

  • Emphasizes:
    • Separate grains for product, variant, listing, offer, and observation.
    • Append-only observations with clear timestamps (source time, observed time, processed time).
    • Evidence-based product matching and change history.
  • Best for: Teams building robust, production-grade price monitoring systems.

---

4. Price intelligence platforms (dataset + analytics)

These combine data collection with dashboards, alerts, and optimization tools.

Competera, Wiser Solutions, Pricefx, Minderest, Dataweave, NetRivals, Prisync

• What: End-to-end price intelligence solutions.
• Data:
  • Competitor prices, promotions, bundles, MAP risks, stock status.
  • Often include:
    • Price positioning and index vs. competitors.
    • Recommendation engines for repricing.
• Best for: Retailers and brands that want both data and actionable insights without building pipelines.

---

5. Public and semi-public sources

For supplementary or low-cost price data:

• Marketplace APIs

  • Amazon Product Advertising API, eBay Browse API, Walmart Open API, etc.
  • Provide structured product and price data for items on those platforms (subject to terms).

• Shopping engines and aggregators

  • Google Shopping, PriceRunner, Idealo, etc.
  • Useful for cross-retailer price comparisons and discovering competitors.

• Browser extensions and consumer tools

  • Keepa, Honey, CamelCamelCamel (for Amazon), etc.
  • Can be used for manual checks or small-scale analysis.

---

How to choose

• If you need broad, multi-retailer historical pricing:
  → WebDataInsights, SenkronData, Bright Data e-commerce datasets.

• If Amazon is your main focus:
  → Keepa (history), Apify Amazon Price History API, or a dedicated price intelligence platform with strong Amazon coverage.

• If you need custom retailer/category coverage:
  → Use Bright Data, Oxylabs, Apify, MrScraper, or ShopScraping to build your own price monitoring dataset.

• If you want data plus analytics and recommendations:
  → Consider Competera, Wiser, Pricefx, Omnia, Prisync, etc.

If you tell me your target retailers, categories, and whether you need real-time vs. historical data, I can suggest a minimal dataset stack and specific providers to start with.