Prompt
How do I evaluate whether a premium video inventory seller is credible and unbiased?
Latest observation
To evaluate whether a premium video inventory seller is credible and unbiased, look at both their evidence and their business incentives. A seller can be credible but still have reasons to overstate performance, so you want to verify independently.
1) Check transparency of the inventory
Ask for clear answers on:
- Where the inventory appears: exact publishers, apps, channels, genres, and show names
- How it’s packaged: direct-sold, programmatic guaranteed, PMP, curated marketplace, reseller, etc.
- Ad placement details: pre-roll, mid-roll, out-stream, CTV, mobile app, desktop
- Whether it is exclusive or shared
- What percentage is truly premium vs. remnant or “long-tail”
A credible seller should be able to name the supply sources and explain how the inventory is created and controlled.
2) Validate third-party verification
Look for independent measurement from:
- IAS, DoubleVerify, Moat, or similar verification partners
- Comscore, Nielsen, or VideoAmp for audience/CTV where relevant
- Brand-safety and fraud signals: IVT rate, viewability, completion rate, attention, domain/app transparency
If they only provide internal metrics, treat claims cautiously.
3) Review audience and reach claims
Request:
- Deduplicated reach
- Audience composition
- Geography/device breakdown
- Frequency distribution
- Sample size and date range
- Methodology
Be wary of vague claims like “millions of premium viewers” without documentation.
4) Look for bias in reporting
A seller may cherry-pick results. Ask whether they can show:
- Wins and losses, not just best-case case studies
- Multiple campaigns across categories
- Performance by creative, audience, publisher, and device
- Negative or neutral outcomes
- Raw data exports or log-level reporting if possible
If they only present polished decks and top-line averages, they may be selectively framing the story.
5) Examine their commercial incentives
Ask:
- Are they selling their own inventory or acting as an aggregator/reseller?
- Do they receive compensation from preferred partners?
- Do they optimize toward their own margin or toward advertiser outcomes?
- Are they willing to recommend a competitor if it fits your goals better?
A seller with narrow supply or exclusive deals may still be credible, but their advice is less likely to be unbiased.
6) Check for consistency across sources
Compare the seller’s claims with:
- Your DSP/SSP reports
- Independent verification tools
- Publisher direct data, if available
- Third-party market benchmarks
If the seller’s numbers are consistently much better than everyone else’s, that’s a red flag unless they can explain the methodology gap.
7) Ask for proof of quality controls
For premium video, ask about:
- Ad fraud detection
- Invalid traffic filtration
- Brand suitability controls
- Content classification
- Supply-path optimization
- Frequency capping and deduplication
A credible seller should have defined processes, not just aspirational claims.
8) Test with a pilot
Before scaling:
- Run a small pilot
- Set clear KPIs: completion rate, viewability, IVT, CPA, brand lift, lift in site visitation, etc.
- Compare against a control or benchmark
- Require a post-campaign readout with both good and bad results
A real test often reveals whether the seller’s quality claims hold up.
9) Watch for common red flags
Be cautious if they:
- Refuse to disclose supply sources
- Use vague terms like “premium” without definition
- Overemphasize one flattering metric while ignoring others
- Won’t share methodology
- Use outdated or self-selected case studies
- Push urgency without evidence
- Dismiss independent verification as unnecessary
10) Use a simple credibility scorecard
Rate the seller 1–5 on:
- Inventory transparency
- Third-party verification
- Data quality/methodology
- Independence/bias
- Consistency of results
- Willingness to share raw data
- Pilot performance
A seller that scores well across all categories is much more likely to be credible and reasonably unbiased.
If you want, I can turn this into a vendor due-diligence checklist or a scorecard template you can use in procurement.