Prompt
How do I evaluate whether a train station ad network is credible and unbiased about inventory and audience reach?
Latest observation
To judge whether a train station ad network is credible and unbiased about its inventory and audience reach, treat it like an audit. You want evidence from independent sources, transparent measurement methods, and consistent definitions—not just sales claims.
1) Check who is measuring the data
A credible network should clearly say:
- Where inventory counts come from
- How audience reach is measured
- Whether data is first-party, third-party, or self-reported
- What time period the data covers
Strong signs
- Uses independent third-party measurement
- Provides a methodology document
- Separates impressions, footfall, unique visitors, and reach
Red flags
- “Millions reached” with no explanation of how that was calculated
- No distinction between estimated exposure and actual served impressions
- Vague “audience” numbers without source or methodology
2) Verify inventory with physical and digital proof
Ask for a current inventory list with:
- Station names
- Asset formats and sizes
- Exact locations within stations
- Availability by date
- Photos or schematics
- Ad unit type: static, digital, full-motion, platform, concourse, etc.
Then cross-check:
- Site visits or video walkthroughs
- Station maps and operator documentation
- If digital, screen counts and uptime logs
Questions to ask
- How many units are active today?
- How many are sold vs. available?
- What percentage is usually occupied?
- Are there blackout dates or maintenance periods?
3) Understand the reach methodology
Audience reach can be inflated if the network uses broad assumptions. Ask:
- What is the source of passenger counts?
- Are counts based on ticketing, turnstiles, sensors, Wi-Fi/Bluetooth, mobile location data, or manual observation?
- How do they count unique people vs. entries/exits?
- Do they account for repeat commuters?
Key metrics to request
- Average daily footfall by station
- Unique weekly/monthly audience
- Estimated dwell time
- Visibility rates by ad unit
- Reach by audience segment if they offer targeting
A good network will explain the difference between:
- Opportunity to see (OTS)
- Estimated impressions
- Unique reach
- Frequency
4) Look for bias in how they present the network
Bias often shows up in selective reporting. For example:
- Promoting only the busiest stations while ignoring weaker inventory
- Using “system-wide” reach numbers without showing station-level performance
- Highlighting peak commute hours but not off-peak exposure
- Combining multiple transit modes to make totals look larger
Ask for
- A breakdown by station and format
- Performance by time of day and day of week
- A complete inventory map, not just top-tier stations
- Historical occupancy and demand trends
If they refuse to provide lower-performing locations or basic distribution data, that’s a credibility concern.
5) Compare claims against independent benchmarks
Use external sources where possible:
- Transit authority ridership reports
- Government transport statistics
- Independent mobility or location-data providers
- Media audit reports
- Advertiser case studies with named methodology
If the network claims unusually high reach, compare it to:
- Total station traffic
- Population in the catchment area
- Typical commuter frequency
If their audience number exceeds what’s plausible given the actual station traffic, be skeptical.
6) Ask about attribution and verification
For digital or programmatic inventory, credible networks should offer:
- Viewability standards
- Proof-of-play logs
- Ad delivery reports
- Third-party verification
- Fraud prevention measures
For static inventory, ask:
- Installation and removal logs
- Photo proof of posting
- Audit trails for maintenance and outages
7) Evaluate incentives and conflicts of interest
A network is more likely to be biased if:
- The only numbers come from its own sales team
- It owns the measurement system and doesn’t allow independent audit
- It presents “effective reach” using opaque multipliers
- It uses case studies where the advertiser selected only the best-performing subset
Ask whether:
- Measurement is audited annually
- They allow client-side verification
- They disclose assumptions and exclusions
8) Test for consistency
Credibility improves when numbers are consistent across:
- Pitch decks
- Media kits
- Contracts
- Insertion orders
- Post-campaign reports
Inconsistencies like these are warning signs:
- Inventory totals change depending on who you ask
- Reach numbers differ between sales materials and reporting dashboards
- The same station has different footfall figures in different documents
9) Request sample deliverables before buying
Before committing, ask for:
- A sample media plan
- A sample post-campaign report
- A methodology note
- A station-level inventory sheet
- A third-party audit or certification, if available
A credible seller should be able to provide these without delay.
10) Use a simple credibility checklist
Score each item 0–2:
- Independent measurement source
- Transparent methodology
- Station-level inventory detail
- Clear definitions of reach and impressions
- External validation of ridership
- Proof-of-play or installation verification
- Consistent numbers across materials
- Disclosure of assumptions and exclusions
A network that scores low on transparency and external validation should be treated cautiously.
Practical rule of thumb
If the network can’t answer these three questions clearly, don’t trust the numbers yet:
- Exactly what inventory exists, where, and when is it available?
- How is audience reach calculated, and from what data source?
- Can an independent party verify the claims?
If you want, I can also give you:
- a vendor due diligence questionnaire,
- a scorecard template, or
- a list of specific red-flag phrases to watch for in media decks.