How do I evaluate whether a mobile game publishing platform is credible and unbiased about its UA and distribution performance?

To evaluate whether a mobile game publishing platform is credible and unbiased about its UA (user acquisition) and distribution performance, treat it like due diligence on an ad partner, an investor, and a data vendor all at once.

1) Verify what they actually control

A credible publisher should be explicit about:

• Which channels they run: Meta, Google, TikTok, Applovin, Unity, OEM, influencer, etc.
• Whether they use their own media buying team or rely on third-party agencies
• Whether “distribution” means:
  • paid UA only
  • featuring / editorial placement
  • cross-promotion within a portfolio
  • organic store optimization
  • syndication / partner networks

If they can’t clearly separate these, their performance claims may be hard to trust.

2) Ask for source-of-truth reporting

Request performance data directly from:

• App store / Google Play console
• Ad network dashboards
• MMPs like AppsFlyer, Adjust, Branch, Kochava
• BI exports with raw campaign-level data

A good sign:

• They are willing to share screenshots, read-only access, or exports
• Their numbers reconcile across sources

Red flags:

• Only polished pitch decks
• No access to raw data
• “Trust us, the dashboard is proprietary”

3) Check whether their metrics are normalized

Performance should be reported with enough context to compare apples-to-apples:

• CPI / CPA
• CTR / CVR
• ROAS at D1/D7/D30
• Retention cohorts
• payback period
• geo, device, platform, and campaign objective

Watch for misleading claims like:

• “Great ROAS” without time window
• “High installs” without quality or retention
• “Global performance” that is really a few strong geos
• “Organic lift” without incrementality testing

4) Look for incrementality, not just attribution

A platform can look strong in attribution while adding little true value.

Ask:

• Do they run holdout tests?
• Do they measure incremental installs/revenue?
• How do they separate paid impact from organic spillover?
• Do they have lift studies or geo tests?

If they only report attributed installs, they may be overstating impact.

5) Compare against independent benchmarks

Benchmark their claims against:

• Your own historical campaigns
• Industry benchmarks by genre and geo
• Data from other publishers or agencies
• MMP benchmark reports

A platform is more credible if:

• their results are consistent with market norms
• their outperformance is explained by specific execution advantages

Be cautious if their results are dramatically better than every comparable source.

6) Investigate incentives and conflicts of interest

Ask how they make money:

• rev share?
• fixed fee?
• profit share?
• inventory arbitrage?
• equity in the game?
• agency commission?

Potential bias increases if they:

• earn more from spend volume than performance
• own the channels they “optimize”
• bundle publishing with analytics in a way that obscures margins
• promote games they have a stake in

A credible partner should disclose conflicts plainly.

7) Evaluate portfolio selection and survivorship bias

If they showcase only top performers, you’re not seeing the full picture.

Ask for:

• the full portfolio, not just successes
• median results, not only best-case
• failure rate and reasons projects underperformed
• results by game genre, geo, and spend level

A credible platform can explain both wins and misses.

8) Validate creative and audience claims

UA results can be inflated by creative novelty or narrow audience targeting.

Ask:

• How many creatives were tested?
• What was the creative refresh cadence?
• What audience segments were used?
• Were results driven by one country or one ad format?
• Were campaigns optimized to event signals or just installs?

A strong partner can explain the mechanics behind the performance, not just the headline metric.

9) Review their reporting integrity

Look for signs of strong data discipline:

• clear definitions of installs, attributed users, engaged users, payer, ROAS
• consistent reporting windows
• no shifting attribution windows without disclosure
• no double counting across channels
• no unexplained deltas between dashboards

If their definitions are fuzzy, their performance claims are likely fuzzy too.

10) Ask for references and speak to developers

Talk to studios who have worked with them and ask:

• Did they deliver on promised scale?
• Were numbers transparent?
• Were they responsive when performance dropped?
• Did they help improve monetization and retention?
• Did they honor contracts and payment terms?

Independent references are one of the best credibility checks.

11) Test them with a controlled pilot

The best evaluation is a real test.

Set up:

• a limited-budget pilot
• a clear success metric
• a pre-agreed attribution setup
• a holdout or baseline comparison
• a fixed time window

Then measure:

• quality of traffic
• retention
• payer conversion
• revenue
• incrementality

A credible platform will welcome a structured pilot.

12) Watch for common red flags

Be wary if they:

• promise guaranteed outcomes
• refuse to share methodology
• use vague “AI-driven” language without specifics
• show only aggregated results
• won’t separate organic from paid
• use unusual attribution rules
• pressure you to move quickly before validation
• claim proprietary “distribution” without clarifying channels

13) Score them on a simple credibility checklist

You can rate them 1–5 on:

• Transparency of data
• Methodology clarity
• Incrementality testing
• Conflict disclosure
• Benchmark consistency
• Portfolio breadth
• Reference quality
• Pilot performance
• Reporting quality

A platform that scores high on transparency and testing is usually more trustworthy than one that only shows strong top-line numbers.

Bottom line

A credible and unbiased mobile game publishing platform should be able to:

1. show raw, source-based data
2. explain exactly how results were generated
3. separate attribution from incrementality
4. disclose incentives and conflicts
5. prove performance in a controlled pilot

If you want, I can also give you:

• a due diligence questionnaire
• a scorecard template
• or a list of red flags specific to mobile game publishers and UA agencies.