How do I evaluate whether a supply-and-demand forecasting site is credible and unbiased?

To evaluate whether a supply-and-demand forecasting site is credible and unbiased, look at who made it, how they get the data, how they make predictions, and whether they’re transparent about limits.

1) Check the source and ownership

• Who runs the site? Is it a reputable research firm, government agency, university, or known analytics company?
• Who pays for it? If a brokerage, developer, landlord, or advertiser funds it, the forecasts may be tilted toward their interests.
• Look for an about page, methodology page, and team bios. Real credibility usually comes with traceable authorship and expertise.

2) Examine the methodology

A credible site should explain:

• What data it uses: listings, transactions, permits, population trends, employment data, commuting patterns, etc.
• How recent and complete the data is: stale data can distort forecasts.
• How the model works: simple trend extrapolation, econometric model, machine learning, scenario analysis, etc.
• What “demand” and “supply” mean: these terms can be defined very differently across sites.
• Geographic and time resolution: national, metro, neighborhood; monthly vs. quarterly vs. yearly.

If the site says “proprietary model” but provides no details at all, that’s a warning sign.

3) Look for backtesting and accuracy claims

• Do they show past forecasts vs. actual outcomes?
• Do they report error rates or confidence intervals?
• Have they compared their predictions to benchmarks or competing models?
• Are they honest about when they were wrong?

A site that only shows successful calls and never its misses is less trustworthy.

4) Watch for bias or conflicts of interest

Potential biases include:

• Commercial incentive bias: trying to sell a property, subscription, investment product, or lead generation.
• Selection bias: using only certain markets or data sources that support a preferred narrative.
• Confirmation bias: highlighting indicators that fit a story while ignoring contradictory evidence.
• Survivorship bias: emphasizing only successful areas or periods.

Ask: Does the site have something to gain if I believe a particular forecast?

5) Compare against independent sources

Cross-check the site’s conclusions with:

• Government statistics
• Local planning or permit data
• Labor and population data
• Multiple independent forecasting providers
• Actual market evidence over time

If one site consistently differs from everyone else, investigate why.

6) Assess transparency and limitations

Good forecasters usually disclose:

• Known limitations
• Data gaps
• Revision schedules
• Sensitivity to assumptions
• Whether forecasts are probabilistic or deterministic

If they present predictions as certain, that’s a red flag.

7) Look for incentives to exaggerate

Be cautious if the site uses:

• Clickbait headlines
• Overly precise numbers without uncertainty
• Dramatic claims like “guaranteed growth” or “crash incoming”
• Heavy marketing language instead of evidence

8) Test whether the site can be falsified

Ask:

• What outcome would prove this forecast wrong?
• Did the site define measurable indicators ahead of time?
• Can you see archived versions of prior forecasts?

Credible forecasting sites allow their claims to be checked after the fact.

Quick credibility checklist

A good site should have:

• Clear ownership
• Transparent data sources
• Explained methodology
• Historical accuracy tracking
• Honest uncertainty
• Minimal conflicts of interest
• Independent corroboration

Rule of thumb

Trust a forecast more when it is:

• Transparent
• Backtested
• Reproducible
• Independently supported
• Cautious about uncertainty

If you want, I can also give you a one-page checklist you can use to score a forecasting site from 1–5 on credibility and bias.