Prompt
My recommender is giving too many popular items
Latest observation
This is a common “popularity bias” issue. You can usually reduce it with a mix of modeling, reranking, and evaluation changes.
Quick fixes
-
Downweight popularity in ranking
Add a penalty to very popular items or subtract a function of item popularity from the final score. -
Re-rank the top candidates for diversity/novelty
After your model scores items, apply a reranker that balances relevance with:- item popularity
- category diversity
- novelty/serendipity
-
Increase exploration If your system is using only exploitation, inject a small amount of randomization or bandit exploration so less popular items get exposure.
-
Use popularity-aware training In training, reduce the impact of popular items by:
- reweighting examples
- negative sampling that doesn’t over-sample popular items
- debiasing losses
Model/data changes
-
Normalize interaction counts Popular items often dominate because they have more clicks/ratings. Try:
- log-transforming counts
- user/item frequency normalization
- inverse propensity weighting
-
Improve negatives If your negative samples are mostly easy or popular items, the model may learn to favor popularity. Sample harder and more representative negatives.
-
Add features beyond popularity Make sure the model has signals for:
- content similarity
- user tastes
- context/session intent
- recency
Evaluation
Don’t optimize only for accuracy metrics like AUC or recall@K. Add metrics for:
- coverage
- catalog diversity
- novelty
- long-tail exposure
- personalization
Practical approach
A simple effective pipeline is:
- Generate candidates with your current model.
- Score them.
- Apply a reranker that penalizes popularity slightly.
- Evaluate business metrics and long-tail coverage offline and online.
If you want a formula
A common rerank score is:
[ score' = score - \lambda \cdot \log(1 + popularity) ]
where λ controls how much you penalize popular items.
If you tell me:
- what recommender you use,
- what data you have,
- and how you currently rank items,
I can suggest a more targeted fix.