Normalized Discounted Cumulative Gain
Normalized discounted cumulative gain is the rank-aware retrieval metric that scores result lists using graded relevance while discounting lower-ranked positions - NDCG measures how close ranking quality is to an ideal ordering.
What Is Normalized discounted cumulative gain?
- Definition: Ratio of observed discounted gain to ideal discounted gain for each query.
- Graded Relevance: Supports multi-level labels such as highly relevant, partially relevant, and irrelevant.
- Rank Discounting: Assigns higher importance to relevant results appearing earlier.
- Normalization Benefit: Makes scores comparable across queries with different relevance distributions.
Why Normalized discounted cumulative gain Matters
- Ranking Realism: Better reflects practical utility when relevance is not binary.
- Top-Heavy Evaluation: Prioritizes quality where user attention is highest.
- Model Differentiation: Distinguishes rankers with subtle ordering differences.
- Enterprise Search Fit: Useful for complex corpora with varying evidence usefulness.
- RAG Context Selection: Helps optimize top context slots for maximal answer impact.
How It Is Used in Practice
- Label Design: Define consistent graded relevance scales for evaluation datasets.
- Cutoff Analysis: Measure NDCG at different ranks such as NDCG@5 and NDCG@10.
- Tuning Loops: Optimize rerank models and fusion policies against NDCG targets.
Normalized discounted cumulative gain is a standard metric for graded retrieval quality - by rewarding strong early ranking of highly relevant evidence, NDCG aligns well with real-world search and RAG usage patterns.