Counterfactual evaluation
Part of Evaluation and benchmarking
Counterfactual evaluation is gaining ground in AI research: 0.1% to 0.2% of new AI papers, +0.1 points. It ranks #8 of 214 by gain in share. As of Oct 10, 2026.
- Change in share
- +0.1 pts
- Share, last 3 months
- 0.2%
- Papers, last 3 months
- 75
- Ready for products
- 2.3 / 5
More in Evaluation and benchmarking
Agent benchmark1.4% → 1.6%+0.2 ptsVision language model evaluation0.2% → 0.3%+0.1 ptsSoftware engineering benchmark0.2% → 0.3%+0.1 ptsLLM as a judge0.3% → 0.4%+0.1 ptsMultilingual evaluation0.2% → 0.3%+0.0 ptsMulti turn dialogue evaluation0.1% → 0.1%+0.0 ptsFaithfulness evaluation0.1% → 0.1%+0.0 ptsLLM safety evaluation0.1% → 0.1%+0.0 ptsVideo generation evaluation0.1% → 0.1%+0.0 ptsReference free evaluation0.1% → 0.1%+0.0 pts
Companies working on it
Counterfactual evaluation: quick answers
Yes. Its share of new AI papers went from 0.1% to 0.2%, with 75 papers in the last 3 months.