Software engineering benchmark
Part of Evaluation and benchmarking
Software engineering benchmark is gaining ground in AI research: 0.2% to 0.3% of new AI papers, +0.1 points. It ranks #15 of 214 by gain in share. As of Oct 10, 2026.
- Change in share
- +0.1 pts
- Share, last 3 months
- 0.3%
- Papers, last 3 months
- 107
- Ready for products
- 2.5 / 5
More in Evaluation and benchmarking
Agent benchmark1.4% → 1.6%+0.2 ptsCounterfactual evaluation0.1% → 0.2%+0.1 ptsVision language model evaluation0.2% → 0.3%+0.1 ptsLLM as a judge0.3% → 0.4%+0.1 ptsMultilingual evaluation0.2% → 0.3%+0.0 ptsMulti turn dialogue evaluation0.1% → 0.1%+0.0 ptsFaithfulness evaluation0.1% → 0.1%+0.0 ptsLLM safety evaluation0.1% → 0.1%+0.0 ptsVideo generation evaluation0.1% → 0.1%+0.0 ptsReference free evaluation0.1% → 0.1%+0.0 pts
Companies working on it
Software engineering benchmark: quick answers
Yes. Its share of new AI papers went from 0.2% to 0.3%, with 107 papers in the last 3 months.