[tag]

#benchmarks

4 stories

[research]Aug 31, 2026By ByteBulletin Editor

Rasch Models Bring a Statistical Lens to LLM Evaluation

A new framework applies Rasch measurement theory to benchmark large language models, offering a more rigorous way to compare model proficiency and item difficulty.

[research]Aug 17, 2026By ByteBulletin Editor

New Study Quantifies the Hidden Costs of Benchmark Overfitting in AI Models

Researchers show that AI models fine-tuned on popular benchmarks inflate their scores by memorizing, not learning, and propose a framework to measure the real-world performance gap.

[tooling]Aug 14, 2026By ByteBulletin Editor

self-bench lets you build private coding-agent benchmarks from your own repo

A new open-source tool turns completed PRs and coding sessions into hidden-test tasks to compare AI coding agents on your codebase.

[research]Jul 21, 2026By ByteBulletin Editor

New Coding Agent Benchmarks Unveiled for ARC-AGI Challenge

A research paper introduces a suite of coding agent benchmarks designed to evaluate progress on the ARC-AGI abstraction and reasoning corpus.