"Model power" is being conflated with benchmark and reasoning scores.
There are models that do well on academic or coding benchmarks but have poor world knowledge and conversational fluency. That gap isn't visible in standard evals, but it matters a lot for actual use.
"Model power" is being conflated with benchmark and reasoning scores.
There are models that do well on academic or coding benchmarks but have poor world knowledge and conversational fluency. That gap isn't visible in standard evals, but it matters a lot for actual use.