Terminal bench 2.1: Same score, 16% cheaper run Lemoncrow

1 points | by pankaj4u4m an hour ago

1 comments

  • pankaj4u4m an hour ago

    LemonCrow (opus-4-8) vs Baseline (n=445):

      Avg turns/trial:       13.74  vs  16.82   (-18.3%)
  Avg duration/trial:    448.8s vs  550.0s  (-18.4%)
  Total wall time:       55.5h  vs  68.0h   (-18.5%)
  Cost(both @ 1hr tier): $279.40 vs $411.58 (-16%)