I experimented with using an LLM to code the same problem in Ruby (Rails) and Python (Flask) about 10 months back. The LLM performance with Rails was much better - it handled the increasing complexity as features were added much better.
My hypothesis was that the strong emphasis on coding conventions in the Rails ecosystem made it easier for the LLM to cope with scaling complexity.
I don't see any mention of the impact of convention and codebase organisation in the article. And I think it is important (or was 10 months ago!)
I experimented with using an LLM to code the same problem in Ruby (Rails) and Python (Flask) about 10 months back. The LLM performance with Rails was much better - it handled the increasing complexity as features were added much better.
My hypothesis was that the strong emphasis on coding conventions in the Rails ecosystem made it easier for the LLM to cope with scaling complexity.
I don't see any mention of the impact of convention and codebase organisation in the article. And I think it is important (or was 10 months ago!)