I trained a 30M-param LLM from scratch and the scaling "floor" was a mirage

3 points | by rpadhye 2 hours ago

1 comments