Anyone familiar with how we ourselves learn knows that this won’t lead very far in terms of intelligence. Mothers narrate things to us as children, giving descriptions of how they work; children’s books and TV shows act as supplementary material. Then, we go out and play with these things, discovering the meaning of the descriptions for ourselves. Over thousands of iterations we’ll recognize that a specific word pops up in similar contexts, and learn how it describes their similarities with our own internal abstractions. Our very first meanings relate our actions to their effects on the environment; LLMs know little of this.
Embodiment is key.