An SLM trained on $8 ESP32-S3

2 points | by pavelai an hour ago

1 comments

  • pavelai an hour ago

    This small Klingon speaking language model was trained completely on ESP32. The training took 2 days

    Number of parameters: 319K

    (Disclaimer) The models is tiny and is not a pocket chatbot. It mistakes and is not capable to support conversation, but that's not the goal of the project

    The goals of the project is to bring training to edge devices and it worked out

    How can one use it? By using solar panels such device could be turned into autonomous meteorological station