The smallest edge AI device for local LLMs

11 points | by alex-moon an hour ago

2 comments

  • ingen0s 10 minutes ago

    I am confused as to weather this is software or a product

    [-]
      micromacrofoot 5 minutes ago

      both, but def hardware

      > SoC (Armv9.2

      > CPU + NPU) 30TOPS +

      > dNPU 160TOPS