6.4x faster than llama.cpp, 3.9x faster than MLX

4 comments

• para_parolu 16 hours ago

  I wonder how it’s compared to https://github.com/antirez/ds4

• d3Xt3r 17 hours ago

  Headline is missing a critical detail: "on Apple Silicon".

• 19 hours ago
  [deleted]
• lukasonedge 19 hours ago

  [dead]