TurboPrefill: 3.27× Prefill Speedup in Llama.cpp

1 comments

• trykhlieb an hour ago

  TurboPrefill by Trykhlieb is now also available for ik_llama.cpp by Ivan Kawrakow.