The architecture of open-weight LLMs: MoE, hybrid layers, ternary weights

3 points | by silasyl 27 minutes ago

No comments yet