My "4-bit" quant was 6.2 bits per weight

3 points | by murphman an hour ago

1 comments