1 points | by Philpax 17 minutes ago
1 comments
See also https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A..., which fits in a 24GB card through a special 2-bit quantisation.
See also https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A..., which fits in a 24GB card through a special 2-bit quantisation.