Makes me wonder how much real world industrial espionage happens. Most companies are not sitting on "pre-post-Singularity-AI-god-intelligence-technology" valuations so the actual secret sauce between competitors strikes me as pedestrian and not worth the hassle.
This repo already has ~6k downloads, so surely those who really care (OpenAI, DeepSeek, etc) have a copy without doing the leg work themselves (assuming it is real). Although, I thought at this point, the pre-training between the companies would be mostly identical, so all of the real work comes afterwards.
According to [0], many tensors are a bit-perfect match to NumPy RNG output. Running a 14T model is quite expensive, I don't know if I'd waste money trying this.
Obviously fake. Come on. This isn’t like leaking llama… even if it were real you would need several racks of b200s to even run this at all coupled with nvlink.
Not legit. The repo is real and the shards are real files, but they are not an Anthropic checkpoint.
The only evidence on the model card is the name numbat. That is a real internal codename from the public Claude Code source leak ("remove this section when we launch numbatiại). That comment does not describe this architecture, and anyone can read it.
The card contradicts itself. It says the weights were quantized to NVFP4 so evals could run on Trainium2.
Trainium2 does not support NVFP4. AWS documents its types as FP32, TF32, BF16, FP16, and FP8. NVFP4 is an NVIDIA format. The architecture is also just public papers stapled together: Gated DeltaNet, DeepSeek-style latent attention, 1,224 experts, multi-token prediction. Nothing ties that stack to Anthropic.
A few smaller tells: the account was created on Oct 16 and is named burner, the readme says ~141 params while the file index counts 6.85T, and the training log only ever advances in steps of 6, 7, or 8 seconds, including straight through a line that claims a 178-second checkpoint. It has been public since Oct 23. Anthropic DMCA'd the Claude Code mirrors within days. This is still up.
Don't run the custom Python in that repo.
Its fake.
https://huggingface.co/burner22/numbat/discussions/13
This comment even has the receipts.
Idk how his AI figured this out, but the matrixes are literally just random data and the seed is the tensor name.
My own agent reproduced the findings.
That's pretty incredible back-tracking. So much that could have gone wrong in identifying the pipeline from seed generation to final output.
Is it realistic that this has been on HF for a week and it's not been taken down for copyright?
Makes me wonder how much real world industrial espionage happens. Most companies are not sitting on "pre-post-Singularity-AI-god-intelligence-technology" valuations so the actual secret sauce between competitors strikes me as pedestrian and not worth the hassle.
This repo already has ~6k downloads, so surely those who really care (OpenAI, DeepSeek, etc) have a copy without doing the leg work themselves (assuming it is real). Although, I thought at this point, the pre-training between the companies would be mostly identical, so all of the real work comes afterwards.
According to [0], many tensors are a bit-perfect match to NumPy RNG output. Running a 14T model is quite expensive, I don't know if I'd waste money trying this.
[0]: https://huggingface.co/burner22/numbat/discussions/13
"43 complete tensors exactly match name-seeded NumPy RNG output"
https://huggingface.co/burner22/numbat/discussions/13
A day will come when such a leak will happen - thats almost a certainty. But it's not today.
If the poster could provide some extra context that’d be great (why do people think this is actually an Anthropic checkpoint?)
Should we all start downloading it in case it's legit?
Obviously fake. Come on. This isn’t like leaking llama… even if it were real you would need several racks of b200s to even run this at all coupled with nvlink.
If it were real anthropic obviously wouldn't let it last a week on HF lol
seems to be fake from what I can gather. I would really like to be wrong but that's the consensus on r/localllama comments[0] as well
[0]: https://www.reddit.com/r/LocalLLaMA/comments/1xl7xdk/is_that...
https://www.reddit.com/r/ClaudeAI/s/HAMAh5La4D based on this Reddit discussion it seems fake for a variety of reasons, copying u/Strider96’s comment here:
Not legit. The repo is real and the shards are real files, but they are not an Anthropic checkpoint. The only evidence on the model card is the name numbat. That is a real internal codename from the public Claude Code source leak ("remove this section when we launch numbatiại). That comment does not describe this architecture, and anyone can read it. The card contradicts itself. It says the weights were quantized to NVFP4 so evals could run on Trainium2. Trainium2 does not support NVFP4. AWS documents its types as FP32, TF32, BF16, FP16, and FP8. NVFP4 is an NVIDIA format. The architecture is also just public papers stapled together: Gated DeltaNet, DeepSeek-style latent attention, 1,224 experts, multi-token prediction. Nothing ties that stack to Anthropic. A few smaller tells: the account was created on Oct 16 and is named burner, the readme says ~141 params while the file index counts 6.85T, and the training log only ever advances in steps of 6, 7, or 8 seconds, including straight through a line that claims a 178-second checkpoint. It has been public since Oct 23. Anthropic DMCA'd the Claude Code mirrors within days. This is still up. Don't run the custom Python in that repo.