Not sure where you're looking, but you have companies like Minstral releasing Ministral 3 models for edge compute. Works fine on gaming PCs.
Edit: I doubt the "defaults" companies ship are going to matter much. We see what's happening with Microsoft and I've not met anyone that's happy with how LLMs are being shoveled into every digital product possible. Seriously, Microsoft doesn't need Copilot in their OS, they need to fix their stupid start menu decisions first.
Not sure where you're looking, but you have companies like Minstral releasing Ministral 3 models for edge compute. Works fine on gaming PCs.
Edit: I doubt the "defaults" companies ship are going to matter much. We see what's happening with Microsoft and I've not met anyone that's happy with how LLMs are being shoveled into every digital product possible. Seriously, Microsoft doesn't need Copilot in their OS, they need to fix their stupid start menu decisions first.
The problem with local AI is that in the future Agents will be running 10s of simultaneous conversations.