Seriously though, home AI is never going to compete. Few people have PCs in their home any longer and only a tiny subset of those users will fiddle with local models. I’d like to, but I don’t have the compute. :(
And I don’t see that changing. :( And in no case are loads of people going to get into local AI. Lotta nerds around here, but Joe on the street barely knows what AI is, and he certainly doesn’t have a PC any longer.
At best a macbook air/neo or equivalent on windows good enough to browse the average web and the gamer joe will have a gpu with ~8GB vram for most games (aka 3070 or something like that)
What profit margins? :)
Seriously though, home AI is never going to compete. Few people have PCs in their home any longer and only a tiny subset of those users will fiddle with local models. I’d like to, but I don’t have the compute. :(
If hardware prices weren’t insane, we would have prosumer level turnkey home AI already.
Now it’s just for hobbyists with too much money.
And I don’t see that changing. :( And in no case are loads of people going to get into local AI. Lotta nerds around here, but Joe on the street barely knows what AI is, and he certainly doesn’t have a PC any longer.
It’d be Apple packaging local AI capabilities to something like an Apple TV Pro or any other manufacturer with enough integration.
Google might do it too, but less private - ad revenue you know.
But with these prices a decent local AI box would be closer to 1k, ain’t nobody buying that.
At best a macbook air/neo or equivalent on windows good enough to browse the average web and the gamer joe will have a gpu with ~8GB vram for most games (aka 3070 or something like that)