Memory Prices Indefinitely High: SK Hynix Says Shortage Continues Through 2030 We haven't been complaining about RAM prices quite as much on the podcast
Bullshit. Chinese RAM is ramping up to world scale levels. LLMs are reaching massive diminishing returns points, and open weights local AI setups that are near frontier level, and which can be run on consumer level hardware are already here, and getting very hardware efficient. The AI bubble burst is very close. Memory makers are pushing FOMO buying.
Yea, I wouldn’t be surprised if Samsung and SK Hynix would come to regret their deals with OpenAI once the Chinese have ramped up production and price them out of the market.
This. As with any technology, it will always improve. The American government helped the Chinese by barring the chips from them, meaning they had to program more efficient models.
We don’t know if they’re actually more efficient because ClosedAI and Anthropic won’t tell us how (in)efficient their models are, whether they’re running quants, etc. Kimi K3 is about 3 terabytes of VRAM unquantized so I wouldn’t call the Chinese models super efficient either. The “efficient” models are the distillations and particularly quantized versions of some Chinese models. Nothing stopping ClosedAI and Anthropic from doing the same if they’re willing to lose a bit in accuracy.
Bullshit. Chinese RAM is ramping up to world scale levels. LLMs are reaching massive diminishing returns points, and open weights local AI setups that are near frontier level, and which can be run on consumer level hardware are already here, and getting very hardware efficient. The AI bubble burst is very close. Memory makers are pushing FOMO buying.
Ay, if you are sure about that, buy calls (or puts, idk) from open AI and 2x your money!
The local models require massive amounts of ram that isn’t available for most consumer hardware
I do hope the bubble bursts soon but low ram and local ai aren’t compatible
Yea, I wouldn’t be surprised if Samsung and SK Hynix would come to regret their deals with OpenAI once the Chinese have ramped up production and price them out of the market.
This. As with any technology, it will always improve. The American government helped the Chinese by barring the chips from them, meaning they had to program more efficient models.
We don’t know if they’re actually more efficient because ClosedAI and Anthropic won’t tell us how (in)efficient their models are, whether they’re running quants, etc. Kimi K3 is about 3 terabytes of VRAM unquantized so I wouldn’t call the Chinese models super efficient either. The “efficient” models are the distillations and particularly quantized versions of some Chinese models. Nothing stopping ClosedAI and Anthropic from doing the same if they’re willing to lose a bit in accuracy.
Yeah, but that news won’t make a boardroom happy.