RAM (and flash) costs. As for why:
Onderzoek: populaire AI-modellen overtreden op grote schaal de wet - Security.NL
(scroll down about halfway to the only post in English)
“The reason RAM prices went up 4x is that a massive amount of not-yet-manufactured memory was bought with money that doesn’t really exist to be put into GPUs that haven’t been made yet, to be installed in data centers that haven’t been built, powered by infrastructure that may never exist, to satisfy demand that isn’t actually there, in order to generate profits that are mathematically impossible.”
6 Likes