AI data centers are swallowing the world's memory and storage supply, setting the stage for a pricing apocalypse that could last a decade

NAND Flash pricing decline
(Image credit: Micron)
19
Disclaimer

This free-to-access article was made possible by Tom's Hardware Premium, where you can find in-depth news analysis, features and access to Bench.

Latest Videos FromTom's Hardware
Luke James
Contributor

Luke James is a freelance writer and journalist.  Although his background is in legal, he has a personal interest in all things tech, especially hardware and microelectronics, and anything regulatory. 

  • edzieba
    That's assuming the LLM bubble takes a decade to pop, which seems pretty unlikely.
    Reply
  • LabRat 891
    Shouldn't this also mean a *lot* of high-end eWaste and 'surplus' Enterprise equipment in that time? Or, is pretty much everyone demanding their kit be destroyed post-use?
    Reply
  • kameljoe23
    I'm weary of people calling AI a bubble. AI is the future and everyone knows it. Sure companies might be overvalued at this time yet their future potential is so great that their valuation deserves what they are today. The demand for hardware and software will will be 10-fold. Large language models might be the tip of the iceberg right now yet there are a number of other AI models out there that will require the same hardware.
    Reply
  • Alvar "Miles" Udell
    “NAND will face severe shortages in the next year. I think supply will be tight for the next ten years,” he said in a recent interview.

    Guess I'll still be rocking this 5950X for another decade then.
    Reply
  • hhuling86
    kameljoe23 said:
    I'm weary of people calling AI a bubble. AI is the future and everyone knows it. Sure companies might be overvalued at this time yet their future potential is so great that their valuation deserves what they are today. The demand for hardware and software will will be 10-fold. Large language models might be the tip of the iceberg right now yet there are a number of other AI models out there that will require the same hardware.
    I have no use for AI nor will I ever, especially if I have to start paying extra on my electricity bill, for instance
    Reply
  • ggeeoorrggee
    kameljoe23 said:
    I'm weary of people calling AI a bubble. AI is the future and everyone knows it. Sure companies might be overvalued at this time yet their future potential is so great that their valuation deserves what they are today. The demand for hardware and software will will be 10-fold. Large language models might be the tip of the iceberg right now yet there are a number of other AI models out there that will require the same hardware.
    The problem with AI is that the models and the systems that drive them are all derivative (also based on theft). Further the output is generally flawed by an inability to do anything other than mimicry — which leads to repetition of flaws — leading further refinement on the same principle to reach a finer and finer flaw point. Unfortunately, that flaw point continues and becomes harder to locate once fringe cases surface issues. At its root, AI in its current forms doesn’t understand a problem it can’t find in the past and routinely misidentifies dissimilar problems as the same due to an inability to parse nuance.

    However none of that is the actual bubble. The actual bubble that will drag us all down is, as ever, financial in the way companies are pouring dump trucks of cash into increasingly hungry systems that are not giving anything remotely equivalent in return. As with all financial bubbles, the upper limit comes when there are no more promises to be made, futures to gild, and places to hide massive debt. Just like the dot com, the banking, and the housing bubbles. I wouldn’t be surprised if auto loans are coming up on that soon too.
    Reply
  • Zaranthos
    It wasn't long ago the articles were about RAM and NAND suppliers cutting production because of lower demand. This to shall pass. Right now most of the world is investing in AI and semiconductor manufacturing. Even Intel suddenly seems to possibly have a future when some thought they were soon dead. There is a lot of new competition in RAM and NAND as well.

    There may be some supply constraints that drive prices higher like they have with GPU prices, but all of this is also driving innovation, R&D, and more advanced technologies. Ultimately we'll all benefit, unfortunately a lot of us are going to pay a lot more for electricity before that problem is fixed. If even some of AI ends up being a bubble that bursts then at some point electricity rates should come crashing back down with it as demand for power decreases or supply far exceeds demand. As dump as a lot of AI is right now it should ultimately drive a whole new era of benefits to mankind, if it doesn't kill us all first. Maybe I'll watch Terminator again just in case. :tongueout:
    Reply
  • LinuxRocks
    ggeeoorrggee said:
    The problem with AI is that the models and the systems that drive them are all derivative (also based on theft). Further the output is generally flawed by an inability to do anything other than mimicry — which leads to repetition of flaws — leading further refinement on the same principle to reach a finer and finer flaw point. Unfortunately, that flaw point continues and becomes harder to locate once fringe cases surface issues. At its root, AI in its current forms doesn’t understand a problem it can’t find in the past and routinely misidentifies dissimilar problems as the same due to an inability to parse nuance.

    However none of that is the actual bubble. The actual bubble that will drag us all down is, as ever, financial in the way companies are pouring dump trucks of cash into increasingly hungry systems that are not giving anything remotely equivalent in return. As with all financial bubbles, the upper limit comes when there are no more promises to be made, futures to gild, and places to hide massive debt. Just like the dot com, the banking, and the housing bubbles. I wouldn’t be surprised if auto loans are coming up on that soon too.
    100% This!

    AI's biggest problem, as most people see it, is its not smart at all yet! I mean, it only knows what humans feed it, and that is data from the internet... Really? That is not an intelligence at all, that's just a parser.

    Now, I use AI to help consolidate searches, because a computer is much faster at collating than I am LOL.

    Disclaimer: Im not an AI expert, but we do use it every day to help with Ansible and bash scripting and other code stuffs, and is it helpful, but where I work, we have a couple racks of GPUs and do our own LLMs, we dont rely on Google or xAI because we work in a classified environment and dont have access.

    I also use it on my Linux systems at home though LM Studio and find AI to be, again, nothing but a fast information parser.

    It doesn't make decisions on anything... In fact, I find I correct it all the time even on xAI and Google, and its very happy to be corrected and reminds me of some little kind that thinks they know everything HAH.
    Reply
  • BloodLust2222
    When AI can clean my house, cook and go to work for me is when I will care about AI.
    Reply
  • ggeeoorrggee
    I forgot my biggest issue with AI: lack of deterministic outcomes.

    Combine that with an unknown trust level, it’s like if every junior engineer in my company would produce randomly different, unverifiable content that they might then also lie about.

    Basically H.A.L. without access to life support and the airlock.
    Reply