Memory Becomes The New AI Bottleneck, Weighing On Markets

By Michael Ball, Bloomberg Markets Live reporeter and strategist 

AI capex is increasingly running into a new hard constraint: memory. 

A bottleneck is threatening to spill over from AI servers into broader electronic products, pushing up device costs and adding an inflation impulse that could weigh on risk sentiment. 

High bandwidth memory sits at the center of it. Training and inference are causing a significant increase in demand, and supply doesn’t scale quickly. HBM also pulls in wafer capacity and advanced packaging, which tightens conventional DRAM and NAND too. 

That’s why this is more than just an AI capex worry. The shortage leaks into PCs and smartphones, then into margins and end prices. HP is already pointing to memory-cost inflation as a margin problem, and Samsung is warning higher memory costs are pushing electronics prices up. Researcher IDC goes even further, flagging outright demand destruction, forecasting the chip shortage will engender a much smaller smartphone market and structurally higher pricing.

The market risk is two-sided, according to Oppenheimer’s Ananth Muniyappa: Long positions in winners are crowded, which makes headline risk matter more than usual, and the supply chokepoint invites workarounds. Nvidia will give more details at its annual developers conference next month about incorporating more on-chip SRAM capacity and reducing its reliance on HBM, Muniyappa says, adding that Google’s TPU roadmaps are also headed in the same direction. 

Even if HBM demand stays strong, the mere suggestion of circumventing the chips can hit sentiment in the handful of companies that have benefited from the current setup. 

In the near term, HBM remains dominant. The bottleneck persists, pricing stays firm and the memory makers keep earning. But the downstream pressure points widen. Device makers likely pass costs on, with Bloomberg Intelligence seeing a CPI impulse at roughly 0.2 percentage point in the US, euro area, and UK under a strong pass-through case. That’s not a shock on its own but adds to the sticky inflation narrative, keeping central banks cautious at the margin and weighing on risk assets.