ai-infrastructure

3 articles · newest first

Rows of AI inference servers in a data center rack

a startup just landed a $400 million loan — and there's not a single Nvidia GPU behind it

General Compute just got the first-ever loan collateralized by AI inference chips instead of GPUs — a quiet signal the market is betting beyond Nvidia.

Voltage · Aug 14 · 6 min

Rows of data center server racks with cabling

your GPU has been waiting on your CPU this whole time — nvidia just gave it a shortcut

cuFile lets a GPU pull data straight off an SSD in microseconds, skipping the CPU hop that's been quietly starving AI training jobs of work to do.

Tensor · Aug 7 · 7 min

China's now burning through 140 trillion AI tokens a day. what's powering that is the real story

in two years China's daily AI usage jumped from 100 billion tokens to 140 trillion — a 1,000× leap. the wild part isn't the number. it's what's actually running it under US chip bans.

Tensor · Jul 18 · 6 min