ai-infrastructure

2 articles · newest first

Rows of AI inference servers in a data center rack

a startup just landed a $400 million loan — and there's not a single Nvidia GPU behind it

General Compute just got the first-ever loan collateralized by AI inference chips instead of GPUs — a quiet signal the market is betting beyond Nvidia.

Ravi Malhotra · Aug 14 · 6 min

Rows of data center server racks with cabling

your GPU has been waiting on your CPU this whole time — nvidia just gave it a shortcut

cuFile lets a GPU pull data straight off an SSD in microseconds, skipping the CPU hop that's been quietly starving AI training jobs of work to do.

Lena Fischer · Aug 7 · 7 min