
A $60 Million AI Rack Cluster with 1.4 Petabytes of Memory and Nearly 10,000 Nvidia AI GPUs Listed on eBay

By Roberta Williams


By Roberta Williams
A colossal AI supercomputer, valued at nearly $60 million, was recently made available for purchase on eBay. This immense system, comprising 300 racks, is loaded with thousands of Nvidia A100 GPUs and AMD EPYC CPUs, reflecting the substantial hardware investments driving the artificial intelligence sector. This unique offering emerged from Core 4 Solutions, a major IT parts supplier to prominent tech giants and government agencies.
Each of the 300 racks in this configuration is outfitted with four compute nodes, each housing eight Nvidia A100 40 GB GPUs, eight Nvidia Connect network interface cards, and two AMD EPYC 64-core CPUs. Furthermore, every rack is equipped with 1 TB of DDR4 memory and three 1U management nodes, each featuring two EPYC CPUs. Collectively, this translates to an astonishing 9,600 GPUs and 4,200 CPUs, underscoring the sheer processing power and memory capacity integrated into this single system. The Nvidia A100 GPU, an enterprise-grade unit built on the Ampere architecture, is specifically optimized for AI workloads and data analytics, delivering considerable CUDA core performance tailored for computational intensity rather than conventional gaming.
The listing, which concluded on October 28, presented a rare opportunity to acquire such an advanced AI cluster. Notably, domestic shipping within the United States was offered free of charge via FedEx options, adding an unusual perk to a transaction of this magnitude. The total memory capacity of this cluster reaches an astounding 1.4 petabytes, a figure that powerfully illustrates the substantial resources dedicated to developing and deploying AI technologies and highlights why memory components are in such high demand and consequently, expensive. This instance serves as a vivid example of the extensive capital and infrastructure required by AI enterprises to sustain their cutting-edge operations.
This remarkable eBay listing offers a fascinating glimpse into the high stakes and rapid technological advancements characterizing the artificial intelligence domain. It underscores the ongoing arms race in computing power and memory resources among leading AI companies, each striving to push the boundaries of innovation. Such a monumental investment in hardware signals a future where increasingly sophisticated AI models and applications will reshape industries and everyday life, demanding ever-greater computational capabilities to unlock their full potential.
About the author

Pioneer of graphic adventure games, co-founder of Sierra On-Line, and creator of "King's Quest."

by Reiner Knizia
by Hideo Kojima