SAN JOSE, Calif. - Supermicro, Inc. (NASDAQ: SMCI), known for its IT solutions for AI, Cloud, Storage, and 5G/Edge, has announced a new line of SuperCluster solutions aimed at accelerating generative AI deployment. These solutions are designed to serve as the foundation for large language model (LLM) infrastructures.
The Supermicro SuperCluster portfolio includes three configurations: 4U liquid-cooled systems, 8U air-cooled systems, and 1U air-cooled Supermicro NVIDIA (NASDAQ:NVDA) MGX™ systems. These systems are engineered to deliver strong performance for LLM training and high-capacity inference workloads. The company's CEO, Charles Liang, emphasized the ability to deliver these AI clusters rapidly to customers, leveraging Supermicro's global manufacturing capacity.
The 4U liquid-cooled systems, equipped with NVIDIA HGX H100/H200 8-GPU, are designed to support NVIDIA's next-generation Blackwell architecture-based GPUs. These systems aim to reduce energy consumption and lower the total cost of ownership (TCO) for data centers through efficient cooling technology that can result in up to a 40% reduction in electricity costs.
Supermicro's new offerings are integrated with NVIDIA AI Enterprise software and networking solutions, including 400Gb/s NVIDIA Quantum-2 InfiniBand and Spectrum-X Ethernet, to facilitate the training of LLMs with up to trillions of parameters. The SuperClusters also feature customizable AI data pipeline storage fabric with parallel file system options and are designed to support high-throughput and low-latency storage access.
The 1U air-cooled NVIDIA MGX systems feature the NVIDIA GH200 Grace Hopper Superchips, which address the GPU memory bandwidth and capacity needs for running LLMs with high inference batch sizes to lower operational costs. These systems are scalable and suitable for cloud-scale, high-volume inference.
Supermicro's announcement highlights the company's commitment to providing application-optimized IT solutions and its focus on innovation and sustainability in its product design and manufacturing processes. This release is based on a press release statement from Super Micro Computer (NASDAQ:SMCI), Inc.
This article was generated with the support of AI and reviewed by an editor. For more information see our T&C.