Supermicro Delivers Performance and Efficiency Optimized Liquid-Cooled and Air-Cooled AI Solutions with AMD Instinct™ MI350 Series GPUs and Platforms
- Supermicro launches highly optimized AI solutions, based on AMD Instinct MI350 Series GPUs and AMD ROCm™ Software, delivering breakthrough inference performance and power efficiency.
- The new Supermicro H14 GPU solutions are powered by the newest 4th generation AMD CDNA™ architecture, delivering optimized performance and efficiency for large AI training models and high-speed inference workloads
- Large memory capacity with 2.304TB total HBM3e per 8-GPU server which delivers faster computation and more efficient scaling for AI, inferencing, and training
"Supermicro continues to lead the industry with the most experience in delivering high-performance systems designed for AI and HPC applications," said
Learn more about Supermicro Servers with AMD Instinct MI350 Series GPUs here.
Supermicro's H14 generation data center solutions offer unparalleled performance and flexibility for a wide range of AI, HPC, Cloud, and Enterprise workloads. These systems are built on Supermicro's proven building-block architecture to help enterprise customers efficiently upgrade and scale their workloads. The new Supermicro GPU servers feature both the latest AMD EPYC CPU and AMD Instinct GPUs which together offer a powerhouse family of AI-enabled solutions, adding to Supermicro's data center building block solutions (DCBBS) ensuring customer success from consultation to on-site deployment and support.
"Our new AMD Instinct MI350 series delivers up to 40 percent more tokens-per-dollar relative to the competition, while retaining the industry standard form factor for OEM infrastructure compatibility," said Dr.
Supermicro is expanding its proven liquid-cooled and air-cooled high-performance fabric 8-GPU system, leveraging the open multi-architecture industry standard OCP Accelerator Module (OAM) to support the latest AMD Instinct MI350 series GPUs. For higher-density environments, the 4U liquid-cooled system with AMD Instinct MI355X GPUs features Supermicro's new improved Direct Liquid Cooling (DLC) architecture incorporating new technologies for cooling various server components and reducing power consumption by up to 40%, unlocking higher performance per rack and supporting advanced cooling infrastructure at scale. Customers can choose Supermicro's 4U liquid-cooled option for higher- density rack-scale deployments as well as the 8U option for air-cooled environments.
Designed to maximize computational throughput, memory bandwidth utilization, and energy efficiency to enable more power-efficient AI inference. these accelerated GPU servers with AMD Instinct MI350 series will offer 288GB HBM3e per GPU, boosting 1.5x memory capacity compared to previous generations of AMD Instinct accelerator, 8TB/s bandwidth, and 1.8x petaflops of FP16 / FP8 compared to the previous generation Instinct MI325X, so customers can process more data faster for their AI workloads.
"AI models aren't just increasing in size; they're demanding faster, more efficient infrastructure that can stay consistently deployable in real-world environments," said
These new GPU solutions are designed for powering AI at scale, across cloud service providers and enterprise partners, built on the 4th Gen AMD CDNA architecture, the AMD Instinct MI350 Series delivers exceptional performance and energy efficiency for a wide range of workloads, from AI training and inference to complex scientific simulations. The new AMD MI350 series will also feature new FP6 and FP4 data types to provide exceptional AI capabilities, handling larger models for AI deployments.
These Supermicro GPU systems supporting the AMD Instinct GPUs are available to order:
Liquid-Cooled GPU, 4U https://www.supermicro.com/en/products/system/gpu/4u/as%20-4126gs-nmr-lcc
Air-Cooled GPU, 8U
https://www.supermicro.com/en/products/system/gpu/8u/as%20-8126gs-tnmr
About
Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in
Supermicro, Server
All other brands, names, and trademarks are the property of their respective owners.
View original content to download multimedia:https://www.prnewswire.com/news-releases/supermicro-delivers-performance-and-efficiency-optimized-liquid-cooled-and-air-cooled-ai-solutions-with-amd-instinct-mi350-series-gpus-and-platforms-302480186.html
SOURCE