New Storage Server Options in Spectrum Fusion HCI 2.4


On December 15, the new 2.4 version of IBM Spectrum Fusion HCI was released.  From a system hardware perspective, the most significant change in this release is the availability of powerful new storage servers.  The new storage servers have a total of 64 cores (128 threads) of processing power that comes from two AMD EPYC 3 7543 processors.  To support the applications using all these cores, there is 1024GB of RAM in each server, which works out to be 16GB/core.  While it's true that such 64-core servers were already available for Spectrum Fusion HCI, what is different now is that these servers come with a minimum of two Samsung 7.68TB PM1733 PCIe Gen 4 NVMe drives.  And they can be expanded to have up to 10 of these drives.

With these new storage servers come new options for creating the base storage cluster in the system.  Previously, because there was only one storage server configuration available, there was only one way to build the base storage cluster and that was with six 32-core servers:

But with the new storage server option, it is possible to exchange some 32-core servers in this base cluster for 64-core servers.  To begin, let's leave the three OpenShift control plane nodes as 32-core servers and upgrade the worker nodes.  The control plane nodes are considered infrastructure nodes and they don't run any user applications, so putting the power of the 64-core servers onto the control plane doesn't make sense if no user applications will run there.  The result is a mixture of 32-core and 64-core servers with the worker nodes now being 64-core servers:

With this mixture of 32-core and 64-core servers, we now have a base storage cluster with more than 2.5x the number of cores available for user applications in the worker nodes that are now 64-core servers!  That's a significant upgrade.

The third available base cluster configuration goes all-in on the new 64-core servers, using 64-core servers for the three control plane nodes and the three worker nodes:

For this fully 64-core server configuration to be worthwhile, the control plane nodes must now run user applications otherwise the additional cores and RAM on those nodes would go to waste.  OpenShift licensing considerations come into play with user applications now running on the control nodes.  Whether this third base cluster configuration is cost-effective will depend on your OpenShift licensing situation and the license agreements of the user applications running on these control plane/worker nodes.

With more flexibility in configuring the base storage cluster using servers with high-density compute power, IBM Spectrum Fusion HCI systems can now be applied in even more situations.

Previous post: Upgraded Compute Power for IBM Spectrum Fusion HCI

Next post: Energizing IBM Spectrum Fusion HCI


The opinions expressed in this post are those of the author.

Comments

Post a Comment

Popular posts from this blog

Inside the Storage/Compute Servers of IBM Spectrum Fusion HCI

Image
Previously, I provided an overview of the IBM Spectrum Fusion HCI hardware followed by posts giving an overview of the different server and switch components that go into that system. Most of the servers in an IBM Spectrum Fusion HCI system will be storage/compute servers, so you can think of these servers as the workhorses of the system. In this post, I take a closer look at the CPU, memory, storage, and network elements inside these storage/compute servers. CPU and Memory A storage/compute server is built from a Lenovo SR645 server that is one rack unit (1U) high.  (A rack unit is an industry standard that translates to 1.75 inches; an industry standard data center rack used to hold servers and switches is 42U tall.)  Inside the server are two processor sockets that are each populated with an AMD EPYC 7302 processor.  The EPYC 7302 is a 16-core, 32-thread, processor that operates with a base clock speed of 3.0 GHz.  With two of these process...
Read more

Fusion HCI Adds 8x the GPU Power

Image
IBM Storage Fusion HCI System has released a new GPU server today that takes a huge step forward in the support of AI applications.  The new server, called the G03, can be configured to have as many as 8 double-wide GPU adapter cards .   Fine-tuning and inferencing with foundation models used in AI applications increasingly requires faster and more powerful hardware, and the Fusion HCI G03 meets that need head on! The tremendous boost provided by the G03 for AI apps comes from having up to 8 of the  NVIDIA L40S  GPU PCIe double-wide adapter cards inside a single server.  The L40S is powered by the NVIDIA Ada Lovelace Architecture and is designed for generative AI and LLM training and inferencing.  It contains fourth generation tensor cores and the latest transformer engine that puts those tensor cores to good use. The design of the G03 provides flexibility for deploying GPU resources.  Many organizations will order the G03 with a full complement o...
Read more

Fusion HCI Performance Boost for AI Apps

Image
Fine-tuning and inferencing with foundation models used in AI applications increasingly requires faster and more powerful hardware as AI foundation models grow ever larger.  In response to this need, IBM Storage Fusion HCI System released a new GPU server option earlier this month called the G02 that gives a performance boost for AI applications. The new G02 GPU server is based on the Lenovo SR650 V3.  The configuration used in the G02 includes a pair of Intel Xeon Gold 6418H 24-core "Sapphire Rapids" processors.  This processor model includes Intel Deep Learning Boost, designed to accelerate AI use cases by extending the Intel AVX-512 instruction extension with a new instruction that increases deep learning inference performance. But the big boost provided by the G02 for AI apps comes from the three  NVIDIA A100 80GB GPU PCIe adapter cards in each G02 server.  This newer version of the A100 has u p to 1.25x higher AI inference performance over the A100 40...
Read more