RDMA

One of the interesting elements about NVIDIA’s A100 card is the potential compute density offered, especially for AI applications. There is set to be a strong rush to enable high-density AI platforms that can take advantage of all the new features that A100 offers in the PCIe form factor, and GIGABYTE was the first in my inbox with news of its new G492 server systems, built to take up to 10 new A100 accelerators. These machines are built on AMD EPYC, which allows for PCIe Gen4 support, as well as offering GPU-to-GPU direct access, direct transfers, and GPUDirect RDMA. The G492 servers use dual EPYC CPUs, allowing for 128 PCIe 4.0 lanes in total, however in order to expand support to 10 GPUs as well...