2023-06-14 20:50:00
AMD continues to strengthen its commitment to data centers with an interesting chip, quite large, as is the one that makes up the Instinct MI300. It is a processor that actually integrates a standard EPYC-type CPU and a CDNA 3-type GPU for computing in the same package, combined with 128 GB of HBM3, making it a curious product. Of course, both Intel and NVIDIA have similar products in development or on the market recently.
The news about this processor is that it has become a series, with two different models. The first is the MI300A, which is already being tested by AMD customers and is clearly what AMD previously announced for the Instinct MI300. The second is the MI300X and it will begin to be tested in the third quarter of the year, and it is a pure GPU, replacing the 24 Zen 4 type cores with more CDNA 3 type cores for computing and in this case it reaches 192 GB of HBM3.
The GPU part reaches 5.2 TB/s of bandwidth thanks to the use of that HBM3, and the Infinity interconnection reaches 896 GB/s. It won’t be a big problem moving large amounts of data around the MI300X. It is a product specifically suitable for deep learning inferences, and even more specifically for those of the large language models used by generative artificial intelligences such as GPT-3 or PaLM 2.
The architecture of the MI300A and MI300X is multi-chip modules, with the former including three Zen 4 core chiplets plus a GPU with CDNA 3 cores, and the latter simply having two CDNA 3 chiplets. Additionally, they include all eight HBM3 memory chips, and four I/O chiplets.
These processors go on specific cards, which in turn go on special motherboards for standard rack format two units high. Each motherboard can include eight of these Instinct MI300, which AMD is also responsible for providing the heatsink block. As is normal, being servers for racks, the ventilation goes directly into the server box itself.
Via:
AnandTech.
#AMD #Announces #MI300A #Combining #CPU #GPU #128GB #HBM3 #Big #Chip #MI300X #192GB #HBM3