2024-03-30 22:00:00
The MLCommons study ranked the AI acceleration chips on the market and left Intel and Nvidia at the top of the tests
Intel (Nasdaq: INTC) reports good results in AI performance test, MLPerf. The AI accelerator Intel Gaudi 2 demonstrated powerful performance, remaining the only alternative tested against the Nvidia H100 in the field of generative AI. At the same time, 5th generation Intel Xeon processors with Intel AMX expansion achieved an average improvement of 1.42 times compared to the previous generation.
The test revealed that the Intel Gaudi 2 AI accelerator supports advanced models such as Stable Diffusion XL and Llama v2-70B, and due to optimized architecture and software, Gaudi 2 manages to provide exceptional performance in relation to the price, and is an ideal solution for companies looking for an alternative to Nvidia.
For Intel’s 5th generation Xeon processors, hardware and software improvements led to an average 1.42x improvement in performance over the previous generation. For example, the GPT-J model achieved 1.8 times better performance thanks to various optimizations. The DLRMv2 model also recorded a similar improvement alongside a high accuracy of 99.9% thanks to the utilization of Intel AMX technology, which is a set of commands designed to accelerate the speed of AI applications, and especially of neural networks, by efficiently performing matrix multiplication.
Intel notes that it maintains close cooperation with leading manufacturers such as Cisco, Dell and Supermicro, which also presented impressive results in the MLPerf test with systems based on Intel technology.
#Intel #test #conducted #Gaudi #presented #performance #NVIDIA #H100