[Source: Huashang.com] News on September 5, according to media reports, NVIDIA has long dominated the field of AI computing power, but AMD’s latest GPU product MI300X finally showed performance comparable to NVIDIA H100/200 strength. According to an evaluation report published b

According to an evaluation report released by The Information, AMD’s Instinct Mi300X GPU performs on par with Nvidia’s H100 GPU in the AI ​​inference benchmark test, showing AMD’s progress in the field of high-performance AI computing.

This evaluation report provides data from mlcommons. In the test, AMD's mi300x GPU and Nvidia's h100 and h200 GPU were evaluated. The results of

show that in AI inference tasks, the performance of mi300x GPU is comparable to that of h100 GPU. Coupled with the estimation of GPU cost and total system cost, it is not an exaggeration to say that mi300x GPU can be comparable to h100 and h200 GPU.

It is worth noting that these tests only used llama 2 70b from meta. Despite the limitations of the test, this result still shows that AMD's mi300x GPU has strong potential in handling large AI models.

Industry insiders are also optimistic about AMD's development prospects in the AI ​​field. Aidan Gomez, the author of Transformer and one of the founders of Cohere, said that he believes that platforms such as AMD and Tranium will soon enter the mainstream market.