Directly benchmark NVIDIA! AMD launches latest AI chip, stock price drops 3%

The rise of AI has brought new increments to the chip industry. The stock price of Nvidia, the industry’s big brother, is even more impressive, and other chip manufacturers have also joined the competition.

On Tuesday local time, AMD held the "AMD Data Center and Artificial Intelligence Technology Premiere" and released the most advanced AI processor series Instinct MI300.

Directly benchmark NVIDIA AI chip

At the press conference, AMD first announced the Instinct MI300A, which is claimed to be the world's first acceleration processor (APU) acceleration card for AI and high-performance computing (HPC).

According to reports, MI300A has 13 small chips containing a total of 146 billion transistors: 24 Zen 4 CPU cores, 1 CDNA 3 graphics engine and 128GB HBM3 memory. Compared with the previous generation MI250, the performance of MI300 is eight times higher and the efficiency is five times higher.

Subsequently, AMD announced a version of MI300X specially optimized for large language models, with a memory of 192GB, a memory bandwidth of 5.2TB/s, an Infinity Fabric bandwidth of 896GB/s, and a transistor count of 153 billion.

At the press conference, in order to demonstrate its functions, company CEO Su Zifeng used Hugging Face’s large model based on MI300X to write a poem about San Francisco, where the event was held.

Su Zifeng said that the high-bandwidth memory (HBM) density provided by MI300X is 2.4 times that of Nvidia H100, and the HBM bandwidth is 1.6 times that of competing products.

Su Zifeng pointed out that the model size is getting larger and larger, and you actually need multiple GPUs to run it. As AMD processor memory expands, developers no longer need to use as many GPUs, which can reduce costs.

Su Zifeng said: "There is an amazing amount of technology here, and it is the most complex chip we have ever made to make artificial intelligence easier to use." Everyone who wants to use AI needs more GPUs, and we have a powerful, very efficient GPU that we believe will be a serious winner in the AI market. ”

In addition, AMD also released the AMD Instinct platform, which has eight MI300X, uses industry-standard OCP design, and provides a total of 1.5TB of HBM3 memory. To compete with Nvidia's CUDA, AMD said the company has also launched its own GPU software, "ROCm."

In terms of the factory process, Su Zifeng revealed that MI300A has been sampled now, and MI300X and Instinct platforms will be sampled in the third quarter of this year and officially launched in the fourth quarter.

Su Zifeng said that she believes AMD will be able to produce enough chips in 2024 to meet demand. But she declined to disclose the pricing of the new AI chips. The price of the Nvidia H100 has risen to $40,000 due to tight supply and demand in the market.

NVIDIA dominates the AI chip market

At the press conference, Su Zifeng was very optimistic about the future AI chip market. She said: "We are still very early in the artificial intelligence life cycle. By 2027, the total addressable market size of the data center AI accelerator market is expected to grow at least five times to more than $150 billion.

However, currently, NVIDIA has almost no large-scale competitors in the field of AI chips. Since the beginning of this year, NVIDIA's stock price has risen by 170%. They occupy 80%-95% of the market share and become the dominant player in the market.

Although Intel and several startups such as Cerebras Systems and SambaNova Systems have competing products, Nvidia’s biggest threat currently is still the internal chip business of Google and Amazon’s cloud unit. Both companies lease their custom chips to External developers.

The market and analysts are not optimistic

Currently, AMD hopes to compete with Nvidia in AI chips while continuing to win data center market share from Intel.

Although AMD's new chips seem to outperform Intel in terms of data, market performance and analysts have already expressed their opinions. AMD's U.S. stock price fell 3.62% after the product was released, but rose 0.59% after the market. As of this year, AMD's stock price has increased by 92.26%. NVIDIA closed up 3.9%, with its market value closing above the 1 trillion mark for the first time.

Citi chip analyst Chris Danely noted in a new client note

AMD's MI300 chip appears to be a huge design win, however, given its performance limitations and history of failures, we question its sustainability.

Moor Insights&Strategy analyst Anshel Sag also pointed out:

People still don't believe that AMD's software solution is competitive with Nvidia's, even if it is competitive in terms of hardware performance.

The above is the detailed content of Directly benchmark NVIDIA! AMD launches latest AI chip, stock price drops 3%. For more information, please follow other related articles on the PHP Chinese website!