Home Technology peripherals AI The artificial intelligence boom has led to a shortage of computing power, Microsoft launches a new server rental plan

The artificial intelligence boom has led to a shortage of computing power, Microsoft launches a new server rental plan

Apr 13, 2023 pm 02:49 PM
AI chatgpt

ChatGPT’s continued popularity has led to a chip shortage: there is not enough computing power to handle ChatGPT’s computing needs, which has overloaded OpenAI’s servers. The last large-scale chip shortage was caused by crazy mining for virtual currencies. However, as the demand for generative artificial intelligence continues to increase, this time the computing power shortage may continue for quite some time.

The artificial intelligence boom has led to a shortage of computing power, Microsoft launches a new server rental plan

Microsoft hopes to fill this gap with a new virtual machine product called ND H100 v5, which includes a large number of Nvidia code-named Hopper The latest H100 GPU, for generative artificial intelligence applications.

The idea is to provide higher computing speeds to companies working on generative artificial intelligence, which can dig deeper into data, build relationships, reason and predict answers. Generative AI is still in its early stages, but the popularity of apps like ChatGPT is already demonstrating the technology’s potential.

But this technology also requires huge computing power, and Microsoft is introducing it into Azure cloud services.

The virtual machine offering can be scaled to the size of generative AI applications and scales to thousands of H100 GPUs, which are interconnected via the chipmaker's Quantum-2 InfiniBand technology.

Pricing for H100 virtual machines on Azure was not immediately announced. The price of virtual machines varies depending on the configuration, with a fully loaded A100 virtual machine with 96 CPU cores, 900GB of storage, and eight A100 GPUs costing nearly $20,000 per month.

When ChatGPT was first launched last year, Nvidia GPU faced a severe test. Its calculations are undertaken by the OpenAI supercomputer, which is built with Nvidia A100 GPUs.

But the server was quickly overwhelmed by the crazy increase in demand for ChatGPT, and users complained that the server could not respond and process query tasks in time.

The H100 could close the speed gap needed for generative artificial intelligence, which is already used in healthcare, robotics and other industries. Various development companies are also looking to fill the last mile gap and deploy an interface to make AI simple and usable, like ChatGPT.

Nvidia and Microsoft are already using the H100 to build an artificial intelligence supercomputer. The GPU is designed to work best with applications coded in CUDA (CUDA is Nvidia's parallel programming framework). Products also include the Triton inference server, which will help deploy artificial intelligence model GPT-3 on its GPU environment.

Microsoft began to fully embed artificial intelligence in its products: it implemented a customized version of GPT-3.5, the large language model behind ChatGPT, in the Bing search engine. Microsoft is taking a DevOps (development operations) style iterative approach to Bing AI, in which applications can be quickly updated by learning about users as they use the model. Microsoft 365 Copilot is the original OFFICE suite with embedded artificial intelligence. Familiar software such as WORD, PPT and EXCEL will change traditional working methods with new capabilities. And behind all this, it is inseparable from the support of computing power.

The new Azure virtual machine base configuration interconnects eight H100 Tensor Core GPUs via NVIDIA’s proprietary NVLink 4.0 interconnect. This configuration can be scaled to additional GPUs via the Quantum-2 interconnect. The server features Intel's 4th generation Xeon (Sapphire Rapids) scalable processors, with data transfer to and from the GPU via PCIe Gen5.

The above is the detailed content of The artificial intelligence boom has led to a shortage of computing power, Microsoft launches a new server rental plan. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undress AI Tool

Undress AI Tool

Undress images for free

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Hot Topics

PHP Tutorial
1488
72
Bytedance Cutting launches SVIP super membership: 499 yuan for continuous annual subscription, providing a variety of AI functions Bytedance Cutting launches SVIP super membership: 499 yuan for continuous annual subscription, providing a variety of AI functions Jun 28, 2024 am 03:51 AM

This site reported on June 27 that Jianying is a video editing software developed by FaceMeng Technology, a subsidiary of ByteDance. It relies on the Douyin platform and basically produces short video content for users of the platform. It is compatible with iOS, Android, and Windows. , MacOS and other operating systems. Jianying officially announced the upgrade of its membership system and launched a new SVIP, which includes a variety of AI black technologies, such as intelligent translation, intelligent highlighting, intelligent packaging, digital human synthesis, etc. In terms of price, the monthly fee for clipping SVIP is 79 yuan, the annual fee is 599 yuan (note on this site: equivalent to 49.9 yuan per month), the continuous monthly subscription is 59 yuan per month, and the continuous annual subscription is 499 yuan per year (equivalent to 41.6 yuan per month) . In addition, the cut official also stated that in order to improve the user experience, those who have subscribed to the original VIP

ChatGPT now allows free users to generate images by using DALL-E 3 with a daily limit ChatGPT now allows free users to generate images by using DALL-E 3 with a daily limit Aug 09, 2024 pm 09:37 PM

DALL-E 3 was officially introduced in September of 2023 as a vastly improved model than its predecessor. It is considered one of the best AI image generators to date, capable of creating images with intricate detail. However, at launch, it was exclus

To provide a new scientific and complex question answering benchmark and evaluation system for large models, UNSW, Argonne, University of Chicago and other institutions jointly launched the SciQAG framework To provide a new scientific and complex question answering benchmark and evaluation system for large models, UNSW, Argonne, University of Chicago and other institutions jointly launched the SciQAG framework Jul 25, 2024 am 06:42 AM

Editor |ScienceAI Question Answering (QA) data set plays a vital role in promoting natural language processing (NLP) research. High-quality QA data sets can not only be used to fine-tune models, but also effectively evaluate the capabilities of large language models (LLM), especially the ability to understand and reason about scientific knowledge. Although there are currently many scientific QA data sets covering medicine, chemistry, biology and other fields, these data sets still have some shortcomings. First, the data form is relatively simple, most of which are multiple-choice questions. They are easy to evaluate, but limit the model's answer selection range and cannot fully test the model's ability to answer scientific questions. In contrast, open-ended Q&A

SK Hynix will display new AI-related products on August 6: 12-layer HBM3E, 321-high NAND, etc. SK Hynix will display new AI-related products on August 6: 12-layer HBM3E, 321-high NAND, etc. Aug 01, 2024 pm 09:40 PM

According to news from this site on August 1, SK Hynix released a blog post today (August 1), announcing that it will attend the Global Semiconductor Memory Summit FMS2024 to be held in Santa Clara, California, USA from August 6 to 8, showcasing many new technologies. generation product. Introduction to the Future Memory and Storage Summit (FutureMemoryandStorage), formerly the Flash Memory Summit (FlashMemorySummit) mainly for NAND suppliers, in the context of increasing attention to artificial intelligence technology, this year was renamed the Future Memory and Storage Summit (FutureMemoryandStorage) to invite DRAM and storage vendors and many more players. New product SK hynix launched last year

SOTA performance, Xiamen multi-modal protein-ligand affinity prediction AI method, combines molecular surface information for the first time SOTA performance, Xiamen multi-modal protein-ligand affinity prediction AI method, combines molecular surface information for the first time Jul 17, 2024 pm 06:37 PM

Editor | KX In the field of drug research and development, accurately and effectively predicting the binding affinity of proteins and ligands is crucial for drug screening and optimization. However, current studies do not take into account the important role of molecular surface information in protein-ligand interactions. Based on this, researchers from Xiamen University proposed a novel multi-modal feature extraction (MFE) framework, which for the first time combines information on protein surface, 3D structure and sequence, and uses a cross-attention mechanism to compare different modalities. feature alignment. Experimental results demonstrate that this method achieves state-of-the-art performance in predicting protein-ligand binding affinities. Furthermore, ablation studies demonstrate the effectiveness and necessity of protein surface information and multimodal feature alignment within this framework. Related research begins with "S

Iyo One: Part headphone, part audio computer Iyo One: Part headphone, part audio computer Aug 08, 2024 am 01:03 AM

At any time, concentration is a virtue. Author | Editor Tang Yitao | Jing Yu The resurgence of artificial intelligence has given rise to a new wave of hardware innovation. The most popular AIPin has encountered unprecedented negative reviews. Marques Brownlee (MKBHD) called it the worst product he's ever reviewed; The Verge editor David Pierce said he wouldn't recommend anyone buy this device. Its competitor, the RabbitR1, isn't much better. The biggest doubt about this AI device is that it is obviously just an app, but Rabbit has built a $200 piece of hardware. Many people see AI hardware innovation as an opportunity to subvert the smartphone era and devote themselves to it.

ChatGPT is now available for macOS with the release of a dedicated app ChatGPT is now available for macOS with the release of a dedicated app Jun 27, 2024 am 10:05 AM

Open AI’s ChatGPT Mac application is now available to everyone, having been limited to only those with a ChatGPT Plus subscription for the last few months. The app installs just like any other native Mac app, as long as you have an up to date Apple S

Laying out markets such as AI, GlobalFoundries acquires Tagore Technology's gallium nitride technology and related teams Laying out markets such as AI, GlobalFoundries acquires Tagore Technology's gallium nitride technology and related teams Jul 15, 2024 pm 12:21 PM

According to news from this website on July 5, GlobalFoundries issued a press release on July 1 this year, announcing the acquisition of Tagore Technology’s power gallium nitride (GaN) technology and intellectual property portfolio, hoping to expand its market share in automobiles and the Internet of Things. and artificial intelligence data center application areas to explore higher efficiency and better performance. As technologies such as generative AI continue to develop in the digital world, gallium nitride (GaN) has become a key solution for sustainable and efficient power management, especially in data centers. This website quoted the official announcement that during this acquisition, Tagore Technology’s engineering team will join GLOBALFOUNDRIES to further develop gallium nitride technology. G

See all articles