Azure AI infrastructure is greatly upgraded! Further expanding artificial intelligence capabilities

Microsoft Azure AI Infrastructure is a core pillar of Microsoft's expanded offering and services, providing developers with the systems, tools and resources they need to build the next generation of AI-driven applications on the Azure platform.

Microsoft’s early investments in hardware and AI infrastructure are helping customers turn AI efficiency and innovation into business value. By leveraging AI, users can create richer user experiences, drive innovation, and improve business productivity

Microsoft Azure AI infrastructure can support global scalability, and Microsoft will continue to invest and expand it in the future. Now, Microsoft has launched the ND H100 v5 virtual machine series, which is equipped with NVIDIA H100 Tensor Core graphics processing unit (GPU) and low-latency network to propel enterprises into a new era of AI applications.

The degree of AI processing and scale is unprecedented

Released the ND H100 v5 virtual machine series

Microsoft’s new Azure ND H100 v5 virtual machine (VM) series is now available in the US East and US Central and South Azure regions. The series features the latest NVIDIA H100 Tensor Core GPU and NVIDIA Quantum-2 InfiniBand networking. Drawing on extensive experience in supercomputing performance and scale, Microsoft has engineered the ND H100 v5 series of virtual machines to handle the increasing complexity of advanced AI workloads. As part of Microsoft’s deep and ongoing investment in AI, Microsoft is leveraging an AI-optimized 4K GPU cluster and will scale it to hundreds of thousands of new GPUs over the next year.

ND H100 v5 VM virtual machine series has the following features: - High performance: The ND H100 v5 VM virtual machine series has powerful computing power and processing speed, and can quickly handle complex computing tasks. - Flexibility: This series of virtual machines supports flexible configuration options and can be adjusted and customized according to actual needs. - Reliability: The ND H100 v5 VM virtual machine series uses reliable hardware and software components to ensure system stability and reliability. - Security: This series of virtual machines provides a secure isolation environment and can effectively protect users' data and applications. - Ease of use: ND H100 v5 VM virtual machine series provides simple and easy-to-use interfaces and tools, allowing users to easily manage and operate virtual machines

• AI Super Computing GPU: Equipped with eight NVIDIA H100 Tensor Core GPUs. This series can significantly speed up AI models compared to previous generation virtual machines, providing enterprises with unparalleled computing power.
• New generation computer processing unit (CPU): CPU performance is crucial for AI training and inference. Microsoft chose the fourth generation Intel Xeon Scalable processor to ensure the best processing of virtual machines speed.
• Low-latency network: Using NVIDIA Quantum-2 ConnectX-7 InfiniBand, each GPU has 400Gb/s and each VM has 3.2 Tb/s cross-node bandwidth to ensure seamless connectivity between GPUs performance, it can be called the world's top supercomputer.
• Optimized host-to-GPU performance: Delivering 64GB/s of bandwidth per GPU via PCIe Gen5, Azure has significant performance advantages between CPU and GPU.
• RAM AND MEMORY BANDWIDTH AT SCALE: DDR5 memory is at the heart of this series of virtual machines, delivering higher data transfer speeds and efficiency, making them ideal for workloads handling large-scale data sets .

This series of virtual machines has proven their performance advantages, using the new 8-bit FP8 floating point data type for matrix multiplication operations, which is six times faster than the previous generation FP16. ND H100 v5 VM helps large language models (such as the BLOOM 175B end-to-end model) achieve up to two times the inference speed, validating their potential to further optimize AI applications.

Artificial Intelligence, powered by Azure AI infrastructure, has the potential to power industries ranging from manufacturing to retail, and from financial services to healthcare.

The above is the detailed content of Azure AI infrastructure is greatly upgraded! Further expanding artificial intelligence capabilities. For more information, please follow other related articles on the PHP Chinese website!