Chongqing Artificial Intelligence Innovation Center successfully incubated the first large-scale model solution

Recently, Chongqing Artificial Intelligence Innovation Center successfully incubated Yuncong Technology’s first large model solution, named “Conongong Large Model Training and Pushing Integrated Machine”, and has been successfully deployed. As one of the earliest cloud service providers in China to deploy large models, Huawei is not only committed to deepening its computing power and building a powerful computing infrastructure to support the development of China's artificial intelligence industry, but also focusing on general large models and industry large models to truly Achieve the provision of high-quality artificial intelligence services for thousands of industries and scientific research

Through the joint efforts of the Chongqing Artificial Intelligence Innovation Center technical team, Shengteng R&D experts and Yuncong Technology Artificial Intelligence Research Institute, the accuracy and performance alignment and product integration of the "Calm and Large Model Training and Pushing All-in-One Machine" were successfully completed within one month. and testing, this became the first large-scale model solution incubated by Chongqing Artificial Intelligence Innovation Center

The "Calmly Large Model Training and Push All-in-one Machine" is based on the Ascend AI basic software and hardware platform, including Ascend AI server, heterogeneous computing architecture CANN and full-scenario AI framework Shengsi MindSpore. It is also compatible with PyTorch and has a single machine of 2.5 PFLOPS FP16 computing power. The training performance exceeds 8000 tokens/s, supports multi-machine network deployment and enterprise privatization deployment, and meets the information security requirements of data not leaving the factory.

The Congrong large model production platform independently developed by Yuncong Technology has built-in Congrong large model production platform independently developed by Yuncong Technology, which supports enterprises to create exclusive industry large models to achieve a 5-fold efficiency improvement. Optional model parameter specifications include billions, tens of billions and hundreds of billions. Combined with Yuncong's traditional visual advantages, it provides three types of basic models: language, vision and multi-modal. By using the company's private industry and scenario-based data to perform reinforcement learning and model fine-tuning (such as SFT, RM and PPO), expert knowledge and technology are injected into the basic model to make it intelligent and accurate in the areas of concern to the company. , thereby creating a large industry model and improving the efficiency of enterprise business scenarios and product competitiveness. Under the condition that the parameters and loss curves converge and align, the model training performance based on Ascend and Ascend MindSpore exceeds the industry average by 1.6 times, and the inference question and answer results are better

Shengteng AI cooperates with the industry to build a full-process large model enabling system and jointly build China's large model ecosystem. This system has successfully incubated and adapted more than 30 major mainstream models, and established an industrial consortium in the fields of remote sensing and multi-modality. At present, more than 80 scientific research institutions and enterprises have joined it, jointly incubating more than 100 new industry applications

Shengteng AI will cooperate with Yuncong Technology to build a basic software and hardware platform, promote the role of AI technology in Chongqing's urban characteristic industries, and create application cases with demonstration effects to provide comprehensive improvements for various industries. Help enterprises achieve sustained and high-quality development

Ma Liang releases upstream news

Sorry, the information you provided is insufficient for rewriting. Please provide the original sentence that needs to be rewritten

Editor: Yang Xinhua is responsible for writing

Review: Review Zhao Lei

The above is the detailed content of Chongqing Artificial Intelligence Innovation Center successfully incubated the first large-scale model solution. For more information, please follow other related articles on the PHP Chinese website!