Super AI performance demonstrated, AndesGPT empowers Find X7

Starting from the end of 2022, artificial intelligence (AI) has rapidly spread around the world and become one of the focuses of global attention. As smart products, mobile phones also need to become smarter. Therefore, mobile phone manufacturers are also actively working tirelessly to improve the AI ​​capabilities of mobile phones. On January 8, OPPO grandly launched the Find X7 series. This high-end flagship series has not only made huge breakthroughs in performance, imaging, screen, etc., but its significant enhancement in AI capabilities has also become a highlight in the mobile phone industry.

We have previously learned that the Find X7 series will launch the industry's first 7 billion parameter large model deployed on the device side. Through the "device-cloud collaboration" architecture, this series can realize local and cloud collaborative operation, thereby bringing new intelligent capabilities to the Find X7 series.

OPPO’s Andes Grand Model (AndesGPT) is a user-centered large-scale agent. It has three important capabilities: dialogue enhancement, personalization, and device-cloud collaboration. It provides powerful capabilities for the application of AI assistants in smart terminals. support. The goal of this model is to provide users with more personalized and intelligent services, and to achieve a super entrance to intelligent terminals through dialogue and interaction with users.

Thanks to the flexible computing deployment of Andes Cloud, the Find X7 series can quickly iterate large models in the cloud. Among them, the immersed GPU IB network training cluster improves training performance by more than 8% compared with traditional air cooling, while improving energy efficiency by 45% and increasing computing power deployment density by more than 400%. OPPO’s self-developed SGPU cloud-native virtualization technology reduces GPU usage costs by up to 70%. In addition, through the original PagedAttention technology, AndesGPT can reduce the first word delay by 50% and increase the inference throughput by 30%.

It is worth mentioning that through in-depth cooperation with MediaTek, OPPO took the lead in the industry to adopt 4-bit quantization technology (the industry’s optimal large model end-side deployment solution), and jointly promoted the AndesGPT large language model and visual large model on the end side. Gradually implement it to achieve better accuracy and better performance. With the support of 4-bit quantization technology, AndesGPT has faster response and better security on the client side. It can be calculated using two optimization solutions based on the same model, thereby improving the content generation time of the model. In addition, OPPO has also jointly optimized with MediaTek to achieve high-performance acceleration of HTP, APU, and GPU.

The Find X7 series is equipped with a 7 billion parameter large language model based on AndesGPT end-side deployment, which enables it to have faster large model response speed and capabilities than other mobile phones. For example, Find X7 only takes 0.2 seconds to generate the first word of a 200-word summary, which is 20 times faster than other mobile phones. For a 2,000-word abstract, it only takes 2.9 seconds, which is 2.5 times faster than other mobile phones. It can be seen from these data that in terms of the Al smart call summary function, the Find X7 series has reached 3.5 times the level of other mobile phones with 14,000 words.

In addition, the Find X7 series also introduces a new Xiaobu assistant, a self-developed large voice noise reduction model, and an AI weak network preloading function. Xiaobu Assistant has been further upgraded and become more intelligent. It can not only inspire your creative inspiration, but also provide SWOT analysis commonly used in business analysis tools and help you make PPT outlines and other functions. In addition, more experimental functions will be gradually opened in the future to continuously enrich users’ intelligent AI experience.

It has to be said that this time the Find X7 series has excellently integrated AI and provided more efficient and convenient functions to help users easily solve daily life problems.

The above is the detailed content of Super AI performance demonstrated, AndesGPT empowers Find X7. For more information, please follow other related articles on the PHP Chinese website!