AI large model opens up innovation in human-computer interaction, Honor Developer Conference roundtable forum focuses on discussion

From January 10 to 11, 2023, Honor held the 2023 Developer Conference, during which it officially released its self-developed operating system MagicOS 8.0 (Chinese name: Magic OS 8.0). The operating system introduces the intention recognition human-computer interaction function enabled by platform-level AI, bringing a new paradigm to intelligent terminal interaction. At the same time, Honor Magic 6 series mobile phones are equipped with the self-developed 7 billion parameter large model - "Magic Model" for the first time, and announced the launch of the "Hundred Model Ecological Plan" to use Magic OS to provide access to China's top 100 models, aiming to Create a smart service ecosystem based on intent interaction. This series of releases has created a more intelligent and diverse future for Honor.

On January 11, Honor held a roundtable forum with the theme of "Insight on Trends: A New Generation of Operating Systems Driven by AI Large Models". This forum brought together Academician Lu Jian of Nanjing University, Dong Zhenning, Vice President of AutoNavi, Professor Huang Xuanjing of Fudan University, Associate Professor Yu Chun of the Department of Computer Science of Tsinghua University, Wu Bofan, Dean of the New Species Research Institute, Fang Fei, Product Line President of Honor Terminal Co., Ltd., and Honor Deng Bin, President of R&D Management of Terminal Co., Ltd. and other experts and scholars. They conducted in-depth discussions on AI large models and new generation operating systems, and looked forward to the future of MagicOS. This forum brought new insights and trends about AI large models and new generation operating systems to the industry.

The era of large models is coming, and large models of end-side AI define the future operating system

In 2023, global technological and industrial changes will be rapidly detonated by the large generative language model. Domestic academia and industry are full of expectations for the prospects and value of large models.

In the roundtable forum, Professor Huang Xuanjing pointed out that we have entered the era of large models and discussed in detail the differences between cloud-side large models and end-side large models. The cloud-side large model has powerful functions, but requires a large amount of computing power support, and may face latency and privacy protection issues. The large model on the client side has the characteristics of low inference latency and is suitable for scenarios that require real-time response and protection of private data. By working together with the cloud-side large model, the client-side large model can provide more comprehensive services.

Professor Huang Xuanjing also emphasized the help of the terminal-side large model to the mobile operating system. She believes that large models have powerful intelligent information processing capabilities that can improve the efficiency of mobile phone operating systems, including managing hardware devices, applications and user interactions.

Honor MagicOS 8.0 uses a large device-side AI model with 7 billion parameters. Deng Bin said that Honor faces two major challenges when developing large end-side AI models. First of all, how to effectively use a large amount of personal experience data and trajectory data to turn it into effective and personally customized prompts is something Honor needs to solve urgently, because it involves a lot of user privacy. Secondly, in the face of the software trend of complex tasks and full scenarios, how to let computers replace humans to effectively decompose tasks and break down the requirements for a clear macro definition or instruction-level language so that each specialized model can understand user intentions.

In order to achieve the above goals, Honor and Qualcomm have conducted a lot of in-depth development and debugging. Honor has optimized large models through quantification and operator acceleration through a high-performance acceleration platform, thereby compressing large models that originally required 24G of memory and a desktop-level GPU to run by more than six times. In the end, these optimized models were successfully deployed on the Snapdragon 8 Gen3 processor, bringing users a smooth end-to-side running experience that is personalized, user-friendly, and privacy-protected.

Intention recognition of human-computer interaction, a new direction for the development of next-generation OS

With the support of the large end-side AI model, platform-level AI can serve as a technical base to fully enable the operating system, giving it the possibility of intent-recognized human-computer interaction, which is the next generation of OS. new direction of development.

Fang Fei said that MagicOS 8.0 brings a "two-way rush" experience to users, that is, the system can not only actively recommend services to users, but also provide support when users actively look for services.

MagicOS 8.0 has indeed achieved this. It provides users with "conversation movies" that can automatically select specific materials in personal galleries, quickly edit them into wonderful personal videos, and accurately search gallery images using natural language. "Gallery semantic search" and the "any door" function that allows quick access to services with one click.

Take the iconic function "Any Door" as an example. Users only need to long-press the text, pictures, files, and videos on the interface and drag them to the edges of the left and right screens to automatically trigger any door. The system will automatically trigger the door according to the drag and drop. The content intelligently identifies user intentions and dynamically matches smart recommendation services within the door, greatly reducing operating steps and time.

Currently, "Anydoor" has supported more than 100 mainstream Chinese application services, covering seven high-frequency scenarios such as travel, office, social networking, search, entertainment, shopping, and food. Baidu Maps, Bilibili, AutoNavi, Didi, Douyin, Youku, Alipay, etc. have opened any door to realize one-to-one taxi hailing, navigation, search, shopping, password resolving, printing, sharing, global collection and other services, covering daily life all aspects.

Fang Fei also mentioned other innovative technology applications brought by MagicOS 8.0, such as "Breath Awakening" and "Smart Capsule". These technologies aim to make human-computer interaction more natural and convenient, such as waking up the device through soft whispers and achieving more intuitive interactions through eye movements, ultimately providing users with a smarter and more personalized interactive experience.

Reconstruction of Internet business model by large model technology

Under the future operating system, the relationship between terminal manufacturers and partners will undergo major changes. Dong Zhenning, vice president of AutoNavi Maps, shared that in the past, industry APPs had an independent relationship with mobile phones, but the era of large models will change this form. At the same time, it also focuses on the architecture based on the large model technology bus built by MagicOS 8.0 and the magic large model, which provides the possibility of integrating the industry vertical large model into the mobile operating system.

Deng Bin elaborated on the future changes in the operating system from the perspective of user experience, emphasizing the goal of the Honor 100-mode ecological plan, which is to improve the efficiency and user satisfaction of the operating system in completing complex tasks through intelligent services, and convert most of them into Quantify user scenarios and cooperate with professional models to achieve sublimation of experience. He vividly summarized the value that Honor’s large-scale end-to-end model brings to users and industry partners as “you don’t know you can live better, you don’t know you can do better.”

Academician Lu Jian predicts that the future operating system will be an operating system that supports the three-dimensional integration of humans, machines, and things, and will be reflected in various ways such as intelligent operating systems, ubiquitous operating systems, and scenario-based operating systems. It is no longer a passive service provider, but can actively understand user needs based on the characteristics of the application scenario, and can even predict user needs and provide corresponding services. Such a system will greatly improve the user experience and will also provide developers with more innovation possibilities.

Conclusion:

Honor uses AI as the core to make breakthroughs, and uses reconstructed logic as the system, bringing new human-computer interaction based on intent recognition. At the same time, working with industry partners, it is building a new ecosystem of "Magic OS". But MagicOS 8.0 is just the beginning of Honor’s future operating system. With the continuous upgrade of the system and the continuous growth of the Magic model, I believe Honor will bring us more surprises in the future!

The above is the detailed content of AI large model opens up innovation in human-computer interaction, Honor Developer Conference roundtable forum focuses on discussion. For more information, please follow other related articles on the PHP Chinese website!