Tsinghua's new research decrypts information cocoon room! New information dynamics theory published in Nature sub-journal

The rapid development of the new generation of information and intelligent technology is pushing mankind to gradually move into an intelligent society. With the support of digital technology and intelligent recommendation algorithms, media and platforms are becoming more and more considerate, and can always meet people's personalized preferences and needs as quickly and accurately as possible.

However, at the same time, intelligent and accurate recommendations have led to the continuous fermentation of the "information cocoon room" phenomenon. People with similar views form groups in cyberspace, and specific value preferences are gathered and amplified in the group. Gradually develop extreme views.

Every extreme view on celebrities or social events can be used as a tool for ideological participation and influence, adding fuel to the flames in cyberspace and the real world, setting off "turbulent public opinion." .

However, even so, we still know very little about information cocoons: How serious are information cocoons in real online systems? There is a lack of large-scale empirical research; what is the formation mechanism of information cocoons? Lack of basic theoretical support; how to solve the problem of information cocoon room? There is a lack of effective means.

Recently, the Urban Science and Computing Research Center of the Department of Electronics of Tsinghua University and the School of Public Policy and Management collaborated across disciplines to conduct the first large-scale data empirical research through large-scale empirical research and information dynamics theoretical modeling. And theory reveals the internal mechanism and phase transition boundaries of the emergence of information cocoon rooms in information media, providing a new way of understanding the complex social system of human-intelligence interaction in the current intelligent society.

The result was published in "Nature·Machine Intelligence" under the title "Human-AI adaptive dynamics drives the emergence of information cocoons" "(Nature Machine Intelligence) published online.

Paper link: https://www.nature.com/articles/s42256-023-00731-4

Code and data link: https://github.com/tsinghua-fib-lab/Adaptive-Information-Dynamic-Model

This achievement focuses on news and video In two typical scenarios, by analyzing 570 million user behavior data and using information entropy to measure the severity of information cocooning, it was found that after one year of interaction, more than 57% of active users experienced varying degrees of information entropy decline, marking a real-world system The seriousness of the information cocoon.

Based on empirical findings, this result proposes a human-intelligence adaptive information dynamics model to model the key feedback loop between humans and recommendation algorithms, and through the system The evolution law of information entropy is used to describe the phase transition process of information cocoon.

This model reveals the phase change process and phase change boundary of the "diversity-partial information cocoon room-depth information cocoon room" complex system from the perspective of non-equilibrium statistical mechanics, and is used for control The problem of information cocoons in human-intelligence interactive complex social systems provides a theoretical basis and inspires subsequent designs to break the information cocoon by balancing the positive and negative feedback of the system, as well as precise algorithm push and user free exploration, thereby achieving responsible recommendations. algorithm.

Overview of the paper

As an emerging disruptive technology, artificial intelligence is profoundly changing human production, lifestyle and way of thinking, and has a profound impact on economic development and social progress. It has a significant and far-reaching impact. Among them, recommendation algorithms, as the most widely used artificial intelligence technology, can effectively alleviate the problem of information overload and greatly affect what people see, hear and think.

However, the recommendation algorithm is also a double-edged sword. The personalized recommendations it provides will make the information people are exposed to become more and more homogeneous, and they will gradually become trapped in information. In the cocoon room. This homogeneous information will not only limit people's horizons and alienate them from the collective and society, but will also encourage social conflicts and divisions.

Therefore, in order to curb the occurrence of information cocoons, understanding the mechanism behind them is the first step.

There have been studies on the problem of information homogeneity [1-5], most of which focus on human behavior or intelligent algorithms. Through empirical research methods, the study pointed out the potential factors of homogeneous crowd gathering on social media or the filtering effect of algorithms. However, due to limitations of data and methodology, only correlation conclusions can be provided.

Recently, some empirical studies [25,26] have conducted causal analysis. However, these studies still do not provide analysis and explanation of the underlying mechanism. Furthermore, most of the current recommendation algorithms are based on black-box artificial intelligence deep learning methods, and the hundreds of millions of parameters behind them make it more difficult for us to gain insight into the root causes of information cocoons.

In response to the problem of unknown sources of information cocooning, the research team focused on two typical scenarios: news and video. Through large-scale empirical research, they found that during one year of interaction, more than 57% of active users experienced Different degrees of information diversity decline, and it is pointed out that similarity-based matching and positive and negative feedback are key elements that affect the information homogenization process.

Further, based on empirical discovery and practice in the field of recommendation algorithms, the research team was inspired by the idea of ​​stochastic thermodynamics and creatively proposed a human-intelligence adaptive information dynamics model.

This model mechanically models the key feedback loop between humans and recommendation algorithms by describing two basic mechanisms based on similarity matching and feedback utilization, and through system information entropy The evolution of the system is used to describe the phase transition process of the system.

Through simulation experiments and theoretical analysis, the phase change process and phase change boundaries of the complex system of "diversity-partial information cocoon room-deep information cocoon room" are revealed, providing a basis for the controller- The information cocoon problem in intelligent interactive complex social systems provides a theoretical foundation and practical methods.

Human-Intelligence Adaptive Information Dynamics Model

Technical Points

The research team focused on two typical content recommendation scenarios: news and video. Through empirical analysis of large-scale real data, the research team characterized the severity of the real-world information cocoon and its influencing factors.

Specifically, the research team used information entropy to characterize the diversity of information received by users and found that more than 57% of active users experienced varying degrees of decline in information diversity. Its vision is gradually limited by recommendation algorithms to a narrow information cocoon.

Through further analysis, the research team found that the strength of the recommendation algorithm based on similarity matching and positive and negative feedback are key factors that affect the generation of information cocoons. This empirical study not only quantifies the severity of information cocoons in real large-scale online information systems for the first time, but also lays the foundation for the subsequent theoretical model.

(a-c) Focus on two typical scenes of news and video to quantify real-world information Severity of cocoon room; (d-f) Similarity matching strength, positive and negative feedback are important factors affecting the formation of information cocoon room.

Based on empirical conclusions and practice in the field of recommendation algorithms, combined with the theory of stochastic thermodynamics, the research team creatively proposed a human-intelligence adaptive information dynamics model.

This model uses information entropy to represent the diversity of information that users are exposed to, and uses system information entropy distribution to represent the state of the system.

Different from deep learning models that rely on hundreds of millions of parameters, the proposed model only relies on two basic mechanisms based on similarity matching and user feedback to model humans mechanically. The key feedback loop between recommendation algorithm and human-intelligence complex dynamic interaction process using stochastic dynamic equations.

Among them, represents the observed interest distribution of user l, represents the characteristic distribution of item k, and represents similarity-based matching strength, positive feedback utilization, negative feedback utilization, and free exploration intensity respectively.

Based on the above formula, we can derive the Focke-Planck equation describing the observed preferences of users on various topics. Further, through the mean field approximation method, we can finally The distribution of information entropy received by users over the population is derived.

The research team pointed out that under different parameter spaces, the human-intelligence interactive complex social system has three states: diversification, partial information cocoon room and deep information cocoon room, and these three system states are respectively divided into three states: Characterized by different information entropy distributions.

Large-scale simulation experiments and empirical analysis further verified the explanatory power and effectiveness of the proposed model.

With (a) similarity-based matching strength or (b) positive feedback utilization As the rate increases, the human-intelligence interactive complex social system has experienced a phase transition process from a diversified state to a partial information cocoon state, and then to a deep information cocoon state. The red dotted line is the theoretical line, and the histogram is the simulation line.

The research team found that as the strength of similarity-based matching or the utilization of positive feedback increases, the complex system presents a state from a diversified state to a partial information cocoon state, and then to The phase transition process of depth information cocoon state.

However, if the utilization rate of negative feedback or the intensity of free exploration is increased, the system will undergo a reverse phase change process, that is, from a deep information cocoon to a partial information cocoon, and finally to a diverse status. The above four phase transition processes have been consistently verified by theoretical analysis and large-scale simulation experiments.

As (a) the utilization of negative feedback increases or (b) the intensity of free exploration increases, human-intelligence interaction complex social systems experience It describes the reverse phase transition process from the deep information cocoon state to the partial information cocoon state, and then to the diversified state. The red dotted line is the theoretical line, and the histogram is the simulation line.

Through joint analysis, the research team demonstrated the phase change diagram of the overall system driven by the joint drive of four elements based on similarity recommendation, utilization of positive and negative feedback, and free exploration, and revealed The inner mechanism of emergence in information cocoon.

Specifically, similarity-based matching serves as an effective force field to promote complex interactive systems from diversification to homogeneity. Positive feedback further amplifies this force field, resulting in reduced information diversity.

Negative feedback and free exploration introduce disturbance into the system by resisting the effect of the effective force field, thus promoting information diversity.

Regarding the phase transition boundary, the theoretical prediction results and the simulation experimental results show a high degree of consistency. At the same time, through a large number of simulation experiments and empirical analysis, such as replacement functions, measured information entropy distribution, etc., The robustness and effectiveness of the proposed model are further verified.

System phase change diagram, (a-b) Three-dimensional system phase change diagram based on video and news scene data, (c-e) Two-dimensional system phase change diagram based on video scene data, (f-h ) Phase change diagram of a two-dimensional system based on news scene data.

With the widespread application of artificial intelligence technology, the complex interactions between humans and intelligent systems constitute a complex human-intelligence interaction system involving multiple entities and multiple feedbacks.

Current artificial intelligence is mostly based on deep learning technology, and its black-box nature further hinders a deep understanding of the dynamic characteristics and emergent behaviors in such complex interactive systems.

The adaptive information dynamics model proposed by the research team provides a mechanism for the in-depth study of various types of complex human-intelligence interaction systems by providing a mechanistic modeling of the emergent behavior of information cocoons. A powerful theoretical tool. Furthermore, the proposed theoretical model has practical guiding significance for responsible recommendation algorithm design.

This study points out two effective methods for information cocooning, namely promoting the effective use of negative feedback and modeling user preferences from a new perspective of learning users’ negative feedback; and promoting Users can explore freely and broaden their information horizons by increasing their freedom and autonomy in consuming their own content.

In summary, this research result not only points out the practical improvement direction for recommendation algorithm design, but also provides theoretical tools for understanding human-intelligence interactive complex social systems to inspire subsequent Related research on Complex System for AI.

Introduction to the authors

Ph.D. student Pu Jinghua and postdoctoral fellow Liu Jiazhen from the Urban Science and Computing Research Center, Department of Electronics, Tsinghua University are the co-first authors of the paper. Li Associate Professor Yong is the corresponding author; Assistant Professor Zhang Fang and Professor Su Jun of Tsinghua School of Public Policy and Management are co-authors.

The research results are supported by the Science and Technology Innovation 2030-"New Generation Artificial Intelligence" major project and the Natural Science Foundation of China.

The above is the detailed content of Tsinghua's new research decrypts information cocoon room! New information dynamics theory published in Nature sub-journal. For more information, please follow other related articles on the PHP Chinese website!