FeaturedTranslation

Governing Misinformation

Governing Misinformation

Madelyn Rose Sanfilippo, Xiaohua Awa Zhu, and Shengnan Yang

Misinformation—from false claims to deepfakes to conspiracy theories—is pervasive in modern information environment and poses global risks. Over 100 million users view posts with synthetic media per month on X and an estimated 80% of misinformation on X comes from a small population of supersharers with high visibility; in the US alone, 73% of voters have encountered election misinformation in 2024, echoing trends seen earlier this year in India and across elections in multiple African nations. Many adults report that they encounter misinformation frequently or daily, with research indicating that the elderly and those with low trust in traditional media are most susceptible to misinformation.

—Misinformation represents a complex, urgent sociotechnical problem—

Misinformation represents a complex, urgent sociotechnical problem, reflecting an assemblage of: synchronous and asynchronous communications distributed across multiple platforms and systems; regulatory regimes and technical, media, and telecommunications infrastructure; and intentionally deceptive or manipulative actors, as well as unwitting accomplices.

Research has addressed many aspects of misinformation, from a variety of disciplinary perspectives, including information science, computer science, management, law, political science, public policy, journalism, communications, psychology, and sociology. From characterizing and conceptualizing to the development of taxonomies and ontologies, from automated detection and filtering to content moderation strategies, and from analysis of individual experiences with misinformation to mapping the prevalence and dissemination of misinformation, we have a good sense of what misinformation is, the state of human and technical identification, and social experiences with it. But what can we do about it?

In a recent ARIST review, “Sociotechnical Governance of Misinformation,” we collected and systematically examined 277 peer-reviewed publications examining different aspects of misinformation governance, considering the breadth and depth of sociotechnical approaches to governance. We analyzed the complexity and impact of misinformation as a governance challenge, what has been managed and governed relative to misinformation, the institutional structure of different governance parameters, and empirically identified sources of success and failure in different governance models.

We found that by comparison to other aspects of misinformation research, governance research, much like governance approaches in practice, lags behind the issues, both in volume and responsiveness. Further, very few papers offered multimodal governance suggestions, but those that did, incorporating policy or law, social norms, market-oriented approaches, and technical solutions, offer the most robust path forward. The problems around misinformation are such that one law or one platform-level policy will not be enough to intervene meaningfully. Robust governance interventions require alignment between community norms and expectations in context with platform design, policy or regulatory oversight, and changes to the current incentive structures to produce and share misinformation, as well as for platforms to promote this content via algorithms, given the engagement it produces.

In addition to the multidisciplinary nature and diversity of approaches of existing research on misinformation governance, our analysis reveals disciplinary siloing, uneven geographic coverage, and other gaps. We offer a sociotechnical model to better support interdisciplinary and information science research on misinformation governance, aiming to encourage more empirical analysis and theoretical examination. Ultimately, our goal is to inform and support improved misinformation management and governance by citizens, policymakers, information professionals, and platforms themselves.

There’s no time like the present to contribute to solving misinformation challenges. Addressing this urgent need will require the contributions of many experts and a strong resolve from those with decision-making power. Without a committed effort, misinformation will only become a larger problem.

Cite this article in APA as: Sanfilippo, M. R., Zhu, X. A., & Yang, S. Governing misinformation. (2024, November 14). Information Matters, Vol. 4, Issue 11. https://informationmatters.org/2024/11/governing-misinformation/

Authors

  • Madelyn Rose Sanfilippo is an Assistant Professor in the School of Information Sciences at the University of Illinois at Urbana-Champaign. Her research empirically explores governance of sociotechnical systems and practically supports decision-making in, management of, and participation in a diverse public sphere. Using mixed-methods, including computational social science approaches and institutional analysis, she addresses research questions about: participation and legitimacy; social justice issues; privacy; and differences between policies or regulations and sociotechnical practices. Her most recent book Governing Privacy in Knowledge Commons was published by Cambridge University Press in 2021.

    View all posts Assistant Professor
  • Awa Zhu

    Xiaohua Awa Zhu is an Associate Professor at the School of Information Sciences at the University of Tennessee, Knoxville. Her work focuses on several themes at the intersection of information policy, social informatics, and libraries: misinformation governance, rights related to digital intellectual properties and digital ownership, open government data and community empowerment, and the impact of digital transformation on libraries. Her work combines qualitative and quantitative methods, often drawing on social theories and historical perspectives.

    View all posts
  • Shengnan Yang

Madelyn Sanfilippo

Madelyn Rose Sanfilippo is an Assistant Professor in the School of Information Sciences at the University of Illinois at Urbana-Champaign. Her research empirically explores governance of sociotechnical systems and practically supports decision-making in, management of, and participation in a diverse public sphere. Using mixed-methods, including computational social science approaches and institutional analysis, she addresses research questions about: participation and legitimacy; social justice issues; privacy; and differences between policies or regulations and sociotechnical practices. Her most recent book Governing Privacy in Knowledge Commons was published by Cambridge University Press in 2021.