Philosophy & Technology · 2020 · 137 citations · 66 references
Social SciencesCommunicationSociologyCommunication EthicsFreedom Of ExpressionMedia TheoryCensorshipFreedom Of InformationMedia EthicsMedia FreedomPlatform GovernanceSocial MediaHuman CommunicationOnline CensorshipOnline Content ModerationPlatform CensorshipPlatform Content ModerationSocial Media CensorshipSocial Media ModerationSocial Media Platforms
Effective content moderation on social platforms is challenging due to the volume, cultural sensitivity, and nuance of user communications, prompting a shift toward automated suppression methods that raise new concerns. This paper examines the structural effects of algorithmic censorship by social platforms to better understand the risks of such approaches to content moderation. Algorithmic censorship uniquely enables platforms to monitor all communications and intervene more actively, granting unprecedented control over public and private messages, embedding commercial priorities into billions of interactions, and making escape difficult while still leaving room for resistance.
Abstract Effective content moderation by social platforms is both important and difficult; numerous issues arise from the volume of information, the culturally sensitive and contextual nature of that information, and the nuances of human communication. Attempting to scale moderation, social platforms are increasingly adopting automated approaches to suppressing communications that they deem undesirable. However, this brings its own concerns. This paper examines the structural effects of algorithmic censorship by social platforms to assist in developing a fuller understanding of the risks of such approaches to content moderation. This analysis shows that algorithmic censorship is distinctive for two reasons: (1) in potentially bringing all communications carried out on social platforms within reach and (2) in potentially allowing those platforms to take a more active, interventionist approach to moderating those communications. Consequently, algorithmic censorship could allow social platforms to exercise an unprecedented degree of control over both public and private communications. Moreover, commercial priorities would be inserted further into the everyday communications of billions of people. Due to the dominance of the web by a few social platforms, this may be difficult or impractical to escape for many people, although opportunities for resistance do exist.
66
Discipline and Punish: The Birth of the Prison.
David W. Tarbet, Alan Sheridan · Eighteenth-Century Studies · 1978 · 19.3K citations
Weapons of the weak: Everyday forms of peasant resistance
World Development · 1986 · 9.9K citations
Governmentality: power and rule in modern society
Choice Reviews Online · 2010 · 6.2K citations
Powers of freedom: reframing political thought
Choice Reviews Online · 2000 · 5.7K citations