Ethics and Information Technology · 2025 · 17 citations · 61 references
ComputingComputer ScienceComputational LinguisticsDiscourse AnalysisNatural Language ProcessingLanguage ModelingNatural Language GenerationText GenerationBiasesChatbotsCollapseHomogenizationLarge Language ModelsMetaphor
Abstract In this article, we examine a peculiar issue apropos large language models (LLMs) and generative AI more broadly: the frequently overlooked phenomenon of output homogenization. It describes the tendency of chatbots to structure their outputs in a highly recognizable manner, which often amounts to the aggregation of verbal, visual, and narrative clichés, trivialities, truisms, predictable argumentations, and similar. We argue that the most appropriate conceptual lens through which said phenomenon can be framed is that of Frankfurtian bullshit. In this respect, existing attempts at applying the BS framework to LLMs are insufficient, as those are chiefly presented in opposition to the so-called algorithmic hallucinations. Here, we contend that further conceptual rupture from the original metaphor of Frankfurt (1986) is needed, distinguishing between the what-BS, which manifests in falsehoods and factual inconsistencies of LLMs, and the how-BS, which reifies in the dynamics of output homogenization. We also discuss how issues of algorithmic biases and model collapse can be framed as critical instances of the how-BS. The homogenization problem, then, is more significant than it initially appears, potentially exhibiting a powerful structuring effect on individuals, organizations, institutions, and society at large. We discuss this in the concluding section of the article.
61
AI models collapse when trained on recursively generated data
Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao et al. · Nature · 2024 · 583 citations · Full text
Michael Townsen Hicks, James Humphries, Joe Slater · Ethics and Information Technology · 2024 · 342 citations · Full text
Kieran Healy · Sociological Theory · 2017 · 317 citations