A social semiotic perspective on emoji: How emoji and language interact to make meaning in digital messages

TLDR

The article offers a social semiotic analysis of how emoji and language interact to create meaning in digital messages. It combines Systemic Functional Linguistics with Multimodal Discourse Analysis to develop a framework, which is then applied using WebAnno to a corpus of text messages and social media posts. The analysis reveals that emoji and language jointly construct ideational meaning across intermodal taxonomies, foreground each other's semantic potential, and that emoji convey attitudinal meaning in ways that differ from linguistic prosody.

Abstract

This article presents a social semiotic analysis of emoji-language semiosis. Combining the theoretical architecture of Systemic Functional Linguistics and methodology of Multimodal Discourse Analysis, we propose an analytical framework that can identify how emoji make meaning both individually and in interaction with language. Using the web-based coding software WebAnno, we apply this framework to a dataset of text messages and social media posts. The results identify typical realisations of particular semiotic features by emoji as well as noteworthy dynamics in how emoji interact with language to realise meaning. We observe (1) how emoji and language jointly construing ideational meaning realise intermodal taxonomies (where hyper/hyponyms are distributed across modes) and particular fields of discourse (domains of experiential meaning), (2) how resources in one mode can serve to foreground particular regions of meaning potential in other modes, and (3) how attitudinal meaning realised by emoji appears to differ from the prosodic patterning of linguistic attitude.