Multimodality, resemiotization: extending the analysis of discourse as multi-semiotic practice

TLDR

The article outlines two overarching aims. The study traces the evolution of multimodal discourse analysis, argues for maintaining hierarchical semiotic structures, and introduces resemiotization as a complementary analytical lens. It employs diverse empirical data to illustrate how multimodal analysis and resemiotization trace semiotic translation and explain the selective mobilization of semiotics.

Abstract

This article has the following two overarching aims. First, it traces the development of multimodal discourse analysis and sets out its main descriptive and analytical parameters; in doing so, the article highlights the specific advantages which the multimodal approach has to offer and exemplifies its application. The article also argues that the hierarchical arrangement of different semiotics (in the way common sense construes this) should not be lost from sight. Second, and related to this last point, the article will advance a complementary perspective to that of multimodality: resemiotization. Resemiotization is meant to provide the analytical means for (1) tracing how semiotics are translated from one into the other as social processes unfold, as well as for (2) asking why these semiotics (rather than others) are mobilized to do certain things at certain times. The article draws on a variety of empirical data to exemplify these two perspectives on visual communication and analysis.