Who is where referred to how, and why? The influence of visual saliency on referent accessibility in spoken language production

Abstract

AbstractSalient entities are assumed to be more accessible in memory, which makes them more likely to be referred to first and to be referred to with an attenuated expression, such as a pronoun. It is less clear, however, how different types of salience interact in influencing referent accessibility. In this article, we address the question whether non-linguistic factors can affect accessibility in the presence of a linguistic context. We present two story completion experiments in which we investigated the effect of visual salience (foregrounding) in interaction with linguistic salience (subjecthood) of two story characters both on the choice of referent and on the choice of referring expression. In Experiment 1, linguistic salience was moderated by inducing a topic shift in the discourse context. In Experiment 2, contexts in which linguistic salience was unclear were compared to contexts in which one of the characters was highly linguistically salient. The results show that visual salience influences referent choice independently of linguistic salience, but that it does not have an effect on the choice of referring expression. This suggests that visual salience has an influence on the global interpretation of the scene, but does not directly affect the accessibility status of individual entities. This is compatible with a view of language production in which utterance planning is influenced by conceptual and discourse factors rather than by low-level perceptual factors.Keywords: Visual salienceReferenceReferring expressionsAccessibility The authors are grateful to Marjolijn Antheunis, Martijn Balsters, Ben Bergmans, Ed Boschman, Rein Cozijn, Marieke Hoetjes, Constantijn Kaland, Ruud Koolen, Kitty Leuverink, Lisette Mol, Hanneke Schoormans, Mandy Visser, Hans Westerbeek and our other colleagues at TiCC for their help with the experiments and their useful comments.The authors are grateful to Marjolijn Antheunis, Martijn Balsters, Ben Bergmans, Ed Boschman, Rein Cozijn, Marieke Hoetjes, Constantijn Kaland, Ruud Koolen, Kitty Leuverink, Lisette Mol, Hanneke Schoormans, Mandy Visser, Hans Westerbeek and our other colleagues at TiCC for their help with the experiments and their useful comments.