Planning-while-acting: addressing the continuous dynamics of planning and action in a virtually embodied task

Abstract

Abstract Everyday tasks, such as selecting routes when driving or preparing meals, require making sequences of embodied decisions, in which planning and action processes are intertwined. In this study, we address how people make sequential embodied decisions, requiring balancing be-tween immediate affordances and long-term utilities of alternative action plans. We designed a novel virtually embodied task in which participants controlled an avatar tasked with “crossing rivers” by jumping across rocks. The task permitted us to assess how participants balanced between immediate jumping affordances (“safe” versus “risky” jumps) and the utility (length) of the ensuing paths to the goal. Behavioral and computational analyses revealed that partici-pants planned ahead their path to the goal rather than simply focusing on the most immediate jumping affordances. Furthermore, spatial and embodied components of the task influenced participants’ decision strategies, as participants’ current direction of movement and momen-tum influenced their choice between safe and risky jumps. Additionally, participants showed (pre)planning before making the first jump, but they continued deliberating during it, with movement speed decreasing at decision points and when approaching them. Computational modeling indicates that farsighted participants who assigned greater weight to the utility of future jumps showed a better performance, highlighting the usefulness of planning in embodied settings. Finally, analysing participants’ performance across trials indicates that during the experiment, they become faster in moving and deciding but they do not change their overall strategy. Our findings underscore the importance of studying decision-making and planning in ecologically valid, embodied settings, providing new insights into the interplay between action and cognition in real-world planning-while-acting scenarios. Significance statement Everyday activities, such as navigating a crowded street or assembling objects, often involve contin-uous interactions between planning and action. Yet, it is unclear how people balance opportunities for action (affordances) with long-term planning in embodied settings. In a novel virtually embod-ied task, in which people have to “cross rivers” by making a series of jumps across rocks, we found that they plan ahead their path to the goal rather than simply focusing on the immediate jumping affordances - and they continue deliberating during movement. Crucially, spatial and embodied constraints, such as movement direction and momentum, influenced decision-making, challenging traditional models that treat decision and action as distinct stages and highlighting the importance of studying decisions in ecologically valid, embodied settings.