Augmented reality in surgical procedures

TLDR

Minimally invasive therapy, a major trend in modern medicine, offers faster recovery and cost savings but introduces challenges such as reduced dexterity, loss of tactile feedback, and reliance on image guidance rather than direct vision. The ARIS*ER consortium aims to develop decision‑support tools that augment visual and sensorial feedback for minimally invasive therapy, providing a seamless workflow for clinicians through tailored visualization, robotics, and haptics solutions. These tools combine advanced visualization, robotics, and haptics and are demonstrated in radio‑frequency ablation of liver tumors, laparoscopic liver surgery, and minimally invasive cardiac surgery. The approach reduces hospital stay time by enabling faster recovery and improves cost‑effectiveness for hospitals and society.

Abstract

Minimally invasive therapy (MIT) is one of the most important trends in modern medicine. It includes a wide range of therapies in videoscopic surgery and interventional radiology and is performed through small incisions. It reduces hospital stay-time by allowing faster recovery and offers substantially improved cost-effectiveness for the hospital and the society. However, the introduction of MIT has also led to new problems. The manipulation of structures within the body through small incisions reduces dexterity and tactile feedback. It requires a different approach than conventional surgical procedures, since eye-hand co-ordination is not based on direct vision, but more predominantly on image guidance via endoscopes or radiological imaging modalities. ARIS*ER is a multidisciplinary consortium developing a new generation of decision support tools for MIT by augmenting visual and sensorial feedback. We will present tools based on novel concepts in visualization, robotics and haptics providing tailored solutions for a range of clinical applications. Examples from radio-frequency ablation of liver-tumors, laparoscopic liver surgery and minimally invasive cardiac surgery will be presented. Demonstrators were developed with the aim to provide a seamless workflow for the clinical user conducting image-guided therapy.