System for touchless interaction with medical images in surgery using Leap Motion


In the operating room surgeons need to have access to preand intraoperative images such as computer tomography (CT), magnetic resonance imagery (MRI), x-ray images and fluoroscopy along with various procedure-specific imaging applications. This visual data supports diagnostics and planning and provide virtual “insight” into the body of the patient during surgery. Although surgeons rely on capture, browsing and manipulation of these images they are constrained by typical interaction mechanisms such as keyboard and mouse. At the heart of this constraint is the need to maintain a strict boundary between the sterile and non sterile environment. In this paper we present a new system based on combining the Leap Motion gesture recognition controller and medical imaging toolkit for touchless visualization and browsing for medical image data.


  • Agata Manolova


International Conference on Communications, Electromagnetics and Medical Applications (CEMA), 2014.