Augmented Reality Magic Mirror for Anatomy Education

• Applicants: Professor Dr. Nassir Navab, since 8/2016; Professor Dr. Jens Waschke
• Subject Area: Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
• Term: from 2015 to 2020
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 257417417

Education of anatomy is a challenging but crucial element in educating medical professionals, but also for the general education of pupils or higher education (such as students of sports & physiotherapy). Our research group at TU Munchen has previously developed a prototype of an Augmented Reality (AR) magic mirror which allows intuitive visualization of realistic anatomical information on the user.We aim to research the use of such a system for in-depth training of anatomy and radiology for pupils, students and medical students. The magic mirror allows visualization of medical and radiological information directly on the user and a gesture-based user interface (UI) allows direct interaction with this data. For using such a system in education three problems have to be solved: fundamental research on dynamically changing real-time AR visualization e.g. of muscles and bones; fundamental research on intuitive use of gesture-based UIs; integration of such a system into the teaching curriculum using gaming elements to facilitate learning.

• DFG Programme: Research Grants
• Participating Institution: Universiteit van Amsterdam ; Amsterdam UMC - Universitair Medisch Centra
• Ehemaliger Antragsteller: Professor Pascal Fallavollita, Ph.D., until 8/2016