Development of Augmented and Virtual Multi-User Applications for Medical-Technical Exchange in Immersive Rooms (AVATAR)

The exchange of surgical experience and competence nowadays mainly takes place at conferences, through the presentation of surgical videos and through the organisation of visits to each other. Complex manual skills and surgical techniques have to be newly developed, trained and passed on to younger surgeons or colleagues. With the methods currently used, this exchange is very costly and time-consuming.
In this project, VR interaction and visualization techniques will be developed to improve the exchange of experience and competence between medical professionals. In a virtual reality, several users are to train collaboratively – simultaneously and in real time. The positions of locally distributed persons will be determined using hybrid tracking systems based on ultra-wideband technologies and inertial sensors. On this basis, VR training scenarios are designed, implemented in a multi-user communication system and clinically evaluated over distance.
The innovation of this project is the combination of collaborative interaction and visualization techniques with hybrid tracking technologies in an advanced multi-user communication system. The project results should form a basis for the development of future VR-based communication and simulation systems in medicine.

Contact

Publications

2021

A VR/AR Environment for Multi-User Liver Anatomy Education

Danny Schott, Patrick Saalfeld, Gerd Schmidt, Fabian Joeres, Christian Boedecker, Florentine Hüttl, Hauke Lang, Tobias Huber, Bernhard Preim, Christian Hansen

A VR/AR Environment for Multi-User Liver Anatomy Education Inproceedings

Proc. of IEEE Conference on Virtual Reality (IEEE VR), pp. 296-305, Lisbon, Portugal, 2021.

BibTeX | Links:

Collaborative VR for Liver Surgery Planning using Wearable Data Gloves: An Interactive Demonstration

Vuthea Chheang, Vikram Apilla, Patrick Saalfeld, Christian Boedecker, Tobias Huber, Florentine Hüttl, Hauke Lang, Bernhard Preim, Christian Hansen

Collaborative VR for Liver Surgery Planning using Wearable Data Gloves: An Interactive Demonstration Inproceedings

Proc. of IEEE Conference on Virtual Reality (IEEE VR), pp. 768, Lisbon, Portugal, 2021.

BibTeX | Links:

Using Virtual 3D-models in Surgical Planning: Workflow of an Immersive Virtual Reality Application in Liver Surgery

Christian Boedecker, Florentine Huettl, Patrick Saalfeld, Marcus Paschold, Werner Kneist, J Baumgart, Bernhard Preim, Christian Hansen, Hauke Lang, Tobias Huber

Using Virtual 3D-models in Surgical Planning: Workflow of an Immersive Virtual Reality Application in Liver Surgery Journal Article

Langenbeck`s Archives of Surgery, pp. 911-915, 2021.

BibTeX

Virtual Reality and 3D Printing Improve Preoperative Visualization of 3D Liver Reconstructions - Results from a Preclinical Comparison of Presentation Modalities and User`s Preference

Florentine Huettl, Patrick Saalfeld, Christian Hansen, Bernhard Preim, A Poplawski, Werner Kneist, Hauke Lang, Tobias Huber

Virtual Reality and 3D Printing Improve Preoperative Visualization of 3D Liver Reconstructions - Results from a Preclinical Comparison of Presentation Modalities and User`s Preference Journal Article

Annals of Translational Medicine, pp. 1-11, 2021.

BibTeX

2020

Toward interprofessional team training for surgeons and anesthesiologists using virtual reality

Vuthea Chheang, Virve Fischer, Holger Buggenhagen, Tobias Huber, Florentine Hüttl, Werner Kneist, Bernhard Preim, Patrick Saalfeld, Christian Hansen

Toward interprofessional team training for surgeons and anesthesiologists using virtual reality Journal Article

International Journal of Computer Assisted Radiology and Surgery, 2020.

BibTeX | Links:

Training of Patient Handover in Virtual Reality

Sebastian Streuber, Patrick Saalfeld, Katja Podulski, Florentine Hüttl, Tobias Huber, Holger Buggenhagen, Christian Boedecker, Bernhard Preim, Christian Hansen

Training of Patient Handover in Virtual Reality Inproceedings

19. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie e.V. , 2020.

BibTeX | Links:

2019

Collaborative Virtual Reality for Laparoscopic Liver Surgery Training

Vuthea Chheang, Patrick Saalfeld, Tobias Huber, Florentine Hüttl, Werner Kneist, Bernhard Preim, Christian Hansen

Collaborative Virtual Reality for Laparoscopic Liver Surgery Training Journal Article

Proceedings of IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), 2019.

BibTeX | Links:

VR Multi-user Conference Room for Surgery Planning

Oleksii Bashkanov, Patrick Saalfeld, Hariharasudhan Gunasekaran, Mathews Jabaraj, Bernhard Preim, Tobias Huber, Florentine Hüttl, Werner Kneist, Christian Hansen

VR Multi-user Conference Room for Surgery Planning Inproceedings

18. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie e.V. , pp. 264–268, 2019.

BibTeX | Links:

2018

Florian Heinrich, Sebastian Rohde, Tobias Huber, Markus Paschold, Werner Kneist, Hauke Lang, Bernhard Preim, Christian Hansen

VR-basierte Interaktion mit 3D-Organmodellen zur Planung und Simulation laparoskopischer Eingriffe Inproceedings

Proceedings of the Annual Meeting of the German Society of Computer- and Robot-Assisted Surgery, pp. 57–62, 2018.

BibTeX | Links: