XR UKM : Extended Reality at University Hospital Münster
Origin language: English
The University Hospital Münster (UKM) uses extended reality (XR) to make complex medical imaging more understandable. The project “XR UKM” originated in the Department of Neurosurgery (initially as “Inside your brain”), where it was first developed for neurosurgical and neuro-oncological patients. Today, the technology is available to all departments at the UKM: interactive three-dimensional models are created from MRI, CT or ultrasound data and can be used across all specialties. Patients can view these models spatially and better understand their condition – for example a brain tumor, a complex fracture or a vascular finding – as well as the planned treatment or procedure.
In addition to VR headsets, UKM currently uses autostereoscopic 3D displays that complement the headsets. They present the same three-dimensional models in true 3D without any headset or glasses, allow patients, relatives and clinicians to look at a model together, and lower the threshold for patients who are hesitant about VR. This makes the technology considerably more user-friendly in everyday clinical practice. The technology also supports clinicians in medical education, interdisciplinary collaboration and the planning of complex operations and interventions. By visualizing anatomical structures, pathologies, blood vessels and surrounding tissue in three dimensions, XR can help make spatial relationships more tangible before treatment decisions are made.
A central aim of the project is to improve patient information and shared understanding. Instead of relying only on two-dimensional scans, clinicians can use VR headsets or 3D displays to explain where a lesion is located, how it relates to surrounding structures, and what a procedure may involve. UKM was awarded first place in the NRW Health Award 2025 for this project, and the Department of Neurosurgery was listed as a digital pioneer by the ATLAS Project at Witten/Herdecke University.
- Turning a teaching tool into a care tool. VR was first used to explain complex anatomy in medical education. The challenge was to transfer this approach into patient care, so that the technology supports understanding, reduces complexity and helps patients discuss their treatment options more clearly.
- Not every patient is ready for VR. Some patients may benefit greatly from seeing their findings in 3D, while others may feel overwhelmed or anxious when wearing a headset. Glasses-free autostereoscopic 3D displays offer a lower-threshold alternative for these patients.
- VR counselling takes time. Explaining the images, guiding patients through the model and answering questions requires additional time from experienced clinicians.
Lessons learned
- Use technology to solve a real problem: The project is successful because it addresses a real challenge in patient communication: many patients struggle to understand two-dimensional scans and what a procedure would mean. This challenge is not limited to neuro-oncology, which is why the approach has been opened up to all UKM departments.
- Use XR where spatial understanding really matters. XR adds value when location, size and relation to critical structures are difficult to explain with conventional images. It helps make complex risks and treatment options more tangible.
- Build on existing strengths. At the department of Neurosurgery, the close connection between teaching, research and clinical care helped the team move VR from education into patient counselling. This experience now forms the basis for making the technology available to all departments at UKM.
- Engaged clinicians make the difference. The project was driven by physicians who saw the potential of VR beyond teaching and actively adapted it to patient communication.
- Digital tools can strengthen shared decision-making. When patients better understand their diagnosis and the planned procedure, they can ask more informed questions and participate more actively in treatment decisions.
Recommendations
- Use XR selectively for patients who are likely to benefit. It should not be used automatically in every case. It is most helpful when the patient is interested, emotionally ready and the 3D explanation can support the consultation. Where a headset is a barrier, the 3D display is often the better choice.
- The focus should remain on the patient’s diagnosis, questions and treatment decision. XR should support the conversation, not dominate it.
- Use feedback to keep improving the application. Clinicians should document where VR helps patients understand their condition, where it takes too much time, and what needs to be adapted together with the technology provider.
