Medical training,
made interactive.
An ICU training environment for Meta Quest, connected to an instructor tablet. Built around the trainee’s actions and the instructor’s view of the session.
Two views of the same training session.
The trainee needs to interact with a believable care environment. The instructor needs to see what is happening and assess the trainee’s actions. My contribution brought those two views together through Unity development, simulated patient behaviour and a synchronized tablet interface.
The environment includes an interactive patient, ventilator, infusion pumps, alarms and live vital-sign simulation. These systems give the training scenario things to observe, respond to and discuss.
What I built.
The headset experience
A Meta Quest ICU environment with interactive patient and equipment systems, developed in Unity and C#.
The instructor view
A synchronized tablet interface for observing trainee actions in real time and assessing performance.
Live simulation feedback
Vital signs and alarms that make the patient’s simulated state visible during the session.
A connected workflow
The headset and tablet support the same training session, linking immersive interaction with instructor observation.
The engineering focus.
The useful part of a simulation is how its interactions connect. A patient state, an equipment control, a changing vital sign and the instructor’s view all belong to one experience. This project brings together the areas I work on in Unity/XR: interaction systems, real-time data and companion interfaces.
See the work.
The medical sequence begins around 14 seconds into my 32-second showreel. It provides a short visual example of the environment described here.
The trainee interacts inside the ICU environment while the instructor follows the session through the tablet interface.
Keep exploring.
Something in
mind?
Unity, XR, simulation, or a software challenge worth getting into. Let’s talk.
Say hello