Mixed Reality Flight Training Prototype Using HoloLens

Case study

Mixed Reality Flight Training Prototype Using HoloLens

hololensxruiunityBy Jackson Barnes

A HoloLens educational prototype combining a Cessna cockpit, an instructional video, and a 3D aircraft demonstration to explore situated learning about aerodynamics.

Mixed-Reality Learning Prototype ยท HoloLens and Unity

I created this HoloLens prototype to explore how an educational experience could place a learner inside the subject being taught. The scene combined a Cessna cockpit with an instructional video about aircraft aerodynamics and a separate 3D view of the aircraft's maneuvers.

Learning From Two Perspectives

The experience brought three elements together:

  • A cockpit view that situated the learner inside the aircraft.
  • An instructional video explaining aerodynamic concepts.
  • A bird's-eye view of a 3D aircraft maneuvering as the video played.

The idea was to connect an explanation with a spatial demonstration, allowing the learner to see both the cockpit context and the aircraft's movement from outside.

Mixed-reality flight lesson combining a cockpit environment with instructional content and a 3D aircraft

The prototype brings the lesson and aircraft demonstration into the same mixed-reality scene.

Building the Experience

I assembled the cockpit, lesson content, and aircraft animation in Unity for the first-generation HoloLens. This was an experiment in situated instruction: using the surrounding scene as part of the lesson rather than presenting the video alone.

Unity development view showing the cockpit, lesson panel, aircraft model, and animation curves

The Unity scene and animation timeline show how the instructional content and aircraft demonstration were arranged.