Mobile Medic: Network-Aware XR Telementoring
As part of the Booz Allen 5G/XR team, I helped develop telemedicine applications that utilize 5G's Ultra-Reliable Low-Latency Communications and eMBB capabilities.
Lead Mobile AR Prototyper & Network Integration Engineer — Booz Allen Hamilton (2022-2024)
Video: https://www.youtube.com/watch?v=AuwZF2ZFsJU
Project Overview
As Lead Mobile AR & Network Integration Engineer on Booz Allen's 5G/XR team, I helped design and build a next-generation telemedicine prototype, 5G Mobile Medic, aimed at extending critical medical expertise to remote, austere, or operationally constrained environments where specialist access is limited or impossible. The system leverages 5G's ultra-low latency and high-bandwidth capabilities alongside AR, volumetric video, and dynamic network management to create a seamless bridge between remote medical experts and on-site first responders.
The Problem
In emergency or austere settings, whether a battlefield, disaster zone, or rural location, on-site responders often lack access to specialist medical guidance. Traditional telemedicine solutions struggle with bandwidth constraints, latency issues, and a lack of spatial context, limiting the quality of remote support that can be provided in critical moments.
How It Works
The system connects two perspectives in real time, each with a distinct role in the care workflow.
Remote Medical Mentor
The remote medical expert views a live 3D volumetric stream of the emergency scene, seeing the first responder and patient in full spatial context. This gives the expert the situational awareness needed to provide precise, real-time guidance rather than relying on a flat video call.
On-site Medical Responder
The on-site responder receives AR guidance overlaid directly into their field of view, allowing them to follow expert instruction hands-free while continuing to provide critical care to the patient.
Key Features & Technology
- Volumetric Video: Creates a photorealistic, 3D live stream of the emergency scene, giving remote experts full spatial awareness rather than a flat 2D video feed.
- AR Telementoring : On-site responders receive real-time AR overlays from the remote expert, enabling guided, hands-on instruction during critical care.
- Network Awareness via Shabodi AEP : The application integrates with Shabodi's Application Enablement Platform (AEP) to make it natively "network-aware," allowing it to communicate directly with the underlying 5G infrastructure.
- Dynamic QoS (Quality on Demand) : The platform dynamically requests and adjusts Quality of Service in real time, guaranteeing the bandwidth needed for uninterrupted, high-fidelity communications during critical moments.
- Multi-modal Data Integration : Live sensor feeds, HD video, digital medical imagery, and EHR data are unified into a single situational awareness view for the remote clinician.
The Outcome
5G Mobile Medic enables a remote medical expert to virtually "be present" at an emergency scene through a real-time volumetric video stream, giving them full 3D spatial awareness of the patient and environment. Paired with live physiological sensor data, HD video, medical imaging, and electronic health records, the expert can provide precise, informed guidance to the on-site responder as if standing in the room.
Outcome
The prototype was showcased as a flagship example of Booz Allen's 5G innovation capabilities, featured on the official Booz Allen 5G Technology page and demonstrated to defense and healthcare stakeholders as a viable model for next-generation battlefield and remote medicine.
My Role
As the Lead Mobile AR & Network Integration Engineer, my responsibilities spanned both the application and infrastructure layers:
Architected and developed the mobile AR application used by on-site first responders Led integration of the 5G network layer with the AR application via Shabodi's AEP Implemented dynamic QoS request flows to ensure guaranteed bandwidth during live sessions Collaborated with the XR and medical domain teams to translate clinical requirements into technical features Contributed to prototype demonstrations and stakeholder presentations
Initial Concept of the Prototype
