Mobile Medic: Network-Aware XR Telementoring

Case study

Mobile Medic: Network-Aware XR Telementoring

armobileengineeringBy Jackson Barnes

Led solution architecture and partner REST API integration for a network-aware XR prototype demonstrated to government stakeholders as part of the team's existing JBSA contract.

Solution Architecture & Mobile AR Development ยท Booz Allen Hamilton

Mobile Medic was a government demonstration prototype exploring how augmented reality, volumetric video, and network-aware 5G applications could support remote medical mentoring. I led the solution architecture for integrating a partner's network APIs into the application and worked on mobile AR development in Unity and iOS.

  • Ownership: Application-side solution architecture, partner REST API integration, and mobile AR development.
  • Technical scope: A Unity/iOS responder experience connected to a network-enablement platform through quality-of-service requests.
  • Delivery: A government technical demonstration supporting the team's existing JBSA contract.

Watch the Mobile Medic demonstration.

Prototype Integration Overview

The application used partner REST APIs to request quality-of-service changes for a live session. The logical architecture has two paths: the mentor/responder experience, and the application's network-control requests.

Prototype integration overview: a mentor spatial view connects with a Unity/iOS responder application, while a separate REST API path sends network quality requests to the partner platform

Simplified prototype integration separating the mentoring experience from the network-control path.

Open diagram at full size

Part of the prototypePurpose
Mentor spatial viewExplore how volumetric video could communicate the scene's spatial context.
Unity/iOS responder applicationPresent AR guidance to the on-site participant and connect the application to network capabilities.
Partner REST API integrationLet the application request quality-of-service changes through the network-enablement platform.

The Challenge

The concept addressed a difficult remote-support scenario: a specialist needs to understand a scene and communicate guidance to someone working on site. A conventional video call offers a limited view of the environment, while a richer spatial experience introduces bandwidth and latency requirements.

Mobile Medic explored both parts of that problem. The XR experience connected a remote mentor and an on-site responder; the network integration let the application request service quality from the underlying 5G infrastructure.

Integration principle: The spatial experience and the network controls serve different purposes. One carries the mentoring interaction; the other lets the application request the connectivity that interaction needs.

What I Owned

I translated the partner platform's network-aware capabilities into application behavior, designing and implementing REST API request flows between the mobile application and the network-enablement platform.

I also worked on the Unity and iOS application, connecting the AR experience to those capabilities. Within Booz Allen's 5G/XR team, I collaborated across application development, network integration, and medical-domain input to turn the concept into something stakeholders could see and evaluate.

This work required connecting the demonstration's use case to the technical integration: what the mobile experience needed, what the partner APIs exposed, and how those parts fit within the prototype.

Two Connected Perspectives

The remote mentor. The concept used a live volumetric view to give the remote participant spatial context around the scene. This explored a different way to communicate the environment than a flat video feed.

Mobile Medic remote mentor interface

The remote participant's perspective in the Mobile Medic concept.

The on-site responder. The AR experience presented remote guidance in the responder's view. Its role was to bring the mentoring interaction into the local participant's experience.

Mobile Medic on-site responder experience

The responder experience connected to the remote-mentoring workflow.

What the Work Delivered

Mobile Medic gave government stakeholders a concrete demonstration of Booz Allen's approach to combining XR applications with partner network capabilities. My contribution brought together solution architecture, hands-on mobile development, REST API integration, and support for a technical demonstration under the team's existing JBSA contract.

Read Booz Allen's 5G technology overview.

Early Concept

Initial Mobile Medic prototype concept