AR IxD Prototyping Tool

This IxD prototyping tool enables designers to create and test interactions for AR devices with eye tracking and brain-computer interfaces. The tool focuses on gaze-based interactions while incorporating phone-based controls as a complementary input method. This allows for rapid prototyping of mixed-reality experiences that combine natural eye movements with familiar mobile device interactions.

Tested Interaction Modalities

• Eye-To-World Interaction Modality (TrueDepth Camera)Tracks user's gaze direction and focal points to enable intuitive interaction with virtual elements in the physical space.
• Neural Interaction Modality (Nextmind Headset)Interprets neural signals for hands-free control, allowing for more natural and immersive interaction patterns.
• Mobile Device Interaction Modality (Mobile Touch Display)Provides familiar touch-based controls that complement gaze and neural inputs, offering precise manipulation of AR elements.