Workflow Guidance using XR and Gesture-Driven User Interaction, Phase I

Metadata Updated: February 28, 2019

Access to up-to-date information, with contextual relevance, is critical to advancing the mission objectives for human exploration in space. Crew efficiency and safety depends on the associated workflows.

The proposed project aims to develop a new user experience (UX) for information visualization, with a custom user interface (UI), navigated via micromovement sensors. This innovation allows crew members to access visual data, even while their hands are occupied during a maintenance/support task.

This proprietary control functionality (Pison device) will be combined with commercially-available X-R (Augmented, Hybrid, and Virtual Reality) technology. The Pison device utilizes neuromuscular and Inertial Measurement Unit (IMU) inputs, which are translated into a UI control signal. The UI will be displayed on smart glasses, which allows for navigation of procedures, while visual cues and unobtrusive non-visual notifications are also presented to the user.

This system will be tested in a simulated environment, on the ground, to ensure acceptability for end-users. The proposed proof-of-concept trial will incorporate the display/navigation of step-by-step instructions, response to notifications, and assembly of a physical object. The user will maintain visual access to their surroundings, as well as the procedural instructions. In addition, the system can query the user[HTML_REMOVED]s attention through notifications (auditory/haptic), which the user will acknowledge using the Pison device. Subjective and objective measures of task performance and efficiency will be collected in order to refine the hardware design. This will allow for future integration of the technology into standard mission workflow and on-board systems (Phase II).

Access & Use Information

Public: This dataset is intended for public access and use. License: U.S. Government Work

Downloads & Resources


Metadata Created Date February 28, 2019
Metadata Updated Date February 28, 2019

Metadata Source

Harvested from NASA Data.json

Additional Metadata

Resource Type Dataset
Metadata Created Date February 28, 2019
Metadata Updated Date February 28, 2019
Publisher Space Technology Mission Directorate
Unique Identifier TECHPORT_94799
Maintainer Email
Public Access Level public
Bureau Code 026:00
Metadata Context
Metadata Catalog ID
Schema Version
Catalog Describedby
Harvest Object Id f5e37b79-5d19-4f9a-a2a7-82b78e3730cb
Harvest Source Id 39e4ad2a-47ca-4507-8258-852babd0fd99
Harvest Source Title NASA Data.json
Data First Published 2019-01-01
Homepage URL
Data Last Modified 2018-09-07
Program Code 026:027
Source Datajson Identifier True
Source Hash 3f2e208b9355f5598f8f7e660fcb8a4285878258
Source Schema Version 1.1

Didn't find what you're looking for? Suggest a dataset here.