MonitAR, Phase I

Metadata Updated: July 17, 2020

We propose to develop MonitAR, an Augmented Reality (AR) system that provides procedure completion guidance to astronauts. MonitAR will replace guidance from mission control during periods of long time delay or when communication with Earth is not possible. Astronauts using AR glasses will receive feedback from MonitAR via visual cues as they progress through procedures on the spacecraft. The visual cues will be provided when MonitAR determines the astronaut is executing a task (a specific step in the procedure) that deviates from the current procedure. MonitAR will then guide the astronaut back to completing the task in a way that fits with the procedure. During execution, the current and upcoming tasks are proactively displayed to the astronaut in a readable form.

The key innovation is to apply Case-Based Reasoning (CBR) to enable MonitAR to predict the task the astronaut is beginning to execute rather than recognize it when completed. This look-ahead capability enables guidance to be provided early enough to avoid procedure/task failure. Moreover, CBR takes advantage of the astronaut?s extensive training to capture how procedures/tasks are completed and, thereby, avoid a cumbersome and brittle modeling effort. Astronaut procedures will be represented as tasks in a plan using Action Notation Modeling Language (ANML), a planning language already being used to represent astronaut procedures. By representing the procedures as plans, the different ways a procedure can be correctly executed will be captured directly from the existing procedures.

Access & Use Information

Public: This dataset is intended for public access and use. License: No license information was provided. If this work was prepared by an officer or employee of the United States government as part of that person's official duties it is considered a U.S. Government Work.

Downloads & Resources


Metadata Created Date August 1, 2018
Metadata Updated Date July 17, 2020

Metadata Source

Harvested from NASA Data.json

Additional Metadata

Resource Type Dataset
Metadata Created Date August 1, 2018
Metadata Updated Date July 17, 2020
Publisher Space Technology Mission Directorate
Unique Identifier TECHPORT_89609
Maintainer Email
Public Access Level public
Bureau Code 026:00
Metadata Context
Metadata Catalog ID
Schema Version
Catalog Describedby
Harvest Object Id 7dacd927-a68d-4398-862f-cdcab77e39f0
Harvest Source Id 39e4ad2a-47ca-4507-8258-852babd0fd99
Harvest Source Title NASA Data.json
Data First Published 2016-12-01
Homepage URL
Data Last Modified 2020-01-29
Program Code 026:027
Source Datajson Identifier True
Source Hash 27bdaf5bc92fb1cf096e73f674300d20dbdc8a25
Source Schema Version 1.1

Didn't find what you're looking for? Suggest a dataset here.