Telerobotic Perception during Asteroid and Mars Regolith Operations

Metadata Updated: February 28, 2019

Current space telerobotic systems are constrained to only operating in bright light and dust-free conditions. This project will study the effects of difficult lighting and dust conditions on telerobotic perception systems to better assess and refine regolith operations on other neighboring celestial bodies. In partnership with Embry-Riddle Aeronautical University and Caterpillar, Inc., optical, LiDAR and RADAR sensing equipment will be used in performing the study. This project will create a known dust environment in the Swamp Works Granular Mechanics [HTML_REMOVED] Regolith Operations (GMRO) Laboratory regolith test bin to characterize the behavior of the sensing equipment in various calibrated lighting and dust conditions. It will also identify potential methods for mitigating the impacts of these undesirable conditions on the performance of the sensing equipment.[HTML_REMOVED]Enhancing the capability of telerobotic perception systems will help improve life on earth for those working in dangerous, dusty mining conditions, as well as help advance the same technologies used for safer self-driving automobiles in various lighting and weather conditions.[HTML_REMOVED] It will also prove to be a critical skill needed for advancing robotic and human exploration throughout our solar system, for activities such as mining on an asteroid or pioneering the first colony on Mars. The goal of this project is to study the effect of difficult lighting and dust conditions on Telerobotic Perception Systems to better assess and refine regolith operations for asteroid, Mars and polar lunar missions.[HTML_REMOVED] Low illumination and low angle of incidence lighting pose significant problems to computer vision and human perception. Levitated dust on Asteroids interferes with imaging and degrades depth perception.[HTML_REMOVED] Dust storms on Mars pose a significant problem.Due to these factors, the likely performance of telerobotics is poorly understood for future missions. Current space telerobotic systems are only operated in bright lighting and dust-free conditions. This technology development testing will identify:the impact of degraded lighting and environmental dust on computer vision and operator perceptionpotential methods and procedures for mitigating these impactsrequirements for telerobotic perception systems for asteroid capture, Mars dust storms and lunar regolith ISRU missions.Machine perception during navigation will be studied and improved using a variety of new optical sensing techniques. It is anticipated that sensing techniques will be highly dependent on ambient light and dust concentrations. Velodyne LiDAR systems used by Caterpillar in commercial applications will be tested. Lighting angle of incidence mounts to simulate various geometries will be manufactured. Collimation will be achieved by a combination of low viewing angle LEDs and commercially available optical components. Evaluation will coincide with Regolith Operations development testing opportunities and be available for further use and simulation to advance robotics and telepresence understanding.Studies will involve a variety of optical, and other sensor tests, using preprogrammed asteroid tumbling models, varying both intensity and angle of incidence to determine susceptibility to bloom, glare, and contrast issues. Polarization, single and multi-wavelength band pass will be tested and improvements researched.In telerobotic systems, sensors, cameras and other optic elements suffer from pixel saturation and bloom with associated recovery times.[HTML_REMOVED] Coupled with a decreased perceived contrast and erratic daylight cycles, asteroid missions will have to overcome, or compensate for these effects.[HTML_REMOVED] This study will have a direct impact on both human habitation and the extraction of in-situ resources using autonomous systems. The study will also highlight shortfalls prior to deployment for automated systems and identify physiological hazards. Thus, the study has potential to significantly influence design of telerobotic perception systems and operations for future exploration missions.Autonomous mining vehicles (as well as self-driving cars) are an emerging technology with large potential. Dust and lighting conditions may cause serious accidents if sensing systems are compromised. Research in this area could also impact the understanding of perception and cognition in older drivers and mitigate a leading cause of traffic accidents.The knowledge gained by this project:Understanding of the operational challenges facing a telerobotic asteroid missionDevelopment of full capability to simulate lighting conditions through user interface to 3 axis tumbling simulation codeInsight into the effect on computer vision systems under these conditions as well as human perceptionAbility to test and evaluate new technologies in high fidelity conditions for use in future telerobotic missions

Access & Use Information

Public: This dataset is intended for public access and use. License: U.S. Government Work

Downloads & Resources


Metadata Created Date August 1, 2018
Metadata Updated Date February 28, 2019

Metadata Source

Harvested from NASA Data.json

Additional Metadata

Resource Type Dataset
Metadata Created Date August 1, 2018
Metadata Updated Date February 28, 2019
Publisher Space Technology Mission Directorate
Unique Identifier TECHPORT_32721
Maintainer Email
Public Access Level public
Bureau Code 026:00
Metadata Context
Metadata Catalog ID
Schema Version
Catalog Describedby
Harvest Object Id e12c1c90-fefe-4a93-b253-4c1c2398297d
Harvest Source Id 39e4ad2a-47ca-4507-8258-852babd0fd99
Harvest Source Title NASA Data.json
Data First Published 2016-05-01
Homepage URL
Data Last Modified 2018-07-19
Program Code 026:027
Source Datajson Identifier True
Source Hash 9227c79b5d3ceec1bfaaa642afdfb910c1b709e3
Source Schema Version 1.1

Didn't find what you're looking for? Suggest a dataset here.