Open Source Parallel Image Analysis and Machine Learning Pipeline, Phase I

Metadata Updated: July 17, 2020

Continuum Analytics proposes a Python-based open-source data analysis machine learning pipeline toolkit for satellite data processing, weather and climate data processing, and machine learning and prediction with optional proprietary cluster management tools for streamlined deployment for cloud providers and on-premises clusters. The innovative software will empower scientists and analysts to readily and seamlessly construct and test workflows that transparently and scalably perform calculations across cluster nodes for data-driven discovery. The simple API for homogenous processing of images, mosaics and tiles further improves ease of use for rapid testing and prototyping of analyses paradigms for multiple extremely large data sets.

Today, NASA researchers must create, debug, and tune custom workflows for each analysis. Creation and modification of custom workflows is fragile, non-portable, and consumes time that could be better spent on advancing scientific discovery.

The Phase I work plan will demonstrate that it is feasible to easily create and compose data manipulations and analytics from a variety of sources with a portable, reproducible, extensible process that can be deployed on a wide variety of systems and software. This is a major improvement over the current state-of-the-art because of reduced workflow creation time, portability of deployment and use, extensibility, and robustness.

Access & Use Information

Public: This dataset is intended for public access and use. License: No license information was provided. If this work was prepared by an officer or employee of the United States government as part of that person's official duties it is considered a U.S. Government Work.

Downloads & Resources

Dates

Metadata Created Date August 1, 2018
Metadata Updated Date July 17, 2020

Metadata Source

Harvested from NASA Data.json

Additional Metadata

Resource Type Dataset
Metadata Created Date August 1, 2018
Metadata Updated Date July 17, 2020
Publisher Space Technology Mission Directorate
Unique Identifier TECHPORT_90531
Maintainer
TECHPORT SUPPORT
Maintainer Email
Public Access Level public
Bureau Code 026:00
Metadata Context https://project-open-data.cio.gov/v1.1/schema/catalog.jsonld
Metadata Catalog ID https://data.nasa.gov/data.json
Schema Version https://project-open-data.cio.gov/v1.1/schema
Catalog Describedby https://project-open-data.cio.gov/v1.1/schema/catalog.json
Harvest Object Id 6408fca9-926c-4d34-a766-6936e2e3f989
Harvest Source Id 39e4ad2a-47ca-4507-8258-852babd0fd99
Harvest Source Title NASA Data.json
Data First Published 2016-12-01
Homepage URL https://techport.nasa.gov/view/90531
Data Last Modified 2020-01-29
Program Code 026:027
Source Datajson Identifier True
Source Hash 1c73f6efbdd80dde7aa5eefe60985c511aa2bd5c
Source Schema Version 1.1

Didn't find what you're looking for? Suggest a dataset here.