Accelerating Communication-Intensive Applications via Novel Data Compression Techniques, Phase I

Metadata Updated: February 28, 2019

Processor speed has traditionally grown at a rate faster than that of communication speed in computer and supercomputer networks, and it is expected that this trend will continue even stronger, as we move into the exascale age in the upcoming decade. This has resulted in what is known as the "communication gap" for communication-bound HPC applications: their communication-to-computation time-ratio is so large, that the processors remain mostly sub-utilized, with lots of "disposable" FLOPS available. In the last few years, scientists have proposed to use these disposable FLOPS (which otherwise would be wasted idling) to compress and decompress the communicated data so to effectively speed up the underlying application. Although the idea bears tremendous potential, efforts in this direction have consistently rendered very poor results, with typical resulting speedups averaging below 1.5x. In this project, we identify the strongest reasons why traditional data compression has fallen short in terms of speedup performance for HPC, and propose novel techniques particularly crafted for groundbreaking performance within the HPC framework. Preliminary results show that these techniques break the 10x speedup markup consistently for a wide class of HPC applications of primary importance to NASA. We propose to develop the theory and methods behind these techniques, which ultimately will result into a library product for transparent acceleration of HPC communication platforms, such as MPI. Accelogic has already secured Phase III private capital in the amount of $1 million for the deployment of such potentially revolutionary product, following a successful Phase II.

Access & Use Information

Public: This dataset is intended for public access and use. License: U.S. Government Work

Downloads & Resources

Dates

Metadata Created Date August 1, 2018
Metadata Updated Date February 28, 2019

Metadata Source

Harvested from NASA Data.json

Additional Metadata

Resource Type Dataset
Metadata Created Date August 1, 2018
Metadata Updated Date February 28, 2019
Publisher Space Technology Mission Directorate
Unique Identifier TECHPORT_16736
Maintainer
TECHPORT SUPPORT
Maintainer Email
Public Access Level public
Bureau Code 026:00
Metadata Context https://project-open-data.cio.gov/v1.1/schema/catalog.jsonld
Metadata Catalog ID https://data.nasa.gov/data.json
Schema Version https://project-open-data.cio.gov/v1.1/schema
Catalog Describedby https://project-open-data.cio.gov/v1.1/schema/catalog.json
Harvest Object Id 81a9dc81-7a66-44e5-ad8f-c3fd963bf03a
Harvest Source Id 39e4ad2a-47ca-4507-8258-852babd0fd99
Harvest Source Title NASA Data.json
Data First Published 2013-11-01
Homepage URL https://techport.nasa.gov/view/16736
License http://www.usa.gov/publicdomain/label/1.0/
Data Last Modified 2018-07-19
Program Code 026:027
Source Datajson Identifier True
Source Hash 0808daf1ac1f86d5de6414e83a8b3eaeb0256edf
Source Schema Version 1.1

Didn't find what you're looking for? Suggest a dataset here.