Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Skip to content

The Convergence of High Performance Computing, Big Data, and Machine Learning: Summary of the Big Data and High End Computing Interagency Working Groups Joint Workshop

Metadata Updated: October 16, 2023

The high performance computing (HPC) and big data (BD) communities traditionally have pursued independent trajectories in the world of computational science. HPC has been synonymous with modeling and simulation, and BD with ingesting and analyzing data from diverse sources, including from simulations. However, both communities are evolving in response to changing user needs and technological landscapes. Researchers are increasingly using machine learning (ML) not only for data analytics but also for modeling and simulation; science-based simulations are increasingly relying on embedded ML models not only to interpret results from massive data outputs but also to steer computations. Science-based models are being combined with data-driven models to represent complex systems and phenomena. There also is an increasing need for real-time data analytics, which requires large-scale computations to be performed closer to the data and data infrastructures, to adapt to HPC-like modes of operation. These new use cases create a vital need for HPC and BD systems to deal with simulations and data analytics in a more unified fashion. To explore this need, the NITRD Big Data and High-End Computing R&D Interagency Working Groups held a workshop, The Convergence of High-Performance Computing, Big Data, and Machine Learning, on October 29-30, 2018, in Bethesda, Maryland. The purposes of the workshop were to bring together representatives from the public, private, and academic sectors to share their knowledge and insights on integrating HPC, BD, and ML systems and approaches and to identify key research challenges and opportunities. The 58 workshop participants represented a balanced cross-section of stakeholders involved in or impacted by this area of research. Additional workshop information, including a webcast, is available at https://www.nitrd.gov/nitrdgroups/index.php?title=HPC-BD-Convergence.

Access & Use Information

Public: This dataset is intended for public access and use. License: See this page for license information.

Downloads & Resources

Dates

Metadata Created Date November 12, 2020
Metadata Updated Date October 16, 2023

Metadata Source

Harvested from NIRTD JSON

Additional Metadata

Resource Type Dataset
Metadata Created Date November 12, 2020
Metadata Updated Date October 16, 2023
Publisher NCO NITRD
Maintainer
Identifier 000-000-093
Language en-US
Data Last Modified 2019-09-09
Category publications
Public Access Level public
Bureau Code 100:65
Metadata Context https://project-open-data.cio.gov/v1.1/schema/catalog.jsonld
Schema Version https://project-open-data.cio.gov/v1.1/schema
Catalog Describedby https://project-open-data.cio.gov/v1.1/schema/catalog.json
Harvest Object Id 782a1c2f-e6fe-43e1-8f74-71184eac1ff7
Harvest Source Id fa17348a-aa9f-4a73-b6b3-76dd0242ddb3
Harvest Source Title NIRTD JSON
Homepage URL https://www.nitrd.gov/
License https://project-open-data.cio.gov/unknown-license/#v1-legacy/public
Program Code 000:000
Source Datajson Identifier True
Source Hash 892e70ffec14069515c2e7b3eaf289e7af2861038db2d00ffb9ace05d0983380
Source Schema Version 1.1

Didn't find what you're looking for? Suggest a dataset here.