NREL Eagle supercomputer jobs
High performance computing dataset with 11M+ jobs from NREL's Eagle supercomputer. These jobs were submitted to run on Eagle between Nov 2018 and Feb 2023. The data are sufficiently anonymized and do not include sensitive user or project data. HPC research community does not have many public, large, and complete job traces like this one, and releasing this dataset should help address this gap.
Resources
4 resources available
-
GitHub repo for data
MD -
0_READ_ME.txt
TXT -
eagle_data.csv.bz2
BZ2 -
eagle_data.parquet
PARQUET
Find Related Datasets
Search by Tags
Click any tag below to search for similar datasets
Complete Metadata
| @type | dcat:Dataset |
|---|---|
| accessLevel | public |
| bureauCode |
[
"019:20"
]
|
| contactPoint |
{
"fn": "Dmitry Duplyakin",
"@type": "vcard:Contact",
"hasEmail": "mailto:dmitry.duplyakin@nlr.gov"
}
|
| dataQuality |
true
|
| description | High performance computing dataset with 11M+ jobs from NREL's Eagle supercomputer. These jobs were submitted to run on Eagle between Nov 2018 and Feb 2023. The data are sufficiently anonymized and do not include sensitive user or project data. HPC research community does not have many public, large, and complete job traces like this one, and releasing this dataset should help address this gap. |
| distribution |
[
{
"@type": "dcat:Distribution",
"title": "GitHub repo for data",
"format": "md",
"accessURL": "https://github.com/openEDI/documentation/blob/eagle-jobs/eagle-jobs.md",
"mediaType": "application/octet-stream",
"description": "OEDI Public Dataset Documentation"
},
{
"@type": "dcat:Distribution",
"title": "0_READ_ME.txt",
"format": "txt",
"mediaType": "text/plain",
"description": "Description of the fields in this dataset.",
"downloadURL": "https://data.openei.org/files/5860/READ_ME.txt"
},
{
"@type": "dcat:Distribution",
"title": "eagle_data.csv.bz2",
"format": "bz2",
"mediaType": "application/octet-stream",
"description": "Eagle job trace in a compressed csv file",
"downloadURL": "https://data.openei.org/files/5860/eagle_data.csv.bz2"
},
{
"@type": "dcat:Distribution",
"title": "eagle_data.parquet",
"format": "parquet",
"mediaType": "application/octet-stream",
"description": "Eagle job trace in a parquet file",
"downloadURL": "https://data.openei.org/files/5860/eagle_data.parquet"
}
]
|
| identifier | https://data.openei.org/submissions/5860 |
| issued | 2023-02-28T07:00:00Z |
| keyword |
[
"HPC",
"computer science",
"computing",
"high performance computing",
"job trace",
"jobs",
"processed data",
"supercomputer"
]
|
| landingPage | https://data.openei.org/submissions/5860 |
| license | https://creativecommons.org/licenses/by/4.0/ |
| modified | 2023-06-15T21:46:56Z |
| programCode |
[
"019:023"
]
|
| publisher |
{
"name": "National Renewable Energy Laboratory",
"@type": "org:Organization"
}
|
| spatial |
"{"type":"Polygon","coordinates":[[[-105.17088767367916,39.74066257144145],[-105.16862154006958,39.74066257144145],[-105.16862154006958,39.742949336089374],[-105.17088767367916,39.742949336089374],[-105.17088767367916,39.74066257144145]]]}"
|
| title | NREL Eagle supercomputer jobs |
