Trojan Detection Software Challenge - image-classification-aug2020-holdout
Round 2 Holdout DatasetThe data being generated and disseminated is the holdout data used to evaluate trojan detection software solutions. This data, generated at NIST, consists of human level AIs trained to perform a variety of tasks (image classification, natural language processing, etc.). A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 144 trained, human level, image classification AI models using a variety of architectures. The models were trained on synthetically created image data of non-real traffic signs superimposed on road background scenes. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the images when the trigger is present.
Resources
2 resources available
-
DOI Access for Trojan Detection Software Challenge - Round 2 Holdout Dataset
FILE -
image-classification-aug2022-holdout
FILE
Find Related Datasets
Search by Tags
Click any tag below to search for similar datasets
Complete Metadata
| @type | dcat:Dataset |
|---|---|
| accessLevel | public |
| bureauCode |
[
"006:55"
]
|
| contactPoint |
{
"fn": "Michael Paul Majurski",
"hasEmail": "mailto:michael.majurski@nist.gov"
}
|
| description | Round 2 Holdout DatasetThe data being generated and disseminated is the holdout data used to evaluate trojan detection software solutions. This data, generated at NIST, consists of human level AIs trained to perform a variety of tasks (image classification, natural language processing, etc.). A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 144 trained, human level, image classification AI models using a variety of architectures. The models were trained on synthetically created image data of non-real traffic signs superimposed on road background scenes. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the images when the trigger is present. |
| distribution |
[
{
"title": "DOI Access for Trojan Detection Software Challenge - Round 2 Holdout Dataset",
"accessURL": "https://doi.org/10.18434/mds2-2322"
},
{
"title": "image-classification-aug2022-holdout",
"accessURL": "https://drive.google.com/drive/folders/1Dk03W-TdDVAMQoti2rwBsDo6I143B2gm?usp=drive_link"
}
]
|
| identifier | ark:/88434/mds2-2322 |
| issued | 2020-10-30 |
| keyword |
[
"Trojan Detection; Artificial Intelligence; AI; Machine Learning; Adversarial Machine Learning;"
]
|
| landingPage | https://data.nist.gov/od/id/mds2-2322 |
| language |
[
"en"
]
|
| license | https://www.nist.gov/open/license |
| modified | 2020-10-23 00:00:00 |
| programCode |
[
"006:045"
]
|
| publisher |
{
"name": "National Institute of Standards and Technology",
"@type": "org:Organization"
}
|
| theme |
[
"Information Technology:Computational science",
"Information Technology:Cybersecurity",
"Information Technology:Software research"
]
|
| title | Trojan Detection Software Challenge - image-classification-aug2020-holdout |
