Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Skip to content

Trojan Detection Software Challenge - image-classification-jun2020-test

Metadata Updated: March 14, 2025

Round 1 Test DatasetThe data being generated and disseminated is the test data used to evaluate trojan detection software solutions. This data, generated at NIST, consists of human level AIs trained to perform a variety of tasks (image classification, natural language processing, etc.). A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 1000 trained, human level, image classification AI models using the following architectures (Inception-v3, DenseNet-121, and ResNet50). The models were trained on synthetically created image data of non-real traffic signs superimposed on road background scenes. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the images when the trigger is present.Errata: This dataset had a software bug in the trigger embedding code that caused 2 models trained for this dataset to have a ground truth value of 'poisoned' but which did not contain any triggers embedded. These models should not be used.Models Without a Trigger Embedded: id-00000077, id-00000083

Access & Use Information

Public: This dataset is intended for public access and use. License: See this page for license information.

Downloads & Resources

Dates

Metadata Created Date March 11, 2021
Metadata Updated Date March 14, 2025

Metadata Source

Harvested from NIST

Additional Metadata

Resource Type Dataset
Metadata Created Date March 11, 2021
Metadata Updated Date March 14, 2025
Publisher National Institute of Standards and Technology
Maintainer
Identifier ark:/88434/mds2-2283
Data First Published 2020-08-31
Language en
Data Last Modified 2020-01-10 00:00:00
Category Information Technology:Cybersecurity, Information Technology:Software research, Information Technology:Computational science
Public Access Level public
Bureau Code 006:55
Metadata Context https://project-open-data.cio.gov/v1.1/schema/data.json
Schema Version https://project-open-data.cio.gov/v1.1/schema
Catalog Describedby https://project-open-data.cio.gov/v1.1/schema/catalog.json
Harvest Object Id 3b38bc76-4349-4f9b-b085-b8249987ec19
Harvest Source Id 74e175d9-66b3-4323-ac98-e2a90eeb93c0
Harvest Source Title NIST
Homepage URL https://data.nist.gov/od/id/mds2-2283
License https://www.nist.gov/open/license
Program Code 006:045
Source Datajson Identifier True
Source Hash 897ab3e8312965e7c48ea5233010c50bd2e63710e9331980b9a346913d08a21a
Source Schema Version 1.1

Didn't find what you're looking for? Suggest a dataset here.