Trojan Detection Software Challenge - nlp-question-answering-sep2021-test
Round 8 Test DatasetThis is the training data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform extractive question answering. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 360 QA AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present.
Find Related Datasets
Search by Tags
Click any tag below to search for similar datasets
Complete Metadata
| @type | dcat:Dataset |
|---|---|
| accessLevel | public |
| bureauCode |
[ "006:55" ] |
| contactPoint |
{ "fn": "Michael Paul Majurski", "hasEmail": "mailto:michael.majurski@nist.gov" } |
| description | Round 8 Test DatasetThis is the training data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform extractive question answering. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 360 QA AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present. |
| distribution |
[ { "title": "nlp-question-answering-sep2021-test", "accessURL": "https://drive.google.com/drive/folders/1cngI3oe9hAmYKg2dAxxcwWZG2u_vIX1G?usp=drive_link" } ] |
| identifier | ark:/88434/mds2-2536 |
| issued | 2022-01-26 |
| keyword |
[ "AI", "Adversarial Machine Learning", "Artificial Intelligence", "Machine Learning", "Trojan Detection" ] |
| landingPage | https://data.nist.gov/od/id/mds2-2536 |
| language |
[ "en" ] |
| license | https://www.nist.gov/open/license |
| modified | 2021-08-09 00:00:00 |
| programCode |
[ "006:045" ] |
| publisher |
{ "name": "National Institute of Standards and Technology", "@type": "org:Organization" } |
| theme |
[ "Information Technology:Cybersecurity", "Information Technology:Software research" ] |
| title | Trojan Detection Software Challenge - nlp-question-answering-sep2021-test |
