KAIROS Evaluation Software
The KAIROS Evaluation Software Suite was developed by NIST in support of evaluation of DARPA's Program on Knowledge Directed Artificial Intelligence Reasoning Over Schemas (KAIROS). Some of the capabilities of this software include:* calculating a variety of metrics and scores indicative of performance of individual KAIROS systems* processing and format conversion of KAIROS system output, data annotations, and human assessment results* analyzing metrics, scores, and assessment results* generating statistics and charts summarizing these results
Find Related Datasets
Search by Tags
Click any tag below to search for similar datasets
Complete Metadata
| @type | dcat:Dataset |
|---|---|
| accessLevel | public |
| accrualPeriodicity | irregular |
| bureauCode |
[ "006:55" ] |
| contactPoint |
{ "fn": "Oleg Aulov", "hasEmail": "mailto:oleg.aulov@nist.gov" } |
| describedBy | https://github.com/usnistgov/KAIROS |
| description | The KAIROS Evaluation Software Suite was developed by NIST in support of evaluation of DARPA's Program on Knowledge Directed Artificial Intelligence Reasoning Over Schemas (KAIROS). Some of the capabilities of this software include:* calculating a variety of metrics and scores indicative of performance of individual KAIROS systems* processing and format conversion of KAIROS system output, data annotations, and human assessment results* analyzing metrics, scores, and assessment results* generating statistics and charts summarizing these results |
| identifier | ark:/88434/mds2-2526 |
| issued | 2022-10-17 |
| keyword |
[ "Artificial Intelligence (AI) Explainability", "Evaluation of AI systems", "Human Language Technology (HLT)", "Multimodal and Multilingual Information Retrieval (IR)" ] |
| landingPage | https://data.nist.gov/od/id/mds2-2526 |
| language |
[ "en" ] |
| license | https://www.nist.gov/open/license |
| modified | 2021-12-19 00:00:00 |
| programCode |
[ "006:045" ] |
| publisher |
{ "name": "National Institute of Standards and Technology", "@type": "org:Organization" } |
| theme |
[ "Information Technology:Data and informatics" ] |
| title | KAIROS Evaluation Software |
