Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Skip to content
  • Feedback

    • Active Evaluation Software for Selection of Ground Truth Labels

    Metadata Updated: July 29, 2022

    This software repository contains a python package Aegis (Active Evaluator Germane Interactive Selector) package that allows us to evaluate machine learning systems's performance (according to a metric such as accuracy) by adaptively sampling trials to label from an unlabeled test set to minimize the number of labels needed. This includes sample (public) data as well as a simulation script that tests different label-selecting strategies on already labelled test sets. This software is configured so that users can add their own data and system outputs to test evaluation.

    Access & Use Information

    Public: This dataset is intended for public access and use. License: See this page for license information.

    Downloads & Resources

    Dates

    Metadata Created Date March 11, 2021
    Metadata Updated Date July 29, 2022

    Metadata Source

    Harvested from NIST

    Other Data Resources

    Additional Metadata

    Resource Type Dataset
    Metadata Created Date March 11, 2021
    Metadata Updated Date July 29, 2022
    Publisher National Institute of Standards and Technology
    Maintainer
    Identifier ark:/88434/mds2-2227
    Data First Published 2020-07-09
    Language en
    Data Last Modified 2020-04-28 00:00:00
    Category Information Technology:Data and informatics
    Public Access Level public
    Bureau Code 006:55
    Metadata Context https://project-open-data.cio.gov/v1.1/schema/data.json
    Schema Version https://project-open-data.cio.gov/v1.1/schema
    Catalog Describedby https://project-open-data.cio.gov/v1.1/schema/catalog.json
    Harvest Object Id 68d97b08-4ef5-448a-94cb-82bbc4893864
    Harvest Source Id 74e175d9-66b3-4323-ac98-e2a90eeb93c0
    Harvest Source Title NIST
    Homepage URL https://github.com/usnistgov/active-evaluation
    License https://www.nist.gov/open/license
    Program Code 006:045
    Source Datajson Identifier True
    Source Hash 12e1285c4b4fb916d3e1c426cbfd61768bc581e0
    Source Schema Version 1.1

    Didn't find what you're looking for? Suggest a dataset here.