Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Skip to content
  • Feedback

    • Active Evaluation Software for Selection of Ground Truth Labels

    Metadata Updated: September 30, 2025

    This software repository contains a python package Aegis (Active Evaluator Germane Interactive Selector) package that allows us to evaluate machine learning systems's performance (according to a metric such as accuracy) by adaptively sampling trials to label from an unlabeled test set to minimize the number of labels needed. This includes sample (public) data as well as a simulation script that tests different label-selecting strategies on already labelled test sets. This software is configured so that users can add their own data and system outputs to test evaluation.

    Access & Use Information

    Public: This dataset is intended for public access and use. License: See this page for license information.

    Downloads & Resources

    Dates

    Metadata Created Date November 12, 2020
    Metadata Updated Date September 30, 2025

    Metadata Source

    Harvested from Commerce Non Spatial Data.json Harvest Source

    Other Data Resources

    Additional Metadata

    Resource Type Dataset
    Metadata Created Date November 12, 2020
    Metadata Updated Date September 30, 2025
    Publisher National Institute of Standards and Technology
    Maintainer
    Identifier ark:/88434/mds2-2227
    Data First Published 2020-07-09
    Language en
    Data Last Modified 2020-04-28 00:00:00
    Category Information Technology:Data and informatics
    Public Access Level public
    Bureau Code 006:55
    Metadata Context https://project-open-data.cio.gov/v1.1/schema/catalog.jsonld
    Schema Version https://project-open-data.cio.gov/v1.1/schema
    Catalog Describedby https://project-open-data.cio.gov/v1.1/schema/catalog.json
    Harvest Object Id a0b3064c-f22a-41de-9e4e-6f67fcd78a8d
    Harvest Source Id bce99b55-29c1-47be-b214-b8e71e9180b1
    Harvest Source Title Commerce Non Spatial Data.json Harvest Source
    Homepage URL https://github.com/usnistgov/active-evaluation
    License https://www.nist.gov/open/license
    Program Code 006:045
    Source Datajson Identifier True
    Source Hash 5c08e2520c59e3798d34d8507a65ff032e20300d1a688c19f61e0bb9e9913ad0
    Source Schema Version 1.1

    Didn't find what you're looking for? Suggest a dataset here.