Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Skip to content
  • Feedback

    • A Framework for Systematic Benchmarking of Monitoring and Diagnostic Systems

    Metadata Updated: August 30, 2025

    In this paper, we present an architecture and a formal framework to be used for systematic benchmarking of monitoring and diagnostic systems and for producing comparable performance assessments of different diagnostic technologies. The framework defines a number of standardized specifications, which include a fault catalog, a library of modular test scenarios, and a common protocol for gathering and processing diagnostic data. At the center of the framework are 13 benchmarking metric definitions. The calculation of metrics is illustrated on a probabilistic model-based diagnosis algorithm utilizing Bayesian reasoning techniques. The diagnosed system is a real-world electrical power system, namely the Advanced Diagnostics and Prognostics Testbed (ADAPT) developed and located at the NASA Ames Research Center. The proposed benchmarking approach shows how to generate realistic diagnostic data sets for large-scale, complex engineering systems, and how the generated experimental data can be used to enable “apples to apples” assessments of the effectiveness of different diagnostic and monitoring algorithms.

    Access & Use Information

    Public: This dataset is intended for public access and use. License: No license information was provided. If this work was prepared by an officer or employee of the United States government as part of that person's official duties it is considered a U.S. Government Work.

    Downloads & Resources

    Dates

    Metadata Created Date November 12, 2020
    Metadata Updated Date August 30, 2025
    Data Update Frequency irregular

    Metadata Source

    Harvested from NASA Data.json

    Other Data Resources

    Additional Metadata

    Resource Type Dataset
    Metadata Created Date November 12, 2020
    Metadata Updated Date August 30, 2025
    Publisher Dashlink
    Maintainer
    Identifier DASHLINK_858
    Data First Published 2013-12-12
    Data Last Modified 2025-04-01
    Public Access Level public
    Data Update Frequency irregular
    Bureau Code 026:00
    Metadata Context https://project-open-data.cio.gov/v1.1/schema/catalog.jsonld
    Schema Version https://project-open-data.cio.gov/v1.1/schema
    Catalog Describedby https://project-open-data.cio.gov/v1.1/schema/catalog.json
    Harvest Object Id 441b6ab0-3351-4048-a1dc-b826a9698aad
    Harvest Source Id 58f92550-7a01-4f00-b1b2-8dc953bd598f
    Harvest Source Title NASA Data.json
    Homepage URL https://c3.nasa.gov/dashlink/resources/858/
    Program Code 026:029
    Source Datajson Identifier True
    Source Hash 187039e4cb7ef25677f762630e353f5a26ad13e435ab3ca5f5499ffe86a0caec
    Source Schema Version 1.1

    Didn't find what you're looking for? Suggest a dataset here.