{"@type": "dcat:Dataset", "accessLevel": "public", "accrualPeriodicity": "irregular", "bureauCode": ["026:00"], "contactPoint": {"@type": "vcard:Contact", "fn": "SCOTT POLL", "hasEmail": "mailto:scott.d.poll@nasa.gov"}, "description": "In this paper, we present an architecture and a formal framework to be used for systematic benchmarking of\r\nmonitoring and diagnostic systems and for producing comparable performance assessments of different diagnostic\r\ntechnologies. The framework defines a number of standardized specifications, which include a fault catalog, a library of modular test scenarios, and a common protocol for gathering and processing diagnostic data. At the center of the framework are 13\r\nbenchmarking metric definitions. The calculation of metrics is\r\nillustrated on a probabilistic model-based diagnosis algorithm\r\nutilizing Bayesian reasoning techniques. The diagnosed system is\r\na real-world electrical power system, namely the Advanced\r\nDiagnostics and Prognostics Testbed (ADAPT) developed and\r\nlocated at the NASA Ames Research Center. The proposed\r\nbenchmarking approach shows how to generate realistic\r\ndiagnostic data sets for large-scale, complex engineering systems,\r\nand how the generated experimental data can be used to enable\r\n\u201capples to apples\u201d assessments of the effectiveness of different\r\ndiagnostic and monitoring algorithms.", "distribution": [{"@type": "dcat:Distribution", "description": "2008PHM_Kurtoglu_FrameworkForBenchmarkingDiagnosis.pdf", "downloadURL": "https://c3.nasa.gov/dashlink/static/media/publication/2008PHM_Kurtoglu_FrameworkForBenchmarkingDiagnosis.pdf", "format": "PDF", "mediaType": "application/pdf", "title": "2008PHM_Kurtoglu_FrameworkForBenchmarkingDiagnosis.pdf"}], "identifier": "DASHLINK_858", "issued": "2013-12-12", "keyword": ["ames", "dashlink", "nasa"], "landingPage": "https://c3.nasa.gov/dashlink/resources/858/", "modified": "2025-04-01", "programCode": ["026:029"], "publisher": {"@type": "org:Organization", "name": "Dashlink"}, "title": "A Framework for Systematic Benchmarking of Monitoring and Diagnostic Systems"}