Text · dataset · 2025
A Framework for Systematic Benchmarking of Monitoring and Diagnostic Systems
Listed in NASA Data Portal
In this paper, we present an architecture and a formal framework to be used for systematic benchmarking of monitoring and diagnostic systems and for producing comparable performance assessments of different diagnostic technologies.
Description
The framework defines a number of standardized specifications, which include a fault catalog, a library of modular test scenarios, and a common protocol for gathering and processing diagnostic data.
At the center of the framework are 13 benchmarking metric definitions. The calculation of metrics is illustrated on a probabilistic model-based diagnosis algorithm utilizing Bayesian reasoning techniques. The diagnosed system is a real-world electrical power system, namely the Advanced Diagnostics and Prognostics Testbed (ADAPT) developed and located at the NASA Ames Research Center.
Read the rest (1 more)
The proposed benchmarking approach shows how to generate realistic diagnostic data sets for large-scale, complex engineering systems, and how the generated experimental data can be used to enable “apples to apples” assessments of the effectiveness of different diagnostic and monitoring algorithms.
Links
Get the data
- c3.nasa.gov /dashlink/static/media/publication/2008PHM_Kurtoglu_FrameworkFo… ↗
2008PHM_Kurtoglu_FrameworkForBenchmarkingDiagnosis.pdf
download · from data nasa gov
Where it is published
- NASA Data Portal dataset page data.nasa.gov/dataset/a-framework-for-systematic-benchmarking-of-monitoring-… ↗
landing page · from data nasa gov
Catalogue records · 1
- CKAN API data.nasa.gov/api/3/action/package_show?id=c7bfe1ad-9834-46fb-bc52-40727a88f… ↗
metadata API · from data nasa gov
Topics
- Inferred from text
- Performance evaluation 77%
Provenance · 1 source records, 7 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| NASA Data Portal | c7bfe1ad-9834-46fb-bc52-40727a88f0ed | 9 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:field:460611 | enrichment · data nasa gov | taxonomy-embedding@1.1.0 | title+keywords+description (77%) |
| created_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| description | source · data nasa gov | connector:data_nasa_gov@1.0.0 | /notes |
| license_text | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| publication_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| title | source · data nasa gov | connector:data_nasa_gov@1.0.0 | /title |
| updated_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 |