Imaging · dataset · 2025
Solving a prisoner's dilemma in distributed anomaly detection
Listed in NASA Data Portal
Anomaly detection has recently become an important problem in many industrial and financial applications.
Description
In several instances, the data to be analyzed for possible anomalies is located at multiple sites and cannot be merged due to practical constraints such as bandwidth limitations and proprietary concerns. At the same time, the size of data sets affects prediction quality in almost all data mining applications.
In such circumstances, distributed data mining algorithms may be used to extract information from multiple data sites in order to make better predictions. In the absence of theoretical guarantees, however, the degree to which data decentralization affects the performance of these algorithms is not known, which reduces the data providing participants' incentive to cooperate.This creates a metaphorical 'prisoners' dilemma' in the context of data mining.
Read the rest (2 more)
In this work, we propose a novel general framework for distributed anomaly detection with theoretical performance guarantees. Our algorithmic approach combines existing anomaly detection procedures with a novel method for computing global statistics using local sufficient statistics. We show that the performance of such a distributed approach is indistinguishable from that of a centralized instantiation of the same anomaly detection algorithm, a condition that we call zero information loss.
We further report experimental results on synthetic as well as real-world data to demonstrate the viability of our approach. The remaining content of this presentation is presented in Fig. 1.
Links
Get the data
- CIDU09_distributed_AD.jpg c3.nasa.gov/dashlink/static/media/other/CIDU09_distributed_AD.jpg ↗
download · from data nasa gov
Where it is published
- NASA Data Portal dataset page data.nasa.gov/dataset/solving-a-prisoners-dilemma-in-distributed-anomaly-det… ↗
landing page · from data nasa gov
Catalogue records · 1
- CKAN API data.nasa.gov/api/3/action/package_show?id=2d92e40c-0903-4a00-80c0-bb869d28f… ↗
metadata API · from data nasa gov
Topics
- Inferred from text
- Distributed computing and systems software 72%
Provenance · 1 source records, 7 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| NASA Data Portal | 2d92e40c-0903-4a00-80c0-bb869d28fbcf | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:group:4606 | enrichment · data nasa gov | taxonomy-embedding@1.1.0 | title+keywords+description (72%) |
| created_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| description | source · data nasa gov | connector:data_nasa_gov@1.0.0 | /notes |
| license_text | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| publication_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| title | source · data nasa gov | connector:data_nasa_gov@1.0.0 | /title |
| updated_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 |