Text · dataset · 2025
Distributed Anomaly Detection using 1-class SVM for Vertically Partitioned Data
Listed in NASA Data Portal
There has been a tremendous increase in the volume of sensor data collected over the last decade for different monitoring tasks.
Description
For example, petabytes of earth science data are collected from modern satellites, in-situ sensors and different climate models. Similarly, huge amount of flight operational data is downloaded for different commercial airlines.
These different types of datasets need to be analyzed for finding outliers. Information extraction from such rich data sources using advanced data mining methodologies is a challenging task not only due to the massive volume of data, but also because these datasets are physically stored at different geographical locations with only a subset of features available at any location. Moving these petabytes of data to a single location may waste a lot of bandwidth.
Read the rest (2 more)
To solve this problem, in this paper, we present a novel algorithm which can identify outliers in the entire data without moving all the data to a single location. The method we propose only centralizes a very small sample from the different data subsets at different locations. We analytically prove and experimentally verify that the algorithm offers high accuracy compared to complete centralization with only a fraction of the communication cost.
We show that our algorithm is highly relevant to both earth sciences and aeronautics by describing applications in these domains. The performance of the algorithm is demonstrated on two large publicly available datasets: (1) the NASA MODIS satellite images and (2) a simulated aviation dataset generated by the ‘Commercial Modular Aero-Propulsion System Simulation’ (CMAPSS).
Links
Get the data
- DAnom.pdf c3.nasa.gov/dashlink/static/media/publication/DAnom_2.pdf ↗
download · from data nasa gov
Where it is published
- NASA Data Portal dataset page data.nasa.gov/dataset/distributed-anomaly-detection-using-1-class-svm-for-ve… ↗
landing page · from data nasa gov
Catalogue records · 1
- CKAN API data.nasa.gov/api/3/action/package_show?id=849f28cf-fcd3-49cf-a82e-2ec291370… ↗
metadata API · from data nasa gov
Topics
- Inferred from text
- Data management and data science 75% · Image 65% · Simulation 75%
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| NASA Data Portal | 849f28cf-fcd3-49cf-a82e-2ec291370f01 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:group:4605 | enrichment · data nasa gov | taxonomy-embedding@1.1.0 | title+keywords+description (75%) |
| concepts[method].local:method:simulation | enrichment · data nasa gov | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[modality].local:modality:image | enrichment · data nasa gov | keyword-concept-rules@1.0.0 | title+description (65%) |
| created_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| description | source · data nasa gov | connector:data_nasa_gov@1.0.0 | /notes |
| license_text | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| publication_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| title | source · data nasa gov | connector:data_nasa_gov@1.0.0 | /title |
| updated_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 |