Text · dataset · 2025
SIAM 2007 Text Mining Competition dataset
Listed in NASA Data Portal
**Subject Area:** Text Mining **Description:** This is the dataset used for the SIAM 2007 Text Mining competition.
Description
This competition focused on developing text mining algorithms for document classification. The documents in question were aviation safety reports that documented one or more problems that occurred during certain flights.
The goal was to label the documents with respect to the types of problems that were described. This is a subset of the Aviation Safety Reporting System (ASRS) dataset, which is publicly available. **How Data Was Acquired:** The data for this competition came from human generated reports on incidents that occurred during a flight. **Sample Rates, Parameter Description, and Format:** There is one document per incident. The datasets are in raw text format.
Read the rest (1 more)
All documents for each set will be contained in a single file. Each row in this file corresponds to a single document. The first characters on each line of the file are the document number and a tilde separats the document number from the text itself. **Anomalies/Faults:** This is a document category classification problem.
Links
Get the data
- TrainingData.txt.gz c3.nasa.gov/dashlink/static/media/dataset/TrainingData.txt.gz ↗
download · from data nasa gov
- TrainCategoryMatrix.csv.gz c3.nasa.gov/dashlink/static/media/dataset/TrainCategoryMatrix.csv.gz ↗
download · from data nasa gov
- TestData.txt.gz c3.nasa.gov/dashlink/static/media/dataset/TestData.txt.gz ↗
download · from data nasa gov
- TestTruth.csv.gz c3.nasa.gov/dashlink/static/media/dataset/TestTruth.csv.gz ↗
download · from data nasa gov
- Contest_Description_and_Rules.pdf c3.nasa.gov/dashlink/static/media/dataset/Contest_Description_and_Rules.pdf ↗
download · from data nasa gov
- ScoringSoftware.tar.gz c3.nasa.gov/dashlink/static/media/dataset/ScoringSoftware.tar.gz ↗
download · from data nasa gov
Where it is published
- NASA Data Portal dataset page data.nasa.gov/dataset/siam-2007-text-mining-competition-dataset ↗
landing page · from data nasa gov
Catalogue records · 1
- CKAN API data.nasa.gov/api/3/action/package_show?id=74c0c747-e0e1-44c4-911f-a3d40e0fd… ↗
metadata API · from data nasa gov
Topics
- Inferred from text
- Text 75%
Provenance · 1 source records, 7 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| NASA Data Portal | 74c0c747-e0e1-44c4-911f-a3d40e0fdc2a | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[modality].local:modality:text | enrichment · data nasa gov | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| description | source · data nasa gov | connector:data_nasa_gov@1.0.0 | /notes |
| license_text | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| publication_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 | |
| title | source · data nasa gov | connector:data_nasa_gov@1.0.0 | /title |
| updated_date | source · data nasa gov | connector:data_nasa_gov@1.0.0 |