Table · dataset · 2020
HDBSCAN star, galaxy, QSO classification
Listed in IVOA Registry (Virtual Observatory)
Classification will be an important first step for upcoming surveys that will detect billions of new sources such as LSST and Euclid, as well as DESI, 4MOST and MOONS.
Description
The application of traditional methods of model fitting and colour-colour selections will face significant computational constraints, while machine-learning (ML) methods offer a viable approach to tackle datasets of that volume. While supervised learning methods can perform very well for classification tasks, the creation of representative and accurate training sets is a resource and time consuming task.
We present a viable alternative using an unsupervised ML method to separate stars, galaxies and QSOs using photometric data. The heart of our work uses HDBSCAN to find the star, galaxy and QSO clusters in a multidimensional colour space. We optimized the hyperparameters and input attributes of three separate HDBSCAN runs, each to select a particular object class, and thus treat the output of each separate run as a binary classifier.
Read the rest (2 more)
We subsequently consolidate the output to give our final classifications, optimized on their F1 scores. We explore the use of Random Forest and PCA as part of the pre-processing stage for feature selection and dimensionality reduction. Using our dataset of ~50000 spectroscopically labelled objects we obtain an F1 score of 98.9, 98.9 and 93.13 respectively for star, galaxy and QSO selection using our unsupervised learning method.
We find that careful attribute selection is a vital part of accurate classification with HDBSCAN. We applied our classification to a subset of the SDSS spectroscopic catalogue and demonstrate the potential of our approach in correcting misclassified spectra useful for DESI and 4MOST. Finally, we create a multiwavelength catalogue of 2.7 million sources using the KiDS, VIKING and ALLWISE surveys and publish corresponding classifications and photometric redshifts.
Links
Where it is published
- Reference page cdsarc.cds.unistra.fr/viz-bin/cat/J/A+A/633/A154 ↗
landing page · from IVOA Registry
Documentation and papers
- ADS 2020A&A...633A.154L ui.adsabs.harvard.edu/abs/2020A%26A...633A.154L ↗
publication · from IVOA Registry
Catalogue records · 2
- VOResource record dc.g-vo.org/oai.xml?verb=GetRecord&metadataPrefix=ivo_vor&identifier=ivo%3… ↗
metadata API · from IVOA Registry
- Registry record (GAVO) dc.g-vo.org/I/cds.vizier/j/a%2Ba/633/a154 ↗
catalogue entry · from IVOA Registry
Topics
- Stated by source
- Optical
- From keywords
- Astronomy & Astrophysics
- Inferred from text
- Heart 75%
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| IVOA Registry (Virtual Observatory) | ivo://cds.vizier/j/a+a/633/a154 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · IVOA Registry | connector:ivoa_registry@1.0.0 | |
| concepts[anatomy].local:anatomy:heart | enrichment · IVOA Registry | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[field].local:field:astronomy | mapping · IVOA Registry | connector:ivoa_registry@1.0.0 | |
| concepts[modality].ivoa_waveband:optical | source · IVOA Registry | connector:ivoa_registry@1.0.0 | |
| description | source · IVOA Registry | connector:ivoa_registry@1.0.0 | rr.resource.res_description |
| license_text | source · IVOA Registry | connector:ivoa_registry@1.0.0 | |
| publication_date | source · IVOA Registry | connector:ivoa_registry@1.0.0 | |
| title | source · IVOA Registry | connector:ivoa_registry@1.0.0 | rr.resource.res_title |
| updated_date | source · IVOA Registry | connector:ivoa_registry@1.0.0 |