Table · dataset · 2026
Processed RFI Segmentation Datasets for Cross-Telescope Generalization Benchmark
Listed in ScienceDB
This dataset contains processed radio frequency interference (RFI) segmentation data used in the manuscript Cross-Telescope Generalization of Deep Learning RFI Segmentation.
Description
It is designed for training, validation, and cross-telescope generalization evaluation of deep-learning-based RFI segmentation models. The dataset covers four data domains: HERA, LOFAR, NSRT-low_el, and NSRT-pulsar_sf.
The initial ScienceDB submission includes 10 HDF5 files, corresponding to the training, validation, and test splits used in the experiments.The HERA and LOFAR files are derived from publicly available Zenodo datasets released under the Creative Commons Attribution 4.0 International (CC-BY-4.0) license. The original data sources, authors, and DOIs are acknowledged in the metadata. The NSRT files are processed data products redistributed with permission from the data providers; original NSRT observation files are not included in this dataset.
Read the rest (6 more)
The NSRT-low_el domain corresponds to low-elevation observation scenarios, while the NSRT-pulsar_sf domain corresponds to pulsar-related observation scenarios.The processing workflow includes reading the original observation or public source data, constructing image or dynamic-spectrum tensors, generating non-overlapping 512 x 512 patches, median subtraction, channel-level standardization, and producing binary RFI masks using AOFlagger-derived reference masks where applicable.
In each HDF5 file, arr0 stores the processed image or dynamic-spectrum tensor, and arr1 stores the corresponding binary RFI mask or label. The files can be read using common scientific Python tools such as h5py, NumPy, and PyTorch.The dataset is not associated with a single geographic study region. Instead, it is organized by telescope or data-source domain, including HERA, LOFAR, and NSRT.
The temporal information depends on the original source data. The NSRT-low_el data mainly originate from low-elevation observations in January 2024, and the NSRT-pulsar_sf data mainly originate from pulsar-related observations in July 2024. The temporal information for the HERA and LOFAR domains follows the corresponding Zenodo source records.
The submitted files are processed machine-learning datasets and do not preserve the full structure of the original observation files.The initial submission contains 10 HDF5 files with a total size of approximately 103 GiB. The HERA domain includes hera_strong_train.h5 and hera_strong_val.h5. The LOFAR domain includes lofar_strong_train.h5 and lofar_strong_val.h5.
The NSRT-low_el domain includes low_el_train_v3b.h5, low_el_val_v3b.h5, and low_el_ood_test.h5. The NSRT-pulsar_sf domain includes pulsar_sf_train.h5, pulsar_sf_val.h5, and pulsar_sf_test.h5. These files correspond to the training, validation, and test splits used in the associated experiments and can be used together with the related code repository for reproducibility.The masks and processed tensors may be affected by the quality of the original observations, the AOFlagger reference masks, the preprocessing and standardization procedures, and patch-boundary effects.
The binary RFI masks are intended for model training and evaluation, but should not be interpreted as error-free manual pixel-level ground truth. The main purpose of this dataset is to provide a unified, reproducible benchmark for cross-telescope RFI segmentation experiments rather than to replace the original observation data.
Links
Where it is published
- DOI doi.org/10.57760/sciencedb.39104 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.57760%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Astronomy & Astrophysics · Earth & Environmental Science · Engineering · Humanities · Life Sciences · Social Science
- Inferred from text
- Image 75%
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.57760/sciencedb.39104 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:astronomy | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[modality].local:modality:image | enrichment · scidb cn | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/rights |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |