On Heterogeneous Ensembles for Anomaly Detection - Evaluation Tests

We additionally carry out validation tests with the CIC2017IDS dataset. Experiments test different ensemble configurations, including varying ensemble sizes, homogeneous versus heterogeneous ensembles, and multiple score normalization and aggregation strategies. This repository provides the datasets, algorithm implementations in Python, and experiment configurations used in our study.

It enables replication of our experiments, further evaluation, and comparison of anomaly detection methods and ensemble strategies. It is framed within the broader research domains of anomaly detection, ensemble learning, unsupervised learning, machine learning, and data mining. Docker This repository includes required Docker files to build a containerized environment for testing as well as the already pre-compiled docker-image ready to be used.

Technical details Experiments are conducted in Python v3. 11 . The file and folder structure is as follows: "AD_ensembles_Apr2026.tar" contains the pre-compiled docker-container-image to run experiments in a secure, tested environment "docker.zip" contains docker configuration files, including Python dependencies, to build the docker environment of the pre-compiled image. “HetEns_Apr2026.zip” contains the source files with datasets (ADBench and GLCA collections) and Python scripts. “results_Apr2026.zip” contains results, performance files, log files, tables, figures and all extracted statistics and material of experiments as published in the paper.

Most algorithms used are implementations from the PyOD library/repository ( pyod.readthedocs.io/en/latest/index.html ), presented in: Han, S., Hu, X., Huang, H., Jiang, M., & Zhao, Y. (2022). Adbench: Anomaly detection benchmark. Advances in neural information processing systems , 35 , 32142-32159.

License The CC-BY license applies to all data generated with the GLCA tool. All distributed code is under the GPLv3+ license. ADBench datasets were originally published in the repository: ADBench ( github.com/Minqi824/ADBench/tree/main ), In particular, the Classical collection ( github.com/Minqi824/ADBench/tree/main/adbench/datasets/Classical ) These datasets are © the original authors and are licensed under the BSD 2-Clause "Simplified" License.

No endorsement by the original authors is implied. The CIC-IDS2017 dataset (Kaggle version by Laurens D'hooge, kaggle.com/datasets/dhoogla/cicids2017 ), originally by the Canadian Institute for Cybersecurity (CIC), University of New Brunswick. This dataset is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) License.