Constarium
← Search

Table · dataset · 2026

Reproducibility supplement for "Evaluating ColBERT for Cyber Threat Intelligence: Supervision and Coverage in ATT&CK Mapping"

Listed in figshare

<p dir="ltr">Reproducibility supplement accompanying "Evaluating ColBERT for Cyber Threat Intelligence: Supervision and Coverage in ATT&CK Mapping" by Eshan Ahmad, Department of Computer Science, University of Nevada, Las Vegas.

Description

This deposit contains the source-separated ATT&CK technique-mapping benchmark, a designed 50-label exclusion evaluation, experiment code, saved model scores, statistical checks, trained model states, and the numerical supplement.

The study evaluates ColBERT late interaction alongside lexical, learned-sparse, dense, and supervised classification baselines. It evaluates technique retrieval as a proxy for the retrieval stage of a security RAG system; generated answers are not evaluated. Start with README.md.

Read the rest (4 more)

The experiment archive contains code, data, results and verification instructions. The trained-model archive is optional for replaying saved-score statistics. The LaTeX archive contains the manuscript and supplement sources.

The analysis includes 74 primary/held-label metric sets and one 65-contrast Holm family. A separate exploratory BGE diagnostic compares training-order shuffling and title-negative filtering on 542 queries for 50 excluded labels. The supplement documents the checks and their scope; saved-score verification is distinct from independently repeating all model training.

Licensing scope: CC BY 4.0 applies to original text, documentation and results. MIT applies to original experiment and analysis code. Third-party material retains its existing terms; these are component-specific licenses, not alternative licenses for every file.

See LICENSES.md. This deposit supports a research manuscript; it does not assert IEEE publication or conference acceptance.</p>

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Text 75%
Provenance · 1 source records, 18 field assertions
SourceKeyLast seenRaw
figshareoai:figshare.com:article/339493304 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · figshare comconnector:figshare_com@1.0.0
concepts[field].anzsrc:field:460407mapping · figshare comvocabulary-mapper@1.0.0keywords['System and network security']
concepts[field].local:field:astronomymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:humanitiesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:life-sciencesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:medicine-healthmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:social-sciencemapping · figshare comconnector:figshare_com@1.0.0
concepts[modality].local:modality:textenrichment · figshare comkeyword-concept-rules@1.0.0title+description (75%)
descriptionsource · figshare comconnector:figshare_com@1.0.0/metadata/dc/description
licensesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/rights
publication_datesource · figshare comconnector:figshare_com@1.0.0
titlesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/title