Table · dataset · 2026
Reproducibility supplement for "Evaluating ColBERT for Cyber Threat Intelligence: Supervision and Coverage in ATT&CK Mapping"
Listed in figshare
<p dir="ltr">Reproducibility supplement accompanying "Evaluating ColBERT for Cyber Threat Intelligence: Supervision and Coverage in ATT&CK Mapping" by Eshan Ahmad, Department of Computer Science, University of Nevada, Las Vegas.
Description
This deposit contains the source-separated ATT&CK technique-mapping benchmark, a designed 50-label exclusion evaluation, experiment code, saved model scores, statistical checks, trained model states, and the numerical supplement.
The study evaluates ColBERT late interaction alongside lexical, learned-sparse, dense, and supervised classification baselines. It evaluates technique retrieval as a proxy for the retrieval stage of a security RAG system; generated answers are not evaluated. Start with README.md.
Read the rest (4 more)
The experiment archive contains code, data, results and verification instructions. The trained-model archive is optional for replaying saved-score statistics. The LaTeX archive contains the manuscript and supplement sources.
The analysis includes 74 primary/held-label metric sets and one 65-contrast Holm family. A separate exploratory BGE diagnostic compares training-order shuffling and title-negative filtering on 542 queries for 50 excluded labels. The supplement documents the checks and their scope; saved-score verification is distinct from independently repeating all model training.
Licensing scope: CC BY 4.0 applies to original text, documentation and results. MIT applies to original experiment and analysis code. Third-party material retains its existing terms; these are component-specific licenses, not alternative licenses for every file.
See LICENSES.md. This deposit supports a research manuscript; it does not assert IEEE publication or conference acceptance.</p>
Links
Where it is published
- DOI doi.org/10.6084/m9.figshare.33949330.v1 ↗
DOI / persistent id · from figshare com
Catalogue records · 1
- OAI-PMH record api.figshare.com/v2/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Af… ↗
metadata API · from figshare com
Topics
- From keywords
- Astronomy & Astrophysics · Chemistry · Computer Science & AI · Earth & Environmental Science · Economics & Finance · Engineering · Humanities · Life Sciences · Medicine & Health · Ocean & Atmospheric Science · Social Science · System and network security
- Inferred from text
- Text 75%
Provenance · 1 source records, 18 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| figshare | oai:figshare.com:article/33949330 | 4 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].anzsrc:field:460407 | mapping · figshare com | vocabulary-mapper@1.0.0 | keywords['System and network security'] |
| concepts[field].local:field:astronomy | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:chemistry | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:economics-finance | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:engineering | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:humanities | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:social-science | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · figshare com | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/description |
| license | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/rights |
| publication_date | source · figshare com | connector:figshare_com@1.0.0 | |
| title | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/title |