Constarium
← Search

Table · dataset · 2026

replication package

Listed in figshare and Loughborough Research Repository — shown once because both records carry DOI 10.6084/m9.figshare.33959791.v1

Description

<pre># Replication package<br><br>## Intelligent Agile Adoption Framework — archival demonstration (Section 5)<br><br>Khaled Ismail · ORCID 0000-0002-0499-5805<br><br>### What this tests<br><br>Proposition 2 of the manuscript is separated into two claims and both are tested here.<br><br>* **P2a** — the dominant component of squared forecast error in human Agile estimation is<br>dispersion, not bias. **Supported.**<br>* **P2b** — predictive inference reduces that dispersion component. **Not supported** on this<br>corpus, in a result consistent with independent replications (Tawosi et al., 2023, 2024).<br><br>Pooled human forecast error: SD 2.358 log-units, mean +0.071; the central 80% of issues are<br>realized at 0.05x to 13.5x their planned duration.<br><br>A third analysis (`p2\_conformal.py`) compares interval calibration methods on identical<br>predictions.

Quantile regression attains **64.3%** coverage on a nominal 80% interval;<br>locally adaptive split conformal attains **76.6%**, within 5 points of nominal in 21 of 24<br>projects (Wilcoxon p = 5.2e-6, rank-biserial 0.91), at a 28% cost in interval width. The<br>severe under-coverage is therefore largely an estimator artifact rather than an irreducible<br>property of the data; the residual 3.4-point shortfall (p = 0.039) indicates mild<br>non-exchangeability, i.e. process drift.<br><br>### Data<br><br>TAWOS — a versatile dataset of agile open source software projects (Tawosi, Al-Subaihin,<br>Moussa \& Sarro, MSR 2022), DOI 10.1145/3524842.3528029.

Read the rest (4 more)

Dataset DOI 10.5522/04/21308124,<br>Apache License 2.0. 458,232 issues, 39 projects, 12 public Jira repositories.<br><br>The dataset ships as a MySQL dump. `extract.py` stream-parses it directly and requires no<br>database server.<br><br>### Pipeline<br><br>```<br>python3 extract.py # TAWOS.sql -> issues.csv (458,232 rows)<br>python3 p2\_analysis.py primary # total-effort outcome, revised estimates excluded<br>python3 p2\_analysis.py sens\_resolution # resolution-time sensitivity<br>python3 p2\_conformal.py # conformal vs quantile interval calibration<br>python3 delegation\_rule.py # regenerates Table 3, Table 4 and Table S6<br>python3 figs.py # regenerates Figures 1, 2, 3 and S1<br>```<br><br>### Analysed sample<br><br>|Specification|Projects|Predictions|<br>|-|-|-|<br>|primary (Total\_Effort\_Minutes)|25|31,356|<br>|sensitivity (Resolution\_Time\_Minutes)|32|43,536|<br><br>Inclusion: story point > 0; outcome > 0; story point not revised after estimation;<br>at least 150 prior issues before the first prediction; at least 60 evaluable predictions<br>per project.<br><br>### Method<br><br>Error is taken in log space, e = ln(actual) − ln(predicted), giving the exact decomposition<br>MSLE = mean(e)² + var(e) into a bias and a dispersion term.

Three forecasters are evaluated<br>strictly out of sample under a time-ordered walk-forward within each project:<br><br>* **H** human — story point × historical minutes-per-point rate (velocity planning)<br>* **R** reference class — historical median duration of prior same-type issues<br>* **M** model — gradient-boosted quantile regression at the 0.10 / 0.50 / 0.90 quantiles<br><br>Inference across projects uses Wilcoxon signed-rank tests, 10,000-sample bootstrap<br>confidence intervals, and matched-pairs rank-biserial effect sizes.

The unit of analysis is<br>the project (n = 25), not the issue.<br><br>### Known limitations<br><br>* The outcome is a **duration proxy** derived from issue state transitions, not logged<br>effort. Only 900 issues in the corpus carry logged work, too few to analyse.<br>* The corpus contains **none of the Layer 1 telemetry** the framework specifies — no CI<br>outcomes, work-in-progress levels, dependency depth, review latency or team composition<br>history.

The P2b test is therefore a joint test of P1 and P2b, and a null is what P1<br>predicts under thin telemetry.<br>* The model arm is one model class with one feature set.<br><br>### Environment<br><br>Python 3.13 · numpy 2.4 · pandas 3.0 · scipy 1.17 · scikit-learn 1.8 · matplotlib.<br>Random seed 20260921 for all bootstrap resampling.<br><br>### Figure palette<br><br>The two-colour categorical palette (#2E6FA8, #C2681A) was validated for colour-vision<br>deficiency separation, lightness band, chroma floor and surface contrast before use.<br><br><br><br></pre><p></p>

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Tabular 65%
Provenance · 2 source records, 35 field assertions
SourceKeyLast seenRaw
figshareoai:figshare.com:article/339597915 d agoJSON v1
Loughborough Research Repositoryoai:figshare.com:article/339597915 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · figshare comconnector:figshare_com@1.0.0
concepts[field].anzsrc:field:401003mapping · figshare comvocabulary-mapper@1.0.0keywords['Engineering practice']
concepts[field].anzsrc:field:401003mapping · repository lboro ac ukvocabulary-mapper@1.0.0keywords['Engineering practice']
concepts[field].anzsrc:field:401006mapping · figshare comvocabulary-mapper@1.0.0keywords['Systems engineering']
concepts[field].anzsrc:field:401006mapping · repository lboro ac ukvocabulary-mapper@1.0.0keywords['Systems engineering']
concepts[field].anzsrc:field:461206mapping · figshare comvocabulary-mapper@1.0.0keywords['Software architecture']
concepts[field].anzsrc:field:461206mapping · repository lboro ac ukvocabulary-mapper@1.0.0keywords['Software architecture']
concepts[field].local:field:astronomymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:chemistrymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:engineeringmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:humanitiesmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:life-sciencesmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:life-sciencesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:materials-sciencemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:mathematics-statisticsmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:medicine-healthmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:medicine-healthmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:psychology-behavioralmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · figshare comconnector:figshare_com@1.0.0
concepts[modality].local:modality:tabularenrichment · figshare comkeyword-concept-rules@1.0.0title+description (65%)
descriptionsource · figshare comconnector:figshare_com@1.0.0/metadata/dc/description
licensesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/rights
publication_datesource · figshare comconnector:figshare_com@1.0.0
titlesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/title