Constarium
← Search

Table · dataset · 2026

Java dataset and results

Listed in figshare and Loughborough Research Repository — shown once because both records carry DOI 10.6084/m9.figshare.33972877.v1

Description

<p dir="ltr">This dataset contains the Java benchmark projects and experimental results used to evaluate a skill-based framework for LLM-assisted Java unit-test generation and iterative test repair.</p><p dir="ltr">The benchmark collection comprises Maven-based open-source Java projects, including Apache Commons CLI, Commons CSV, Commons Lang, Google Gson, and additional benchmark projects. For each benchmark, the release includes project manifests and target-method metadata used to define the unit-test generation tasks.</p><p dir="ltr">The experimental-results package contains one directory per experiment run.

Each run includes: (1) summary-level effectiveness metrics; (2) per-class and per-target execution records; (3) baseline results without skill injection; (4) results obtained with skill selection and iterative skill evolution; (5) coverage and, where enabled, mutation-testing measurements; (6) execution status and logs; and (7) skill-evolution records. The reported metrics include compilation success, test pass rate, line coverage, branch coverage, mutation score, and token usage.</p><p dir="ltr">The framework compares a no-skill baseline with a skill-enhanced setting.

Read the rest (1 more)

In the enhanced setting, the system selects test-generation skills based on observed failure signals and may evolve skills through iterative generation, execution, feedback, and repair cycles.</p><p dir="ltr"><br></p><p dir="ltr">The archive is intended to support reproduction, validation, and secondary analysis of experiments on skill-guided LLM-based Java unit-test generation. Generated build artifacts (for example, Maven target directories), credentials, and local configuration overrides are excluded.</p>

Links

Where it is published

Catalogue records · 1

Topics

Provenance · 2 source records, 30 field assertions
SourceKeyLast seenRaw
figshareoai:figshare.com:article/339728775 d agoJSON v1
Loughborough Research Repositoryoai:figshare.com:article/339728775 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · figshare comconnector:figshare_com@1.0.0
concepts[field].anzsrc:field:461208mapping · repository lboro ac ukvocabulary-mapper@1.0.0keywords['Software testing, verification and validation']
concepts[field].anzsrc:field:461208mapping · figshare comvocabulary-mapper@1.0.0keywords['Software testing, verification and validation']
concepts[field].local:field:astronomymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:computer-science-aimapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:engineeringmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:life-sciencesmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:life-sciencesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:materials-sciencemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:mathematics-statisticsmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:medicine-healthmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:medicine-healthmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:psychology-behavioralmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:social-sciencemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
descriptionsource · figshare comconnector:figshare_com@1.0.0/metadata/dc/description
licensesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/rights
publication_datesource · figshare comconnector:figshare_com@1.0.0
titlesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/title