Constarium
← Search

Data · dataset · 2026

Codebook and Annotated Dataset for LLM Career Guidance Analysis Across Ten African Countries

Listed in Teesside University Research Data Repository

This dataset contains the annotated responses, coding schema, and reliability statistics used in a comparative analysis of large language models (LLMs) for computing career guidance across ten African countries.

Description

The underlying research examined how different LLMs articulate technical and professional competencies for entry-level computing roles and the extent to which these recommendations reflect local contextual factors.

The dataset includes 60 LLM-generated responses (six models × ten countries) produced using a standardized prompt. Models analyzed include ChatGPT-4, Claude 3.5 Sonnet, Gemini 1.5 Pro, LLaMA 3, DeepSeek-V2, and Mistral. Countries represented are Egypt, South Africa, Senegal, Tunisia, Kenya, Nigeria, Ghana, Benin, Zambia, and Morocco.

Read the rest (3 more)

All responses were collected in English within a fixed time window and without follow-up prompts. Responses were analyzed using a conceptual content analysis approach informed by the CC2020 Computing Curricula framework. Coding captured both technical competencies (e.g., programming, algorithms, AI/ML, cloud computing) and professional competencies (e.g., adaptability, teamwork, communication, ethics).

In addition, a contextual awareness analysis assessed the presence of country-specific references, including local technology ecosystems, language or cultural considerations, national policies, and institutional mentions. Coding reflects the presence of concepts rather than strict keyword matching. The dataset also includes a rubric-based scoring sheet evaluating response quality across four dimensions (technical coverage, contextual awareness, skills balance, and depth), inter-rater reliability (IRR) data from dual coders, pooled and category-level reliability statistics, and aggregated summaries.

Together, these materials enable replication of the reported analyses, secondary analysis of LLM behavior in career guidance contexts, and methodological reuse of the coding framework. The dataset is intended for research and educational purposes and reflects model behavior at the time of data collection.

Links

Where it is published

Catalogue records · 1

Topics

Provenance · 1 source records, 15 field assertions
SourceKeyLast seenRaw
Teesside University Research Data Repositoryoai:data.mendeley.com/xt42c2jfdg.110 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].anzsrc:field:390303mapping · researchdata tees ac ukvocabulary-mapper@1.0.0keywords['Higher Education']
concepts[field].anzsrc:field:460208mapping · researchdata tees ac ukvocabulary-mapper@1.0.0keywords['Natural Language Processing']
concepts[field].anzsrc:group:4601mapping · researchdata tees ac ukvocabulary-mapper@1.0.0keywords['Applied Computing']
concepts[field].anzsrc:group:4602mapping · researchdata tees ac ukvocabulary-mapper@1.0.0keywords['Artificial Intelligence']
concepts[field].local:field:computer-science-aimapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:engineeringmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:life-sciencesmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
descriptionsource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/description
licensesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/rights
publication_datesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
titlesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/title