Data · dataset · 2026
Replication Data for: Can LLMs Substitute for Humans in Evaluating Conceptual Modeling Language Vocabularies? An Experimental Study
Listed in Borealis
This is a reproducibility package for paper titled "Can LLMs Substitute for Humans in Evaluating Conceptual Modeling Language Vocabularies?
Description
An Experimental Study" appearing in the proceedings of the ACM/IEEE 29th International Conference on Model Driven Engineering Languages and Systems (MODELS 2026). The package contains: - Anonymised (according to ethics protocol) data from experimental participants (and LLMs). - HTML and MD reports of the analysis - Scripts for reproducing the analysis using R To access the dataset: - Download the ZIP file and unzip locally. - Consult README.MD at the root directory for reproduction directions and for locating the data.
Information is also available on github: github.com/cmg-yorku/MODELS2026/ (commit: 5bf168a84e245184c37feb9b9aa0b5997baacaea)
Links
Where it is published
- Dataverse dataset page borealisdata.ca/dataset.xhtml?persistentId=doi%3A10.5683%2FSP4%2FFVPNZR ↗
landing page · from borealisdata ca
- DOI doi.org/10.5683/sp4/fvpnzr ↗
DOI / persistent id · from borealisdata ca
Catalogue records · 1
- Dataverse API borealisdata.ca/api/datasets/:persistentId/?persistentId=doi%3A10.5683%2FSP4%2… ↗
metadata API · from borealisdata ca
Topics
- Stated by source
- Computer and Information Science
- Inferred from text
- Data management and data science 72%
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Borealis | doi:10.5683/SP4/FVPNZR | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:group:4605 | enrichment · borealisdata ca | taxonomy-embedding@1.1.0 | title+keywords+description (72%) |
| concepts[field].dataverse_subject:computer-and-information-science | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | /subjects |
| created_date | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | |
| description | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | /description |
| publication_date | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | |
| title | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | /name |
| updated_date | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | |
| version_label | source · borealisdata ca | connector:borealisdata_ca@1.0.0 |