Data · dataset · 2025
Synthetic datasets generated by Large Language Models
Listed in e-cienciaDatos
This dataset is the result of the work done in the project GRESEL-UAM: About GRESEL: AI Generation Results Enriched with Simplified Explanations Based on Linguistic Features (Resultados de Generación de IA Enriquecidos con Explicaciones Simplificadas Basadas en Características Lingüísticas).
Description
This dataset is part of the publication titled "Assessing a Literary RAG System with a Human-Evaluated Synthetic QA Dataset Generated by an LLM: Experiments with Knowledge Graphs," which will be presented in September 2025 in Zaragoza, within the framework of the conference of the Sociedad Española para el Procesamiento del Lenguaje Natural (SEPLN).
The work has already been accepted for publication in SEPLN’s official journal, Procesamiento del Lenguaje Natural. This dataset consists of three synthetically generated datasets, a process known as Synthetic Data Generation (SDG). We used three different LLMs: deepseek-r1:14b, llama3.1:8b-instruct-q8_0, and mistral:7b-instruct.
Read the rest (4 more)
Each was given a prompt instructing them to generate a question answering (QA) dataset based on context fragments from the novel Trafalgar by Benito Pérez Galdós. These datasets were later used to evaluate a Retrieval-Augmented Generation (RAG) system. Three CSV files are provided, each corresponding to the synthetic dataset generated by one of the models.
In total, the dataset contains 359 items. The header includes the following fields: id, context, question, answer, and success. Fields are separated by tabs.
The id column is simply an identifier number. The context column contains the text fragment from which the model generated the questions and answers. The question and answer fields contain the generated questions and answers, respectively.
The success column indicates whether the model successfully generated the question and answer in the corresponding fields ("yes" or "no").
Links
Where it is published
- Dataverse dataset page edatos.consorciomadrono.es/dataset.xhtml?persistentId=doi%3A10.21950%2FYXP8Q8 ↗
landing page · from edatos consorciomadrono es
- DOI doi.org/10.21950/yxp8q8 ↗
DOI / persistent id · from edatos consorciomadrono es
Catalogue records · 1
- Dataverse API edatos.consorciomadrono.es/api/datasets/:persistentId/?persistentId=doi%3A10.21950%2FYXP8… ↗
metadata API · from edatos consorciomadrono es
Topics
- Stated by source
- Ciencias de la información y computación
- From keywords
- Computer Science & AI · Humanities
- Inferred from text
- Natural language processing 77% · Text 75%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| e-cienciaDatos | doi:10.21950/YXP8Q8 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:field:460208 | enrichment · edatos consorciomadrono es | taxonomy-embedding@1.1.0 | title+keywords+description (77%) |
| concepts[field].dataverse_subject:ciencias-de-la-informaci-n-y-computaci-n | source · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 | /subjects |
| concepts[field].local:field:computer-science-ai | mapping · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 | /subjects |
| concepts[field].local:field:humanities | mapping · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 | /subjects |
| concepts[modality].local:modality:text | enrichment · edatos consorciomadrono es | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 | |
| description | source · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 | /description |
| publication_date | source · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 | |
| title | source · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 | /name |
| updated_date | source · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 | |
| version_label | source · edatos consorciomadrono es | connector:edatos_consorciomadrono_es@1.0.0 |