Archive · dataset · 2025
Labadain-ZSRunS: Sparse and Zero-Shot Dense Retrieval Runs with LLM-Generated Summaries for Tetun Ad-Hoc Text Retrieval
Listed in INESC TEC Research Data Repository
**1.
Description
Overview** Labadain-ZSRunS is a dataset consisting of run files produced by classical sparse and zero-shot dense retrieval models, resulted from the experiments on Tetun ad-hoc text retrieval. It also includes document summaries generated by a large language model (LLM) based on the full content of each document from the Labadain-Avaliadór collection.
The dataset is intended to support research in Tetun information retrieval and, more broadly, in multilingual, cross-lingual, and zero-shot retrieval scenarios involving underrepresented languages. **2. Dataset Components** The dataset comprises model-specific run files and LLM-generated document summaries. **2.1. Model-Specific Run Files** This component contains retrieval run files produced by a diverse set of models, including: - Classical sparse models: BM25, DFR BM25, and Hiemstra LM - Zero-shot dense retrieval models: This includes pretrained dense retrievers applied to Tetun in a zero-shot setting to generate document embeddings.
Read the rest (3 more)
The models used are DPR, mDPR, Contriever, mContriever, ColBERTv2, and ColBERT-X. **2.2. LLM-Generated Document Summaries** Summaries were automatically generated using Claude Haiku 3, based on the full content of each Tetun document. **3. Dataset Structure** All files are organized under the root folder of Labadain-ZSRunS. **3.1.
Run Files** Run files are stored in CSV format, comprising qid, docno, score, and rank columns. - Sparse retrieval models: Each sparse model (BM25, DFR BM25, Hiemstra LM) has its own run file. All sparse model run files are located within the sparse-baseline-run-files/[files]. - Dense retrieval models: Each dense model (e.g., DPR, mDPR, Contriever) includes two run files: one using title embeddings and the other using contextual (title + summary) embeddings.
All dense model run files are located within the dense-zero-shot-run-files/[folders]. **3.2. LLM-Generated Summaries** The LLM-generated summaries file is provided in CSV format with docno and contextual_document columns and located within the llm-generated-summaries/[file]. - The docno column represents the document identifier as used in the Labadain-Avaliadór document collection. - The contextual_document column contains a concatenation of the document's title and its LLM-generated summary, separated by a newline character (\n).
Links
Get the data
- Labadain-ZSRunS rdm.inesctec.pt/dataset/0c8ca96b-d606-4d52-ad2b-763a97f7a361/resource/9f5b931d… ↗
download · from rdm inesctec pt
Where it is published
- INESC TEC Research Data Repository dataset page rdm.inesctec.pt/dataset/cs-2025-004 ↗
landing page · from rdm inesctec pt
Catalogue records · 1
- CKAN API rdm.inesctec.pt/api/3/action/package_show?id=0c8ca96b-d606-4d52-ad2b-763a97f7a… ↗
metadata API · from rdm inesctec pt
Topics
- From keywords
- Computer Science & AI · Engineering · Humanities
- Inferred from text
- Text 75%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| INESC TEC Research Data Repository | 0c8ca96b-d606-4d52-ad2b-763a97f7a361 | 5 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[field].local:field:engineering | mapping · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[field].local:field:humanities | mapping · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · rdm inesctec pt | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| description | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | /notes |
| license_text | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| publication_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| title | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | /title |
| updated_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 |