Text · dataset · 2024
Labadain-30k+: A Monolingual Tetun Document-Level Audited Dataset
Listed in INESC TEC Research Data Repository
Labadain-30k+ is a monolingual Tetun dataset containing 33,550 documents spanning from June 2001 to September 2023, excluding the years 2004 and 2005, for which no documents are available.
Description
Acquired through web crawling, the dataset is in text format and includes title, URL, source, category, publication date, and content. Each document is separated by two consecutive newlines.
Links
Get the data
- Text Information Retrieval in Tetun rdm.inesctec.pt/dataset/cf10a95c-2e6f-4709-970a-54043b9c0679/resource/42ed40e9… ↗
download · from rdm inesctec pt
- Labadain crawler github.com/gabriel-de-jesus/labadain-crawler ↗
download · from rdm inesctec pt
Where it is published
- INESC TEC Research Data Repository dataset page rdm.inesctec.pt/dataset/cs-2024-003 ↗
landing page · from rdm inesctec pt
Catalogue records · 1
- CKAN API rdm.inesctec.pt/api/3/action/package_show?id=cf10a95c-2e6f-4709-970a-54043b9c0… ↗
metadata API · from rdm inesctec pt
Topics
- Stated by source
- CS: Computer Science
- From keywords
- Computer Science & AI · Engineering · Text
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| INESC TEC Research Data Repository | cf10a95c-2e6f-4709-970a-54043b9c0679 | 7 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[field].local:field:engineering | mapping · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[modality].local:modality:text | mapping · rdm inesctec pt | vocabulary-mapper@1.0.0 | keywords['text corpus'] |
| concepts[topic].ckan_group:rdm_inesctec_pt:cs-computer-science | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| created_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| description | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | /notes |
| license_text | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| publication_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| title | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | /title |
| updated_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 |