Data · dataset · 2026
LORELEI Ilocano Incident Language Pack
Listed in UC Berkeley Library Dataverse
Description
LORELEI Ilocano Incident Language Pack was developed by the Linguistic Data Consortium (LDC) and consists of approximately 8.9 million words of Ilocano monolingual text, 3.3 million words of English monolingual text, 3.2 million words of parallel Ilocano-English text, and 3 million words of data annotated for Entity Discovery and Linking and Situation Frames. It contains all of the text data, annotations, supplemental resources, and related software tools for the Ilocano language used in the DARPA LORELEI / LoReHLT 2019 Evaluation.
The LORELEI (Low Resource Languages for Emergent Incidents) program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources.
Read the rest (2 more)
Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation. The evaluation protocol was based on a scenario in which some unforeseen event triggered a need for humanitarian and logistical support in a region where the predominant language was one that had received little or no attention in natural language processing (NLP) research.
Evaluation participants provided NLP solutions, including information extraction and machine translation, based on limited resources and with limited development time.
Links
Where it is published
- Dataverse dataset page datasets.lib.berkeley.edu/dataset.xhtml?persistentId=doi%3A10.60503%2FD3%2FVHLPUR ↗
landing page · from datasets lib berkeley edu
- DOI doi.org/10.60503/d3/vhlpur ↗
DOI / persistent id · from datasets lib berkeley edu
Catalogue records · 1
- Dataverse API datasets.lib.berkeley.edu/api/datasets/:persistentId/?persistentId=doi%3A10.60503%2FD3%2… ↗
metadata API · from datasets lib berkeley edu
Topics
- Stated by source
- Social Sciences
- From keywords
- Social Science
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| UC Berkeley Library Dataverse | doi:10.60503/D3/VHLPUR | 5 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[disease].local:disease:disease | enrichment · datasets lib berkeley edu | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[field].dataverse_subject:social-sciences | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | /subjects |
| concepts[field].local:field:social-science | mapping · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | /subjects |
| concepts[modality].local:modality:text | enrichment · datasets lib berkeley edu | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | |
| description | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | /description |
| publication_date | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | |
| title | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | /name |
| updated_date | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | |
| version_label | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 |