Data · dataset · 2024
SemEval2020 Task 1
Listed in Researchdata.se
Description
This data collection contains the Swedish test data for SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection: - a Swedish text corpus pair (`corpus1/`, `corpus2/`) - 31 lemmas which have been annotated for their lexical semantic change between the two corpora (`targets.txt`) We sample from the KubHist2 corpus, digitized by the National Library of Sweden, and available through the Språkbanken corpus infrastructure Korp (Borin et al., 2012).
The full corpus is available through a CC BY (attribution) license. Each word for which the lemmatizer in the Korp pipeline has found a lemma is replaced with the lemma. In cases where the lemmatizer cannot find a lemma, we leave the word as is (i.e., unlemmatized, no lower-casing).
Read the rest (3 more)
KubHist contains very frequent OCR errors, especially for the older data.More detail about the properties and quality of the Kubhist corpus can be found in (Adesam et al., 2019). Lars Borin, Markus Forsberg, and Johan Roxendal. Korp-the corpus infrastructure of Språkbanken.
LREC. 2012.
- Yvonne Adesam, Dana Dannélls, and Nina Tahmasebi. Exploring the Quality of the Digital Historical Newspaper Archive KubHist. DHN. 2019. __Corpus 1__ - based on: Kubhist 2 - language: Swedish - time covered: 1790-1830 - size: ~71 million tokens - format: lemmatized, sentence length >= 9 (before removal of punctuation), no punctuation, sentences randomly shuffled - encoding: UTF-8 - note: contains frequent OCR errors __Corpus 2__ - based on: Kubhist 2 - language: Swedish - time covered: 1895-1903 - size: ~111 million tokens - format: lemmatized, sentence length >= 9 (before removal of punctuation), no punctuation, sentences randomly shuffled - encoding: UTF-8 - note: contains OCR errors Reference this testset as: Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky and Nina Tahmasebi. SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection:.In Proceedings of the 14th International Workshop on Semantic Evaluation, Barcelona, Spain, 2020. Association for Computational Linguistics. More information can be found on Swedish Test Data for SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection and SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection.
Links
Where it is published
- DOI doi.org/10.23695/d79w-qa67 ↗
DOI / persistent id · from researchdata se
Catalogue records · 1
- OAI-PMH record api.researchdata.se/oai-pmh?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3A… ↗
metadata API · from researchdata se
Topics
- From keywords
- Computer Science & AI · Earth & Environmental Science · Humanities · Natural language processing
- Inferred from text
- Optical character recognition 65% · Text 75%
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Researchdata.se | oai:researchdata.se:doi-10-23695-d79w-qa67/0 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · researchdata se | connector:researchdata_se@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · researchdata se | connector:researchdata_se@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · researchdata se | connector:researchdata_se@1.0.0 | |
| concepts[field].local:field:humanities | mapping · researchdata se | connector:researchdata_se@1.0.0 | |
| concepts[method].local:method:ocr | enrichment · researchdata se | keyword-concept-rules@1.0.0 | title+description (65%) |
| concepts[modality].local:modality:text | enrichment · researchdata se | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · researchdata se | connector:researchdata_se@1.0.0 | /metadata/dc/description |
| license | source · researchdata se | connector:researchdata_se@1.0.0 | /metadata/dc/rights |
| publication_date | source · researchdata se | connector:researchdata_se@1.0.0 | |
| title | source · researchdata se | connector:researchdata_se@1.0.0 | /metadata/dc/title |