Text · dataset · 2022
masakhaner2.0
Listed in Hugging Face Datasets
MasakhaNER 2.0 is the largest publicly available high-quality dataset for named entity recognition (NER) in 20 African languages.
Description
Named entities are phrases that contain the names of persons, organizations, locations, times and quantities. Example: [PER Wolff] , currently a journalist in [LOC Argentina] , played with [PER Del Bosque] in the final years of the seventies in [ORG Real Madrid] .
MasakhaNER is a named entity dataset consisting of PER, ORG, LOC, and DATE entities annotated by Masakhane for 20 African languages: - Bambara (bam) - Ghomala (bbj) - Ewe (ewe) - Fon (fon) - Hausa (hau) - Igbo (ibo) - Kinyarwanda (kin) - Luganda (lug) - Dholuo (luo) - Mossi (mos) - Chichewa (nya) - Nigerian Pidgin - chShona (sna) - Kiswahili (swą) - Setswana (tsn) - Twi (twi) - Wolof (wol) - isiXhosa (xho) - Yorùbá (yor) - isiZulu (zul) The train/validation/test sets are available for all the ten languages.
Read the rest (1 more)
For more details see arxiv.org/abs/2103.11811
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/masakhane/masakhaner2 ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2103.11811 arxiv.org/abs/2103.11811 ↗
publication · from Hugging Face
- arXiv:2210.12391 arxiv.org/abs/2210.12391 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/masakhane/masakhaner2 ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text · token classification
- From keywords
- Computer Science & AI
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | masakhane/masakhaner2 | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:token-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |