Table · dataset · 2022

wikimedia/wikipedia

Listed in Hugging Face Datasets

Dataset Card for Wikimedia Wikipedia Dataset

Description

Summary

Wikipedia dataset containing cleaned articles of all languages. The dataset is built from the Wikipedia dumps (dumps.wikimedia.org/) with one subset per language, each containing a single train split. Each example contains the content of one full Wikipedia article with cleaning to strip markdown and unwanted sections (references, etc.).

Read the rest (1 more)

All language subsets have already been processed for recent dump… See the full description on the dataset page: huggingface.co/datasets/wikimedia/wikipedia.

Topics

Stated by source: fill mask · text · text generation
From keywords: Computer Science & AI

Provenance · 1 source records, 11 field assertions

Source	Key	Last seen	Raw
Hugging Face Datasets	wikimedia/wikipedia	14 d ago	JSON v1

Field	Assertion	Extractor	Evidence
access_level	source · Hugging Face	connector:huggingface@1.0.0	/gated
concepts[field].local:field:computer-science-ai	mapping · Hugging Face	connector:huggingface@1.0.0
concepts[modality].hf_modality:text	source · Hugging Face	connector:huggingface@1.0.0
concepts[task].hf_task:fill-mask	source · Hugging Face	connector:huggingface@1.0.0	/tags[task_categories:*]
concepts[task].hf_task:text-generation	source · Hugging Face	connector:huggingface@1.0.0	/tags[task_categories:*]
created_date	source · Hugging Face	connector:huggingface@1.0.0
description	source · Hugging Face	connector:huggingface@1.0.0	/description
license_text	source · Hugging Face	connector:huggingface@1.0.0
publication_date	source · Hugging Face	connector:huggingface@1.0.0
title	source · Hugging Face	connector:huggingface@1.0.0	/id
updated_date	source · Hugging Face	connector:huggingface@1.0.0

Open at huggingface.co ↗

Access: open
License: cc-by-sa-3.0
Published: 2022-03-02
Updated: 2024-01-09
Formats: Parquet
Tasks: text-generation, fill-mask
Size category: 10M<n<100M
Languages: ab, ace, ady, af, alt, am, ami, an, ang, anp, ar, arc, ary, arz, as, ast, atj, av, avk, awa, ay, az, azb, ba, ban, bar, bbc, bcl, be, bg, bh, bi, bjn, blk, bm, bn, bo, bpy, br, bs, bug, bxr, ca, cbk, cdo, ce, ceb, ch, chr, chy, ckb, co, cr, crh, cs, csb, cu, cv, cy, da, dag, de, dga, din, diq, dsb, dty, dv, dz, ee, el, eml, en, eo, es, et, eu, ext, fa, fat, ff, fi, fj, fo, fon, fr, frp, frr, fur, fy, ga, gag, gan, gcr, gd, gl, glk, gn, gom, gor, got, gpe, gsw, gu, guc, gur, guw, gv, ha, hak, haw, hbs, he, hi, hif, hr, hsb, ht, hu, hy, hyw, ia, id, ie, ig, ik, ilo, inh, io, is, it, iu, ja, jam, jbo, jv, ka, kaa, kab, kbd, kbp, kcg, kg, ki, kk, kl, km, kn, ko, koi, krc, ks, ksh, ku, kv, kw, ky, la, lad, lb, lbe, lez, lfn, lg, li, lij, lld, lmo, ln, lo, lt, ltg, lv, lzh, mad, mai, map, mdf, mg, mhr, mi, min, mk, ml, mn, mni, mnw, mr, mrj, ms, mt, mwl, my, myv, mzn, nah, nan, nap, nds, ne, new, nia, nl, nn, no, nov, nqo, nrf, nso, nv, ny, oc, olo, om, or, os, pa, pag, pam, pap, pcd, pcm, pdc, pfl, pi, pih, pl, pms, pnb, pnt, ps, pt, pwn, qu, rm, rmy, rn, ro, ru, rue, rup, rw, sa, sah, sat, sc, scn, sco, sd, se, sg, sgs, shi, shn, si, sk, skr, sl, sm, smn, sn, so, sq, sr, srn, ss, st, stq, su, sv, sw, szl, szy, ta, tay, tcy, te, tet, tg, th, ti, tk, tl, tly, tn, to, tpi, tr, trv, ts, tt, tum, tw, ty, tyv, udm, ug, uk, ur, uz, ve, vec, vep, vi, vls, vo, vro, wa, war, wo, wuu, xal, xh, xmf, yi, yo, yue, za, zea, zgh, zh, zu

Hugging Face: wikimedia/wikipedia

wikimedia/wikipedia

Description

Summary

Links

Where it is published

Topics