Table · dataset · 2025
codelion/fineweb-edu-100M
Listed in Hugging Face Datasets
Description
Sampling Methodology This dataset was created using reservoir sampling, a statistically unbiased random sampling algorithm that guarantees each sample from the source dataset has an equal probability of being included. This ensures the 100M token sample is representative of the full dataset's characteristics. Source Dataset: HuggingFaceFW/fineweb-edu Sample Size: 100M tokens Content: Curated educational web resources Reservoir sampling enables rapid experimentation and ablation… See the full description on the dataset page: huggingface.co/datasets/codelion/fineweb-edu-100M.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/codelion/fineweb-edu-100M ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/codelion/fineweb-edu-100M ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text
- From keywords
- Computer Science & AI
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | codelion/fineweb-edu-100M | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |