Data · dataset · 2022

CarperAI/pile-v2-small-filtered

Listed in Hugging Face Datasets

Description

Dataset Description A small subset in each dataset of pile-v2(~1000 samples) of pile-v2 dataset, each has 1,000 random samples from the original dataset. The dataset has 255MB of text (code and english). Languages The dataset contains technical text on programming languages and natural language with the following subsets, Bible TED2020 PileOfLaw StackExchange GithubIssues Opensubtitles USPTO S2ORC DevDocs CodePileReddit2022 USENET GNOME ASFPublicMail PileV2Reddit2020… See the full description on the dataset page: huggingface.co/datasets/CarperAI/pile-v2-small-filtered.

Topics

Stated by source: text generation
From keywords: Computer Science & AI
Inferred from text: Text 75%

Provenance · 1 source records, 9 field assertions

Source	Key	Last seen	Raw
Hugging Face Datasets	CarperAI/pile-v2-small-filtered	12 d ago	JSON v1

Field	Assertion	Extractor	Evidence
access_level	source · Hugging Face	connector:huggingface@1.0.0	/gated
concepts[field].local:field:computer-science-ai	mapping · Hugging Face	connector:huggingface@1.0.0
concepts[modality].local:modality:text	enrichment · Hugging Face	keyword-concept-rules@1.0.0	title+description (75%)
concepts[task].hf_task:text-generation	source · Hugging Face	connector:huggingface@1.0.0	/tags[task_categories:*]
created_date	source · Hugging Face	connector:huggingface@1.0.0
description	source · Hugging Face	connector:huggingface@1.0.0	/description
publication_date	source · Hugging Face	connector:huggingface@1.0.0
title	source · Hugging Face	connector:huggingface@1.0.0	/id
updated_date	source · Hugging Face	connector:huggingface@1.0.0

CarperAI/pile-v2-small-filtered

Description

Links

Where it is published

Topics