Constarium
← Search

Table · dataset · 2024

SmolTalk

Listed in Hugging Face Datasets

Description

SmolTalk Dataset description This is a synthetic dataset designed for supervised finetuning (SFT) of LLMs. It was used to build SmolLM2-Instruct family of models and contains 1M samples. More details in our paper arxiv.org/abs/2502.02737 During the development of SmolLM2, we observed that models finetuned on public SFT datasets underperformed compared to other models with proprietary instruction datasets.

To address this gap, we created new synthetic datasets… See the full description on the dataset page: huggingface.co/datasets/HuggingFaceTB/smoltalk.

Links

Where it is published

Documentation and papers

Catalogue records · 1

Topics

Stated by source
tabular · text
Provenance · 1 source records, 9 field assertions
SourceKeyLast seenRaw
Hugging Face DatasetsHuggingFaceTB/smoltalk13 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · Hugging Faceconnector:huggingface@1.0.0/gated
concepts[field].local:field:computer-science-aimapping · Hugging Faceconnector:huggingface@1.0.0
concepts[modality].hf_modality:tabularsource · Hugging Faceconnector:huggingface@1.0.0
concepts[modality].hf_modality:textsource · Hugging Faceconnector:huggingface@1.0.0
created_datesource · Hugging Faceconnector:huggingface@1.0.0
descriptionsource · Hugging Faceconnector:huggingface@1.0.0/description
publication_datesource · Hugging Faceconnector:huggingface@1.0.0
titlesource · Hugging Faceconnector:huggingface@1.0.0/id
updated_datesource · Hugging Faceconnector:huggingface@1.0.0