Constarium
← Search

Text · dataset · 2023

kaiokendev/SuperCOT-dataset

Listed in Hugging Face Datasets

Description

epochs: 3 learning rate: 3e-4 lora rank: 8 lora alpha: 16 lora dropout: 0.05 for cutoff 1024 13B, otherwise no dropout due to gradient checkpointing masking: none mbatch size: 4 (1 for 30B) batch size: 8 (2 for 30B) val set size: 0.2 sdp implementation: xformers optimizer: AdamW eval strategy: none Cleaned combination of: huggingface.co/datasets/QingyiSi/Alpaca-CoT Chain of thought QED Chain of thought Aqua CodeAlpaca huggingface.co/datasets/neulab/conala Code snippets… See the full description on the dataset page: huggingface.co/datasets/kaiokendev/SuperCOT-dataset.

Links

Where it is published

Catalogue records · 1

Topics

Stated by source
text
Provenance · 1 source records, 9 field assertions
SourceKeyLast seenRaw
Hugging Face Datasetskaiokendev/SuperCOT-dataset12 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · Hugging Faceconnector:huggingface@1.0.0/gated
concepts[field].local:field:computer-science-aimapping · Hugging Faceconnector:huggingface@1.0.0
concepts[modality].hf_modality:textsource · Hugging Faceconnector:huggingface@1.0.0
created_datesource · Hugging Faceconnector:huggingface@1.0.0
descriptionsource · Hugging Faceconnector:huggingface@1.0.0/description
licensesource · Hugging Faceconnector:huggingface@1.0.0/tags[license:*]
publication_datesource · Hugging Faceconnector:huggingface@1.0.0
titlesource · Hugging Faceconnector:huggingface@1.0.0/id
updated_datesource · Hugging Faceconnector:huggingface@1.0.0