Table · dataset · 2024

BigCodeBench

Listed in Hugging Face Datasets

BigCodeBench The dataset has 2 variants: BigCodeBench-Complete: Code Completion based on the structured docstrings.

Description

BigCodeBench-Instruct: Code Generation based on the NL-oriented instructions. The overall statistics of the dataset are as follows: Complete Instruct # Task 1140 1140 # Avg.

Test Cases 5.6 5.6 # Avg. Coverage 99% 99% # Avg. Prompt Char. 1112.5 663.2 # Avg.

Read the rest (2 more)

Prompt Line 33.5 11.7 # Avg. Prompt Char. (Code) 1112.5 124.0 # Avg.

Solution Char.… See the full description on the dataset page: huggingface.co/datasets/bigcode/bigcodebench.

Topics

Stated by source: text
From keywords: Computer Science & AI

Provenance · 1 source records, 9 field assertions

Source	Key	Last seen	Raw
Hugging Face Datasets	bigcode/bigcodebench	13 d ago	JSON v1

Field	Assertion	Extractor	Evidence
access_level	source · Hugging Face	connector:huggingface@1.0.0	/gated
concepts[field].local:field:computer-science-ai	mapping · Hugging Face	connector:huggingface@1.0.0
concepts[modality].hf_modality:text	source · Hugging Face	connector:huggingface@1.0.0
created_date	source · Hugging Face	connector:huggingface@1.0.0
description	source · Hugging Face	connector:huggingface@1.0.0	/description
license	source · Hugging Face	connector:huggingface@1.0.0	/tags[license:*]
publication_date	source · Hugging Face	connector:huggingface@1.0.0
title	source · Hugging Face	connector:huggingface@1.0.0	/id
updated_date	source · Hugging Face	connector:huggingface@1.0.0

BigCodeBench

Description

Links

Where it is published

Documentation and papers

Topics