Constarium
← Search

Data · dataset · 2026

BEAR Benchmark

Listed in Hugging Face Datasets

BEAR Benchmark Data + runnable evaluation code for the BEAR benchmark.

Description

Each task folder holds its data (*.json + images/videos) and a run.sh. The shared runners and util/ live at the repository root.

You run in two steps: Inference — a VLM answers every question → produces a final_*.json. Scoring — eval.py uses a GPT judge (for multiple-choice) or geometry (for pointing/bbox) to grade those replies and print the final accuracy. 1. Setup pip install -r… See the full description on the dataset page: huggingface.co/datasets/yqi19/BEAR-benchmark.

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Image 65%
Provenance · 1 source records, 11 field assertions
SourceKeyLast seenRaw
Hugging Face Datasetsyqi19/BEAR-benchmark12 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · Hugging Faceconnector:huggingface@1.0.0/gated
concepts[field].local:field:computer-science-aimapping · Hugging Faceconnector:huggingface@1.0.0
concepts[modality].local:modality:imageenrichment · Hugging Facekeyword-concept-rules@1.0.0title+description (65%)
concepts[task].hf_task:video-text-to-textsource · Hugging Faceconnector:huggingface@1.0.0/tags[task_categories:*]
concepts[task].hf_task:visual-question-answeringsource · Hugging Faceconnector:huggingface@1.0.0/tags[task_categories:*]
created_datesource · Hugging Faceconnector:huggingface@1.0.0
descriptionsource · Hugging Faceconnector:huggingface@1.0.0/description
licensesource · Hugging Faceconnector:huggingface@1.0.0/tags[license:*]
publication_datesource · Hugging Faceconnector:huggingface@1.0.0
titlesource · Hugging Faceconnector:huggingface@1.0.0/id
updated_datesource · Hugging Faceconnector:huggingface@1.0.0