Data · dataset · 2026
SciChart-KR
Listed in ScienceDB
SciChart-KR is a benchmark dataset for structured knowledge extraction from scientific charts.
Description
It is designed to evaluate whether multimodal models can recover numerical observations, chart-expressed condition-result relations, and scientific entity roles from figures in scholarly literature.The dataset is built from arXiv papers submitted in June 2025. The raw paper pool is collected through the official arXiv API using a date-only query, without keyword, subject-category, author, or venue filters.
After PDF parsing, image extraction, figure-caption anchoring, chart-type filtering, single-panel screening, and manual verification, SciChart-KR contains 1,200 scientific charts across four chart types: line, bar, pie, and radar charts, with 300 charts for each type.SciChart-KR focuses on reusable chart-derived knowledge structures rather than only question answering, caption generation, or chart-to-table conversion.
Read the rest (3 more)
Each record includes source metadata, figure captions, anchored textual context, structured chart data, condition-result chains, and chain-conditioned scientific entity labels. The dataset contains 21,433 annotated condition-result chains and seven entity categories: Problem, Method, Dataset, Material, Tool, Indicator, and Value.The annotation process follows a model-assisted annotation and expert adjudication protocol.
Draft JSON annotations are first generated by a model and then independently reviewed by two domain annotators in a blind setting. Inter-annotator agreement before adjudication reaches Cohen’s κ values of 0.85 for condition-result chains and 0.87 for entity types. Disagreements are resolved through annotator discussion and, when necessary, final adjudication by a senior reviewer.SciChart-KR is released as an evaluation-only benchmark.
It supports systematic evaluation of causal-chain extraction, chain-conditioned entity recognition, and end-to-end scientific chart knowledge representation.
Links
Where it is published
- DOI doi.org/10.57760/sciencedb.46110 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.57760%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Earth & Environmental Science · Engineering · Humanities · Life Sciences · Social Science
- Inferred from text
- Image 75%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.57760/sciencedb.46110 | 7 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[modality].local:modality:image | enrichment · scidb cn | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license_text | source · scidb cn | connector:scidb_cn@1.0.0 | |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |