Constarium
← Search

Data · dataset · 2025

A Multimodal Large-Scale Dataset for Visual Question Answering on Electronic Documents

Listed in ScienceDB

A large-scale, high-quality visual question answering dataset for electronic documents, integrating both textual and visual information from document images to generate questions and corresponding answers.

Description

The dataset contains 324,546 images and 2,036,263 QA pairs, with quality ensured through quantity and format validation, data filtering, and consistency checks. Random sampling indicates an accuracy of 91.34% for the QA pairs.

In application, the dataset significantly improves the performance of multimodal large language models on document-based QA tasks: when fine-tuned on LLaVA-OV and Deepseek-VL, the average normalized edit similarity on the DocVQA benchmark increases by 1.4% and 2.6%, respectively. Ablation studies show that removing the data filtering step decreases performance by 1.3%, while complementary experiments with human-annotated data demonstrate a 1.3% improvement when partially combined with this dataset.

Read the rest (1 more)

Compared with datasets generated by existing methods, this dataset yields the most notable performance gains, while still leaving room for further optimization.

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Design 69% · Image 65%
Provenance · 1 source records, 11 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.j00240.0004610 d agoJSON v1
FieldAssertionExtractorEvidence
concepts[field].anzsrc:group:3303enrichment · scidb cntaxonomy-embedding@1.0.0title+keywords+description (69%)
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
concepts[modality].local:modality:imageenrichment · scidb cnkeyword-concept-rules@1.0.0title+description (65%)
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
license_textsource · scidb cnconnector:scidb_cn@1.0.0
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title