Constarium
← Search

Data · dataset · 2025

Chinese Aligned Multimodal Sentiment Dataset v1.0

Listed in ScienceDB

This dataset is constructed for multimodal sentiment analysis in Chinese context.

Description

It contains natural conversational and interview scenarios, covering three modalities: text, audio, and vision. All original video and audio data have been de-identified; only sentence-level aligned feature vectors and corresponding sentiment annotations are provided.The dataset consists of 2,281 Chinese utterances, and each sample includes:Text modality: [CLS] vector extracted by BERT-base-chinese (768 dimensions);Audio modality: Prosodic and spectral features extracted using COVAREP, aggregated by temporal mean pooling into a 74-dimensional vector;Vision modality: Action Units (AU), eye gaze and head pose features extracted with Facet, mean-pooled into a 35-dimensional vector;Sentiment intensity label: ranged in [-3, +3], where negative values denote negative emotions, positive values denote positive emotions, and larger absolute values indicate stronger intensity.The dataset also provides train/validation/test splits to ensure reproducibility of experiments.

It is suitable for research on multimodal sentiment modeling, confidence-aware fusion methods, and training and evaluation of related machine learning and deep learning models.

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Audio 75% · Text 75% · Video 75%
Provenance · 1 source records, 13 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.2932910 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
concepts[modality].local:modality:audioenrichment · scidb cnkeyword-concept-rules@1.0.0title+description (75%)
concepts[modality].local:modality:textenrichment · scidb cnkeyword-concept-rules@1.0.0title+description (75%)
concepts[modality].local:modality:videoenrichment · scidb cnkeyword-concept-rules@1.0.0title+description (75%)
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
licensesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/rights
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title