Constarium
← Search

Data · dataset · 2019

Audiovisual and lexical cues do not additively enhance perceptual adaptation

Listed in IISH Dataverse and ODISSEI Portal — shown once because both records carry DOI 10.34894/8rztgk

When listeners experience difficulty in understanding a speaker, lexical and audiovisual (or lip-reading) information can be a helpful source of guidance.

Description

These two types of information embedded in speech can also guide perceptual adjustment, also known as recalibration or perceptual retuning. With retuning or recalibration, listeners can use these contextual cues to temporarily or permanently reconfigure internal representations of phoneme categories to adjust to and understand novel interlocutors more easily.

These two types of perceptual learning, previously investigated in large part separately, are highly similar in allowing listeners to use speech-external information to make phoneme boundary adjustments. This study explored whether the two sources may work in conjunction to induce adaptation, thus emulating real life, in which listeners are indeed likely to encounter both types of cue together. Listeners who received combined audiovisual and lexical cues showed perceptual learning effects similar to listeners who only received audiovisual cues, while listeners who received only lexical cues showed weaker effects compared to the two other groups.

Read the rest (1 more)

The combination of cues did not lead to additive retuning or recalibration effects, however, suggesting that lexical and audiovisual cues operate differently with regard to how listeners utilize them for reshaping perceptual categories. Reaction times did not significantly differ across the three conditions, so none of the forms of adjustment were either aided or hindered by processing time differences. Mechanisms underlying these forms of perceptual learning may diverge in numerous ways despite similarities in experimental applications.

Links

Topics

Stated by source
Social Sciences · Social Sciences
Inferred from text
Audio 65%
Provenance · 2 source records, 11 field assertions
SourceKeyLast seenRaw
IISH Dataversedoi:10.34894/8RZTGK11 d agoJSON v1
ODISSEI Portaldoi:10.34894/8RZTGK7 d agoJSON v1
FieldAssertionExtractorEvidence
concepts[field].dataverse_subject:social-sciencessource · datasets iisg amsterdamconnector:datasets_iisg_amsterdam@1.0.0/subjects
concepts[field].dataverse_subject:social-sciencessource · portal odissei nlconnector:portal_odissei_nl@1.0.0/subjects
concepts[field].local:field:social-sciencemapping · datasets iisg amsterdamconnector:datasets_iisg_amsterdam@1.0.0/subjects
concepts[field].local:field:social-sciencemapping · portal odissei nlconnector:portal_odissei_nl@1.0.0/subjects
concepts[modality].local:modality:audioenrichment · datasets iisg amsterdamkeyword-concept-rules@1.0.0title+description (65%)
created_datesource · datasets iisg amsterdamconnector:datasets_iisg_amsterdam@1.0.0
descriptionsource · datasets iisg amsterdamconnector:datasets_iisg_amsterdam@1.0.0/description
publication_datesource · datasets iisg amsterdamconnector:datasets_iisg_amsterdam@1.0.0
titlesource · datasets iisg amsterdamconnector:datasets_iisg_amsterdam@1.0.0/name
updated_datesource · datasets iisg amsterdamconnector:datasets_iisg_amsterdam@1.0.0
version_labelsource · datasets iisg amsterdamconnector:datasets_iisg_amsterdam@1.0.0