Data · dataset · 2023
Refiner processing in visual narrative grammar
Listed in IISH Dataverse and ODISSEI Portal — shown once because both records carry DOI 10.34894/bvdlzx
Linguistic syntax has often been claimed as uniquely complex due to features like anaphoric relations and distance dependencies.
Description
However, visual narratives of sequential images, like those in comics, have been argued to use sequencing mechanisms analogous to those in language. These narrative structures include “refiner” panels that “zoom in” on the contents of another panel.
Similar to anaphora in language, refiners indexically connect inexplicit referential information in one unit (refiner, pronoun) to a more informative “antecedent” elsewhere in the discourse. Also like in language, refiners can follow their antecedents (anaphoric) or precede them (cataphoric), along with having either proximal or distant connections. We here explore the constraints on visual narrative refiners created by modulating these features of order and distance.
Read the rest (2 more)
Experiment 1 examined participants’ preferences for where refiners are placed in a sequence using a force-choice test, which revealed that refiners are preferred to follow their antecedents and have proximal distances from them. Experiment 2 then showed that distance dependencies lead to slower self-paced viewing times. Finally, measurements of event-related brain potentials (ERPs) in Experiment 3 revealed that these patterns evoke similar brain responses as those observed to referential dependencies in language (i.e., N400, LAN, Nref).
Across all three studies, the constraints and (neuro)cognitive responses to refiners parallel those shown to anaphora in language, suggesting domain-general constraints on the sequencing of referential dependencies.
Links
Where it is published
- Dataverse dataset page dataverse.nl/dataset.xhtml?persistentId=doi%3A10.34894%2FBVDLZX ↗
landing page · from datasets iisg amsterdam
- Dataverse dataset page portal.odissei.nl/dataset.xhtml?persistentId=doi%3A10.34894%2FBVDLZX ↗
landing page · from portal odissei nl
- DOI doi.org/10.34894/bvdlzx ↗
DOI / persistent id · from datasets iisg amsterdam
Catalogue records · 2
- Dataverse API dataverse.nl/api/datasets/:persistentId/?persistentId=doi%3A10.34894%2FBVDL… ↗
metadata API · from datasets iisg amsterdam
- Dataverse API portal.odissei.nl/api/datasets/:persistentId/?persistentId=doi%3A10.34894%2FBVDL… ↗
metadata API · from portal odissei nl
Topics
- Stated by source
- Arts and Humanities · Arts and Humanities · Social Sciences · Social Sciences
- From keywords
- Humanities · Humanities · Linguistics · Linguistics · Linguistic structures · Linguistic structures · Psychology & Behavioral Science · Psychology & Behavioral Science · Social Science · Social Science
- Inferred from text
- Image 65% · Sequencing 75%
Provenance · 2 source records, 22 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| IISH Dataverse | doi:10.34894/BVDLZX | 13 d ago | JSON v1 |
| ODISSEI Portal | doi:10.34894/BVDLZX | 9 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:field:470409 | mapping · portal odissei nl | vocabulary-mapper@1.0.0 | keywords['Syntax'] |
| concepts[field].anzsrc:field:470409 | mapping · datasets iisg amsterdam | vocabulary-mapper@1.0.0 | keywords['Syntax'] |
| concepts[field].anzsrc:group:4704 | mapping · portal odissei nl | vocabulary-mapper@1.0.0 | keywords['Linguistics'] |
| concepts[field].anzsrc:group:4704 | mapping · datasets iisg amsterdam | vocabulary-mapper@1.0.0 | keywords['Linguistics'] |
| concepts[field].dataverse_subject:arts-and-humanities | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /subjects |
| concepts[field].dataverse_subject:arts-and-humanities | source · portal odissei nl | connector:portal_odissei_nl@1.0.0 | /subjects |
| concepts[field].dataverse_subject:social-sciences | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /subjects |
| concepts[field].dataverse_subject:social-sciences | source · portal odissei nl | connector:portal_odissei_nl@1.0.0 | /subjects |
| concepts[field].local:field:humanities | mapping · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /subjects |
| concepts[field].local:field:humanities | mapping · portal odissei nl | connector:portal_odissei_nl@1.0.0 | /subjects |
| concepts[field].local:field:psychology-behavioral | mapping · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /subjects |
| concepts[field].local:field:psychology-behavioral | mapping · portal odissei nl | connector:portal_odissei_nl@1.0.0 | /subjects |
| concepts[field].local:field:social-science | mapping · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /subjects |
| concepts[field].local:field:social-science | mapping · portal odissei nl | connector:portal_odissei_nl@1.0.0 | /subjects |
| concepts[modality].local:modality:image | enrichment · datasets iisg amsterdam | keyword-concept-rules@1.0.0 | title+description (65%) |
| concepts[modality].local:modality:sequencing | enrichment · datasets iisg amsterdam | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | |
| description | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /description |
| publication_date | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | |
| title | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /name |
| updated_date | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | |
| version_label | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 |