學術產出-Periodical Articles

Article View/Open

Publication Export

Google ScholarTM

政大圖書館

Citation Infomation

題名 Modulation of scene consistency and task demand on language-driven eye movements for audio-visual integration.
作者 蔡介立
Yu, W.-Y.
Tsai, Jie-Li
貢獻者 心理系
關鍵詞 Audio-visual integration; Comprehension; Scene consistency; Spoken language
日期 2016-11
上傳時間 3-Nov-2016 17:59:33 (UTC+8)
摘要 Previous psycholinguistic studies have demonstrated that people tend to direct fixations toward the visual object to which spoken input refers during language comprehension. However, it is still unclear how the visual scene, especially the semantic consistency between object and background, affects the word-object mapping process during comprehension. Two visual world paradigm experiments were conducted to investigate how the scene consistency dynamically influenced the language-driven eye movements in a speech comprehension and a scene comprehension task. In each trial, participants listened to a spoken sentence while viewing a picture with two critical objects: one is the mentioned target object (e.g., tiger), which was embedded in either a consistent (e.g., field), inconsistent (e.g., sky) or blank background; the other is an unmentioned non-target object (e.g., eagle), which was always consistent with its background. The results showed that the fixation proportion of the inconsistent target was higher than the consistent target, and the task demand can affect the strength and the direction of the inconsistency effect before and after the target had been mentioned. In summary, the spoken language, scene-based knowledge and task demand were intertwined to determine eye movements during audio-visual integration for comprehension.
關聯 Acta Psychologica, Vol.171, pp.1-16
資料類型 article
DOI http://dx.doi.org/10.1016/j.actpsy.2016.09.004
dc.contributor 心理系-
dc.creator (作者) 蔡介立zh_TW
dc.creator (作者) Yu, W.-Y.-
dc.creator (作者) Tsai, Jie-Lien_US
dc.date (日期) 2016-11-
dc.date.accessioned 3-Nov-2016 17:59:33 (UTC+8)-
dc.date.available 3-Nov-2016 17:59:33 (UTC+8)-
dc.date.issued (上傳時間) 3-Nov-2016 17:59:33 (UTC+8)-
dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/103390-
dc.description.abstract (摘要) Previous psycholinguistic studies have demonstrated that people tend to direct fixations toward the visual object to which spoken input refers during language comprehension. However, it is still unclear how the visual scene, especially the semantic consistency between object and background, affects the word-object mapping process during comprehension. Two visual world paradigm experiments were conducted to investigate how the scene consistency dynamically influenced the language-driven eye movements in a speech comprehension and a scene comprehension task. In each trial, participants listened to a spoken sentence while viewing a picture with two critical objects: one is the mentioned target object (e.g., tiger), which was embedded in either a consistent (e.g., field), inconsistent (e.g., sky) or blank background; the other is an unmentioned non-target object (e.g., eagle), which was always consistent with its background. The results showed that the fixation proportion of the inconsistent target was higher than the consistent target, and the task demand can affect the strength and the direction of the inconsistency effect before and after the target had been mentioned. In summary, the spoken language, scene-based knowledge and task demand were intertwined to determine eye movements during audio-visual integration for comprehension.-
dc.format.extent 3607285 bytes-
dc.format.mimetype application/pdf-
dc.relation (關聯) Acta Psychologica, Vol.171, pp.1-16-
dc.subject (關鍵詞) Audio-visual integration; Comprehension; Scene consistency; Spoken language-
dc.title (題名) Modulation of scene consistency and task demand on language-driven eye movements for audio-visual integration.-
dc.type (資料類型) article-
dc.identifier.doi (DOI) 10.1016/j.actpsy.2016.09.004-
dc.doi.uri (DOI) http://dx.doi.org/10.1016/j.actpsy.2016.09.004-