學術產出-Periodical Articles

Article View/Open

Publication Export

Google ScholarTM

政大圖書館

Citation Infomation

題名 Neural correlates of the processing of self-adaptors, emblems, and iconic gestures with speech: an fMRI study
作者 張葶葶
Chang, Ting-Ting
Chui, Kawai
Yeh, Kanyu
貢獻者 心理系
關鍵詞 Self-adaptor ; emblem ; iconic ; gesturegesture-speech processing
日期 2020-12
上傳時間 27-Oct-2021 09:30:23 (UTC+8)
摘要 Various types of arm-and-hand movements co-occurring with speech give rise to diverse cross-modal semantic relations. This study investigated how the brain processes self-adaptors, emblems, and iconic gestures with the same speech by using fMRI. Gestures with speech evoked bilateral fusiform gyrus and left supramarginal gyrus in visual and multisensory processing. These regions were involved in processing conventional forms and meanings in emblems with speech. Iconic gestures uniquely activated right supramarginal gyrus associated with spatial processing of unconventional configurations of event knowledge of lexical concepts. Self-adaptors without meaning particularly involved the left superior parietal lobule in directing spatial attention to hand movements and processing spatio-motoric attributes with motor representations. Without gestures, bilateral superior temporal gyrus and calcarine sulcus were engaged in processing sounds and meanings of audiovisual speech. The overall results demonstrate the brain’s sensitivity to gesture-speech semantic variation, and reveal the nature of knowledge in the involved neural regions.
關聯 Language, Cognition and Neuroscience, 36:4, 401-421
資料類型 article
DOI https://doi.org/10.1080/23273798.2020.1853785
dc.contributor 心理系
dc.creator (作者) 張葶葶
dc.creator (作者) Chang, Ting-Ting
dc.creator (作者) Chui, Kawai
dc.creator (作者) Yeh, Kanyu
dc.date (日期) 2020-12
dc.date.accessioned 27-Oct-2021 09:30:23 (UTC+8)-
dc.date.available 27-Oct-2021 09:30:23 (UTC+8)-
dc.date.issued (上傳時間) 27-Oct-2021 09:30:23 (UTC+8)-
dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/137544-
dc.description.abstract (摘要) Various types of arm-and-hand movements co-occurring with speech give rise to diverse cross-modal semantic relations. This study investigated how the brain processes self-adaptors, emblems, and iconic gestures with the same speech by using fMRI. Gestures with speech evoked bilateral fusiform gyrus and left supramarginal gyrus in visual and multisensory processing. These regions were involved in processing conventional forms and meanings in emblems with speech. Iconic gestures uniquely activated right supramarginal gyrus associated with spatial processing of unconventional configurations of event knowledge of lexical concepts. Self-adaptors without meaning particularly involved the left superior parietal lobule in directing spatial attention to hand movements and processing spatio-motoric attributes with motor representations. Without gestures, bilateral superior temporal gyrus and calcarine sulcus were engaged in processing sounds and meanings of audiovisual speech. The overall results demonstrate the brain’s sensitivity to gesture-speech semantic variation, and reveal the nature of knowledge in the involved neural regions.
dc.format.extent 3703200 bytes-
dc.format.mimetype application/pdf-
dc.relation (關聯) Language, Cognition and Neuroscience, 36:4, 401-421
dc.subject (關鍵詞) Self-adaptor ; emblem ; iconic ; gesturegesture-speech processing
dc.title (題名) Neural correlates of the processing of self-adaptors, emblems, and iconic gestures with speech: an fMRI study
dc.type (資料類型) article
dc.identifier.doi (DOI) 10.1080/23273798.2020.1853785
dc.doi.uri (DOI) https://doi.org/10.1080/23273798.2020.1853785