Publications-Theses
Article View/Open
Publication Export
-
Google ScholarTM
NCCU Library
Citation Infomation
Related Publications in TAIR
題名 表情符號與文字的情緒知覺交互作用
The Interaction on the Emotional Perception between Emojis and Texts作者 楊詠晴
Yang, Yung-Ching貢獻者 張葶葶<br>黃淑麗
Chang, Ting-Ting<br>Huang, Shwu-Lih
楊詠晴
Yang, Yung-Ching關鍵詞 表情符號
情緒知覺
情緒效價一致性
喚起度
功能性磁振造影
電腦中介溝通
emoji
emotional perception
valence congruency
arousal
fMRI
computer-mediated communication日期 2025 上傳時間 1-Sep-2025 16:12:40 (UTC+8) 摘要 表情符號已在數位溝通中被廣泛使用，能夠強化文字訊息的情緒表達。過去研究指出，當表情符號與文字的情緒效價一致時，有助於情緒理解；相反的，效價不一致的組合則可能使情緒判斷變得困難。然而，有關此類互動背後的神經機制，以及文字喚起度的調節作用，仍未被充分討論。本研究運用具生態效度且經過預先驗證的訊息材料，模擬日常聊天情境，並系統性操弄文字效價、文字喚起度與表情符號效價。三十三位參與者於功能性磁振造影掃描期間，依據2（文字效價）x 2（文字喚起度）x 2（表情符號效價）的重複量數設計，評估訊息發送者的情緒狀態。行為資料結果顯示，文字與表情符號一致的組合能引發更一致的情緒知覺，而不一致的組合則導致情緒知覺判斷較為模糊。文字喚起度進一步調節了這些效果：高喚起度的正向文字能減弱負向表情符號帶來的負面效果，而低喚起度的負向文字則更容易受到表情符號的詮釋影響。神經影像分析結果顯示，不一致刺激引發了語意衝突與情感整合相關腦區的顯著活化，包括前腦島、外側眶額葉皮質、輔助運動區及尾狀核。此外，高喚起文字亦涉及顳極、下顳回與內側額葉皮質，反映了注意力分配與情感處理的增強。綜合行為與神經層面的結果，本研究提供了一致證據，支持情緒效價與喚起度在多模態情感溝通中的動態交互作用，並凸顯大腦在自然情境下的電腦中介溝通中，對情感一致性與強度的敏感性。
Emojis have become pervasive in digital communication, enhancing emotional expression in text-based messages. Prior research has demonstrated that text-emoji congruency facilitates emotional interpretation, whereas incongruent pairings introduce ambiguity. However, the neural mechanisms underlying these interactions and the modulation of text arousal remain unclear. The present study addressed these gaps by employing ecologically valid, pre-validated message stimuli resembling everyday chat, systematically varying text valence, text arousal, and emoji valence. Thirty-three participants evaluated the sender’s emotional state while undergoing fMRI scanning in a 2 (text valence) x 2 (text arousal) x 2 (emoji valence) repeated-measures design. Behavioral results revealed that emotionally congruent text-emoji pairings elicited clearer emotional perception, whereas incongruent pairings increased ambiguity. Text arousal modulated these effects: high-arousal positive texts attenuated the negative texts were more susceptible to reinterpretation via emoji cues. Neuroimaging analyses demonstrated that incongruent stimuli elicited heightened activation in regions implicated in semantic conflict and emotional integration, including the anterior insula, lateral orbitofrontal cortex, supplementary motor area, and caudate. High arousal texts additionally engaged the temporal pole, inferior temporal gyrus, and medial frontal cortex, reflecting increased attentional and affective processing. These findings provide converging behavioral and neural evidence for the dynamic interaction between valence and arousal in multimodal emotional communication, highlighting the brain’s sensitivity to emotional congruency and intensity in naturalistic computer-mediated interactions.參考文獻 李仁豪, & 鍾芯瑜. (2020). 中文版簡式 [五大人格量表] BFI 的發展. 測驗學刊 , 67 (4), 271-299. Aldunate, N., Villena-Gonzalez, M., Rojas-Thomas, F., Lopez, V., & Bosman, C. A. (2018). Mood Detection in Ambiguous Messages: The Interaction Between Text and Emoticons. Front Psychol, 9, 423. https://doi.org/10.3389/fpsyg.2018.00423 Bai, Q., Dan, Q., Mu, Z., & Yang, M. (2019). A systematic review of emoji: Current research and future perspectives. Frontiers in psychology, 10, 2221. Barrett, L. F. (2006). Are emotions natural kinds? Perspectives on psychological science, 1(1), 28-58. Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological review, 108(3), 624. Boutet, I., LeBlanc, M., Chamberland, J. A., & Collin, C. A. (2021). Emojis influence emotional communication, social attributions, and information processing. Computers in Human Behavior, 119. https://doi.org/10.1016/j.chb.2021.106722 Bradley, M. M., Codispoti, M., Sabatinelli, D., & Lang, P. J. (2001). Emotion and motivation II: sex differences in picture processing. Emotion, 1(3), 300. Bradley, M. M., & Lang, P. J. (1999). Affective norms for English words (ANEW): Instruction manual and affective ratings. Burrell, A., & Beard, R. (2023). Investigating playful punctuation in children’s narrative and persuasive writing. The Australian Journal of Language and Literacy, 46(2), 161-182. Chatzichristos, C., Morante, M., Andreadis, N., Kofidis, E., Kopsinis, Y., & Theodoridis, S. (2020). Emojis influence autobiographical memory retrieval from reading words: An fMRI-based study. PLoS One, 15(7), e0234104. https://doi.org/10.1371/journal.pone.0234104 Citron, F. M. (2012). Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies. Brain and Language, 122(3), 211-226. Cox, R. W. (1996). AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical research, 29(3), 162-173. Craig, A. D. (2009). How do you feel—now? The anterior insula and human awareness. Nature reviews neuroscience, 10(1), 59-70. Critchley, H. D., Wiens, S., Rotshtein, P., Öhman, A., & Dolan, R. J. (2004). Neural systems supporting interoceptive awareness. Nature neuroscience, 7(2), 189-195. Daniel, T. A., & Camp, A. L. (2020). Emojis affect processing fluency on social media. Psychology of Popular Media, 9(2), 208. Derks, D., Bos, A. E. R., & von Grumbkow, J. (2007). Emoticons and Online Message Interpretation. Social Science Computer Review, 26(3), 379-388. https://doi.org/10.1177/0894439307311611 Ekman, P. (1992). Facial expressions of emotion: New findings, new questions. In: SAGE Publications Sage CA: Los Angeles, CA. Etkin, A., Egner, T., & Kalisch, R. (2011). Emotional processing in anterior cingulate and medial prefrontal cortex. Trends in cognitive sciences, 15(2), 85-93. Ferré, P., Haro, J., Pérez-Sánchez, M. Á., Moreno, I., & Hinojosa, J. A. (2023). Emoji-SP, the Spanish emoji database: Visual complexity, familiarity, frequency of use, clarity, and emotional valence and arousal norms for 1031 emojis. Behavior Research Methods, 55(4), 1715-1733. Filik, R., Ţurcan, A., Ralph-Nearman, C., & Pitiot, A. (2019). What is the difference between irony and sarcasm? An fMRI study. cortex, 115, 112-122. Frith, C. D., & Frith, U. (2006). The neural basis of mentalizing. Neuron, 50(4), 531-534. Ganster, T., Eimler, S. C., & Krämer, N. C. (2012). Same same but different!? The differential influence of smilies and emoticons on person perception. Cyberpsychology, Behavior, and Social Networking, 15(4), 226-230. Grahn, J. A., Parkinson, J. A., & Owen, A. M. (2008). The cognitive functions of the caudate nucleus. Progress in neurobiology, 86(3), 141-155. Hinojosa, J. A., Mercado, F., Albert, J., Barjola, P., Peláez, I., Villalba-García, C., & Carretié, L. (2015). Neural correlates of an early attentional capture by positive distractor words. Frontiers in psychology, 6, 24. Jaeger, S. R., Roigard, C. M., Jin, D., Vidal, L., & Ares, G. (2019). Valence, arousal and sentiment meanings of 33 facial emoji: Insights for the use of emoji in consumer research. Food Research International, 119, 895-907. Janssen, J. H., Ijsselsteijn, W. A., & Westerink, J. H. (2014). How affective technologies can influence intimate interactions and improve social connectedness. International Journal of Human-Computer Studies, 72(1), 33-43. John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The big five inventory—versions 4a and 54. In: Berkeley, CA: University of California, Berkeley, Institute of Personality …. John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues. Kanske, P., & Kotz, S. A. (2011). Emotion speeds up conflict resolution: a new role for the ventral anterior cingulate cortex? Cerebral cortex, 21(4), 911-919. Kaye, L. K., Rodriguez-Cuadrado, S., Jones, B. R., Malone, S. A., & Wall, H. J. (2020). Do emoji enhance emotional processing of written language? Kensinger, E. A., & Corkin, S. (2004). Two routes to emotional memory: Distinct neural processes for valence and arousal. Proceedings of the National Academy of Sciences, 101(9), 3310-3315. Kralj Novak, P., Smailović, J., Sluban, B., & Mozetič, I. (2015). Sentiment of emojis. PloS one, 10(12), e0144296. Kringelbach, M. L., & Rolls, E. T. (2004). The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Progress in neurobiology, 72(5), 341-372. Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30(3), 261-273. Lee, L.-H., Li, J.-H., & Yu, L.-C. (2022). Chinese EmoBank: Building valence-arousal resources for dimensional sentiment analysis. Transactions on Asian and Low-Resource Language Information Processing, 21(4), 1-18. Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012). The brain basis of emotion: a meta-analytic review. Behavioral and brain sciences, 35(3), 121-143. Lithari, C., Frantzidis, C., Papadelis, C., Vivas, A. B., Klados, M., Kourtidou-Papadeli, C., Pappas, C., Ioannides, A., & Bamidis, P. (2010). Are females more responsive to emotional stimuli? A neurophysiological study across arousal and valence dimensions. Brain topography, 23(1), 27-40. Lo, S. K. (2008). The nonverbal communication functions of emoticons in computer-mediated communication. Cyberpsychol Behav, 11(5), 595-597. https://doi.org/10.1089/cpb.2007.0132 Lundqvist, L.-O., & Dimberg, U. (1995). Facial expressions are contagious. Journal of psychophysiology, 9, 203-203. Manganari, E. E. (2021). Emoji Use in Computer-Mediated Communication. The International Technology Management Review, 10(1). https://doi.org/10.2991/itmr.k.210105.001 Mar, R. A., Oatley, K., Djikic, M., & Mullin, J. (2011). Emotion and narrative fiction: Interactive influences before, during, and after reading. Cognition & Emotion, 25(5), 818-833. Menon, V., & Uddin, L. Q. (2010). Saliency, switching, attention and control: a network model of insula function. Brain structure and function, 214, 655-667. Miller, H., Thebault-Spieker, J., Chang, S., Johnson, I., Terveen, L., & Hecht, B. (2016). “Blissfully happy” or “ready tofight”: Varying interpretations of emoji. Proceedings of the international AAAI conference on web and social media, Nachev, P., Kennard, C., & Husain, M. (2008). Functional role of the supplementary and pre-supplementary motor areas. Nature reviews neuroscience, 9(11), 856-869. Ochsner, K. N., Hughes, B., Robertson, E. R., Cooper, J. C., & Gabrieli, J. D. (2009). Neural systems supporting the control of affective and cognitive conflicts. Journal of cognitive neuroscience, 21(9), 1841-1854. Olson, I. R., Plotzker, A., & Ezzyat, Y. (2007). The enigmatic temporal pole: a review of findings on social and emotional processing. Brain, 130(7), 1718-1731. Park, T. W., Kim, S.-J., & Lee, G. (2014). A study of emoticon use in instant messaging from smartphone. International Conference on Human-Computer Interaction, Pfeifer, V. A., Armstrong, E. L., & Lai, V. T. (2022). Do all facial emojis communicate emotion? The impact of facial emojis on perceived sender emotion and text processing. Computers in Human Behavior, 126. https://doi.org/10.1016/j.chb.2021.107016 Picard, N., & Strick, P. L. (2001). Imaging the premotor areas. Current opinion in neurobiology, 11(6), 663-672. Prada, M., Rodrigues, D. L., Garrido, M. V., Lopes, D., Cavalheiro, B., & Gaspar, R. (2018). Motives, frequency and attitudes toward emoji and emoticon use. Telematics and Informatics, 35(7), 1925-1934. https://doi.org/10.1016/j.tele.2018.06.005 Recio, G., Conrad, M., Hansen, L. B., & Jacobs, A. M. (2014). On pleasure and thrill: The interplay between arousal and valence during visual word recognition. Brain and Language, 134, 34-43. Robus, C. M., Hand, C. J., Filik, R., & Pitchford, M. (2020). Investigating effects of emoji on neutral narrative text: Evidence from eye movements and perceived emotional valence. Computers in Human Behavior, 109. https://doi.org/10.1016/j.chb.2020.106361 Rodrigues, D., Prada, M., Gaspar, R., Garrido, M. V., & Lopes, D. (2018). Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions. Behav Res Methods, 50(1), 392-405. https://doi.org/10.3758/s13428-017-0878-6 Rolls, E. T. (2004). The functions of the orbitofrontal cortex. Brain and cognition, 55(1), 11-29. Rozin, P., & Royzman, E. B. (2001). Negativity bias, negativity dominance, and contagion. Personality and social psychology review, 5(4), 296-320. Russell, J. A. (1980). A circumplex model of affect. Journal of personality and social psychology, 39(6), 1161. Sander, D., Grafman, J., & Zalla, T. (2003). The human amygdala: an evolved system for relevance detection. Reviews in the Neurosciences, 14(4), 303-316. Scheffler, T., & Nenchev, I. (2024). Affective, semantic, frequency, and descriptive norms for 107 face emojis. Behavior Research Methods, 56(8), 8159-8180. Scherr, S. A., Polst, S., Müller, L., Holl, K., & Elberzhager, F. (2019). The Perception of Emojis for Analyzing App Feedback. International Journal of Interactive Mobile Technologies (iJIM), 13(02). https://doi.org/10.3991/ijim.v13i02.8492 Schmahmann, J. D. (2019). The cerebellum and cognition. Neuroscience letters, 688, 62-75. Seeley, W. W., Menon, V., Schatzberg, A. F., Keller, J., Glover, G. H., Kenna, H., Reiss, A. L., & Greicius, M. D. (2007). Dissociable intrinsic connectivity networks for salience processing and executive control. Journal of neuroscience, 27(9), 2349-2356. Tang, Y., & Hew, K. F. (2019). Emoticon, emoji, and sticker use in computer-mediated communication: A review of theories and research findings. International Journal of Communication, 13, 27. Tso, R. V.-y., & To, M. W.-h. (2020b). Ambiguity in Text Messages:“I Hate You for Using Emojis Inconsistently With Your Text in WhatsApp”. Proceedings of the Annual Meeting of the Cognitive Science Society, Van Rijn, S., Aleman, A., Van Diessen, E., Berckmoes, C., Vingerhoets, G., & Kahn, R. S. (2005). What is said or how it is said makes a difference: role of the right fronto‐parietal operculum in emotional prosody as revealed by repetitive TMS. European Journal of Neuroscience, 21(11), 3195-3200. Walther, J. B., & D’addario, K. P. (2001). The impacts of emoticons on message interpretation in computer-mediated communication. Social Science Computer Review, 19(3), 324-347. Warriner, A. B., Kuperman, V., & Brysbaert, M. (2013). Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior Research Methods, 45, 1191-1207. Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of personality and social psychology, 54(6), 1063. Weissman, B., & Tanner, D. (2018). A strong wink between verbal and emoji-based irony: How the brain processes ironic emojis during language comprehension. PLoS One, 13(8), e0201727. Yang, J., Yang, Y., Xiu, L., & Yu, G. (2021). Effect of emoji prime on the understanding of emotional words – evidence from ERPs. Behaviour & Information Technology, 1-10. https://doi.org/10.1080/0144929x.2021.1874050 Yuasa, M., Saito, K., & Mukawa, N. (2011). Brain activity when reading sentences and emoticons: an fMRI study of verbal and nonverbal communication. Electronics and Communications in Japan, 94(5), 17-24. https://doi.org/10.1002/ecj.10311 描述 碩士
國立政治大學
心理學系
108752010資料來源 http://thesis.lib.nccu.edu.tw/record/#G0108752010 資料類型 thesis dc.contributor.advisor 張葶葶<br>黃淑麗 zh_TW dc.contributor.advisor Chang, Ting-Ting<br>Huang, Shwu-Lih en_US dc.contributor.author (Authors) 楊詠晴 zh_TW dc.contributor.author (Authors) Yang, Yung-Ching en_US dc.creator (作者) 楊詠晴 zh_TW dc.creator (作者) Yang, Yung-Ching en_US dc.date (日期) 2025 en_US dc.date.accessioned 1-Sep-2025 16:12:40 (UTC+8) - dc.date.available 1-Sep-2025 16:12:40 (UTC+8) - dc.date.issued (上傳時間) 1-Sep-2025 16:12:40 (UTC+8) - dc.identifier (Other Identifiers) G0108752010 en_US dc.identifier.uri (URI) https://nccur.lib.nccu.edu.tw/handle/140.119/159271 - dc.description (描述) 碩士 zh_TW dc.description (描述) 國立政治大學 zh_TW dc.description (描述) 心理學系 zh_TW dc.description (描述) 108752010 zh_TW dc.description.abstract (摘要) 表情符號已在數位溝通中被廣泛使用，能夠強化文字訊息的情緒表達。過去研究指出，當表情符號與文字的情緒效價一致時，有助於情緒理解；相反的，效價不一致的組合則可能使情緒判斷變得困難。然而，有關此類互動背後的神經機制，以及文字喚起度的調節作用，仍未被充分討論。本研究運用具生態效度且經過預先驗證的訊息材料，模擬日常聊天情境，並系統性操弄文字效價、文字喚起度與表情符號效價。三十三位參與者於功能性磁振造影掃描期間，依據2（文字效價）x 2（文字喚起度）x 2（表情符號效價）的重複量數設計，評估訊息發送者的情緒狀態。行為資料結果顯示，文字與表情符號一致的組合能引發更一致的情緒知覺，而不一致的組合則導致情緒知覺判斷較為模糊。文字喚起度進一步調節了這些效果：高喚起度的正向文字能減弱負向表情符號帶來的負面效果，而低喚起度的負向文字則更容易受到表情符號的詮釋影響。神經影像分析結果顯示，不一致刺激引發了語意衝突與情感整合相關腦區的顯著活化，包括前腦島、外側眶額葉皮質、輔助運動區及尾狀核。此外，高喚起文字亦涉及顳極、下顳回與內側額葉皮質，反映了注意力分配與情感處理的增強。綜合行為與神經層面的結果，本研究提供了一致證據，支持情緒效價與喚起度在多模態情感溝通中的動態交互作用，並凸顯大腦在自然情境下的電腦中介溝通中，對情感一致性與強度的敏感性。 zh_TW dc.description.abstract (摘要) Emojis have become pervasive in digital communication, enhancing emotional expression in text-based messages. Prior research has demonstrated that text-emoji congruency facilitates emotional interpretation, whereas incongruent pairings introduce ambiguity. However, the neural mechanisms underlying these interactions and the modulation of text arousal remain unclear. The present study addressed these gaps by employing ecologically valid, pre-validated message stimuli resembling everyday chat, systematically varying text valence, text arousal, and emoji valence. Thirty-three participants evaluated the sender’s emotional state while undergoing fMRI scanning in a 2 (text valence) x 2 (text arousal) x 2 (emoji valence) repeated-measures design. Behavioral results revealed that emotionally congruent text-emoji pairings elicited clearer emotional perception, whereas incongruent pairings increased ambiguity. Text arousal modulated these effects: high-arousal positive texts attenuated the negative texts were more susceptible to reinterpretation via emoji cues. Neuroimaging analyses demonstrated that incongruent stimuli elicited heightened activation in regions implicated in semantic conflict and emotional integration, including the anterior insula, lateral orbitofrontal cortex, supplementary motor area, and caudate. High arousal texts additionally engaged the temporal pole, inferior temporal gyrus, and medial frontal cortex, reflecting increased attentional and affective processing. These findings provide converging behavioral and neural evidence for the dynamic interaction between valence and arousal in multimodal emotional communication, highlighting the brain’s sensitivity to emotional congruency and intensity in naturalistic computer-mediated interactions. en_US dc.description.tableofcontents Abstract i Content iii List of Tables vi List of Figures vii Chapter 1 Background and Introduction 1 Chapter 2 Literature Review 2 2.1 Emojis 2 2.2 Emoji Use in Computer-Mediated Communication (CMC) 3 2.3 Emotional Perception of Emojis 4 2.4 Emotional Perception of Text 4 2.5 Interaction between Emojis and Text 6 2.5.1 Effects of Congruent Text-Emoji Valence 6 2.5.2 Effects of Incongruent Text-Emoji Valence 7 2.5.3 Electrophysiological Evidence for Incongruent Processing 7 2.5.4 Negativity Bias in Incongruent Combination 8 2.6 Neural Aspects 9 2.6.1 Neuroimaging Studies on Emoji-Text Processing 9 2.6.2 Arousal Effects in the Brain 11 2.7 Rationale 13 2.8 Aim and Hypotheses 15 Chapter 3 Methods 17 3.1 Participants 17 3.2 Materials 17 3.2.1 Text Pretest 18 3.2.2 Emoji Pretest 21 3.3 Experimental Design and Procedure 25 3.3.1 Stimulus Presentation Sequence 26 3.3.2 Trial Structure 26 3.4 fMRI data acquisition 27 3.5 fMRI data preprocessing 28 3.6 fMRI analysis 29 Chapter 4 Results 30 4.1 Behavioral Results 30 4.1.1 Descriptive Statistics 30 4.1.2 Repeated-measures ANOVA 32 4.2 Neuroimaging Results 36 4.2.1 Neural Correlates of Text-Emoji Congruence and Incongruence 36 4.2.2 Main Effect of Text Valence 39 4.2.3 Main Effect of Emoji Valence 41 4.2.4 Main Effect of Text Arousal 43 Chapter 5 Discussion 45 5.1 General Discussion 45 5.2 Interpretation of Results 47 5.2.1 Influence of Emoji Congruency on Perceived Emotion 47 5.2.2 Modulatory Role of Text Arousal 49 5.2.3 Neural Correlates of Emotional Incongruency Processing 52 5.2.4 Neural Correlates of Basic Affective Dimensions 55 5.2.5 Behavioral-Neural Integration 57 5.2.6 Emoji Pretest Findings on Valence and Arousal 58 5.3 Strengths 60 5.4 Limitations 61 5.5 Summary and Implications 64 Reference 66 Appendix 75 zh_TW dc.format.extent 12133794 bytes - dc.format.mimetype application/pdf - dc.source.uri (資料來源) http://thesis.lib.nccu.edu.tw/record/#G0108752010 en_US dc.subject (關鍵詞) 表情符號 zh_TW dc.subject (關鍵詞) 情緒知覺 zh_TW dc.subject (關鍵詞) 情緒效價一致性 zh_TW dc.subject (關鍵詞) 喚起度 zh_TW dc.subject (關鍵詞) 功能性磁振造影 zh_TW dc.subject (關鍵詞) 電腦中介溝通 zh_TW dc.subject (關鍵詞) emoji en_US dc.subject (關鍵詞) emotional perception en_US dc.subject (關鍵詞) valence congruency en_US dc.subject (關鍵詞) arousal en_US dc.subject (關鍵詞) fMRI en_US dc.subject (關鍵詞) computer-mediated communication en_US dc.title (題名) 表情符號與文字的情緒知覺交互作用 zh_TW dc.title (題名) The Interaction on the Emotional Perception between Emojis and Texts en_US dc.type (資料類型) thesis en_US dc.relation.reference (參考文獻) 李仁豪, & 鍾芯瑜. (2020). 中文版簡式 [五大人格量表] BFI 的發展. 測驗學刊 , 67 (4), 271-299. Aldunate, N., Villena-Gonzalez, M., Rojas-Thomas, F., Lopez, V., & Bosman, C. A. (2018). Mood Detection in Ambiguous Messages: The Interaction Between Text and Emoticons. Front Psychol, 9, 423. https://doi.org/10.3389/fpsyg.2018.00423 Bai, Q., Dan, Q., Mu, Z., & Yang, M. (2019). A systematic review of emoji: Current research and future perspectives. Frontiers in psychology, 10, 2221. Barrett, L. F. (2006). Are emotions natural kinds? Perspectives on psychological science, 1(1), 28-58. Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological review, 108(3), 624. Boutet, I., LeBlanc, M., Chamberland, J. A., & Collin, C. A. (2021). Emojis influence emotional communication, social attributions, and information processing. Computers in Human Behavior, 119. https://doi.org/10.1016/j.chb.2021.106722 Bradley, M. M., Codispoti, M., Sabatinelli, D., & Lang, P. J. (2001). Emotion and motivation II: sex differences in picture processing. Emotion, 1(3), 300. Bradley, M. M., & Lang, P. J. (1999). Affective norms for English words (ANEW): Instruction manual and affective ratings. Burrell, A., & Beard, R. (2023). Investigating playful punctuation in children’s narrative and persuasive writing. The Australian Journal of Language and Literacy, 46(2), 161-182. Chatzichristos, C., Morante, M., Andreadis, N., Kofidis, E., Kopsinis, Y., & Theodoridis, S. (2020). Emojis influence autobiographical memory retrieval from reading words: An fMRI-based study. PLoS One, 15(7), e0234104. https://doi.org/10.1371/journal.pone.0234104 Citron, F. M. (2012). Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies. Brain and Language, 122(3), 211-226. Cox, R. W. (1996). AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical research, 29(3), 162-173. Craig, A. D. (2009). How do you feel—now? The anterior insula and human awareness. Nature reviews neuroscience, 10(1), 59-70. Critchley, H. D., Wiens, S., Rotshtein, P., Öhman, A., & Dolan, R. J. (2004). Neural systems supporting interoceptive awareness. Nature neuroscience, 7(2), 189-195. Daniel, T. A., & Camp, A. L. (2020). Emojis affect processing fluency on social media. Psychology of Popular Media, 9(2), 208. Derks, D., Bos, A. E. R., & von Grumbkow, J. (2007). Emoticons and Online Message Interpretation. Social Science Computer Review, 26(3), 379-388. https://doi.org/10.1177/0894439307311611 Ekman, P. (1992). Facial expressions of emotion: New findings, new questions. In: SAGE Publications Sage CA: Los Angeles, CA. Etkin, A., Egner, T., & Kalisch, R. (2011). Emotional processing in anterior cingulate and medial prefrontal cortex. Trends in cognitive sciences, 15(2), 85-93. Ferré, P., Haro, J., Pérez-Sánchez, M. Á., Moreno, I., & Hinojosa, J. A. (2023). Emoji-SP, the Spanish emoji database: Visual complexity, familiarity, frequency of use, clarity, and emotional valence and arousal norms for 1031 emojis. Behavior Research Methods, 55(4), 1715-1733. Filik, R., Ţurcan, A., Ralph-Nearman, C., & Pitiot, A. (2019). What is the difference between irony and sarcasm? An fMRI study. cortex, 115, 112-122. Frith, C. D., & Frith, U. (2006). The neural basis of mentalizing. Neuron, 50(4), 531-534. Ganster, T., Eimler, S. C., & Krämer, N. C. (2012). Same same but different!? The differential influence of smilies and emoticons on person perception. Cyberpsychology, Behavior, and Social Networking, 15(4), 226-230. Grahn, J. A., Parkinson, J. A., & Owen, A. M. (2008). The cognitive functions of the caudate nucleus. Progress in neurobiology, 86(3), 141-155. Hinojosa, J. A., Mercado, F., Albert, J., Barjola, P., Peláez, I., Villalba-García, C., & Carretié, L. (2015). Neural correlates of an early attentional capture by positive distractor words. Frontiers in psychology, 6, 24. Jaeger, S. R., Roigard, C. M., Jin, D., Vidal, L., & Ares, G. (2019). Valence, arousal and sentiment meanings of 33 facial emoji: Insights for the use of emoji in consumer research. Food Research International, 119, 895-907. Janssen, J. H., Ijsselsteijn, W. A., & Westerink, J. H. (2014). How affective technologies can influence intimate interactions and improve social connectedness. International Journal of Human-Computer Studies, 72(1), 33-43. John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The big five inventory—versions 4a and 54. In: Berkeley, CA: University of California, Berkeley, Institute of Personality …. John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues. Kanske, P., & Kotz, S. A. (2011). Emotion speeds up conflict resolution: a new role for the ventral anterior cingulate cortex? Cerebral cortex, 21(4), 911-919. Kaye, L. K., Rodriguez-Cuadrado, S., Jones, B. R., Malone, S. A., & Wall, H. J. (2020). Do emoji enhance emotional processing of written language? Kensinger, E. A., & Corkin, S. (2004). Two routes to emotional memory: Distinct neural processes for valence and arousal. Proceedings of the National Academy of Sciences, 101(9), 3310-3315. Kralj Novak, P., Smailović, J., Sluban, B., & Mozetič, I. (2015). Sentiment of emojis. PloS one, 10(12), e0144296. Kringelbach, M. L., & Rolls, E. T. (2004). The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Progress in neurobiology, 72(5), 341-372. Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30(3), 261-273. Lee, L.-H., Li, J.-H., & Yu, L.-C. (2022). Chinese EmoBank: Building valence-arousal resources for dimensional sentiment analysis. Transactions on Asian and Low-Resource Language Information Processing, 21(4), 1-18. Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012). The brain basis of emotion: a meta-analytic review. Behavioral and brain sciences, 35(3), 121-143. Lithari, C., Frantzidis, C., Papadelis, C., Vivas, A. B., Klados, M., Kourtidou-Papadeli, C., Pappas, C., Ioannides, A., & Bamidis, P. (2010). Are females more responsive to emotional stimuli? A neurophysiological study across arousal and valence dimensions. Brain topography, 23(1), 27-40. Lo, S. K. (2008). The nonverbal communication functions of emoticons in computer-mediated communication. Cyberpsychol Behav, 11(5), 595-597. https://doi.org/10.1089/cpb.2007.0132 Lundqvist, L.-O., & Dimberg, U. (1995). Facial expressions are contagious. Journal of psychophysiology, 9, 203-203. Manganari, E. E. (2021). Emoji Use in Computer-Mediated Communication. The International Technology Management Review, 10(1). https://doi.org/10.2991/itmr.k.210105.001 Mar, R. A., Oatley, K., Djikic, M., & Mullin, J. (2011). Emotion and narrative fiction: Interactive influences before, during, and after reading. Cognition & Emotion, 25(5), 818-833. Menon, V., & Uddin, L. Q. (2010). Saliency, switching, attention and control: a network model of insula function. Brain structure and function, 214, 655-667. Miller, H., Thebault-Spieker, J., Chang, S., Johnson, I., Terveen, L., & Hecht, B. (2016). “Blissfully happy” or “ready tofight”: Varying interpretations of emoji. Proceedings of the international AAAI conference on web and social media, Nachev, P., Kennard, C., & Husain, M. (2008). Functional role of the supplementary and pre-supplementary motor areas. Nature reviews neuroscience, 9(11), 856-869. Ochsner, K. N., Hughes, B., Robertson, E. R., Cooper, J. C., & Gabrieli, J. D. (2009). Neural systems supporting the control of affective and cognitive conflicts. Journal of cognitive neuroscience, 21(9), 1841-1854. Olson, I. R., Plotzker, A., & Ezzyat, Y. (2007). The enigmatic temporal pole: a review of findings on social and emotional processing. Brain, 130(7), 1718-1731. Park, T. W., Kim, S.-J., & Lee, G. (2014). A study of emoticon use in instant messaging from smartphone. International Conference on Human-Computer Interaction, Pfeifer, V. A., Armstrong, E. L., & Lai, V. T. (2022). Do all facial emojis communicate emotion? The impact of facial emojis on perceived sender emotion and text processing. Computers in Human Behavior, 126. https://doi.org/10.1016/j.chb.2021.107016 Picard, N., & Strick, P. L. (2001). Imaging the premotor areas. Current opinion in neurobiology, 11(6), 663-672. Prada, M., Rodrigues, D. L., Garrido, M. V., Lopes, D., Cavalheiro, B., & Gaspar, R. (2018). Motives, frequency and attitudes toward emoji and emoticon use. Telematics and Informatics, 35(7), 1925-1934. https://doi.org/10.1016/j.tele.2018.06.005 Recio, G., Conrad, M., Hansen, L. B., & Jacobs, A. M. (2014). On pleasure and thrill: The interplay between arousal and valence during visual word recognition. Brain and Language, 134, 34-43. Robus, C. M., Hand, C. J., Filik, R., & Pitchford, M. (2020). Investigating effects of emoji on neutral narrative text: Evidence from eye movements and perceived emotional valence. Computers in Human Behavior, 109. https://doi.org/10.1016/j.chb.2020.106361 Rodrigues, D., Prada, M., Gaspar, R., Garrido, M. V., & Lopes, D. (2018). Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions. Behav Res Methods, 50(1), 392-405. https://doi.org/10.3758/s13428-017-0878-6 Rolls, E. T. (2004). The functions of the orbitofrontal cortex. Brain and cognition, 55(1), 11-29. Rozin, P., & Royzman, E. B. (2001). Negativity bias, negativity dominance, and contagion. Personality and social psychology review, 5(4), 296-320. Russell, J. A. (1980). A circumplex model of affect. Journal of personality and social psychology, 39(6), 1161. Sander, D., Grafman, J., & Zalla, T. (2003). The human amygdala: an evolved system for relevance detection. Reviews in the Neurosciences, 14(4), 303-316. Scheffler, T., & Nenchev, I. (2024). Affective, semantic, frequency, and descriptive norms for 107 face emojis. Behavior Research Methods, 56(8), 8159-8180. Scherr, S. A., Polst, S., Müller, L., Holl, K., & Elberzhager, F. (2019). The Perception of Emojis for Analyzing App Feedback. International Journal of Interactive Mobile Technologies (iJIM), 13(02). https://doi.org/10.3991/ijim.v13i02.8492 Schmahmann, J. D. (2019). The cerebellum and cognition. Neuroscience letters, 688, 62-75. Seeley, W. W., Menon, V., Schatzberg, A. F., Keller, J., Glover, G. H., Kenna, H., Reiss, A. L., & Greicius, M. D. (2007). Dissociable intrinsic connectivity networks for salience processing and executive control. Journal of neuroscience, 27(9), 2349-2356. Tang, Y., & Hew, K. F. (2019). Emoticon, emoji, and sticker use in computer-mediated communication: A review of theories and research findings. International Journal of Communication, 13, 27. Tso, R. V.-y., & To, M. W.-h. (2020b). Ambiguity in Text Messages:“I Hate You for Using Emojis Inconsistently With Your Text in WhatsApp”. Proceedings of the Annual Meeting of the Cognitive Science Society, Van Rijn, S., Aleman, A., Van Diessen, E., Berckmoes, C., Vingerhoets, G., & Kahn, R. S. (2005). What is said or how it is said makes a difference: role of the right fronto‐parietal operculum in emotional prosody as revealed by repetitive TMS. European Journal of Neuroscience, 21(11), 3195-3200. Walther, J. B., & D’addario, K. P. (2001). The impacts of emoticons on message interpretation in computer-mediated communication. Social Science Computer Review, 19(3), 324-347. Warriner, A. B., Kuperman, V., & Brysbaert, M. (2013). Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior Research Methods, 45, 1191-1207. Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of personality and social psychology, 54(6), 1063. Weissman, B., & Tanner, D. (2018). A strong wink between verbal and emoji-based irony: How the brain processes ironic emojis during language comprehension. PLoS One, 13(8), e0201727. Yang, J., Yang, Y., Xiu, L., & Yu, G. (2021). Effect of emoji prime on the understanding of emotional words – evidence from ERPs. Behaviour & Information Technology, 1-10. https://doi.org/10.1080/0144929x.2021.1874050 Yuasa, M., Saito, K., & Mukawa, N. (2011). Brain activity when reading sentences and emoticons: an fMRI study of verbal and nonverbal communication. Electronics and Communications in Japan, 94(5), 17-24. https://doi.org/10.1002/ecj.10311 zh_TW
