學術產出-學位論文
文章檢視/開啟
書目匯出
-
題名 以行動裝置進行互動敘事的系統設計與評估
Design and Analysis of Interactive Systems on Mobile Devices作者 柯語欣
Ke, Yu-Sin貢獻者 李蔡彥
Li, Tsai-Yen
柯語欣
Ke, Yu-Sin關鍵詞 互動敘事
故事產生
人物動畫
行動裝置
Interactive Narrative
Story generation
Character Animation
Mobile devices日期 2023 上傳時間 9-三月-2023 18:25:27 (UTC+8) 摘要 目前以互動數位敘事為主題所呈現的系統，大多採用電腦、鍵盤或滑鼠等互動工具進行互動。而近期虛擬實境技術受到許多人的關注，開發者多採用虛擬實境裝置開發多元的互動功能。但目前虛擬實境裝置的普及性尚不高，也具有其局限性。本研究的目的在於設計一套系統，只要使用如平板的行動裝置，使用者不只可以用旁觀者的角度體驗虛擬世界，也可以在虛擬世界中與角色進行互動、干預事件及達成不同結局。我們使用行動裝置中可用的輸入介面，如觸碰面板及麥克風，在我們的互動敘事系統中開發互動功能與操作介面。我們導入非互動的故事劇情為主要的故事框架，並增加額外可觸發的角色劇情，讓使用者透過我們開發的互動功能與介面，與角色進行互動。此外，除了這些互動功能與介面，我們也設計兩種不同的體驗模式，分別是劇情模式及自由探索模式。讓使用者體驗以系統預設鏡頭與自由操作鏡頭視角兩種方式體驗故事劇情。最後，我們透過實驗的方式，取得使用者行為紀錄與使用者問卷調查，來探討本研究中的互動功能的直覺性以及角色動畫的呈現方式。得出的結論為互動功能和控制界面在我們的系統中具有直觀性，角色動畫呈現自然。整體而言，我們的系統具不錯的可用性。
In the past, developers were restricted to using computers, keyboards, and mice to exploit the ways of interaction in “Interactive Digital Storytelling” systems. Recent-ly, the technology of virtual reality is gaining much attention, so many developers use virtual reality devices to explore various potentials of interactive functions. However, these virtual reality devices are still far from universal and possess many limitations. The objective of this research is to create a system in which, by using mobile devices, users can experience virtual worlds as standing observers and inter-act with virtual characters, intervene in events, and even achieve a different ending in the virtual world. We use the input interface available on mobile devices, such as touchscreen and microphone, to develop interactive functions and controller inter-face in our Interactive Storytelling system. By importing the plot of a non-interactive story as a main plot frame, users can interact with the virtual characters via our inter-active functions and interfaces. In addition to these interactive functions and inter-faces, we have also designed two modes: the story mode, where users can only follow the perspective of the camera, and the navigation mode, where users can choose their own perspectives. Finally, we investigate the intuition of our interactive functions and the presentation of character animation in this study by using questionnaires, in an experiment. We reach a conclusion at the end that interactive functions and con-trol interfaces are intuitive for use in our system, the animations of characters are natural, and the framework of our system possesses availability and accessibility.參考文獻 [1]吳蕙盈, 打破第四道牆： 以敘事理論為基礎之個人化3D互動敘事創作系統, 碩士論文, 國立政治大學資訊科學系, 2013.[2]林毅聖, 提供多元角色體驗之虛擬拍攝片場, 碩士論文, 國立政治大學資訊科學系, 2018.[3]林謙耘, 探討虛擬實境敘事中的規範以及方法, 碩士論文, 國立政治大學資訊科學系, 2019.[4]康清鈺, 虛擬片場中錄製演員演戲之輔助系統, 碩士論文, 國立政治大學資訊科學系, 2020.[5]K. Amaya, A. Bruderlin, T. Calvert. Emotion from Motion. Proceedings of the conference on Graphics interface `96.(1996 May) Pages 222–229.[6]S.A. Aseeri, D.A. Feliz, J. Schulze. Poster: Virtual reality interaction using mobile devices. 2013 IEEE Symposium on 3D User Interfaces (3DUI).(2013 September 05).[7]R. Aylett. Narrative in Virtual Environments - Towards Emergent Narrative. AAAI Technical Report FS-99-01. (1999).[8]M. Cavazza, E. Andre’, F. Charles, D. Pizzi, T.Vogt. Emotion input for char-acter-based interactive storytelling. Proceedings of AAMAS 2009, (2009) Pages313-320.[9]M. Cavazza, F. Charles, S. J. Mead . AI-based animation for interactive story-telling. Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation. (2002. August 07-08)[10]M. Cavazza. A. Lindasy. J. Porteous, J. Read, M. Truran. Automated exten-sion of narrative planning domains with antonymic operators. Proceedings of the 2015 International Conferences on Autonomous Agents and Multiagent Systems. (2015).[11]Y.T. Chang, S.C. Chen, T.Y. Li. A Computer-aided System for Narrative Crea-tion. 2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC). (2013. April 16-19 )[12]C.H. Chen and T.Y. Li. Context-aware Camera Planning for Interactive Story-telling. 2012 Ninth International Conference on Computer Graphics, Imaging, and Visualization, (2012. July 25-27).[13]K. Chlasta, M. Fjeld, A. Kunz, K. Krejtz, K.D. Le, T.Q. Tran. VXSlate: Com-bining Head Movement and Mobile Touch for Large Virtual Display Interac-tion. 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Ab-stracts and Workshops (VRW).(2021 April 01- March 27)[14]M. Christie, Q. Galvane, I.S. Lin, T.Y. Li. Immersive Previz: VR Authoring for Film Previsualization. SIGGRAPH `18 ACM SIGGRAPH 2018 Studio. Ar-ticle No. 4. (2018. August 12).[15]K. Dautenhahn. Storytelling in Virtual Environments. ECAI ’98 Workshop on Intelligent Virtual Environments, Brighton, UK, (1998).[16]A. Goldberg and K. Perlin. Improv: A System for Scripting Interactive Actors in Virtual Worlds. Proceedings of SIGGRAPH`95, New Orleans (USA). (1995).[17]M. Mateas. An Oz-Centric Review of Interactive Drama and Believable Agents. Technical Report CMU-CS- 97-1 56, Department of Computer Sci-ence, Carnegie Mellon University, Pittsburgh. The USA. (1997).[18]R. Nakatsu and N. Tosa. Interactive Movies. In: B. Furht (Ed), Handbook of internet and Multimedia – Systems and applications, CRC Press and IEEE Press. (1999).[19]G. Papakonstantinou, N.M. Sgouros, P. Tsanakas. A Framework for Plot Con-trol in Interactive Story Systems. AAAI-96 Proceedings. (1996).[20]R.M. Young. Creating Interactive Narrative Structures: The Potential for AI Approaches. AAA1 Spring Symposium in Artificial Intelligence and Interac-tive Entertainment, AAA1 Press, (2000). 描述 碩士
國立政治大學
資訊科學系碩士在職專班
109971015資料來源 http://thesis.lib.nccu.edu.tw/record/#G0109971015 資料類型 thesis dc.contributor.advisor 李蔡彥 zh_TW dc.contributor.advisor Li, Tsai-Yen en_US dc.contributor.author (作者) 柯語欣 zh_TW dc.contributor.author (作者) Ke, Yu-Sin en_US dc.creator (作者) 柯語欣 zh_TW dc.creator (作者) Ke, Yu-Sin en_US dc.date (日期) 2023 en_US dc.date.accessioned 9-三月-2023 18:25:27 (UTC+8) - dc.date.available 9-三月-2023 18:25:27 (UTC+8) - dc.date.issued (上傳時間) 9-三月-2023 18:25:27 (UTC+8) - dc.identifier (其他 識別碼) G0109971015 en_US dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/143782 - dc.description (描述) 碩士 zh_TW dc.description (描述) 國立政治大學 zh_TW dc.description (描述) 資訊科學系碩士在職專班 zh_TW dc.description (描述) 109971015 zh_TW dc.description.abstract (摘要) 目前以互動數位敘事為主題所呈現的系統，大多採用電腦、鍵盤或滑鼠等互動工具進行互動。而近期虛擬實境技術受到許多人的關注，開發者多採用虛擬實境裝置開發多元的互動功能。但目前虛擬實境裝置的普及性尚不高，也具有其局限性。本研究的目的在於設計一套系統，只要使用如平板的行動裝置，使用者不只可以用旁觀者的角度體驗虛擬世界，也可以在虛擬世界中與角色進行互動、干預事件及達成不同結局。我們使用行動裝置中可用的輸入介面，如觸碰面板及麥克風，在我們的互動敘事系統中開發互動功能與操作介面。我們導入非互動的故事劇情為主要的故事框架，並增加額外可觸發的角色劇情，讓使用者透過我們開發的互動功能與介面，與角色進行互動。此外，除了這些互動功能與介面，我們也設計兩種不同的體驗模式，分別是劇情模式及自由探索模式。讓使用者體驗以系統預設鏡頭與自由操作鏡頭視角兩種方式體驗故事劇情。最後，我們透過實驗的方式，取得使用者行為紀錄與使用者問卷調查，來探討本研究中的互動功能的直覺性以及角色動畫的呈現方式。得出的結論為互動功能和控制界面在我們的系統中具有直觀性，角色動畫呈現自然。整體而言，我們的系統具不錯的可用性。 zh_TW dc.description.abstract (摘要) In the past, developers were restricted to using computers, keyboards, and mice to exploit the ways of interaction in “Interactive Digital Storytelling” systems. Recent-ly, the technology of virtual reality is gaining much attention, so many developers use virtual reality devices to explore various potentials of interactive functions. However, these virtual reality devices are still far from universal and possess many limitations. The objective of this research is to create a system in which, by using mobile devices, users can experience virtual worlds as standing observers and inter-act with virtual characters, intervene in events, and even achieve a different ending in the virtual world. We use the input interface available on mobile devices, such as touchscreen and microphone, to develop interactive functions and controller inter-face in our Interactive Storytelling system. By importing the plot of a non-interactive story as a main plot frame, users can interact with the virtual characters via our inter-active functions and interfaces. In addition to these interactive functions and inter-faces, we have also designed two modes: the story mode, where users can only follow the perspective of the camera, and the navigation mode, where users can choose their own perspectives. Finally, we investigate the intuition of our interactive functions and the presentation of character animation in this study by using questionnaires, in an experiment. We reach a conclusion at the end that interactive functions and con-trol interfaces are intuitive for use in our system, the animations of characters are natural, and the framework of our system possesses availability and accessibility. en_US dc.description.tableofcontents 摘要 iAbstract ii目 錄 iii圖目錄 vi表目錄 ix第1章 導論 11.1 研究動機 11.2 研究目標 21.3 論文貢獻 41.4 本論文之章節結構 5第2章 相關研究 62.1 虛擬實境不同視角畫面呈現 62.2 互動敘事故事架構與互動方式 72.3 調整與生成角色動畫 92.4 虛擬實境互動行為 112.5 虛擬攝影機控制 132.6 行動裝置在虛擬實境應用 14第3章 系統架構與設計 163.1 系統使用載具 173.1.1 互動敘事平台設計 173.1.2 直覺化互動 183.2 角色動畫生成 233.2.1 即時反應動畫 243.2.2 物品環境改變動畫生成 253.2.3 具情緒人物動畫 263.3 角色動畫與音頻調整 263.3.1 動畫延遲調整 263.3.2 音頻與動畫不同步 273.4 多變的劇情動畫呈現 283.4.1 各故事節點觸發動畫與體驗模式 323.4.2 不同故事歷程改變結局 423.5 輔助介面介紹 443.5.1 子畫面輔助 443.5.2 體驗模式切換按鈕 443.6 新手教學系統 45第4章 實驗設計與結果分析 514.1 實驗目標 514.2 實驗對象 514.3 實驗流程 534.3.1 書面及影片介紹 534.3.2 新手教學系統 534.3.3 系統體驗任務 544.3.4 自由體驗系統 544.3.5 問卷填寫與深度訪談 544.4 實驗結果與分析 554.4.1 使用者行為紀錄 554.4.2 問卷結果分析 564.4.3 深度訪談 61第5章 結論與未來發展 645.1 研究結論 645.2 未來發展方向 65參考文獻 66Video reference 68附錄一 實驗同意書 69附錄二 實驗流程-故事背景介紹與電影片段 70附錄三 問卷調查 71 zh_TW dc.format.extent 4765754 bytes - dc.format.mimetype application/pdf - dc.source.uri (資料來源) http://thesis.lib.nccu.edu.tw/record/#G0109971015 en_US dc.subject (關鍵詞) 互動敘事 zh_TW dc.subject (關鍵詞) 故事產生 zh_TW dc.subject (關鍵詞) 人物動畫 zh_TW dc.subject (關鍵詞) 行動裝置 zh_TW dc.subject (關鍵詞) Interactive Narrative en_US dc.subject (關鍵詞) Story generation en_US dc.subject (關鍵詞) Character Animation en_US dc.subject (關鍵詞) Mobile devices en_US dc.title (題名) 以行動裝置進行互動敘事的系統設計與評估 zh_TW dc.title (題名) Design and Analysis of Interactive Systems on Mobile Devices en_US dc.type (資料類型) thesis en_US dc.relation.reference (參考文獻) [1]吳蕙盈, 打破第四道牆： 以敘事理論為基礎之個人化3D互動敘事創作系統, 碩士論文, 國立政治大學資訊科學系, 2013.[2]林毅聖, 提供多元角色體驗之虛擬拍攝片場, 碩士論文, 國立政治大學資訊科學系, 2018.[3]林謙耘, 探討虛擬實境敘事中的規範以及方法, 碩士論文, 國立政治大學資訊科學系, 2019.[4]康清鈺, 虛擬片場中錄製演員演戲之輔助系統, 碩士論文, 國立政治大學資訊科學系, 2020.[5]K. Amaya, A. Bruderlin, T. Calvert. Emotion from Motion. Proceedings of the conference on Graphics interface `96.(1996 May) Pages 222–229.[6]S.A. Aseeri, D.A. Feliz, J. Schulze. Poster: Virtual reality interaction using mobile devices. 2013 IEEE Symposium on 3D User Interfaces (3DUI).(2013 September 05).[7]R. Aylett. Narrative in Virtual Environments - Towards Emergent Narrative. AAAI Technical Report FS-99-01. (1999).[8]M. Cavazza, E. Andre’, F. Charles, D. Pizzi, T.Vogt. Emotion input for char-acter-based interactive storytelling. Proceedings of AAMAS 2009, (2009) Pages313-320.[9]M. Cavazza, F. Charles, S. J. Mead . AI-based animation for interactive story-telling. Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation. (2002. August 07-08)[10]M. Cavazza. A. Lindasy. J. Porteous, J. Read, M. Truran. Automated exten-sion of narrative planning domains with antonymic operators. Proceedings of the 2015 International Conferences on Autonomous Agents and Multiagent Systems. (2015).[11]Y.T. Chang, S.C. Chen, T.Y. Li. A Computer-aided System for Narrative Crea-tion. 2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC). (2013. April 16-19 )[12]C.H. Chen and T.Y. Li. Context-aware Camera Planning for Interactive Story-telling. 2012 Ninth International Conference on Computer Graphics, Imaging, and Visualization, (2012. July 25-27).[13]K. Chlasta, M. Fjeld, A. Kunz, K. Krejtz, K.D. Le, T.Q. Tran. VXSlate: Com-bining Head Movement and Mobile Touch for Large Virtual Display Interac-tion. 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Ab-stracts and Workshops (VRW).(2021 April 01- March 27)[14]M. Christie, Q. Galvane, I.S. Lin, T.Y. Li. Immersive Previz: VR Authoring for Film Previsualization. SIGGRAPH `18 ACM SIGGRAPH 2018 Studio. Ar-ticle No. 4. (2018. August 12).[15]K. Dautenhahn. Storytelling in Virtual Environments. ECAI ’98 Workshop on Intelligent Virtual Environments, Brighton, UK, (1998).[16]A. Goldberg and K. Perlin. Improv: A System for Scripting Interactive Actors in Virtual Worlds. Proceedings of SIGGRAPH`95, New Orleans (USA). (1995).[17]M. Mateas. An Oz-Centric Review of Interactive Drama and Believable Agents. Technical Report CMU-CS- 97-1 56, Department of Computer Sci-ence, Carnegie Mellon University, Pittsburgh. The USA. (1997).[18]R. Nakatsu and N. Tosa. Interactive Movies. In: B. Furht (Ed), Handbook of internet and Multimedia – Systems and applications, CRC Press and IEEE Press. (1999).[19]G. Papakonstantinou, N.M. Sgouros, P. Tsanakas. A Framework for Plot Con-trol in Interactive Story Systems. AAAI-96 Proceedings. (1996).[20]R.M. Young. Creating Interactive Narrative Structures: The Potential for AI Approaches. AAA1 Spring Symposium in Artificial Intelligence and Interac-tive Entertainment, AAA1 Press, (2000). zh_TW
