1. NCCU Academic Hub
  2. Publications
  3. College of Informatics
  4. Theses
  5. Item

Publications-Theses

Article View/Open

Publication Export

Google ScholarTM

NCCU Library

Citation Infomation

Related Publications in TAIR

題名 基於領域專屬語言之數位展演可客製化開發環境之研製
Development of a Domain-Specific Language Based and Customizable Development Environment for Digital Interactive Performance
作者 林如意
Lin, Ru Yi
貢獻者 陳恭
Chen, Kung
林如意
Lin, Ru Yi
關鍵詞 數位互動展演
圖型化編輯器
終端使用者
Digital interactive performance
Visual editor
End user
日期 2017
上傳時間 28-Aug-2017 11:42:00 (UTC+8)
摘要 在過去傳統劇場展演的藝術型態，因爲欠缺互動，易形成台上的表演與台下觀眾互動不頻繁的隔閡。近年來，結合科技與藝術的數位互動展演成為一種創新的表演形態。但在開發互動展演會有技術難度，完成腳本後可能會因為缺乏彈性和擴充性，重複進行一樣的表演，或是再由專業的劇場與程式相關人員反覆修改需求。本研究為解決上述遇到的問題，研發應用在數位展演上的圖型化領域專屬語言編輯器，讓終端使用者可以藉由階段性的操作完成腳本，也可根據不同需求更新背景或角色函式庫。另外，透過實體與虛擬角色的骨架資料繫結的方式，也解決在整合虛擬與實體平台的互動中，實體裝置收到感測器資料，卻無法直接解析取得裝置名稱的問題。於系統上本研究增加使用者自主控制元件和創作腳本，使虛實互動的創作更加彈性。
In traditional performance, there is little interaction between actors and their audience. Recently, due to the advance of information and communication technology, art and culture are combined with technology mediated interaction between actors and their audience to create a new style of digital interactive performance. However, there are still many technical barriers in developing digital interactive performance. Essentially, the scripts for such performance are usually fixed, or with limited programmability. As a result, one performance will be repeated played or requires a lot of efforts to modify it. This thesis aims to address the issue of programmable scripts with a visual editor and supporting execution environment. In particular, we focus on helping performance director to develop programmable scripts that enable the flexible interaction between physical characters and their virtual counterparts. Our editing tool allows end-users to write scripts using drag-and-drop elements we developed on top of the Blockly framework. Besides detailed descriptions of the design and implantation of our tool, preliminary evaluation results are also presented.
參考文獻 [1] C.F. Liao, et al. (Liao et al, 2016), “A Functional Reactive DSL Service Facility for Mixed-Reality Interactive Performance Art”, in proceedings 9th IEEE International Conference on Service-Oriented Computing & Applications (Macau, China, 2016), pp. 24–31.
[2] NCCU DCT (2016). The Future Circus. Retrieved February 19, 2016, from http://www.dct.nccu.edu.tw/master/2016/02/19/the-future-circus/.
[3] Yi-Kai Hsiao (Hsiao, 2015), Programming Support for Cyber-Physical Interactive Performance Art.
[4] Vanessa Wang; Frank Salim and Peter Moskovits (Wang et al, 2013), The Definitive Guide to HTML5 WebSocket.
[5] C.-F. Liao, W.-C. Lu, K. Chen, Z. Grannan, W.-C. Chang, and Y.- K. Hsiao. (Liao et al, 2016), “Wise: A wearable platform for performer-guided mixed- reality interactive performance art”, in 2016 International Conference on Platform Technology and Service (PlatCon). IEEE, 2016, pp. 1-6.
[6] M. Odersky, P. Altherr, V. Cremet, B. Emir, S. Maneth, S. Micheloud, N. Mihaylov, M. Schinz, E. Stenman, and M. Zenger. (Odersky et al, 2004), “An overview of the scala programming language” (No. LAMP-REPORT-2004-006).
[7] M. Fowler (Fowler, 2010), Domain-Specific Languages, ser. Addison-Wesley Signature Series (Fowler). Pearson Education.
[8] Phidgets 1056 user guide. Retrieved December 21, 2016, from https://www.phidgets.com/docs/1056_User_Guide.
[9] MQTT.ORG. Retrieved December 21, 2016, from http://mqtt.org/.
[10] Google for Education of Blockly. Retrieved January 2, 2016, from https://developers.google.com/blockly/.
[11] D. Namiot and M. Sneps-Sneppe (Namiot et al, 2014), “On iot programming”, in International Journal of Open Information Technologies, vol. 2, no. 10, 2014.
[12] I. Fette (Fette, 2011), The websocket protocol.
[13] Eclipse Paho. Retrieved December 21, 2016, from https://eclipse.org/paho/.
[14] Live motion capture at 2014 Winter Olympic Games closing ceremony. Retrieved May 24, 2016, from https://www.xsens.com/customer-cases/live-motion-capture-2014-winter-olympic-games-closing-ceremony/.
[15] H. Huang, H.-C. Huang, C.-F. Liao, Y.-C. Li, T.-C. Tsai, L.-j. Teng, and S. W. Wang (Huang et al, 2015), “Future circus: a performer-guided mixed-reality performance art”, in Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. ACM, 2015, pp. 551–556.
[16] A. Banks and R. Gupta. (Banks et al, 2014). MQTT Version 3.1.1. OASIS.
[17] Anind K. Dey, Timothy Sohn, Sara Streng, and Justin Kodama (Anind et al, 2006), “iCAP: Interactive Prototyping of Context-Aware Applications”, in proceedings of the 4th International Conference on Pervasive Computing, PERVASIVE’06, Springer-Verlag (Berlin, Heidelberg, 2006), pp. 254–271.
[18] Lee, J., Gardun ̃o, L., Walker, E., and Burleson, W. (Lee et al, 2013), “A Tangible Programming Tool for Creation of Context-aware Applications”, in proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp ’13, ACM (New York, NY, USA, 2013), pp. 391-400.
[19] Ur, B., McManus, E., Pak Yong Ho, M., and Littman, M. L. (Ur et al, 2014), “Practical Trigger-action Programming in the Smart Home”, in proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, ACM (New York, NY, USA, 2014), pp. 803–812.
[20] Luigi De Russis, and Fulvio Corno (Russis and Corno, 2015), “HomeRules: A Tangible End-User Programming Interface for Smart Homes”, in CHI EA `15 Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2109-2114.
[21] Ting-Hao (Kenneth) Huang, Amos Azaria, Jeffrey P. Bigham (Huang et al, 2016), “InstructableCrowd: Creating IF-THEN Rules via Conversations with the Crowd”, in CHI EA `16 Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1555-1562.
[22] Sidney Viana, Jorge Rady de Almeida Junior, Judith Pavon (Viana et al, 2007), “A rule repository for active database systems”, CLEI Electronic Journal, Vol. 10.
[23] Rashidi, P., and Cook, D. J. (Rashidi and Cook, 2009), “Keeping the resident in the loop: Adapting the smart home to the user.”, IEEE Transactions on Systems, Man, and Cybernetics—Part A 39, 5, pp. 949-959.
[24] Ko, A. J., Myers, B. A., and Aung, H. (Ko et al, 2005), “Six Learning Barriers in End-User Programming Systems.”, IEEE Symp. On VLHCC, pp. 199-206.
[25] J. Wong and J. I. Hong (Wong and Hong, 2007), “Making Mashups with Marmite: Towards End-user Programming for the Web”, in proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2007, pp. 1435-1444.
[26] Martin Fowler and Rebecca Parsons. (Fowler and Parsons, 2010), “Domain-Specific Languages”, Addison-Wesley.
[27] M. Fowler, “Language workbenches: The killer-app for domain specific languages?” Available at http://martinfowler.com/articles/languageWorkbench.html, 2005.
[28] Gorillaz Live on Letterman. Retrieved May 24, 2016, from https://youtu.be/BdAXIj5QViw?t=40s.
[29] Jay Chou OPUS World Tour Concert 2013 Taipei Taiwan- Special Show for Teresa Teng (JVR Music, 2013). Retrieved May 24, 2017 from https://youtu.be/TixHYua3XCI.
[30] Michael Jackson Hologram Rocks Billboard Music Awards: Watch & Go Behind the Scenes (Billboard, 2014). Retrieved May 24, 2017 from http://www.billboard.com/articles/events/bbma-2014/6092040/michael-jackson-hologram-billboard-music-awards.
[31] Marron, A., Weiss, G., & Wiener, G. (Marron et al, 2012), “A decentralized approach for programming interactive applications with javascript and blockly”, in proceedings of the 2nd edition on Programming systems, languages and applications based on actors, agents, and decentralized control abstractions. ACM, 2012, pp. 59-70.
[32] Ashrov, A., Marron, A., Weiss, G., & Wiener, G. (Ashrov et al, 2015), “A use-case for behavioral programming: an architecture in JavaScript and Blockly for interactive applications with cross-cutting scenarios”, Science of Computer Programming, 98, pp. 268-292.
[33] Trower, J., & Gray, J. (Trower and Gray, 2015), “Creating new languages in Blockly: Two case studies in media computation and robotics”, in proceedings of the 46th ACM Technical Symposium on Computer Science Education. ACM, 2015, pp. 677-677.
[34] Trower, J., & Gray, J. (Trower and Gray, 2015), “Blockly language creation and applications: Visual programming for media computation and bluetooth robotics control”, in proceedings of the 46th ACM Technical Symposium on Computer Science Education. ACM, 2015, pp. 5-5.
[35] Grundy, J., Hosking, J., Zhu, N., & Liu, N. (Grundy et al, 2006), “Generating domain-specific visual language editors from high-level tool specifications”, In Automated Software Engineering, 2006. ASE`06. 21st IEEE/ACM International Conference. IEEE, 2006, pp. 25-36.
[36] Wienands, C., & Golm, M. (Wienands and Golm, 2009), “Anatomy of a visual domain-specific language project in an industrial context”, Model Driven Engineering Languages and Systems, 2009, pp. 453-467.
[37] Tilley, E., & Gray, J. (Tilley and Gray, 2017), “Dronely: A Visual Block Programming Language for the Control of Drones”, in proceedings of the SouthEast Conference. ACM, 2017, pp. 208-211.
描述 碩士
國立政治大學
資訊科學學系
104753014
資料來源 http://thesis.lib.nccu.edu.tw/record/#G1047530142
資料類型 thesis
dc.contributor.advisor 陳恭zh_TW
dc.contributor.advisor Chen, Kungen_US
dc.contributor.author (Authors) 林如意zh_TW
dc.contributor.author (Authors) Lin, Ru Yien_US
dc.creator (作者) 林如意zh_TW
dc.creator (作者) Lin, Ru Yien_US
dc.date (日期) 2017en_US
dc.date.accessioned 28-Aug-2017 11:42:00 (UTC+8)-
dc.date.available 28-Aug-2017 11:42:00 (UTC+8)-
dc.date.issued (上傳時間) 28-Aug-2017 11:42:00 (UTC+8)-
dc.identifier (Other Identifiers) G1047530142en_US
dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/112207-
dc.description (描述) 碩士zh_TW
dc.description (描述) 國立政治大學zh_TW
dc.description (描述) 資訊科學學系zh_TW
dc.description (描述) 104753014zh_TW
dc.description.abstract (摘要) 在過去傳統劇場展演的藝術型態，因爲欠缺互動，易形成台上的表演與台下觀眾互動不頻繁的隔閡。近年來，結合科技與藝術的數位互動展演成為一種創新的表演形態。但在開發互動展演會有技術難度，完成腳本後可能會因為缺乏彈性和擴充性，重複進行一樣的表演，或是再由專業的劇場與程式相關人員反覆修改需求。本研究為解決上述遇到的問題，研發應用在數位展演上的圖型化領域專屬語言編輯器，讓終端使用者可以藉由階段性的操作完成腳本，也可根據不同需求更新背景或角色函式庫。另外，透過實體與虛擬角色的骨架資料繫結的方式，也解決在整合虛擬與實體平台的互動中，實體裝置收到感測器資料，卻無法直接解析取得裝置名稱的問題。於系統上本研究增加使用者自主控制元件和創作腳本，使虛實互動的創作更加彈性。zh_TW
dc.description.abstract (摘要) In traditional performance, there is little interaction between actors and their audience. Recently, due to the advance of information and communication technology, art and culture are combined with technology mediated interaction between actors and their audience to create a new style of digital interactive performance. However, there are still many technical barriers in developing digital interactive performance. Essentially, the scripts for such performance are usually fixed, or with limited programmability. As a result, one performance will be repeated played or requires a lot of efforts to modify it. This thesis aims to address the issue of programmable scripts with a visual editor and supporting execution environment. In particular, we focus on helping performance director to develop programmable scripts that enable the flexible interaction between physical characters and their virtual counterparts. Our editing tool allows end-users to write scripts using drag-and-drop elements we developed on top of the Blockly framework. Besides detailed descriptions of the design and implantation of our tool, preliminary evaluation results are also presented.en_US
dc.description.tableofcontents 第1章 緒論 1
1.1 研究背景與動機 1
1.2 研究問題 2
1.3 研究貢獻 4
1.4 論文架構 5
第2章 文獻探討 6
2.1相關研究 6
2.1.1 穿戴式裝置感測器(Wearable device motion sensors) 6
2.1.2 事件－條件－動作規則(Event-Condition-Action Rule, ECA) 7
2.1.3 終端使用者編程(End-user programming) 9
2.1.4 領域專屬語言(Domain-Specific Language, DSL) 10
2.1.5 圖型化編輯器 11
2.2 技術背景 12
2.2.1穿戴式整合平台(Wearable Item Service runtime, WISE) 12
2.2.2 數位互動展演編輯器(Digital Interactive Performance Sketch Creator, DIPS Creator) 13
第3章 系統設計 16
3.1 系統架構 16
3.2 WISE Director系統架構 17
3.3 WISE Director功能規劃 19
第4章 數位互動展演編輯模組實作 23
4.1初始場景內之物件設定 23
4.2 解析模型資訊 24
4.3 Block Factory 中的訊息傳遞格式 25
4.4 Workspace 事件實作 28
4.4.1 Rules 28
4.4.2 CueQueue 29
4.5 展演外 Condition 實作 30
第5章 系統評估 33
5.1 可行性驗證 33
5.1.1 受測過程說明 33
5.1.2 受測結果分析 34
5.1.3 WISE Director改善與修正方向 36
5.2 效能評估 38
5.2.1 WISE Director負載測試 38
5.2.2 感測器的數量所產生延遲時間 39
第6章 結論 40
6.1 本研究貢獻 40
6.2 未來研究 40
參考文獻 42
附錄 47
附錄一、WISE Director 實驗回饋 47
附錄二、WISE Director 操作說明與測試 48		zh_TW
dc.format.extent 8307892 bytes-
dc.format.mimetype application/pdf-
dc.source.uri (資料來源) http://thesis.lib.nccu.edu.tw/record/#G1047530142en_US
dc.subject (關鍵詞) 數位互動展演zh_TW
dc.subject (關鍵詞) 圖型化編輯器zh_TW
dc.subject (關鍵詞) 終端使用者zh_TW
dc.subject (關鍵詞) Digital interactive performanceen_US
dc.subject (關鍵詞) Visual editoren_US
dc.subject (關鍵詞) End useren_US
dc.title (題名) 基於領域專屬語言之數位展演可客製化開發環境之研製zh_TW
dc.title (題名) Development of a Domain-Specific Language Based and Customizable Development Environment for Digital Interactive Performanceen_US
dc.type (資料類型) thesisen_US
dc.relation.reference (參考文獻) [1] C.F. Liao, et al. (Liao et al, 2016), “A Functional Reactive DSL Service Facility for Mixed-Reality Interactive Performance Art”, in proceedings 9th IEEE International Conference on Service-Oriented Computing & Applications (Macau, China, 2016), pp. 24–31.
[2] NCCU DCT (2016). The Future Circus. Retrieved February 19, 2016, from http://www.dct.nccu.edu.tw/master/2016/02/19/the-future-circus/.
[3] Yi-Kai Hsiao (Hsiao, 2015), Programming Support for Cyber-Physical Interactive Performance Art.
[4] Vanessa Wang; Frank Salim and Peter Moskovits (Wang et al, 2013), The Definitive Guide to HTML5 WebSocket.
[5] C.-F. Liao, W.-C. Lu, K. Chen, Z. Grannan, W.-C. Chang, and Y.- K. Hsiao. (Liao et al, 2016), “Wise: A wearable platform for performer-guided mixed- reality interactive performance art”, in 2016 International Conference on Platform Technology and Service (PlatCon). IEEE, 2016, pp. 1-6.
[6] M. Odersky, P. Altherr, V. Cremet, B. Emir, S. Maneth, S. Micheloud, N. Mihaylov, M. Schinz, E. Stenman, and M. Zenger. (Odersky et al, 2004), “An overview of the scala programming language” (No. LAMP-REPORT-2004-006).
[7] M. Fowler (Fowler, 2010), Domain-Specific Languages, ser. Addison-Wesley Signature Series (Fowler). Pearson Education.
[8] Phidgets 1056 user guide. Retrieved December 21, 2016, from https://www.phidgets.com/docs/1056_User_Guide.
[9] MQTT.ORG. Retrieved December 21, 2016, from http://mqtt.org/.
[10] Google for Education of Blockly. Retrieved January 2, 2016, from https://developers.google.com/blockly/.
[11] D. Namiot and M. Sneps-Sneppe (Namiot et al, 2014), “On iot programming”, in International Journal of Open Information Technologies, vol. 2, no. 10, 2014.
[12] I. Fette (Fette, 2011), The websocket protocol.
[13] Eclipse Paho. Retrieved December 21, 2016, from https://eclipse.org/paho/.
[14] Live motion capture at 2014 Winter Olympic Games closing ceremony. Retrieved May 24, 2016, from https://www.xsens.com/customer-cases/live-motion-capture-2014-winter-olympic-games-closing-ceremony/.
[15] H. Huang, H.-C. Huang, C.-F. Liao, Y.-C. Li, T.-C. Tsai, L.-j. Teng, and S. W. Wang (Huang et al, 2015), “Future circus: a performer-guided mixed-reality performance art”, in Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. ACM, 2015, pp. 551–556.
[16] A. Banks and R. Gupta. (Banks et al, 2014). MQTT Version 3.1.1. OASIS.
[17] Anind K. Dey, Timothy Sohn, Sara Streng, and Justin Kodama (Anind et al, 2006), “iCAP: Interactive Prototyping of Context-Aware Applications”, in proceedings of the 4th International Conference on Pervasive Computing, PERVASIVE’06, Springer-Verlag (Berlin, Heidelberg, 2006), pp. 254–271.
[18] Lee, J., Gardun ̃o, L., Walker, E., and Burleson, W. (Lee et al, 2013), “A Tangible Programming Tool for Creation of Context-aware Applications”, in proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp ’13, ACM (New York, NY, USA, 2013), pp. 391-400.
[19] Ur, B., McManus, E., Pak Yong Ho, M., and Littman, M. L. (Ur et al, 2014), “Practical Trigger-action Programming in the Smart Home”, in proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, ACM (New York, NY, USA, 2014), pp. 803–812.
[20] Luigi De Russis, and Fulvio Corno (Russis and Corno, 2015), “HomeRules: A Tangible End-User Programming Interface for Smart Homes”, in CHI EA `15 Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2109-2114.
[21] Ting-Hao (Kenneth) Huang, Amos Azaria, Jeffrey P. Bigham (Huang et al, 2016), “InstructableCrowd: Creating IF-THEN Rules via Conversations with the Crowd”, in CHI EA `16 Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1555-1562.
[22] Sidney Viana, Jorge Rady de Almeida Junior, Judith Pavon (Viana et al, 2007), “A rule repository for active database systems”, CLEI Electronic Journal, Vol. 10.
[23] Rashidi, P., and Cook, D. J. (Rashidi and Cook, 2009), “Keeping the resident in the loop: Adapting the smart home to the user.”, IEEE Transactions on Systems, Man, and Cybernetics—Part A 39, 5, pp. 949-959.
[24] Ko, A. J., Myers, B. A., and Aung, H. (Ko et al, 2005), “Six Learning Barriers in End-User Programming Systems.”, IEEE Symp. On VLHCC, pp. 199-206.
[25] J. Wong and J. I. Hong (Wong and Hong, 2007), “Making Mashups with Marmite: Towards End-user Programming for the Web”, in proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2007, pp. 1435-1444.
[26] Martin Fowler and Rebecca Parsons. (Fowler and Parsons, 2010), “Domain-Specific Languages”, Addison-Wesley.
[27] M. Fowler, “Language workbenches: The killer-app for domain specific languages?” Available at http://martinfowler.com/articles/languageWorkbench.html, 2005.
[28] Gorillaz Live on Letterman. Retrieved May 24, 2016, from https://youtu.be/BdAXIj5QViw?t=40s.
[29] Jay Chou OPUS World Tour Concert 2013 Taipei Taiwan- Special Show for Teresa Teng (JVR Music, 2013). Retrieved May 24, 2017 from https://youtu.be/TixHYua3XCI.
[30] Michael Jackson Hologram Rocks Billboard Music Awards: Watch & Go Behind the Scenes (Billboard, 2014). Retrieved May 24, 2017 from http://www.billboard.com/articles/events/bbma-2014/6092040/michael-jackson-hologram-billboard-music-awards.
[31] Marron, A., Weiss, G., & Wiener, G. (Marron et al, 2012), “A decentralized approach for programming interactive applications with javascript and blockly”, in proceedings of the 2nd edition on Programming systems, languages and applications based on actors, agents, and decentralized control abstractions. ACM, 2012, pp. 59-70.
[32] Ashrov, A., Marron, A., Weiss, G., & Wiener, G. (Ashrov et al, 2015), “A use-case for behavioral programming: an architecture in JavaScript and Blockly for interactive applications with cross-cutting scenarios”, Science of Computer Programming, 98, pp. 268-292.
[33] Trower, J., & Gray, J. (Trower and Gray, 2015), “Creating new languages in Blockly: Two case studies in media computation and robotics”, in proceedings of the 46th ACM Technical Symposium on Computer Science Education. ACM, 2015, pp. 677-677.
[34] Trower, J., & Gray, J. (Trower and Gray, 2015), “Blockly language creation and applications: Visual programming for media computation and bluetooth robotics control”, in proceedings of the 46th ACM Technical Symposium on Computer Science Education. ACM, 2015, pp. 5-5.
[35] Grundy, J., Hosking, J., Zhu, N., & Liu, N. (Grundy et al, 2006), “Generating domain-specific visual language editors from high-level tool specifications”, In Automated Software Engineering, 2006. ASE`06. 21st IEEE/ACM International Conference. IEEE, 2006, pp. 25-36.
[36] Wienands, C., & Golm, M. (Wienands and Golm, 2009), “Anatomy of a visual domain-specific language project in an industrial context”, Model Driven Engineering Languages and Systems, 2009, pp. 453-467.
[37] Tilley, E., & Gray, J. (Tilley and Gray, 2017), “Dronely: A Visual Block Programming Language for the Control of Drones”, in proceedings of the SouthEast Conference. ACM, 2017, pp. 208-211.		zh_TW