Publications-Theses
Article View/Open
Publication Export
-
題名 FingerX：透過可伸縮與收起式支架於手指上提供呈現於真實物體上之虛擬物體視覺形狀
FingerX: Rendering Haptic Shape of Virtual Objects Augmented from Real Objects using Extendable and Withdrawable Supports on Fingers作者 蔡捷
Tsai, Chieh貢獻者 蔡欣叡
Tsai, Hsin-Ruey
蔡捷
Tsai, Chieh關鍵詞 形狀呈現
形狀展示
觸覺
觸碰
抓握
可穿戴設備
虛擬現實
擴增實境
Shape Rendering
Shape Display
Haptics
Touch
Grasp
Wearable Device
Virtual Reality
Augmented Reality日期 2021 上傳時間 2-Sep-2021 18:08:32 (UTC+8) 摘要 不只是與虛擬物體或真實物體互動，甚至是從真實物體中擴增的虛擬物件，都將成為虛擬實境(VR)互動的趨勢，並且在擴增實境(AR)中也逐漸普遍。在跟虛擬物體互動時，形狀的表現是一個重要的要素。但現今呈現形狀的裝置，通常只專注在提供虛擬物體的回饋。而手持式設備和指尖上有指套或皮帶的穿戴式設備，會需要使用者放下或脫下設備才能感受到真實物體的紋理和形狀。因此，我們提出了FingerX來呈現形狀的觸覺，並讓使用者可以同時觸摸、抓握虛擬物體跟真實物體，讓虛擬和真實同時互動。在我們的裝置中，每個延伸支架都會支撐在使用者的指尖和真實物體中間，並延展出相對應的高度，以此讓使用者可以感受到形狀。當不需要觸摸虛擬形狀時，戴在靠近關節的第二指節上的指環，會將延伸支架從指尖指腹上收回至指背。通過獨立控制四個延伸支架和指環，FingerX可以在三個常見的場景中呈現形狀的觸覺回饋，包括觸摸從真實環境（桌子）中擴增出的虛擬物體、抓握從真實物體（瓶子）擴增而出的虛擬物體、抓握手中的虛擬物體。我們進行了形狀識別實驗，以評估這三種情境下的形狀識別率。然後我們進行了VR實驗，觀察使用者如何同時與虛擬物體、真實物體進行互動，並從中驗證FingerX可以增強VR的體驗和沈浸感。
Interacting with not only virtual but also real objects, or even virtual objects augmented from real objects becomes a trend of virtual reality (VR) interactions and is common in augmented reality (AR). Shape is an important property of virtual objects in interactions.However, current shape rendering devices generally focus on providing feedback for virtual objects only. Handheld devices and wearable devices with caps or straps on the fingertips require the users to put down or take off the devices to perceive texture and shape of real objects. Therefore, we propose FingerX to render haptic shape and enable users to touch, grasp and interact with virtual and real objects simultaneously. An extender on each fingertip extends to the corresponding height to support between the fingertip and the real objects or hand, so the users can perceive the shape. A ring worn on the second finger segment rotates the extender to withdraw it to the back of the fingertip when the virtual shape is not rendered. By independently controlling four extenders and rings except the pinky finger, FingerX renders feedback in three common scenarios, including touching virtual objects augmented from real environments (a desk), grasping virtual objects augmented from real objects (a bottle) and grasping virtual objects in the hand. We conducted a shape recognition study to evaluate the recognition rates in these three scenarios. We then performed a VR study to observe how users interact with virtual and real objects simultaneously and verify that FingerX enhances VR experiences.參考文獻 [1] 2020. 3D Printed "Rigid Chain" Mechanism. https://youtu.be/loCBrD4gRi4[2] Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (Eindhoven, Netherlands) (TEI ’16). Association for Computing Machinery, New York, NY, USA, 218–226. https://doi.org/10.1145/2839462.2839484[3] Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-Fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 717–728. https://doi.org/10.1145/2984511.2984526[4] Mourad Bouzit, Grigore Burdea, George Popescu, and Rares Boian. 2002. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on mechatronics 7, 2 (2002), 256–263.[5] Francesco Chinello, Monica Malvezzi, Claudio Pacchierotti, and Domenico Prattichizzo. 2015. Design and development of a 3RRS wearable fingertip cutaneous device. In 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM). IEEE, 293–298.[6] Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC,Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 119–130. https://doi.org/10.1145/3126594.3126599[7] Inrak Choi and Sean Follmer. 2016. Wolverine: A Wearable Haptic Interface for Grasping in VR. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16 Adjunct). Association for Computing Machinery, New York, NY, USA, 117–119. https://doi.org/10.1145/2984751.2985725[8] Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC,Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174228[9] Takahiro Endo, Haruhisa Kawasaki, Tetsuya Mouri, Yasuhiko Ishigure, Hisayuki Shimomura, Masato Matsumura, and Kazumi Koketsu. 2010. Five-fingered haptic interface robot: HIRO III. IEEE Transactions on Haptics 4, 1 (2010), 14–27.[10] Cathy Fang, Yang Zhang, Matthew Dworman, and Chris Harrison. 2020. Wireality: Enabling Complex Tangible Geometries in Virtual Reality with Worn Multi-String Haptics. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20).Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3313831.3376470[11] Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. InFORM: Dynamic Physical Affordances and Constraints through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews,Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 417–426. https://doi.org/10.1145/2501988.2502032[12] Massimiliano Gabardi, Massimiliano Solazzi, Daniele Leonardis, and Antonio Frisoli. 2016. A new wearable fingertip haptic interface for the rendering of virtual shapes and surface features. In 2016 IEEE Haptics Symposium (HAPTICS). IEEE, 140–146.[13] Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1991–1995. https://doi.org/10.1145/2858036.2858487[14] Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor’s Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3174099[15] Seongkook Heo, Jaeyeon Lee, and Daniel Wigdor. 2019. PseudoBend: Producing Haptic Illusions of Stretching, Bending, and Twisting Using Grain Vibrations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19).Association for Computing Machinery, New York, NY, USA, 803–813. https://doi.org/10.1145/3332165.3347941[16] Ronan Hinchet, Velko Vechev, Herbert Shea, and Otmar Hilliges. 2018. DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18).Association for Computing Machinery, New York, NY, USA, 901–912. https://doi.org/10.1145/3242587.3242657[17] CyberGlove Systems Inc. 2021. Cybergrasp. http://www.cyberglovesystems.com/cybergrasp Accessed:2021-03-27.[18] Leap Motion Inc. 2021. Leap Motion. https://www.ultraleap.com/ Accessed:2021-03-28.[19] Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX: adding haptic surface to graphics. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 469–476.[20] Seungwoo Je, Myung Jin Kim, Woojin Lee, Byungjoo Lee, Xing-Dong Yang, Pedro Lopes, and Andrea Bianchi. 2019. Aero-plane: A Handheld Force-Feedback Device that Renders Weight Motion Illusion on a Virtual 2D Plane. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 763–775.[21] F Jensen and S Pellegrino. 2001. Arm development review of existing technologies. Technical Report. Cambridge Univ.(United Kingdom). Dept. of Engineering.[22] Robert Kovacs, Eyal Ofek, Mar Gonzalez Franco, Alexa Fay Siu, Sebastian Marwecki, Christian Holz, and Mike Sinclair. 2020. Haptic PIVOT: On-Demand Handhelds in VR. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 1046–1059. https://doi.org/10.1145/3379337.3415854[23] Chi-Jung Lee, Hsin-Ruey Tsai, and Bing-Yu Chen. 2021. HairTouch: Providing Stiffness, Roughness and Surface Height Differences Using Reconfigurable Brush Hairs on a VR Controller. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.[24] Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver,Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1471–1482. https://doi.org/10.1145/3025453.3025600[25] Jun Murayama, Laroussi Bougrila, YanLin Luo, Katsuhito Akahane, Shoichi Hasegawa, Béat Hirsbrunner, and Makoto Sato. 2004. SPIDAR G&G: a two-handed haptic interface for bimanual VR interaction. In Proceedings of EuroHaptics, Vol. 2004. Citeseer, 138–146.[26] Jun Nishida, Soichiro Matsuda, Hiroshi Matsui, Shan-Yuan Teng, Ziwei Liu, Kenji Suzuki, and Pedro Lopes. 2020. HandMorph: A Passive Exoskeleton That Miniaturizes Grasp. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 565–578. https://doi.org/10.1145/3379337.3415875[27] Domenico Prattichizzo, Francesco Chinello, Claudio Pacchierotti, and Monica Malvezzi. 2013. Towards wearability in fingertip haptics: a 3-dof wearable device for cutaneous force feedback. IEEE Transactions on Haptics 6, 4 (2013), 506–516.[28] Neung Ryu, Woojin Lee, Myung Jin Kim, and Andrea Bianchi. 2020. ElaStick: A Handheld Variable Stiffness Display for Rendering Dynamic Haptic Response of Flexible Object. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 1035–1045.[29] Shahabedin Sagheb, Frank Wencheng Liu, Alireza Bahremand, Assegid Kidane, and Robert LiKamWa. 2019. SWISH: A shifting-weight interface of simulated hydrodynamics for haptic perception of virtual fluid vessels. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 751–761.[30] Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York,NY, USA, 3115–3119. https://doi.org/10.1145/3025453.3025744[31] Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2019. Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 11.[32] Makoto Shimojo, Masami Shinohara, and Yukio Fukui. 1999. Human shape recognition performance for 3D tactile display. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 29, 6 (1999), 637–644.[33] Mike Sinclair, Eyal Ofek, Mar Gonzalez-Franco, and Christian Holz. 2019. CapstanCrunch: A Haptic VR Controller with User-Supplied Force Feedback. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 815–829. https://doi.org/10.1145/3332165.3347891[34] Alexa F. Siu, Eric J. Gonzalez, Shenli Yuan, Jason B. Ginsberg, and Sean Follmer. 2018. ShapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10. 1145/3173574.3173865[35] Bukun Son and Jaeyoung Park. 2018. Haptic Feedback to the Palm and Fingers for Improved Tactile Perception of Large Objects. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery,New York, NY, USA, 757–763. https://doi.org/10.1145/3242587.3242656[36] Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174218[37] Yuqian Sun, Shigeo Yoshida, Takuji Narumi, and Michitaka Hirose. 2019. PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-Based Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300682[38] Ryo Suzuki, Hooman Hedayati, Clement Zheng, James L Bohn, Daniel Szafir, Ellen Yi-Luen Do, Mark D Gross, and Daniel Leithinger. 2020. Roomshift: Room-scale dynamic haptics for vr with furniture-moving swarm robots. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.[39] Shohei Takei, Makoto Iida, and Takeshi Naemura. 2011. KineReels: Extension Actuators for Dynamic 3D Shape. In ACM SIGGRAPH 2011 Posters (Vancouver, British Columbia, Canada) (SIGGRAPH ’11). Association for Computing Machinery, New York, NY, USA, Article 84, 1 pages. https://doi.org/10.1145/2037715.2037810[40] Shan-Yuan Teng, Tzu-Sheng Kuo, Chi Wang, Chi-huan Chiang, Da-Yuan Huang, Liwei Chan, and Bing-Yu Chen. 2018. PuPoP: Pop-up Prop on Palm for Virtual Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18).Association for Computing Machinery, New York, NY, USA, 5–17. https://doi.org/10.1145/3242587.3242628[41] Shan-Yuan Teng, Pengyu Li, Romain Nith, Joshua Fonseca, and Pedro Lopes. 2021. Touchamp;Fold: A Foldable Haptic Actuator for Rendering Touch in Mixed Reality. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445099[42] Hsin-Ruey Tsai, Yuan-Chia Chang, Tzu-Yun Wei, Chih-An Tsao, Xander Koo, Hao-Chuan Wang, and Bing-Yu Chen. 2021. GuideBand: Intuitive 3D Multilevel Force Guidance on a Wristband in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.[43] Hsin-Ruey Tsai, Ching-Wen Hung, Tzu-Chun Wu, and Bing-Yu Chen. 2020. ElastOscillation: 3D Multilevel Force Feedback for Damped Oscillation on VR Controllers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376408[44] Hsin-Ruey Tsai and Jun Rekimoto. 2018. ElasticVR: Providing multi-level active and passive force feedback in virtual reality using elasticity. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1–4.[45] Hsin-Ruey Tsai, Jun Rekimoto, and Bing-Yu Chen. 2019. ElasticVR: Providing Multilevel Continuously-Changing Resistive Force and Instant Impact Using Elasticity for VR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19).Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3290605.3300450[46] Dzmitry Tsetserukou, Katsunari Sato, and Susumu Tachi. 2010. ExoInterfaces: Novel Exosceleton Haptic Interfaces for Virtual Reality, Augmented Sport and Rehabilitation. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). Association for Computing Machinery, New York, NY, USA, Article 1, 6 pages. https://doi.org/10.1145/1785455.1785456[47] Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173660[48] Shigeo Yoshida, Yuqian Sun, and Hideaki Kuzuoka. 2020. PoCoPo: Handheld Pin-Based Shape Display for Haptic Rendering in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery,New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376358[49] Andre Zenner and Antonio Krüger. 2017. Shifty: A weight-shifting dynamic passive haptic proxy to enhance object perception in virtual reality.IEEE transactions on visualization and computer graphics 23, 4 (2017), 1285–1294.[50] André Zenner and Antonio Krüger. 2019. Drag:On: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300441 描述 碩士
國立政治大學
數位內容碩士學位學程
108462013資料來源 http://thesis.lib.nccu.edu.tw/record/#G0108462013 資料類型 thesis dc.contributor.advisor 蔡欣叡 zh_TW dc.contributor.advisor Tsai, Hsin-Ruey en_US dc.contributor.author (Authors) 蔡捷 zh_TW dc.contributor.author (Authors) Tsai, Chieh en_US dc.creator (作者) 蔡捷 zh_TW dc.creator (作者) Tsai, Chieh en_US dc.date (日期) 2021 en_US dc.date.accessioned 2-Sep-2021 18:08:32 (UTC+8) - dc.date.available 2-Sep-2021 18:08:32 (UTC+8) - dc.date.issued (上傳時間) 2-Sep-2021 18:08:32 (UTC+8) - dc.identifier (Other Identifiers) G0108462013 en_US dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/137132 - dc.description (描述) 碩士 zh_TW dc.description (描述) 國立政治大學 zh_TW dc.description (描述) 數位內容碩士學位學程 zh_TW dc.description (描述) 108462013 zh_TW dc.description.abstract (摘要) 不只是與虛擬物體或真實物體互動，甚至是從真實物體中擴增的虛擬物件，都將成為虛擬實境(VR)互動的趨勢，並且在擴增實境(AR)中也逐漸普遍。在跟虛擬物體互動時，形狀的表現是一個重要的要素。但現今呈現形狀的裝置，通常只專注在提供虛擬物體的回饋。而手持式設備和指尖上有指套或皮帶的穿戴式設備，會需要使用者放下或脫下設備才能感受到真實物體的紋理和形狀。因此，我們提出了FingerX來呈現形狀的觸覺，並讓使用者可以同時觸摸、抓握虛擬物體跟真實物體，讓虛擬和真實同時互動。在我們的裝置中，每個延伸支架都會支撐在使用者的指尖和真實物體中間，並延展出相對應的高度，以此讓使用者可以感受到形狀。當不需要觸摸虛擬形狀時，戴在靠近關節的第二指節上的指環，會將延伸支架從指尖指腹上收回至指背。通過獨立控制四個延伸支架和指環，FingerX可以在三個常見的場景中呈現形狀的觸覺回饋，包括觸摸從真實環境（桌子）中擴增出的虛擬物體、抓握從真實物體（瓶子）擴增而出的虛擬物體、抓握手中的虛擬物體。我們進行了形狀識別實驗，以評估這三種情境下的形狀識別率。然後我們進行了VR實驗，觀察使用者如何同時與虛擬物體、真實物體進行互動，並從中驗證FingerX可以增強VR的體驗和沈浸感。 zh_TW dc.description.abstract (摘要) Interacting with not only virtual but also real objects, or even virtual objects augmented from real objects becomes a trend of virtual reality (VR) interactions and is common in augmented reality (AR). Shape is an important property of virtual objects in interactions.However, current shape rendering devices generally focus on providing feedback for virtual objects only. Handheld devices and wearable devices with caps or straps on the fingertips require the users to put down or take off the devices to perceive texture and shape of real objects. Therefore, we propose FingerX to render haptic shape and enable users to touch, grasp and interact with virtual and real objects simultaneously. An extender on each fingertip extends to the corresponding height to support between the fingertip and the real objects or hand, so the users can perceive the shape. A ring worn on the second finger segment rotates the extender to withdraw it to the back of the fingertip when the virtual shape is not rendered. By independently controlling four extenders and rings except the pinky finger, FingerX renders feedback in three common scenarios, including touching virtual objects augmented from real environments (a desk), grasping virtual objects augmented from real objects (a bottle) and grasping virtual objects in the hand. We conducted a shape recognition study to evaluate the recognition rates in these three scenarios. We then performed a VR study to observe how users interact with virtual and real objects simultaneously and verify that FingerX enhances VR experiences. en_US dc.description.tableofcontents Chapter 1 Introduction..... 1Chapter 2 Related Work..... 42.1 Haptic Feedback for Virtual Objects..... 42.2 Haptic Feedback for Shape Rendering..... 62.3 Shape-Changing Devices..... 8Chapter 3 FingerX.....103.1 Design Considerations.....113.2 Hardware.....133.3 Software.....17Chapter 4 Shape Recognition Study...... 214.1 Apparatus and Participants..... 214.2 Task..... 224.3 Procedure..... 234.4 Results and Discussion..... 254.5Recognition Study with Visual Feedback..... 30Chapter 5 VR Experience Study..... 335.1 Apparatus and Participants..... 335.2 Task and Procedure..... 345.3 Results and Discussion..... 37Chapter 6 Limitations and Future Work.....41Chapter 7 Conclusion...... 43References..... 44 zh_TW dc.format.extent 8823035 bytes - dc.format.mimetype application/pdf - dc.source.uri (資料來源) http://thesis.lib.nccu.edu.tw/record/#G0108462013 en_US dc.subject (關鍵詞) 形狀呈現 zh_TW dc.subject (關鍵詞) 形狀展示 zh_TW dc.subject (關鍵詞) 觸覺 zh_TW dc.subject (關鍵詞) 觸碰 zh_TW dc.subject (關鍵詞) 抓握 zh_TW dc.subject (關鍵詞) 可穿戴設備 zh_TW dc.subject (關鍵詞) 虛擬現實 zh_TW dc.subject (關鍵詞) 擴增實境 zh_TW dc.subject (關鍵詞) Shape Rendering en_US dc.subject (關鍵詞) Shape Display en_US dc.subject (關鍵詞) Haptics en_US dc.subject (關鍵詞) Touch en_US dc.subject (關鍵詞) Grasp en_US dc.subject (關鍵詞) Wearable Device en_US dc.subject (關鍵詞) Virtual Reality en_US dc.subject (關鍵詞) Augmented Reality en_US dc.title (題名) FingerX：透過可伸縮與收起式支架於手指上提供呈現於真實物體上之虛擬物體視覺形狀 zh_TW dc.title (題名) FingerX: Rendering Haptic Shape of Virtual Objects Augmented from Real Objects using Extendable and Withdrawable Supports on Fingers en_US dc.type (資料類型) thesis en_US dc.relation.reference (參考文獻) [1] 2020. 3D Printed "Rigid Chain" Mechanism. https://youtu.be/loCBrD4gRi4[2] Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (Eindhoven, Netherlands) (TEI ’16). Association for Computing Machinery, New York, NY, USA, 218–226. https://doi.org/10.1145/2839462.2839484[3] Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-Fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 717–728. https://doi.org/10.1145/2984511.2984526[4] Mourad Bouzit, Grigore Burdea, George Popescu, and Rares Boian. 2002. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on mechatronics 7, 2 (2002), 256–263.[5] Francesco Chinello, Monica Malvezzi, Claudio Pacchierotti, and Domenico Prattichizzo. 2015. Design and development of a 3RRS wearable fingertip cutaneous device. In 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM). IEEE, 293–298.[6] Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC,Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 119–130. https://doi.org/10.1145/3126594.3126599[7] Inrak Choi and Sean Follmer. 2016. Wolverine: A Wearable Haptic Interface for Grasping in VR. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16 Adjunct). Association for Computing Machinery, New York, NY, USA, 117–119. https://doi.org/10.1145/2984751.2985725[8] Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC,Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174228[9] Takahiro Endo, Haruhisa Kawasaki, Tetsuya Mouri, Yasuhiko Ishigure, Hisayuki Shimomura, Masato Matsumura, and Kazumi Koketsu. 2010. Five-fingered haptic interface robot: HIRO III. IEEE Transactions on Haptics 4, 1 (2010), 14–27.[10] Cathy Fang, Yang Zhang, Matthew Dworman, and Chris Harrison. 2020. Wireality: Enabling Complex Tangible Geometries in Virtual Reality with Worn Multi-String Haptics. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20).Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3313831.3376470[11] Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. InFORM: Dynamic Physical Affordances and Constraints through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews,Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 417–426. https://doi.org/10.1145/2501988.2502032[12] Massimiliano Gabardi, Massimiliano Solazzi, Daniele Leonardis, and Antonio Frisoli. 2016. A new wearable fingertip haptic interface for the rendering of virtual shapes and surface features. In 2016 IEEE Haptics Symposium (HAPTICS). IEEE, 140–146.[13] Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1991–1995. https://doi.org/10.1145/2858036.2858487[14] Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor’s Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3174099[15] Seongkook Heo, Jaeyeon Lee, and Daniel Wigdor. 2019. PseudoBend: Producing Haptic Illusions of Stretching, Bending, and Twisting Using Grain Vibrations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19).Association for Computing Machinery, New York, NY, USA, 803–813. https://doi.org/10.1145/3332165.3347941[16] Ronan Hinchet, Velko Vechev, Herbert Shea, and Otmar Hilliges. 2018. DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18).Association for Computing Machinery, New York, NY, USA, 901–912. https://doi.org/10.1145/3242587.3242657[17] CyberGlove Systems Inc. 2021. Cybergrasp. http://www.cyberglovesystems.com/cybergrasp Accessed:2021-03-27.[18] Leap Motion Inc. 2021. Leap Motion. https://www.ultraleap.com/ Accessed:2021-03-28.[19] Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX: adding haptic surface to graphics. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 469–476.[20] Seungwoo Je, Myung Jin Kim, Woojin Lee, Byungjoo Lee, Xing-Dong Yang, Pedro Lopes, and Andrea Bianchi. 2019. Aero-plane: A Handheld Force-Feedback Device that Renders Weight Motion Illusion on a Virtual 2D Plane. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 763–775.[21] F Jensen and S Pellegrino. 2001. Arm development review of existing technologies. Technical Report. Cambridge Univ.(United Kingdom). Dept. of Engineering.[22] Robert Kovacs, Eyal Ofek, Mar Gonzalez Franco, Alexa Fay Siu, Sebastian Marwecki, Christian Holz, and Mike Sinclair. 2020. Haptic PIVOT: On-Demand Handhelds in VR. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 1046–1059. https://doi.org/10.1145/3379337.3415854[23] Chi-Jung Lee, Hsin-Ruey Tsai, and Bing-Yu Chen. 2021. HairTouch: Providing Stiffness, Roughness and Surface Height Differences Using Reconfigurable Brush Hairs on a VR Controller. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.[24] Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver,Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1471–1482. https://doi.org/10.1145/3025453.3025600[25] Jun Murayama, Laroussi Bougrila, YanLin Luo, Katsuhito Akahane, Shoichi Hasegawa, Béat Hirsbrunner, and Makoto Sato. 2004. SPIDAR G&G: a two-handed haptic interface for bimanual VR interaction. In Proceedings of EuroHaptics, Vol. 2004. Citeseer, 138–146.[26] Jun Nishida, Soichiro Matsuda, Hiroshi Matsui, Shan-Yuan Teng, Ziwei Liu, Kenji Suzuki, and Pedro Lopes. 2020. HandMorph: A Passive Exoskeleton That Miniaturizes Grasp. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 565–578. https://doi.org/10.1145/3379337.3415875[27] Domenico Prattichizzo, Francesco Chinello, Claudio Pacchierotti, and Monica Malvezzi. 2013. Towards wearability in fingertip haptics: a 3-dof wearable device for cutaneous force feedback. IEEE Transactions on Haptics 6, 4 (2013), 506–516.[28] Neung Ryu, Woojin Lee, Myung Jin Kim, and Andrea Bianchi. 2020. ElaStick: A Handheld Variable Stiffness Display for Rendering Dynamic Haptic Response of Flexible Object. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 1035–1045.[29] Shahabedin Sagheb, Frank Wencheng Liu, Alireza Bahremand, Assegid Kidane, and Robert LiKamWa. 2019. SWISH: A shifting-weight interface of simulated hydrodynamics for haptic perception of virtual fluid vessels. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 751–761.[30] Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York,NY, USA, 3115–3119. https://doi.org/10.1145/3025453.3025744[31] Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2019. Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 11.[32] Makoto Shimojo, Masami Shinohara, and Yukio Fukui. 1999. Human shape recognition performance for 3D tactile display. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 29, 6 (1999), 637–644.[33] Mike Sinclair, Eyal Ofek, Mar Gonzalez-Franco, and Christian Holz. 2019. CapstanCrunch: A Haptic VR Controller with User-Supplied Force Feedback. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 815–829. https://doi.org/10.1145/3332165.3347891[34] Alexa F. Siu, Eric J. Gonzalez, Shenli Yuan, Jason B. Ginsberg, and Sean Follmer. 2018. ShapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10. 1145/3173574.3173865[35] Bukun Son and Jaeyoung Park. 2018. Haptic Feedback to the Palm and Fingers for Improved Tactile Perception of Large Objects. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery,New York, NY, USA, 757–763. https://doi.org/10.1145/3242587.3242656[36] Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174218[37] Yuqian Sun, Shigeo Yoshida, Takuji Narumi, and Michitaka Hirose. 2019. PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-Based Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300682[38] Ryo Suzuki, Hooman Hedayati, Clement Zheng, James L Bohn, Daniel Szafir, Ellen Yi-Luen Do, Mark D Gross, and Daniel Leithinger. 2020. Roomshift: Room-scale dynamic haptics for vr with furniture-moving swarm robots. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.[39] Shohei Takei, Makoto Iida, and Takeshi Naemura. 2011. KineReels: Extension Actuators for Dynamic 3D Shape. In ACM SIGGRAPH 2011 Posters (Vancouver, British Columbia, Canada) (SIGGRAPH ’11). Association for Computing Machinery, New York, NY, USA, Article 84, 1 pages. https://doi.org/10.1145/2037715.2037810[40] Shan-Yuan Teng, Tzu-Sheng Kuo, Chi Wang, Chi-huan Chiang, Da-Yuan Huang, Liwei Chan, and Bing-Yu Chen. 2018. PuPoP: Pop-up Prop on Palm for Virtual Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18).Association for Computing Machinery, New York, NY, USA, 5–17. https://doi.org/10.1145/3242587.3242628[41] Shan-Yuan Teng, Pengyu Li, Romain Nith, Joshua Fonseca, and Pedro Lopes. 2021. Touchamp;Fold: A Foldable Haptic Actuator for Rendering Touch in Mixed Reality. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445099[42] Hsin-Ruey Tsai, Yuan-Chia Chang, Tzu-Yun Wei, Chih-An Tsao, Xander Koo, Hao-Chuan Wang, and Bing-Yu Chen. 2021. GuideBand: Intuitive 3D Multilevel Force Guidance on a Wristband in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.[43] Hsin-Ruey Tsai, Ching-Wen Hung, Tzu-Chun Wu, and Bing-Yu Chen. 2020. ElastOscillation: 3D Multilevel Force Feedback for Damped Oscillation on VR Controllers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376408[44] Hsin-Ruey Tsai and Jun Rekimoto. 2018. ElasticVR: Providing multi-level active and passive force feedback in virtual reality using elasticity. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1–4.[45] Hsin-Ruey Tsai, Jun Rekimoto, and Bing-Yu Chen. 2019. ElasticVR: Providing Multilevel Continuously-Changing Resistive Force and Instant Impact Using Elasticity for VR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19).Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3290605.3300450[46] Dzmitry Tsetserukou, Katsunari Sato, and Susumu Tachi. 2010. ExoInterfaces: Novel Exosceleton Haptic Interfaces for Virtual Reality, Augmented Sport and Rehabilitation. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). Association for Computing Machinery, New York, NY, USA, Article 1, 6 pages. https://doi.org/10.1145/1785455.1785456[47] Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173660[48] Shigeo Yoshida, Yuqian Sun, and Hideaki Kuzuoka. 2020. PoCoPo: Handheld Pin-Based Shape Display for Haptic Rendering in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery,New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376358[49] Andre Zenner and Antonio Krüger. 2017. Shifty: A weight-shifting dynamic passive haptic proxy to enhance object perception in virtual reality.IEEE transactions on visualization and computer graphics 23, 4 (2017), 1285–1294.[50] André Zenner and Antonio Krüger. 2019. Drag:On: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300441 zh_TW dc.identifier.doi (DOI) 10.6814/NCCU202101489 en_US
