Publications-NSC Projects

Article View/Open

Publication Export

Google ScholarTM

NCCU Library

Citation Infomation

Related Publications in TAIR

題名 結合多點觸控與3D手勢之手機創新介面研究
其他題名 Designing a Novel Interface for Mobile Devices with Multitouch and 3d Gestures
作者 余能豪
貢獻者 資訊科學系
關鍵詞 人機互動;自然使用者介面;多指觸控;行動平台;影像辨識;手勢辨 識;手勢語彙;雙手互動模式
HCI;natural user interface;gestural user interface;multi-touch;mobiles;image recognition;gesture recognition;gesture vocabulary;bimanual input
日期 2012
上傳時間 15-Apr-2016 11:33:03 (UTC+8)
摘要 現今智慧型手機多採用直覺操控的多指觸控操作方式 (Multi-touch)為使用者 介面,並採用電容式感測技術偵測手指在 2D 平面上的動作做為輸入指令,因此 介面設計人員不斷探詢各種自然對應的手勢語彙 (natural gesture vocabulary),以期 增加使用者操作的便利性,然而以2D 平面為主的手勢卻也限制了許多自然手勢操 作的可能性,例如抓取物件在空間中移動等。隨著科技快速發展,智慧型手機的 處理速度將有能力運行手機前、後置鏡頭之3D 手勢辨識,目前國內外已有多項針 對手指影像追蹤及簡單手勢動作辨識之研究,但其研究假設乃基於Touchless 之操 作,對於手持置裝置上與多指觸控螢幕結合之3D 手勢語彙研究卻付之闕如。 本計劃擬研究智慧型手機及平板之使用者運用手勢的方式,探討在手持置裝 置上2D 結合3D 手勢語彙之可能應用,包含一、將GUI 常見之Contextual-menu 延伸,設計用以輔助平面觸控操作之3D 手勢動態選單 (Lift-menu),並提出視覺 介面之設計準則。二、以抓取物件移動之隱喻 (Grasp-and-drop metaphor) 設計新 的拖拉放 (drag-and-drop) 操作模式,並結合2D+3D 手勢設計雙手同步操作模式。 本計劃研究成果將可運用在智慧型手機或平板上,提供使用者更自然且便捷的行 動平台使用者介面 (Mobile User Interface)。
Multi-touch technology has been adopted widely in mobile devices. Researchers therefore try to investigate more natural gesture vocabularies to provide simple and intuitive user interface. However, the touch surfaces can only detect 2D gestures thus constrain some natural gestures such as grasp object and move it in the air. On the other hand, nowaday smart phones have better-performance CPU/GPU and contain better-quality front/back built-in camera. Some researchers utilize these features to design touchless interaction by using finger tracking or gesture recognition. To the best of our knowledge, no such research exists for exploring 2D + 3D gestures with a mobile platform, and filling this gap is thus another driver for the work presented here. In this project, we plan to investigate the daily gestures that are performed on smart phones or tablets and to explore the potential natural interaction that combines 2D and 3D gestures. The research topics include: (1) Redesign the function of contextual-menu by a method called “Lift-menu”, which users simply lift their finger to trigger it. And we will provide the UI design guidelines for this interaction. (2) Redesign the function of drag-and-drop by new metaphoric gesture: “Grasp-and-drop”. The gesture can support bimanual interaction and overcome the problem of original design. We will optimize these new gestures to develop a novel mobile user interface.
關聯 計畫編號 NSC101-2221-E004-013
資料類型 report
dc.contributor 資訊科學系
dc.creator (作者) 余能豪zh_TW
dc.date (日期) 2012
dc.date.accessioned 15-Apr-2016 11:33:03 (UTC+8)-
dc.date.available 15-Apr-2016 11:33:03 (UTC+8)-
dc.date.issued (上傳時間) 15-Apr-2016 11:33:03 (UTC+8)-
dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/84750-
dc.description.abstract (摘要) 現今智慧型手機多採用直覺操控的多指觸控操作方式 (Multi-touch)為使用者 介面,並採用電容式感測技術偵測手指在 2D 平面上的動作做為輸入指令,因此 介面設計人員不斷探詢各種自然對應的手勢語彙 (natural gesture vocabulary),以期 增加使用者操作的便利性,然而以2D 平面為主的手勢卻也限制了許多自然手勢操 作的可能性,例如抓取物件在空間中移動等。隨著科技快速發展,智慧型手機的 處理速度將有能力運行手機前、後置鏡頭之3D 手勢辨識,目前國內外已有多項針 對手指影像追蹤及簡單手勢動作辨識之研究,但其研究假設乃基於Touchless 之操 作,對於手持置裝置上與多指觸控螢幕結合之3D 手勢語彙研究卻付之闕如。 本計劃擬研究智慧型手機及平板之使用者運用手勢的方式,探討在手持置裝 置上2D 結合3D 手勢語彙之可能應用,包含一、將GUI 常見之Contextual-menu 延伸,設計用以輔助平面觸控操作之3D 手勢動態選單 (Lift-menu),並提出視覺 介面之設計準則。二、以抓取物件移動之隱喻 (Grasp-and-drop metaphor) 設計新 的拖拉放 (drag-and-drop) 操作模式,並結合2D+3D 手勢設計雙手同步操作模式。 本計劃研究成果將可運用在智慧型手機或平板上,提供使用者更自然且便捷的行 動平台使用者介面 (Mobile User Interface)。
dc.description.abstract (摘要) Multi-touch technology has been adopted widely in mobile devices. Researchers therefore try to investigate more natural gesture vocabularies to provide simple and intuitive user interface. However, the touch surfaces can only detect 2D gestures thus constrain some natural gestures such as grasp object and move it in the air. On the other hand, nowaday smart phones have better-performance CPU/GPU and contain better-quality front/back built-in camera. Some researchers utilize these features to design touchless interaction by using finger tracking or gesture recognition. To the best of our knowledge, no such research exists for exploring 2D + 3D gestures with a mobile platform, and filling this gap is thus another driver for the work presented here. In this project, we plan to investigate the daily gestures that are performed on smart phones or tablets and to explore the potential natural interaction that combines 2D and 3D gestures. The research topics include: (1) Redesign the function of contextual-menu by a method called “Lift-menu”, which users simply lift their finger to trigger it. And we will provide the UI design guidelines for this interaction. (2) Redesign the function of drag-and-drop by new metaphoric gesture: “Grasp-and-drop”. The gesture can support bimanual interaction and overcome the problem of original design. We will optimize these new gestures to develop a novel mobile user interface.
dc.format.extent 2265464 bytes-
dc.format.mimetype application/pdf-
dc.relation (關聯) 計畫編號 NSC101-2221-E004-013
dc.subject (關鍵詞) 人機互動;自然使用者介面;多指觸控;行動平台;影像辨識;手勢辨 識;手勢語彙;雙手互動模式
dc.subject (關鍵詞) HCI;natural user interface;gestural user interface;multi-touch;mobiles;image recognition;gesture recognition;gesture vocabulary;bimanual input
dc.title (題名) 結合多點觸控與3D手勢之手機創新介面研究zh_TW
dc.title.alternative (其他題名) Designing a Novel Interface for Mobile Devices with Multitouch and 3d Gestures
dc.type (資料類型) report