1. NCCU Academic Hub
  2. Publications
  3. College of Informatics
  4. Theses
  5. Item

Publications-Theses

Article View/Open

Publication Export

Google ScholarTM

NCCU Library

Citation Infomation

Related Publications in TAIR

題名 多語系個人飲食攝影註記典藏系統輔以群眾外包
Multilingual Personal Dietary Photograph Annotation System with The Assistance of Crowdsourcing
作者 林睦叡
Lin, Mu Rui
貢獻者 郭正佩
Kuo, Pei Jeng
林睦叡
Lin, Mu Rui
關鍵詞 群眾外包
飲食記錄
影像標籤
多國語系問題
日期 2013
上傳時間 1-Jul-2014 12:14:34 (UTC+8)
摘要 本研究於個人數位註釋應用程式iPARIS上，建立影像標籤註釋之功能，稱為iPARIS-PLUS。它提供不同於以往文字註釋的新方法，讓使用者可以有另一種選擇，也同時解決在面臨多國語系時的註釋問題，並有效的降低記錄所花費之時間。iPARIS-Plus能讓使用者保有在行動裝置上紀實之便利性的同時，也能兼顧記錄的完整性，讓人們不再將記錄視為一種麻煩。除此之外，我們透過群眾外包的力量將用於註釋的影像標籤轉換為文字後儲存於資料庫中，解決原先因多國語系註釋問題讓使用者無法輸入文字，導致資料庫缺少該筆資料而造成資料空缺。在評估方面，受測者認為影像標籤註釋之方法可以有效的解決多國語系註釋之問題，以及有效節省在行動裝置上打字之時間，更加強了記錄的便利性與完整性，同時也帶來不同以往的新鮮感。而我們藉由群眾外包得到良好的解析率，並且從歷程記錄中發現群眾外包於運作上，越多專業之群眾並不一定帶來越好的成果，只仰賴少部分專業之群眾提供貢獻，反而能減少問題產生，進而得到較好之結果。
In this study, we created the function of image tags annotating in the application, iPARIS-Plus. It provided a new method of annotation which is different from the text annotations, therefore, users could have another choice. This function could solve the problem of multilingual annotation and reduce the time effectively when users take for the record. iPARIS-Plus allows users to retain the convenience of recording on their mobile device, at the same time, it also considers the integrity of the records, so let people will no longer feel recording is a trouble. In addition, we converted the image tags that used to annotate into text through the crowdsourcing system to solve the problem which users couldn’t enter text because of the multilingual annotation, it resulted in a lack of databases. In the evaluation, users argued that the image tags annotation method could solve the problem of multilingual annotation effectively, as well as saving the time they typing on their moblie devices, even more it can enhance the integrity and convenience of records. We got a good resolution rate of converting the image tags into text by crowdsourcing system and found that more professional crowds do not bring better results. On the contrary, we could rely on a few of professional crowds to reduce the problems, then got a better results.
參考文獻 1 Bolaños, Marc, Maite Garolera, and Petia Radeva. "Active labeling application applied to food-related object recognition." Proceedings of the 5th international workshop on Multimedia for cooking & eating activities. ACM, 2013.
2 Bush, Vannevar, and As We May Think. "The atlantic monthly." As We May Think 176.1 (1945): 101-108.
3 Buykx, Lucy, and Helen Petrie. "What Cooks Needs from Multimedia and Textually Enhanced Recipes." Multimedia (ISM), 2011 IEEE International Symposium on. IEEE, 2011.
4 Camera Finder. http://www.flickr.com/cameras.
5 Doan, Anhai, Raghu Ramakrishnan, and Alon Y. Halevy. "Crowdsourcing systems on the world-wide web." Communications of the ACM 54.4 (2011): 86-96.
6 Pishva, Davar, et al. "Bread recognition using color distribution analysis." IEICE TRANSACTIONS on Information and Systems 84.12 (2001): 1651-1659.
7 Geiger, David, Michael Rosemann, and Erwin Fielt. "Crowdsourcing information systems: a systems theory perspective." Proceedings of the 22nd Australasian Conference on Information Systems (ACIS 2011). 2011.
8 Bell, C. Gordon, and Jim Gemmell. Total recall: How the e-memory revolution will change everything. Dutton, 2009.
9 Hoashi, Hajime, Taichi Joutou, and Keiji Yanai. "Image recognition of 85 food categories by feature fusion." Multimedia (ISM), 2010 IEEE International Symposium on. IEEE, 2010.
10 ISO/IEC 15938-1:2002, “Information technology — Multimedia content description interface — Part 1: Systems,” 2002.
11 ISO/IEC 15938-2:2002, “Information technology — Multimedia content description interface — Part 2: Description definition language,” 2002.
12 ISO/IEC 15938-3:2002, “Information technology — Multimedia content description interface — Part 3: Visual,” 2002.
13 ISO/IEC 15938-4:2002, “Information technology — Multimedia content description interface — Part 4: Audio,” 2002.
14 ISO/IEC 15938-5:2003, “Information technology — Multimedia content description interface — Part 5: Multimedia description schemes,” 2003.
15 ISO/IEC 15938-6:2003, “Information technology — Multimedia content description interface — Part 6: Reference software,” 2003.
16 ISO/IEC 15938-7:2003, “Information technology — Multimedia content description interface — Part 7: Conformance testing,” 2003.
17 ISO/IEC TR 15938-8:2002, “Information technology — Multimedia content description interface — Part 8: Extraction and use of MPEG-7 descriptions,” 2002.
18 ISO/IEC 15938-9:2005, “Information technology — Multimedia content description interface — Part 9: Profiles and levels,” 2005.
19 ISO/IEC 15938-10:2005, “Information technology — Multimedia content description interface — Part 10: Schema definition,” 2005.
20 ISO/IEC TR 15938-11:2005, “Information technology — Multimedia content description interface — Part 11: MPEG-7 profile schemas,” 2005.
21 ISO/IEC 15938-12:2008, “Information technology — Multimedia content description interface — Part 12: Query format,” 2008.
22 Kayo Iizuka, Takuya Okawada, and Yasuki Iizuka. "Food Product Information Supplement System-Corresponding to Consumer Needs for Shopping and Eating Out." Multimedia (ISM), 2011 IEEE International Symposium on. IEEE, 2011.
23 Kitamura, Keigo, Toshihiko Yamasaki, and Kiyoharu Aizawa. "Food log by analyzing food images." Proceeding of the 16th ACM international conference on Multimedia. ACM, 2008.
24 Kitamura, Keigo, Toshihiko Yamasaki, and Kiyoharu Aizawa. "Food-Log: Capture, analysis and retrieval of personal food images via web." Proc. Int’l Symposium on Applications and the Internet Workshops. 2009.
25 Kitamura, Keigo, Toshihiko Yamasaki, and Kiyoharu Aizawa. "Image processing based approach to food balance analysis for personal food logging." Multimedia and Expo (ICME), 2010 IEEE International Conference on. IEEE, 2010.
26 KPCB Internet Trends. http://www.scribd.com/doc/115395317/2012-KPCB-Internet-Trends-Year-End-Update.
27 Kuo, Fang-Fei, et al. "Intelligent menu planning: recommending set of recipes by ingredients." Proceedings of the ACM multimedia 2012 workshop on Multimedia for cooking and eating activities. ACM, 2012.
28 Kuo, Pei-Jeng, Terumasa Aoki, and Hiroshi Yasuda. "Building personal digital photograph libraries: An approach with ontology-based MPEG-7 dozen dimensional digital content architecture." Computer Graphics International, 2004. Proceedings. IEEE, 2004.
29 Kuo, Pei-Jeng, Terumasa Aoki, and Hiroshi Yasuda. "MPEG-7 based dozen dimensional digital content architecture for semantic image retrieval services." e-Technology, e-Commerce and e-Service, 2004. EEE`04. 2004 IEEE International Conference on. IEEE, 2004.
30 Kuo, Pei-Jeng, Terumasa Aoki, and Hiroshi Yasuda. "Continuous Archiving of Personal Digital Photograph Collections with a MPEG-7 Based Dozen Dimensional Digital Content Architecture." Archiving Conference. Vol. 2005. No. 1. Society for Imaging Science and Technology, 2005.
31 Messina, Virginia, Vesanto Melina, and Ann Reed Mangels. "A New Food Guide: For North American Vegetarians." Canadian Journal of Dietetic Practice and Research 64.2 (2003): 82-86.
32 Miyawaki, Kenzaburo, et al. "A cooking support system for people with higher brain dysfunction." Proceedings of the ACM multimedia 2009 workshop on Multimedia for cooking and eating activities. ACM, 2009.
33 Morikawa, Chamin, Haruki Sugiyama, and Kiyoharu Aizawa. "Food region segmentation in meal images using touch points." Proceedings of the ACM multimedia 2012 workshop on Multimedia for cooking and eating activities. ACM, 2012.
34 MPEG. "About MPEG - Achievements". chiariglione.org. http://mpeg.chiariglione.org/achievements.htm. Retrieved 2009-10-31.
35 MPEG. "Terms of Reference". chiariglione.org. http://mpeg.chiariglione.org/terms_of_reference.htm. Retrieved 2009-10-31.
36 MPEG. "MPEG standards - Full list of standards developed or under development". chiariglione.org. http://mpeg.chiariglione.org/standards.htm. Retrieved 2009-10-31.
37 Ota, Saori, et al. "Comparison of Experts` between Non-experts` Apple Peeling Skills and the Designing of Learning Support System." Multimedia (ISM), 2010 IEEE International Symposium on. IEEE, 2010.
38 Po-Yen Chen and Pei-Jeng Kuo, “Archiving of Personal Digital Photograph Collections with a MPEG-7 based Geotag Related Annotation Methodology,” Published in Archiving 2012 Copenhagen, Denmark; June 2012; p. 107-110; ISBN / ISSN: 978-0-89208-300-8.
39 Po-Yen Chen, “Building a Mobile Personal Digital Photograph Annotation System Based on Usability Engineering” National Chengchi University, Taipei, 2013.
40 Viitamaki, S. "The FLIRT model of crowdsourcing: planning and executing collective customer collaboration." Masterarbeit an der Helsinki School of Economics, Department of Marketing and Management, Helsinki (2008).
41 Xie, Haoran, Lijuan Yu, and Qing Li. "A Hybrid Semantic Item Model for Recipe Search by Example." Multimedia (ISM), 2010 IEEE International Symposium on. IEEE, 2010.
42 Yamakata, Yoko, et al. "A study of object naming according to the manufacturing processes in a cooking activity." Proceedings of the ACM multimedia 2009 workshop on Multimedia for cooking and eating activities. ACM, 2009.
43 Yin, Wenyuan, Tao Mei, and Chang Wen Chen. "Crowdsourced Learning to Photograph via Mobile Devices." Multimedia and Expo (ICME), 2012 IEEE International Conference on. IEEE, 2012.
44 Zepeda, Lydia, and David Deal. "Think before you eat: photographic food diaries as intervention tools to change dietary decision making and attitudes." International Journal of Consumer Studies 32.6 (2008): 692-698
描述 碩士
國立政治大學
資訊科學學系
100753019
102
資料來源 http://thesis.lib.nccu.edu.tw/record/#G0100753019
資料類型 thesis
dc.contributor.advisor 郭正佩zh_TW
dc.contributor.advisor Kuo, Pei Jengen_US
dc.contributor.author (Authors) 林睦叡zh_TW
dc.contributor.author (Authors) Lin, Mu Ruien_US
dc.creator (作者) 林睦叡zh_TW
dc.creator (作者) Lin, Mu Ruien_US
dc.date (日期) 2013en_US
dc.date.accessioned 1-Jul-2014 12:14:34 (UTC+8)-
dc.date.available 1-Jul-2014 12:14:34 (UTC+8)-
dc.date.issued (上傳時間) 1-Jul-2014 12:14:34 (UTC+8)-
dc.identifier (Other Identifiers) G0100753019en_US
dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/67155-
dc.description (描述) 碩士zh_TW
dc.description (描述) 國立政治大學zh_TW
dc.description (描述) 資訊科學學系zh_TW
dc.description (描述) 100753019zh_TW
dc.description (描述) 102zh_TW
dc.description.abstract (摘要) 本研究於個人數位註釋應用程式iPARIS上，建立影像標籤註釋之功能，稱為iPARIS-PLUS。它提供不同於以往文字註釋的新方法，讓使用者可以有另一種選擇，也同時解決在面臨多國語系時的註釋問題，並有效的降低記錄所花費之時間。iPARIS-Plus能讓使用者保有在行動裝置上紀實之便利性的同時，也能兼顧記錄的完整性，讓人們不再將記錄視為一種麻煩。除此之外，我們透過群眾外包的力量將用於註釋的影像標籤轉換為文字後儲存於資料庫中，解決原先因多國語系註釋問題讓使用者無法輸入文字，導致資料庫缺少該筆資料而造成資料空缺。在評估方面，受測者認為影像標籤註釋之方法可以有效的解決多國語系註釋之問題，以及有效節省在行動裝置上打字之時間，更加強了記錄的便利性與完整性，同時也帶來不同以往的新鮮感。而我們藉由群眾外包得到良好的解析率，並且從歷程記錄中發現群眾外包於運作上，越多專業之群眾並不一定帶來越好的成果，只仰賴少部分專業之群眾提供貢獻，反而能減少問題產生，進而得到較好之結果。zh_TW
dc.description.abstract (摘要) In this study, we created the function of image tags annotating in the application, iPARIS-Plus. It provided a new method of annotation which is different from the text annotations, therefore, users could have another choice. This function could solve the problem of multilingual annotation and reduce the time effectively when users take for the record. iPARIS-Plus allows users to retain the convenience of recording on their mobile device, at the same time, it also considers the integrity of the records, so let people will no longer feel recording is a trouble. In addition, we converted the image tags that used to annotate into text through the crowdsourcing system to solve the problem which users couldn’t enter text because of the multilingual annotation, it resulted in a lack of databases. In the evaluation, users argued that the image tags annotation method could solve the problem of multilingual annotation effectively, as well as saving the time they typing on their moblie devices, even more it can enhance the integrity and convenience of records. We got a good resolution rate of converting the image tags into text by crowdsourcing system and found that more professional crowds do not bring better results. On the contrary, we could rely on a few of professional crowds to reduce the problems, then got a better results.en_US
dc.description.tableofcontents 第一章 緒論 1
1.1 研究背景 1
1.2 研究動機 2
1.2.1 紀錄行為轉變 2
1.2.2 輔助飲食記錄程式 4
1.3 研究問題 5
1.4 研究目的 6
1.5 研究架構 7
第二章 文獻探討 8
2.1 飲食結合科技之研究 8
2.1.1 烹飪與飲食科技相關研究 8
2.1.2 飲食記錄概述 12
2.1.3 飲食記錄系統 12
2.1.4 小結 15
2.2 影像內容描述與檢索 16
2.2.1 MPEG-7概述 16
2.2.2 MPEG-7標準 16
2.2.3 以MPEG-7為基礎的影像註記系統 18
2.2.4 小結 22
2.3 群眾外包系統基礎 23
2.3.1 群眾外包概述 23
2.3.2 群眾外包相關研究 23
2.3.3 小結 29
2.4 文獻總結 29
第三章 研究方法 30
3.1 系統架構 30
3.2 影像標籤解析系統 31
3.3 iPARIS-PluS 33
3.4 結論 37
第四章 評估 38
4.1 實驗說明與流程 38
4.2 實驗限制 39
4.3 評估方法 39
4.4 評估結果 40
4.3.1 iPARIS-Plus受測者問卷 40
4.3.2 影像標籤之解析率與解析歷程 44
第五章 討論 47
5.1 iPARIS-PluS受測者問卷探討 47
5.2 影像標籤解析率與歷程探討 48
第六章 結論與未來展望 50
參考文獻 52
附錄 57		zh_TW
dc.format.extent 8787505 bytes-
dc.format.mimetype application/pdf-
dc.language.iso en_US-
dc.source.uri (資料來源) http://thesis.lib.nccu.edu.tw/record/#G0100753019en_US
dc.subject (關鍵詞) 群眾外包zh_TW
dc.subject (關鍵詞) 飲食記錄zh_TW
dc.subject (關鍵詞) 影像標籤zh_TW
dc.subject (關鍵詞) 多國語系問題zh_TW
dc.title (題名) 多語系個人飲食攝影註記典藏系統輔以群眾外包zh_TW
dc.title (題名) Multilingual Personal Dietary Photograph Annotation System with The Assistance of Crowdsourcingen_US
dc.type (資料類型) thesisen
dc.relation.reference (參考文獻) 1 Bolaños, Marc, Maite Garolera, and Petia Radeva. "Active labeling application applied to food-related object recognition." Proceedings of the 5th international workshop on Multimedia for cooking & eating activities. ACM, 2013.
2 Bush, Vannevar, and As We May Think. "The atlantic monthly." As We May Think 176.1 (1945): 101-108.
3 Buykx, Lucy, and Helen Petrie. "What Cooks Needs from Multimedia and Textually Enhanced Recipes." Multimedia (ISM), 2011 IEEE International Symposium on. IEEE, 2011.
4 Camera Finder. http://www.flickr.com/cameras.
5 Doan, Anhai, Raghu Ramakrishnan, and Alon Y. Halevy. "Crowdsourcing systems on the world-wide web." Communications of the ACM 54.4 (2011): 86-96.
6 Pishva, Davar, et al. "Bread recognition using color distribution analysis." IEICE TRANSACTIONS on Information and Systems 84.12 (2001): 1651-1659.
7 Geiger, David, Michael Rosemann, and Erwin Fielt. "Crowdsourcing information systems: a systems theory perspective." Proceedings of the 22nd Australasian Conference on Information Systems (ACIS 2011). 2011.
8 Bell, C. Gordon, and Jim Gemmell. Total recall: How the e-memory revolution will change everything. Dutton, 2009.
9 Hoashi, Hajime, Taichi Joutou, and Keiji Yanai. "Image recognition of 85 food categories by feature fusion." Multimedia (ISM), 2010 IEEE International Symposium on. IEEE, 2010.
10 ISO/IEC 15938-1:2002, “Information technology — Multimedia content description interface — Part 1: Systems,” 2002.
11 ISO/IEC 15938-2:2002, “Information technology — Multimedia content description interface — Part 2: Description definition language,” 2002.
12 ISO/IEC 15938-3:2002, “Information technology — Multimedia content description interface — Part 3: Visual,” 2002.
13 ISO/IEC 15938-4:2002, “Information technology — Multimedia content description interface — Part 4: Audio,” 2002.
14 ISO/IEC 15938-5:2003, “Information technology — Multimedia content description interface — Part 5: Multimedia description schemes,” 2003.
15 ISO/IEC 15938-6:2003, “Information technology — Multimedia content description interface — Part 6: Reference software,” 2003.
16 ISO/IEC 15938-7:2003, “Information technology — Multimedia content description interface — Part 7: Conformance testing,” 2003.
17 ISO/IEC TR 15938-8:2002, “Information technology — Multimedia content description interface — Part 8: Extraction and use of MPEG-7 descriptions,” 2002.
18 ISO/IEC 15938-9:2005, “Information technology — Multimedia content description interface — Part 9: Profiles and levels,” 2005.
19 ISO/IEC 15938-10:2005, “Information technology — Multimedia content description interface — Part 10: Schema definition,” 2005.
20 ISO/IEC TR 15938-11:2005, “Information technology — Multimedia content description interface — Part 11: MPEG-7 profile schemas,” 2005.
21 ISO/IEC 15938-12:2008, “Information technology — Multimedia content description interface — Part 12: Query format,” 2008.
22 Kayo Iizuka, Takuya Okawada, and Yasuki Iizuka. "Food Product Information Supplement System-Corresponding to Consumer Needs for Shopping and Eating Out." Multimedia (ISM), 2011 IEEE International Symposium on. IEEE, 2011.
23 Kitamura, Keigo, Toshihiko Yamasaki, and Kiyoharu Aizawa. "Food log by analyzing food images." Proceeding of the 16th ACM international conference on Multimedia. ACM, 2008.
24 Kitamura, Keigo, Toshihiko Yamasaki, and Kiyoharu Aizawa. "Food-Log: Capture, analysis and retrieval of personal food images via web." Proc. Int’l Symposium on Applications and the Internet Workshops. 2009.
25 Kitamura, Keigo, Toshihiko Yamasaki, and Kiyoharu Aizawa. "Image processing based approach to food balance analysis for personal food logging." Multimedia and Expo (ICME), 2010 IEEE International Conference on. IEEE, 2010.
26 KPCB Internet Trends. http://www.scribd.com/doc/115395317/2012-KPCB-Internet-Trends-Year-End-Update.
27 Kuo, Fang-Fei, et al. "Intelligent menu planning: recommending set of recipes by ingredients." Proceedings of the ACM multimedia 2012 workshop on Multimedia for cooking and eating activities. ACM, 2012.
28 Kuo, Pei-Jeng, Terumasa Aoki, and Hiroshi Yasuda. "Building personal digital photograph libraries: An approach with ontology-based MPEG-7 dozen dimensional digital content architecture." Computer Graphics International, 2004. Proceedings. IEEE, 2004.
29 Kuo, Pei-Jeng, Terumasa Aoki, and Hiroshi Yasuda. "MPEG-7 based dozen dimensional digital content architecture for semantic image retrieval services." e-Technology, e-Commerce and e-Service, 2004. EEE`04. 2004 IEEE International Conference on. IEEE, 2004.
30 Kuo, Pei-Jeng, Terumasa Aoki, and Hiroshi Yasuda. "Continuous Archiving of Personal Digital Photograph Collections with a MPEG-7 Based Dozen Dimensional Digital Content Architecture." Archiving Conference. Vol. 2005. No. 1. Society for Imaging Science and Technology, 2005.
31 Messina, Virginia, Vesanto Melina, and Ann Reed Mangels. "A New Food Guide: For North American Vegetarians." Canadian Journal of Dietetic Practice and Research 64.2 (2003): 82-86.
32 Miyawaki, Kenzaburo, et al. "A cooking support system for people with higher brain dysfunction." Proceedings of the ACM multimedia 2009 workshop on Multimedia for cooking and eating activities. ACM, 2009.
33 Morikawa, Chamin, Haruki Sugiyama, and Kiyoharu Aizawa. "Food region segmentation in meal images using touch points." Proceedings of the ACM multimedia 2012 workshop on Multimedia for cooking and eating activities. ACM, 2012.
34 MPEG. "About MPEG - Achievements". chiariglione.org. http://mpeg.chiariglione.org/achievements.htm. Retrieved 2009-10-31.
35 MPEG. "Terms of Reference". chiariglione.org. http://mpeg.chiariglione.org/terms_of_reference.htm. Retrieved 2009-10-31.
36 MPEG. "MPEG standards - Full list of standards developed or under development". chiariglione.org. http://mpeg.chiariglione.org/standards.htm. Retrieved 2009-10-31.
37 Ota, Saori, et al. "Comparison of Experts` between Non-experts` Apple Peeling Skills and the Designing of Learning Support System." Multimedia (ISM), 2010 IEEE International Symposium on. IEEE, 2010.
38 Po-Yen Chen and Pei-Jeng Kuo, “Archiving of Personal Digital Photograph Collections with a MPEG-7 based Geotag Related Annotation Methodology,” Published in Archiving 2012 Copenhagen, Denmark; June 2012; p. 107-110; ISBN / ISSN: 978-0-89208-300-8.
39 Po-Yen Chen, “Building a Mobile Personal Digital Photograph Annotation System Based on Usability Engineering” National Chengchi University, Taipei, 2013.
40 Viitamaki, S. "The FLIRT model of crowdsourcing: planning and executing collective customer collaboration." Masterarbeit an der Helsinki School of Economics, Department of Marketing and Management, Helsinki (2008).
41 Xie, Haoran, Lijuan Yu, and Qing Li. "A Hybrid Semantic Item Model for Recipe Search by Example." Multimedia (ISM), 2010 IEEE International Symposium on. IEEE, 2010.
42 Yamakata, Yoko, et al. "A study of object naming according to the manufacturing processes in a cooking activity." Proceedings of the ACM multimedia 2009 workshop on Multimedia for cooking and eating activities. ACM, 2009.
43 Yin, Wenyuan, Tao Mei, and Chang Wen Chen. "Crowdsourced Learning to Photograph via Mobile Devices." Multimedia and Expo (ICME), 2012 IEEE International Conference on. IEEE, 2012.
44 Zepeda, Lydia, and David Deal. "Think before you eat: photographic food diaries as intervention tools to change dietary decision making and attitudes." International Journal of Consumer Studies 32.6 (2008): 692-698		zh_TW