Publications-Theses
Article View/Open
Publication Export
-
Google ScholarTM
NCCU Library
Citation Infomation
Related Publications in TAIR
題名 以使用性工程建構行動個人化數位攝影註釋系統
Building a Mobile Personal Digital Photograph Annotation System Based on Usability Engineering作者 陳柏諺
Chen, Po Yen貢獻者 郭正佩
陳柏諺
Chen, Po Yen關鍵詞 行動攝影註釋系統
使用者介面設計
使用性工程
使用性測試
mobile photograph annotation system
user interface design
usability engineering
usability testing日期 2013 上傳時間 2-Dec-2013 17:47:38 (UTC+8) 摘要 隨著數位相機、智慧型手機等影像記錄產品的普及,人們可以隨時隨地按下快門,使得個人相片的數量不斷的增長。倘若照片中缺少了註釋,進行搜尋檢索大量的個人照片是困難的。雖然如此,人們卻會因為繁瑣累人的照片註釋工作而缺乏意願。 本研究藉由Kuo所發展出的PARIS (Personal Archiving and Retrieving Image System)作為來源系統架構,其系統解決了大部分個人數位影像語義標註的困難,也利用半自動註記方法減少使用者註釋負擔。但由於過去缺乏行動載具,PARIS並未開發一個現代化的行動註釋系統,來協助一般使用者進行個人影像註釋。 為了解決此問題,本研究利用使用性工程進行系統的建構,以設計及開發出一套現代化的行動影像註釋系統iPARIS (Integrated Personal Archiving and Retrieving Image System)。iPARIS擴展了PARIS設計出符合行動載具的後設資料結構與本體,包含將PARIS所定義的DDDC後設資料標準擴充為得以群眾註記之社群媒體地理標籤的iDDDC (Integrated Dozen Dimensional Digital Content),以及在既有的STO (Spatial and Temporal Based Ontology)的空間架構中加入更具彈性的地理標籤關聯方法GRO (Geotag Related Ontology)。iPARIS並利用工作流程設計、介面線稿設計、視覺設計、系統實作、使用者參與設計等步驟來設計及開發系統,再以迭代設計方法不斷地改善系統的使用者介面及使用者體驗。iPARIS在建置完成後利用參與啟發式評估量表、手勢次數、操作時間、操作路徑、錯誤次數進行使用性測試,而其測試結果也達預期的使用性目標。更進一步,透過分析使用者操作系統的實際行為來找出系統存在的使用性問題,並提出未來系統的改進方式。 透過完整的規劃與適切的設計系統介面,讓使用者在拍照、註釋、組織及管理照片都可以在行動應用程式上完成,並使此系統能滿足具有效率、具學習性、具記憶性、低錯誤率及高滿意度等Nielsen所提出的使用性標準,以降低個人影像註釋時的負擔,並增加使用者註釋個人照片的意願,以應付日益增長地個人數位影像資料的管理需求。
With the widespread use of photograph recording products, such as digital camera and smartphone, people take photographs easily so that the number of personal photographs increases unceasingly. If photographs are lacking of annotation, searching and retrieving the large number of personal photographs become difficult. However, people are usually reluctant to the cumbersome and exhausted annotation work. In 2004, Kuo et al. developed PARIS (Personal Archiving and Retrieving Image System) to solve these problems. Based on MPEG-7, PARIS resolved most difficulties of personal digital image semantic annotation and lightened users’ annotation burdens by semi-automatic annotation methods. However, because of the lack of mobile device at that time, PARIS did not develop a modern mobile annotation system to help ordinary people annotate personal photographs. Therefore, this thesis builds a system with usability engineering as well as designs and develops a modern mobile image annotation system iPARIS (Integrated Personal Archiving and Retrieving Image System). iPARIS expands PARIS architecture to add the support for mobile. It expands PARIS DDDC metadata standard to iDDDC (Integrated Dozen Dimensional Digital Content) which is a crowdsourcing annotation enabled by third party social networking services, and provides STO’s spatial ontology a more flexible geo-information description methodology GRO (Geotag Related Ontology). iPARIS also takes the steps of workflow design, wireframe design, visual design, system implementation, participatory design to build the system; moreover, it keeps improving the user interface and user experience by iterative design. After implementing iPARIS, we conduct usability testing including participatory heuristic evaluation, gesture times, operation time, gesture path, error times, and interview. The test results reach the expected usability goals. Furthermore, the thesis finds some usability problems by analyzing users’ behaviors when they are using the application and brings future improvement for the system. By integral planning and appropriate interface design, this system lets user take, annotate, organize, and mange personal photos in a mobile application. We hope that iPARIS can meet the usability index to lighten the burdens of personal photograph annotation, arousing users’ desire to annotate personal photographs, and meet the growing needs for the management of personal digital photograph information.參考文獻 [1] G. Bell and J. Gemmell, Total Recall: How the E-Memory Revolution Will Change Everything. Dutton, 2009. [2] NBC News, 2013. http://instagram.com/p/W2FCksR9-e/. [3] KPCB Internet Trends. http://www.scribd.com/doc/115395317/2012-KPCB-Internet-Trends-Year-End-Update. [4] Camera Finder. http://www.flickr.com/cameras. [5] M. Bamberg, New Image Frontiers: Defining the Future of Photography. Cengage Learning PTR, 2012. [6] P. J. Kuo, T. Aoki, and H. Yasuda, “Building personal digital photograph libraries: an approach with ontology-based MPEG-7 Dozen Dimensional Digital Content architecture,” presented at the Proceedings of the 2004 Computer Graphics International (CGI`04), 2004, pp. 482–489. [7] P. J. Kuo, T. Aoki, and H. Yasuda, “MPEG-7 Based Dozen Dimensional Digital Content Architecture for Semantic Image Retrieval Services,” presented at the Proceedings of the 2004 IEEE International Conference on e-Technology, e-Commerce and e-Service (EEE`04), 2004, pp. 518–525. [8] P. J. Kuo, T. Aoki, and H. Yasuda, “Continuous Archiving of Personal Digital Photograph Collections with a MPEG-7 Based Dozen Dimensional Digital Content Architecture,” presented at the Proceedings of the Second IS&T Archiving Conference, 2005, pp. 188–192. [9] P. J. Kuo, “Continuous Personal Digital Photograph Archival and Retrieval with Spatial and Tempopal Coordinated MPEG-7 Description Scheme,” University of Tokyo, 2007. [10] O. Lassila, “Semantic Web Soul Searching,” Wilbur-and-O blog, March 19, 2007. [11] R. Agrawal, W. I. Grosky, and F. Fotouhi, “Image Clustering and Retrieval Using MPEG-7,” in The handbook of MPEG applications: standards in practice, no. 9, John Wiley & Sons Inc, 2011, pp. 221–239. [12] D. G. Lowe, “Object recognition from local scale-invariant features,” vol. 2, pp. 1150–1157, 1999. [13] H. Bay, T. Tuytelaars, and L. Van Gool, “Surf: Speeded up robust features,” Computer Vision–ECCV 2006, pp. 404–417, 2006. [14] G. Wei, Z. Hai, M. Zhan, and Z. Lizhong, “Face Recognition Based on PCA and SVM Optimized by MEB,” presented at the Intelligent Networks and Intelligent Systems (ICINIS), 2010 3rd International Conference on, 2010, pp. 68–71. [15] S. Committee, “Exchangeable image file format for digital still cameras: Exif version 2.3,” Specification, Camera & Imaging Products Association, vol. 1585, 2010. [16] IPTC, “IPTC Photo Metadata: Core 1.1/Extension 1.1,” Jul. 2010. [17] D. I. Group, “DIG35 Specification,” Apr. 2001. [18] “Dublin Core Metadata Element Set, Version 1.1,” 2012. [19] Adobe Systems Inc., “XMP Specification,” 2012. [20] J. M. Martínez, “MPEG-7 Overview (version 10),” ISO/IEC JTC1/SC29/WG11, N6828, Oct. 2004. [21] E. Hyvönen, A. Styrman, and S. Saarela, “Ontology-Based Image Retrieval,” presented at the Proceedings of XML Finland 2002 Conference, 2002. [22] A. Jaimes and J. R. Smith, “Semi-automatic, data-driven construction of multimedia ontologies,” Multimedia and Expo, IEEE International Conference on, vol. 1, pp. 781–784, 2003. [23] A. T. Schreiber, B. Dubbeldam, J. Wielemaker, and B. Wielinga, “Ontology-Based Photo Annotation,” IEEE Intelligent Systems, vol. 16, no. 3, pp. 66–74, 2001. [24] K. Rodden and K. R. Wood, “How do people manage their digital photographs?,” presented at the CHI `03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2003. [25] B. S. Manjunath, P. Salembier, and T. Sikora, Introduction to Mpeg-7: Multimedia Content Description Interface. John Wiley & Sons Inc, 2002. [26] P. Salembier and J. Smith, “Overview of Multimedia Description Schemes and Schema Tools,” in Introduction to Mpeg-7: Multimedia Content Description Interface, no. 6, John Wiley & Sons Inc, 2002. [27] A. Wilhelm, Y. Takhteyev, R. Sarvas, N. Van House, and M. Davis, “Photo annotation on a camera phone,” presented at the CHI `04 extended abstracts on Human factors in computing systems, New York, NY, USA, 2004, pp. 1403–1406. [28] M. Naaman and R. Nair, “ZoneTag`s Collaborative Tag Suggestions: What is This Person Doing in My Phone?,” IEEE MultiMedia, vol. 15, no. 3, pp. 34–40, 2008. [29] Instagram. http://instagram.com/. [30] N. Bevan, “Human-computer interaction standards,” Advances in Human Factors/Ergonomics, vol. 20, pp. 885–890, 1995. [31] J. Nielsen, Usability Engineering. Academic Press, 1993. [32] J. Nielsen and R. Molich, “Heuristic evaluation of user interfaces,” pp. 249–256, 1990. [33] J. Nielsen and R. L. Mack, Usability inspection methods. John Wiley & Sons Inc, 1994. [34] A. Sears and J. A. Jacko, Eds., The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, Second Edition. CRC Press, 2009. [35] 林欣瑤。以使用性原則設計並探討個人化飲食管理系統介面。國立清華大學碩士論文,2011。 [36] Apple, iOS Human Interface Guidelines, 2012. http://developer.apple.com/library/ios/documentation/UserExperience/Conceptual/MobileHIG/MobileHIG.pdf [37] Google, Android Design Principles. http://developer.android.com/design/get-started/principles.html [38] M. J. Muller and A. McClard, “Validating an extension to participatory heuristic evaluation: quality of work and quality of work life,” pp. 115–116, 1995. [39] M. J. Muller, L. Matheson, C. Page, and R. Gallup, “Methods & tools: participatory heuristic evaluation,” interactions, vol. 5, no. 5, pp. 13–18, 1998. [40] P. Y. Chen and P. J. Kuo, “Archiving of Personal Digital Photograph Collections with a MPEG-7 Based Geotag Related Annotation Methodology,” presented at the Proceedings of the Nine IS&T Archiving Conference, 2012. [41] D. D. Zad and H. Agius, “An MPEG-7 Profile for Collaborative Multimedia Annotation,” in The handbook of MPEG applications: standards in practice, no. 11, John Wiley & Sons Inc, 2011, pp. 263–291. 描述 碩士
國立政治大學
資訊科學學系
99753015
102資料來源 http://thesis.lib.nccu.edu.tw/record/#G0099753015 資料類型 thesis dc.contributor.advisor 郭正佩 zh_TW dc.contributor.author (Authors) 陳柏諺 zh_TW dc.contributor.author (Authors) Chen, Po Yen en_US dc.creator (作者) 陳柏諺 zh_TW dc.creator (作者) Chen, Po Yen en_US dc.date (日期) 2013 en_US dc.date.accessioned 2-Dec-2013 17:47:38 (UTC+8) - dc.date.available 2-Dec-2013 17:47:38 (UTC+8) - dc.date.issued (上傳時間) 2-Dec-2013 17:47:38 (UTC+8) - dc.identifier (Other Identifiers) G0099753015 en_US dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/61996 - dc.description (描述) 碩士 zh_TW dc.description (描述) 國立政治大學 zh_TW dc.description (描述) 資訊科學學系 zh_TW dc.description (描述) 99753015 zh_TW dc.description (描述) 102 zh_TW dc.description.abstract (摘要) 隨著數位相機、智慧型手機等影像記錄產品的普及,人們可以隨時隨地按下快門,使得個人相片的數量不斷的增長。倘若照片中缺少了註釋,進行搜尋檢索大量的個人照片是困難的。雖然如此,人們卻會因為繁瑣累人的照片註釋工作而缺乏意願。 本研究藉由Kuo所發展出的PARIS (Personal Archiving and Retrieving Image System)作為來源系統架構,其系統解決了大部分個人數位影像語義標註的困難,也利用半自動註記方法減少使用者註釋負擔。但由於過去缺乏行動載具,PARIS並未開發一個現代化的行動註釋系統,來協助一般使用者進行個人影像註釋。 為了解決此問題,本研究利用使用性工程進行系統的建構,以設計及開發出一套現代化的行動影像註釋系統iPARIS (Integrated Personal Archiving and Retrieving Image System)。iPARIS擴展了PARIS設計出符合行動載具的後設資料結構與本體,包含將PARIS所定義的DDDC後設資料標準擴充為得以群眾註記之社群媒體地理標籤的iDDDC (Integrated Dozen Dimensional Digital Content),以及在既有的STO (Spatial and Temporal Based Ontology)的空間架構中加入更具彈性的地理標籤關聯方法GRO (Geotag Related Ontology)。iPARIS並利用工作流程設計、介面線稿設計、視覺設計、系統實作、使用者參與設計等步驟來設計及開發系統,再以迭代設計方法不斷地改善系統的使用者介面及使用者體驗。iPARIS在建置完成後利用參與啟發式評估量表、手勢次數、操作時間、操作路徑、錯誤次數進行使用性測試,而其測試結果也達預期的使用性目標。更進一步,透過分析使用者操作系統的實際行為來找出系統存在的使用性問題,並提出未來系統的改進方式。 透過完整的規劃與適切的設計系統介面,讓使用者在拍照、註釋、組織及管理照片都可以在行動應用程式上完成,並使此系統能滿足具有效率、具學習性、具記憶性、低錯誤率及高滿意度等Nielsen所提出的使用性標準,以降低個人影像註釋時的負擔,並增加使用者註釋個人照片的意願,以應付日益增長地個人數位影像資料的管理需求。 zh_TW dc.description.abstract (摘要) With the widespread use of photograph recording products, such as digital camera and smartphone, people take photographs easily so that the number of personal photographs increases unceasingly. If photographs are lacking of annotation, searching and retrieving the large number of personal photographs become difficult. However, people are usually reluctant to the cumbersome and exhausted annotation work. In 2004, Kuo et al. developed PARIS (Personal Archiving and Retrieving Image System) to solve these problems. Based on MPEG-7, PARIS resolved most difficulties of personal digital image semantic annotation and lightened users’ annotation burdens by semi-automatic annotation methods. However, because of the lack of mobile device at that time, PARIS did not develop a modern mobile annotation system to help ordinary people annotate personal photographs. Therefore, this thesis builds a system with usability engineering as well as designs and develops a modern mobile image annotation system iPARIS (Integrated Personal Archiving and Retrieving Image System). iPARIS expands PARIS architecture to add the support for mobile. It expands PARIS DDDC metadata standard to iDDDC (Integrated Dozen Dimensional Digital Content) which is a crowdsourcing annotation enabled by third party social networking services, and provides STO’s spatial ontology a more flexible geo-information description methodology GRO (Geotag Related Ontology). iPARIS also takes the steps of workflow design, wireframe design, visual design, system implementation, participatory design to build the system; moreover, it keeps improving the user interface and user experience by iterative design. After implementing iPARIS, we conduct usability testing including participatory heuristic evaluation, gesture times, operation time, gesture path, error times, and interview. The test results reach the expected usability goals. Furthermore, the thesis finds some usability problems by analyzing users’ behaviors when they are using the application and brings future improvement for the system. By integral planning and appropriate interface design, this system lets user take, annotate, organize, and mange personal photos in a mobile application. We hope that iPARIS can meet the usability index to lighten the burdens of personal photograph annotation, arousing users’ desire to annotate personal photographs, and meet the growing needs for the management of personal digital photograph information. en_US dc.description.tableofcontents 第一章 緒論 1 1.1研究動機及背景 1 1.2問題描述 4 1.3研究目的 5 1.4論文架構 5 第二章 文獻探討 6 2.1影像內容描述與檢索機制 6 2.1.1 MPEG-7多媒體內容描述標準 7 2.1.2十二維度數位影像內容註釋結構 9 2.2行動影像註釋系統 11 2.3使用性(Usability) 12 2.3.1使用性定義 12 2.3.2使用性評估 14 2.3.3使用性設計原則 16 2.3.4使用性工程 20 第三章 系統建構 22 3.1系統建構流程 22 3.2系統定義(System Define) 23 3.2.1整合式十二維度數位影像內容註釋結構(iDDDC) 24 3.2.2基於空間與時間知識本體 27 3.3訂定使用性目標(Setting Goal) 31 3.4工作流程設計(Workflow Design) 33 3.5介面線稿設計(Wireframe Design) 36 3.6視覺設計(Visual Design) 43 5.5系統實作 45 5.5使用者參與設計(Participatory Design) 49 5.6迭代設計(Iterative Design) 52 5.7使用性設計原則之應用 53 第四章 使用性測試 57 4.1實驗流程 58 4.2實驗環境 59 4.3受試者 59 4.4實驗任務 60 4.5評估量表內容 60 4.6實驗結果 62 4.6.1評估量表之數據分析 63 4.6.2操作路徑及錯誤次數之數據分析 65 4.6.3手勢次數與操作時間之數據分析 67 4.6.4訪談內容之整理 69 4.6.5未來系統改善之重點 71 第五章 結論 74 參考文獻 78 zh_TW dc.language.iso en_US - dc.source.uri (資料來源) http://thesis.lib.nccu.edu.tw/record/#G0099753015 en_US dc.subject (關鍵詞) 行動攝影註釋系統 zh_TW dc.subject (關鍵詞) 使用者介面設計 zh_TW dc.subject (關鍵詞) 使用性工程 zh_TW dc.subject (關鍵詞) 使用性測試 zh_TW dc.subject (關鍵詞) mobile photograph annotation system en_US dc.subject (關鍵詞) user interface design en_US dc.subject (關鍵詞) usability engineering en_US dc.subject (關鍵詞) usability testing en_US dc.title (題名) 以使用性工程建構行動個人化數位攝影註釋系統 zh_TW dc.title (題名) Building a Mobile Personal Digital Photograph Annotation System Based on Usability Engineering en_US dc.type (資料類型) thesis en dc.relation.reference (參考文獻) [1] G. Bell and J. Gemmell, Total Recall: How the E-Memory Revolution Will Change Everything. Dutton, 2009. [2] NBC News, 2013. http://instagram.com/p/W2FCksR9-e/. [3] KPCB Internet Trends. http://www.scribd.com/doc/115395317/2012-KPCB-Internet-Trends-Year-End-Update. [4] Camera Finder. http://www.flickr.com/cameras. [5] M. Bamberg, New Image Frontiers: Defining the Future of Photography. Cengage Learning PTR, 2012. [6] P. J. Kuo, T. Aoki, and H. Yasuda, “Building personal digital photograph libraries: an approach with ontology-based MPEG-7 Dozen Dimensional Digital Content architecture,” presented at the Proceedings of the 2004 Computer Graphics International (CGI`04), 2004, pp. 482–489. [7] P. J. Kuo, T. Aoki, and H. Yasuda, “MPEG-7 Based Dozen Dimensional Digital Content Architecture for Semantic Image Retrieval Services,” presented at the Proceedings of the 2004 IEEE International Conference on e-Technology, e-Commerce and e-Service (EEE`04), 2004, pp. 518–525. [8] P. J. Kuo, T. Aoki, and H. Yasuda, “Continuous Archiving of Personal Digital Photograph Collections with a MPEG-7 Based Dozen Dimensional Digital Content Architecture,” presented at the Proceedings of the Second IS&T Archiving Conference, 2005, pp. 188–192. [9] P. J. Kuo, “Continuous Personal Digital Photograph Archival and Retrieval with Spatial and Tempopal Coordinated MPEG-7 Description Scheme,” University of Tokyo, 2007. [10] O. Lassila, “Semantic Web Soul Searching,” Wilbur-and-O blog, March 19, 2007. [11] R. Agrawal, W. I. Grosky, and F. Fotouhi, “Image Clustering and Retrieval Using MPEG-7,” in The handbook of MPEG applications: standards in practice, no. 9, John Wiley & Sons Inc, 2011, pp. 221–239. [12] D. G. Lowe, “Object recognition from local scale-invariant features,” vol. 2, pp. 1150–1157, 1999. [13] H. Bay, T. Tuytelaars, and L. Van Gool, “Surf: Speeded up robust features,” Computer Vision–ECCV 2006, pp. 404–417, 2006. [14] G. Wei, Z. Hai, M. Zhan, and Z. Lizhong, “Face Recognition Based on PCA and SVM Optimized by MEB,” presented at the Intelligent Networks and Intelligent Systems (ICINIS), 2010 3rd International Conference on, 2010, pp. 68–71. [15] S. Committee, “Exchangeable image file format for digital still cameras: Exif version 2.3,” Specification, Camera & Imaging Products Association, vol. 1585, 2010. [16] IPTC, “IPTC Photo Metadata: Core 1.1/Extension 1.1,” Jul. 2010. [17] D. I. Group, “DIG35 Specification,” Apr. 2001. [18] “Dublin Core Metadata Element Set, Version 1.1,” 2012. [19] Adobe Systems Inc., “XMP Specification,” 2012. [20] J. M. Martínez, “MPEG-7 Overview (version 10),” ISO/IEC JTC1/SC29/WG11, N6828, Oct. 2004. [21] E. Hyvönen, A. Styrman, and S. Saarela, “Ontology-Based Image Retrieval,” presented at the Proceedings of XML Finland 2002 Conference, 2002. [22] A. Jaimes and J. R. Smith, “Semi-automatic, data-driven construction of multimedia ontologies,” Multimedia and Expo, IEEE International Conference on, vol. 1, pp. 781–784, 2003. [23] A. T. Schreiber, B. Dubbeldam, J. Wielemaker, and B. Wielinga, “Ontology-Based Photo Annotation,” IEEE Intelligent Systems, vol. 16, no. 3, pp. 66–74, 2001. [24] K. Rodden and K. R. Wood, “How do people manage their digital photographs?,” presented at the CHI `03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2003. [25] B. S. Manjunath, P. Salembier, and T. Sikora, Introduction to Mpeg-7: Multimedia Content Description Interface. John Wiley & Sons Inc, 2002. [26] P. Salembier and J. Smith, “Overview of Multimedia Description Schemes and Schema Tools,” in Introduction to Mpeg-7: Multimedia Content Description Interface, no. 6, John Wiley & Sons Inc, 2002. [27] A. Wilhelm, Y. Takhteyev, R. Sarvas, N. Van House, and M. Davis, “Photo annotation on a camera phone,” presented at the CHI `04 extended abstracts on Human factors in computing systems, New York, NY, USA, 2004, pp. 1403–1406. [28] M. Naaman and R. Nair, “ZoneTag`s Collaborative Tag Suggestions: What is This Person Doing in My Phone?,” IEEE MultiMedia, vol. 15, no. 3, pp. 34–40, 2008. [29] Instagram. http://instagram.com/. [30] N. Bevan, “Human-computer interaction standards,” Advances in Human Factors/Ergonomics, vol. 20, pp. 885–890, 1995. [31] J. Nielsen, Usability Engineering. Academic Press, 1993. [32] J. Nielsen and R. Molich, “Heuristic evaluation of user interfaces,” pp. 249–256, 1990. [33] J. Nielsen and R. L. Mack, Usability inspection methods. John Wiley & Sons Inc, 1994. [34] A. Sears and J. A. Jacko, Eds., The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, Second Edition. CRC Press, 2009. [35] 林欣瑤。以使用性原則設計並探討個人化飲食管理系統介面。國立清華大學碩士論文,2011。 [36] Apple, iOS Human Interface Guidelines, 2012. http://developer.apple.com/library/ios/documentation/UserExperience/Conceptual/MobileHIG/MobileHIG.pdf [37] Google, Android Design Principles. http://developer.android.com/design/get-started/principles.html [38] M. J. Muller and A. McClard, “Validating an extension to participatory heuristic evaluation: quality of work and quality of work life,” pp. 115–116, 1995. [39] M. J. Muller, L. Matheson, C. Page, and R. Gallup, “Methods & tools: participatory heuristic evaluation,” interactions, vol. 5, no. 5, pp. 13–18, 1998. [40] P. Y. Chen and P. J. Kuo, “Archiving of Personal Digital Photograph Collections with a MPEG-7 Based Geotag Related Annotation Methodology,” presented at the Proceedings of the Nine IS&T Archiving Conference, 2012. [41] D. D. Zad and H. Agius, “An MPEG-7 Profile for Collaborative Multimedia Annotation,” in The handbook of MPEG applications: standards in practice, no. 11, John Wiley & Sons Inc, 2011, pp. 263–291. zh_TW