Publications-Theses

題名 以臉部特徵為基礎之誇張肖像畫產生系統
Caricature Generation by Analyzing Facial Features
作者 江佩穎
Chiang , Pei-Ying
貢獻者 廖文宏<br>李蔡彥
Liao, Wen-Hung<br>Li, Tsai-Yen
江佩穎
Chiang , Pei-Ying
關鍵詞 誇張肖像
人臉特徵
影像處理
caricature
facial features
image processing
日期 2003
上傳時間 17-Sep-2009 14:06:51 (UTC+8)
摘要 誇張肖像畫是以誇張與諷刺的手法來表現模特兒的特徵。現今這類畫作比起以寫實手法繪製的肖像畫,更受到大眾的喜愛;但是人們若想要自己模仿繪製出這類的肖像畫,除了要有繪畫天賦之外,也必須經過長時間的繪畫訓練以及對人臉的觀察,才能抓出模特兒的臉部特徵,並用生動的手法誇飾出來。 因此,如果電腦能做到代替誇張肖像畫家的工作,自動模仿繪製出誇張化的卡通肖像畫,將能替人們節省大量的時間及經費。本研究主要在設計一套能誇張肖像畫的系統,以根據使用者輸入的臉部影像,自動擷取臉部的特徵(包括特徵點的相對位置、絕對位置、形狀及大小等),並藉由分析這些特徵與常人相異之處,以一致的方式自動將特徵誇張化。這個系統並能以藝術家的作品為輸入,將使用者的臉部影像轉換成具有畫家卡通風格的誇張肖像畫。除了人臉的效果外,我們也進行了頭髮分離與模擬的研究,以強化畫像風格模擬的完整性。最後,我們以實做出了系統對數個具特徵的人臉影像進行實驗,以驗證其可行性及有效性。
Caricaturists are good at drawing sketches which express the exaggerated likeness of a person with a bit flavor of humor or sarcasm. People are willing to pay for this kind of work because it requires a lot of practice to achieve excellence. Acute observation is needed to extract the distinct features from the subject, and decent painting skill is essential to depict these features vividly. It will save much time and effort if computers can be trained used to draw caricatures. In this thesis, we developed a system which can extract and analyze facial features from simple an input facial images. The main purpose of this system is to generate the user-own caricature model by exaggerating his/her unique facial features. Different types of features, including relative locations and sizes, absolute locations and sizes, and each the shape of features are all taken in accountwill be considered. Unlike the complex process reported in the literature, we develop a transformative process that can handle different types of features in a more uniform fashion. Using an artist’s finished work as the source image; the proposed system is capable of producing cartoon-like colorful caricatures of a similar style effectively and efficiently. Besides the caricature painting of the face part, we also present some approaches for hair segmentation and hair style painting to increase make the system more the completeness of our system. Finally, we prove the feasibility and effectiveness of our system by showing several experimental results.
參考文獻 [1] M. Ashikhmin, “Synthesizing natural textures,” Proceedings of ACM Symposium on Interactive 3D Graphics, pp. 217-226, 2001.
[2] S. Brennan, “Caricature generator,” Master’s thesis, Cambridge, MIT, 1982.
[3] T. Beier and S. Neely, “Feature-Based Image Metamorphosis,” Proceedings of SIGGRAPH`92, pp. 35-42, July 1992.
[4] M. C. Burl, T. K. Leung, and P. Perona, “Face localization via shape statistics,” Proceedings of International Workshop on Automatic Face and Gesture Recognition, pp. 154-159, Zurich, Switzerland, June 26-28, 1995.
[5] P. J. Burt and E. H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Transactions on Communication, 31(4), pp.532-540, 1983.
[6] R. Chellappa, C.L. Wilson, and S. Sirhey, “Human recognition of faces: A survey,” Proceedings of the IEEE, 83(5): 705-740, May 1995.
[7] T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, “Active shape models - their training and application,” Proceedings of Computer Vision and Image Understanding, 61(1):38–59, 1995.
[8] C. J. Curits, S. E. Anderson, J. A E. Seims, K. W. Fleischer, and D. H. Salesin, “Computer-Generated Watercolor,” Proceedings of SIGGRAPH 97 Conference, pp. 421-430, August 1997.
[9] H. Chen, Y. Xu, H. Shum, S. Zhu, and N. Zheng, “Example-based facial sketch generation with non-parametric sampling,” Proceedings of International Conference on Computer Vision (ICCV’01), pp. II: 433–438, 2001.
[10] A. A. Efros and T. K. Leung, “Texture synthesis by non-parametric sampling” Proceedings of IEEE International Conference on Computer Vision (ICCV’99), 1999
[11] A. Eleftheriadis and A. Jacquin, “Automatic face location, detection and tracking for model-assisted coding of video teleconferencing sequences at low bit-rates,” Proceedings of Signal Processing: Image Communication, 7(4), pp. 231-248, July 1995
[12] R. Fisker. “Making Deformable Template Models Operational.” PhD thesis, Department of Mathematical Modelling, Technical University of Denmark, Lyngby, 2000.
[13] H.P. Graf, T. Chen, E. Perajan, and E. Cosatto. “Locating faces and facial parts,” Proceedings of International Workshop on Automatic Face and Gesture Recognition, pp. 41-46, Zurich, Switzerland, June 26-28, 1995.
[14] C. Goodall. “Procrustes methods in the statistical analysis of shape,” Journal Royal Statistical Society, Series B, 53:285–339, 1991.
[15] C. J. Harris and M. Stephens, “A combined corner and edge detector,” Proceedings of 4th Alvey Vision Conference, Manchester, pp. 147-151, 1999.
[16] A. Hertzmann, “Painterly Rendering with Curved Brush Strokes of Multiple Sizes,” Proceedings of the 25th annual conference on Computer Graphics and interactive Techniques, 1998.
[17] A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin, “Image Analogies,” Proceedings of the SIGGRAPH 2001 Conference, pp. 327-340, Los Angeles, California, August 12-16, 2001.
[18] A. Hughes, Caricatures (Learn to Draw), HarperCollins Publishers, London, 1999.
[19] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active contour models,” Journal of Computer Vision, 8(2):321–331, 1988
[20] H. W. Jensen, “Global illumination using photon maps,” Proceedings of the Seventh Eurographics Workshop on Rendering, pp. 21-30. Springer Verlag, 1996.
[21] H. Koshimizu, M. Tominaga, T. Fujiwara, and K.Murakami, “On Kansei Facial Processing for Computerized Facial Caricaturing System Picasso,” Proceedings of IEEE International Conference on Systems, Man, and Cybernetics, pp. 294-299, 1999.
[22] Y. Li and H. Kobatake, “Extraction of facial sketch based on morphological processing,” Processings of IEEE international conference on image, volume 3, pp. 316–319, 1997.
[23] N. Li and Z. Huang, “A Feature-Based Pencil Drawing,” Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australia and South East Asia, 2003.
[24] L. Liang, H. Chen, Y-Q Xu, H-Y Shum. “Example-Based Caricature Generation with Exaggeration,” Proceedings of 10th Pacific Conference on Computer Graphics and Applications, 2002.
[25] R. Lienhart and J. Maydt, "An Extended Set of Haar-like Features for Rapid Object Detection," Proceedings of IEEE International Conference on Image Processing, vol. 1, pp. 900-903, 2002.
[26] W. C. Luo, P. C. Liu, and M. Ouhyoung, "Exaggeration of Facial Features in Caricaturing," Proceedings of ICS2002 (International Computer Symposium), Hualien, ROC, December 2002.
[27] T.W. Pai and C.Y. Yang, “Facial Model Analysis for 2D Caricature Generating Systems,” Proceedings of Workshop on Artificial Intelligence, ICS2002, Taiwan, 2002
[28] T. W. Pai and C. Y. Yang,” Facial Image Based and Customized Feature Vector Based 2D Caricature Generating Systems,” Proceeding of 2003 Computer Graphics Workshop, Taiwan, 2003.
[29] L. Redman, How to Draw Caricatures, Contemporary Books, Chicago, 1984.
[30] M P. Salisbury, M.T. Wong, J. F. Hughes, and D. H. Salesin, “Orientable Textures for Image-Based Pen-and-Ink Illustration.” Proceedings of SIGGRAPH 97 Conference, pp. 401-406, August 1997.
[31] D. Toennies, F. Behrens, and Melanie Aurnhammer, “Feasibility of hough-transform-based iris localisation for real-time-application,” Proceedings of International Conference on Pattern Recognition (ICPR’02), volume II, pp. 1053-1056, 2002.
[32] P. Viola and M. J. Jones. “Rapid Object Detection using a Boosted Cascade of Simple Features,” Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR2001), 2001.
[33] D. J. Williams and M. Shah, “A Fast Algorithm for Active Contours and Curvature Estimation” Proceedings of Image Understanding, Volume 55, pp.14-26, January 1992,
[34] G. Winlenbach and D. H. Salesin. “Computer-Generated Pen-and-Ink Illustration,” Proceedings of SIGGRAPH 94 Conference, pp. 91-100, July 1994.
[35] A. L. Yuille, P. W. Hallinan, and D. S. Cohen, “Feature extraction from faces using deformable templates,” Journal of Computer Vision, 8(2):99–111, 1992.
[36] C. Y. Yang, T W Pai, Y-S Hsiao, and C-H Chiang, ”Face shape classification for 2D caricature generation,” Proceedings of Workshop on Consumer Electronics, 2002.
描述 碩士
國立政治大學
資訊科學學系
91753029
92
資料來源 http://thesis.lib.nccu.edu.tw/record/#G0917530291
資料類型 thesis
dc.contributor.advisor 廖文宏<br>李蔡彥zh_TW
dc.contributor.advisor Liao, Wen-Hung<br>Li, Tsai-Yenen_US
dc.contributor.author (Authors) 江佩穎zh_TW
dc.contributor.author (Authors) Chiang , Pei-Yingen_US
dc.creator (作者) 江佩穎zh_TW
dc.creator (作者) Chiang , Pei-Yingen_US
dc.date (日期) 2003en_US
dc.date.accessioned 17-Sep-2009 14:06:51 (UTC+8)-
dc.date.available 17-Sep-2009 14:06:51 (UTC+8)-
dc.date.issued (上傳時間) 17-Sep-2009 14:06:51 (UTC+8)-
dc.identifier (Other Identifiers) G0917530291en_US
dc.identifier.uri (URI) https://nccur.lib.nccu.edu.tw/handle/140.119/32712-
dc.description (描述) 碩士zh_TW
dc.description (描述) 國立政治大學zh_TW
dc.description (描述) 資訊科學學系zh_TW
dc.description (描述) 91753029zh_TW
dc.description (描述) 92zh_TW
dc.description.abstract (摘要) 誇張肖像畫是以誇張與諷刺的手法來表現模特兒的特徵。現今這類畫作比起以寫實手法繪製的肖像畫,更受到大眾的喜愛;但是人們若想要自己模仿繪製出這類的肖像畫,除了要有繪畫天賦之外,也必須經過長時間的繪畫訓練以及對人臉的觀察,才能抓出模特兒的臉部特徵,並用生動的手法誇飾出來。 因此,如果電腦能做到代替誇張肖像畫家的工作,自動模仿繪製出誇張化的卡通肖像畫,將能替人們節省大量的時間及經費。本研究主要在設計一套能誇張肖像畫的系統,以根據使用者輸入的臉部影像,自動擷取臉部的特徵(包括特徵點的相對位置、絕對位置、形狀及大小等),並藉由分析這些特徵與常人相異之處,以一致的方式自動將特徵誇張化。這個系統並能以藝術家的作品為輸入,將使用者的臉部影像轉換成具有畫家卡通風格的誇張肖像畫。除了人臉的效果外,我們也進行了頭髮分離與模擬的研究,以強化畫像風格模擬的完整性。最後,我們以實做出了系統對數個具特徵的人臉影像進行實驗,以驗證其可行性及有效性。zh_TW
dc.description.abstract (摘要) Caricaturists are good at drawing sketches which express the exaggerated likeness of a person with a bit flavor of humor or sarcasm. People are willing to pay for this kind of work because it requires a lot of practice to achieve excellence. Acute observation is needed to extract the distinct features from the subject, and decent painting skill is essential to depict these features vividly. It will save much time and effort if computers can be trained used to draw caricatures. In this thesis, we developed a system which can extract and analyze facial features from simple an input facial images. The main purpose of this system is to generate the user-own caricature model by exaggerating his/her unique facial features. Different types of features, including relative locations and sizes, absolute locations and sizes, and each the shape of features are all taken in accountwill be considered. Unlike the complex process reported in the literature, we develop a transformative process that can handle different types of features in a more uniform fashion. Using an artist’s finished work as the source image; the proposed system is capable of producing cartoon-like colorful caricatures of a similar style effectively and efficiently. Besides the caricature painting of the face part, we also present some approaches for hair segmentation and hair style painting to increase make the system more the completeness of our system. Finally, we prove the feasibility and effectiveness of our system by showing several experimental results.en_US
dc.description.tableofcontents CHAPTER 1 Introduction 1
1.1 Objective 2
1.2 Related Work 3
1.2.1 Survey of caricature drawing 5
1.2.2 Facial feature extraction 7
1.3 Overview 9
CHAPTER 2 Face Model Definition 10
2.1 Facial Feature Nodes 10
2.1.1 Group hierarchy 11
2.1.2 Types of feature nodes 13
2.2 Average Face Computation 13
CHAPTER 3 Automatic Facial Feature Extraction 18
3.1 Estimation of Eyes and Mouth Positions 18
3.2 Iris Localization 20
3.3 Master Node Location and Shape Matching 21
CHAPTER 4 Caricature Generation 26
4.1 Shape Exaggeration 27
4.2 Image Metamorphosis 31
4.3 Illustrations 34
CHAPTER 5 Hair Generation 39
5.1 Hair Segmentation 40
5.1.1 Hair Color Sampling 41
5.1.2 Skin Color Sampling 42
5.1.3 Hair Region Repairing 43
5.2 Hair Style Generation 47
5.2.1 Hair generation using fixed palette 47
5.2.2 Hair generating by mimicking artist’s work 49
5.2.3 Hair generation using texture synthesis 58
CHAPTER 6 Conclusions 64
Reference 66
zh_TW
dc.format.extent 105656 bytes-
dc.format.extent 74167 bytes-
dc.format.extent 161760 bytes-
dc.format.extent 111643 bytes-
dc.format.extent 580215 bytes-
dc.format.extent 445465 bytes-
dc.format.extent 620087 bytes-
dc.format.extent 4001542 bytes-
dc.format.extent 2301516 bytes-
dc.format.extent 95266 bytes-
dc.format.extent 143943 bytes-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.format.mimetype application/pdf-
dc.language.iso en_US-
dc.source.uri (資料來源) http://thesis.lib.nccu.edu.tw/record/#G0917530291en_US
dc.subject (關鍵詞) 誇張肖像zh_TW
dc.subject (關鍵詞) 人臉特徵zh_TW
dc.subject (關鍵詞) 影像處理zh_TW
dc.subject (關鍵詞) caricatureen_US
dc.subject (關鍵詞) facial featuresen_US
dc.subject (關鍵詞) image processingen_US
dc.title (題名) 以臉部特徵為基礎之誇張肖像畫產生系統zh_TW
dc.title (題名) Caricature Generation by Analyzing Facial Featuresen_US
dc.type (資料類型) thesisen
dc.relation.reference (參考文獻) [1] M. Ashikhmin, “Synthesizing natural textures,” Proceedings of ACM Symposium on Interactive 3D Graphics, pp. 217-226, 2001.zh_TW
dc.relation.reference (參考文獻) [2] S. Brennan, “Caricature generator,” Master’s thesis, Cambridge, MIT, 1982.zh_TW
dc.relation.reference (參考文獻) [3] T. Beier and S. Neely, “Feature-Based Image Metamorphosis,” Proceedings of SIGGRAPH`92, pp. 35-42, July 1992.zh_TW
dc.relation.reference (參考文獻) [4] M. C. Burl, T. K. Leung, and P. Perona, “Face localization via shape statistics,” Proceedings of International Workshop on Automatic Face and Gesture Recognition, pp. 154-159, Zurich, Switzerland, June 26-28, 1995.zh_TW
dc.relation.reference (參考文獻) [5] P. J. Burt and E. H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Transactions on Communication, 31(4), pp.532-540, 1983.zh_TW
dc.relation.reference (參考文獻) [6] R. Chellappa, C.L. Wilson, and S. Sirhey, “Human recognition of faces: A survey,” Proceedings of the IEEE, 83(5): 705-740, May 1995.zh_TW
dc.relation.reference (參考文獻) [7] T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, “Active shape models - their training and application,” Proceedings of Computer Vision and Image Understanding, 61(1):38–59, 1995.zh_TW
dc.relation.reference (參考文獻) [8] C. J. Curits, S. E. Anderson, J. A E. Seims, K. W. Fleischer, and D. H. Salesin, “Computer-Generated Watercolor,” Proceedings of SIGGRAPH 97 Conference, pp. 421-430, August 1997.zh_TW
dc.relation.reference (參考文獻) [9] H. Chen, Y. Xu, H. Shum, S. Zhu, and N. Zheng, “Example-based facial sketch generation with non-parametric sampling,” Proceedings of International Conference on Computer Vision (ICCV’01), pp. II: 433–438, 2001.zh_TW
dc.relation.reference (參考文獻) [10] A. A. Efros and T. K. Leung, “Texture synthesis by non-parametric sampling” Proceedings of IEEE International Conference on Computer Vision (ICCV’99), 1999zh_TW
dc.relation.reference (參考文獻) [11] A. Eleftheriadis and A. Jacquin, “Automatic face location, detection and tracking for model-assisted coding of video teleconferencing sequences at low bit-rates,” Proceedings of Signal Processing: Image Communication, 7(4), pp. 231-248, July 1995zh_TW
dc.relation.reference (參考文獻) [12] R. Fisker. “Making Deformable Template Models Operational.” PhD thesis, Department of Mathematical Modelling, Technical University of Denmark, Lyngby, 2000.zh_TW
dc.relation.reference (參考文獻) [13] H.P. Graf, T. Chen, E. Perajan, and E. Cosatto. “Locating faces and facial parts,” Proceedings of International Workshop on Automatic Face and Gesture Recognition, pp. 41-46, Zurich, Switzerland, June 26-28, 1995.zh_TW
dc.relation.reference (參考文獻) [14] C. Goodall. “Procrustes methods in the statistical analysis of shape,” Journal Royal Statistical Society, Series B, 53:285–339, 1991.zh_TW
dc.relation.reference (參考文獻) [15] C. J. Harris and M. Stephens, “A combined corner and edge detector,” Proceedings of 4th Alvey Vision Conference, Manchester, pp. 147-151, 1999.zh_TW
dc.relation.reference (參考文獻) [16] A. Hertzmann, “Painterly Rendering with Curved Brush Strokes of Multiple Sizes,” Proceedings of the 25th annual conference on Computer Graphics and interactive Techniques, 1998.zh_TW
dc.relation.reference (參考文獻) [17] A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin, “Image Analogies,” Proceedings of the SIGGRAPH 2001 Conference, pp. 327-340, Los Angeles, California, August 12-16, 2001.zh_TW
dc.relation.reference (參考文獻) [18] A. Hughes, Caricatures (Learn to Draw), HarperCollins Publishers, London, 1999.zh_TW
dc.relation.reference (參考文獻) [19] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active contour models,” Journal of Computer Vision, 8(2):321–331, 1988zh_TW
dc.relation.reference (參考文獻) [20] H. W. Jensen, “Global illumination using photon maps,” Proceedings of the Seventh Eurographics Workshop on Rendering, pp. 21-30. Springer Verlag, 1996.zh_TW
dc.relation.reference (參考文獻) [21] H. Koshimizu, M. Tominaga, T. Fujiwara, and K.Murakami, “On Kansei Facial Processing for Computerized Facial Caricaturing System Picasso,” Proceedings of IEEE International Conference on Systems, Man, and Cybernetics, pp. 294-299, 1999.zh_TW
dc.relation.reference (參考文獻) [22] Y. Li and H. Kobatake, “Extraction of facial sketch based on morphological processing,” Processings of IEEE international conference on image, volume 3, pp. 316–319, 1997.zh_TW
dc.relation.reference (參考文獻) [23] N. Li and Z. Huang, “A Feature-Based Pencil Drawing,” Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australia and South East Asia, 2003.zh_TW
dc.relation.reference (參考文獻) [24] L. Liang, H. Chen, Y-Q Xu, H-Y Shum. “Example-Based Caricature Generation with Exaggeration,” Proceedings of 10th Pacific Conference on Computer Graphics and Applications, 2002.zh_TW
dc.relation.reference (參考文獻) [25] R. Lienhart and J. Maydt, "An Extended Set of Haar-like Features for Rapid Object Detection," Proceedings of IEEE International Conference on Image Processing, vol. 1, pp. 900-903, 2002.zh_TW
dc.relation.reference (參考文獻) [26] W. C. Luo, P. C. Liu, and M. Ouhyoung, "Exaggeration of Facial Features in Caricaturing," Proceedings of ICS2002 (International Computer Symposium), Hualien, ROC, December 2002.zh_TW
dc.relation.reference (參考文獻) [27] T.W. Pai and C.Y. Yang, “Facial Model Analysis for 2D Caricature Generating Systems,” Proceedings of Workshop on Artificial Intelligence, ICS2002, Taiwan, 2002zh_TW
dc.relation.reference (參考文獻) [28] T. W. Pai and C. Y. Yang,” Facial Image Based and Customized Feature Vector Based 2D Caricature Generating Systems,” Proceeding of 2003 Computer Graphics Workshop, Taiwan, 2003.zh_TW
dc.relation.reference (參考文獻) [29] L. Redman, How to Draw Caricatures, Contemporary Books, Chicago, 1984.zh_TW
dc.relation.reference (參考文獻) [30] M P. Salisbury, M.T. Wong, J. F. Hughes, and D. H. Salesin, “Orientable Textures for Image-Based Pen-and-Ink Illustration.” Proceedings of SIGGRAPH 97 Conference, pp. 401-406, August 1997.zh_TW
dc.relation.reference (參考文獻) [31] D. Toennies, F. Behrens, and Melanie Aurnhammer, “Feasibility of hough-transform-based iris localisation for real-time-application,” Proceedings of International Conference on Pattern Recognition (ICPR’02), volume II, pp. 1053-1056, 2002.zh_TW
dc.relation.reference (參考文獻) [32] P. Viola and M. J. Jones. “Rapid Object Detection using a Boosted Cascade of Simple Features,” Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR2001), 2001.zh_TW
dc.relation.reference (參考文獻) [33] D. J. Williams and M. Shah, “A Fast Algorithm for Active Contours and Curvature Estimation” Proceedings of Image Understanding, Volume 55, pp.14-26, January 1992,zh_TW
dc.relation.reference (參考文獻) [34] G. Winlenbach and D. H. Salesin. “Computer-Generated Pen-and-Ink Illustration,” Proceedings of SIGGRAPH 94 Conference, pp. 91-100, July 1994.zh_TW
dc.relation.reference (參考文獻) [35] A. L. Yuille, P. W. Hallinan, and D. S. Cohen, “Feature extraction from faces using deformable templates,” Journal of Computer Vision, 8(2):99–111, 1992.zh_TW
dc.relation.reference (參考文獻) [36] C. Y. Yang, T W Pai, Y-S Hsiao, and C-H Chiang, ”Face shape classification for 2D caricature generation,” Proceedings of Workshop on Consumer Electronics, 2002.zh_TW