Publications-Proceedings

Article View/Open

Publication Export

Google ScholarTM

NCCU Library

Citation Infomation

Related Publications in TAIR

題名 Investigation of Feature Distribution and Network Weight Updates in the Machine Unlearning Process
作者 廖文宏
Liao, Wen-Hung;Lin, Yang-Jing
貢獻者 資訊系
關鍵詞 Machine Unlearning; Label Reassignment; Model Manipulation; Weight Pruning
日期 2024-12
上傳時間 19-May-2025 11:44:30 (UTC+8)
摘要 Machine unlearning refers to the process of expunging previously learned information and data from a machine learning model to achieve the objective of privacy protection. In this research, we explore two prevalent methods for unlearning, namely, label reassignment and model manipulation. Using the CIFAR-100 classification problem with ResNet-50 architecture as an example, we examine the efficacy of these two mechanisms and their variants in the corresponding unlearning task. We further investigate the changes in feature distribution and the extent of weight updates across various network layers throughout the unlearning process. Experimental results indicate that the degree of network variation is proportional to the number of removed classes. When employing the label reassignment method, the variation is concentrated in the final stage and fully connected layers. On the other hand, using the weight resetting strategy affects more network layers, with the impact gradually decreasing from the later layers to the middle and earlier layers. Overall, when the categories to be forgotten are less than 10%, no significant impact on feature extraction is observed.
關聯 2024 International Symposium on Multimedia (ISM), IEEE Technical Committee on Multimedia (TCMC)
資料類型 conference
DOI https://doi.org/10.1109/ISM63611.2024.00022
dc.contributor 資訊系
dc.creator (作者) 廖文宏
dc.creator (作者) Liao, Wen-Hung;Lin, Yang-Jing
dc.date (日期) 2024-12
dc.date.accessioned 19-May-2025 11:44:30 (UTC+8)-
dc.date.available 19-May-2025 11:44:30 (UTC+8)-
dc.date.issued (上傳時間) 19-May-2025 11:44:30 (UTC+8)-
dc.identifier.uri (URI) https://nccur.lib.nccu.edu.tw/handle/140.119/157012-
dc.description.abstract (摘要) Machine unlearning refers to the process of expunging previously learned information and data from a machine learning model to achieve the objective of privacy protection. In this research, we explore two prevalent methods for unlearning, namely, label reassignment and model manipulation. Using the CIFAR-100 classification problem with ResNet-50 architecture as an example, we examine the efficacy of these two mechanisms and their variants in the corresponding unlearning task. We further investigate the changes in feature distribution and the extent of weight updates across various network layers throughout the unlearning process. Experimental results indicate that the degree of network variation is proportional to the number of removed classes. When employing the label reassignment method, the variation is concentrated in the final stage and fully connected layers. On the other hand, using the weight resetting strategy affects more network layers, with the impact gradually decreasing from the later layers to the middle and earlier layers. Overall, when the categories to be forgotten are less than 10%, no significant impact on feature extraction is observed.
dc.format.extent 107 bytes-
dc.format.mimetype text/html-
dc.relation (關聯) 2024 International Symposium on Multimedia (ISM), IEEE Technical Committee on Multimedia (TCMC)
dc.subject (關鍵詞) Machine Unlearning; Label Reassignment; Model Manipulation; Weight Pruning
dc.title (題名) Investigation of Feature Distribution and Network Weight Updates in the Machine Unlearning Process
dc.type (資料類型) conference
dc.identifier.doi (DOI) 10.1109/ISM63611.2024.00022
dc.doi.uri (DOI) https://doi.org/10.1109/ISM63611.2024.00022