學術產出-Periodical Articles

Article View/Open

Publication Export

Google ScholarTM

政大圖書館

Citation Infomation

題名 Heterogeneity in generalized reinforcement learning and its relation to cognitive ability
作者 Chen, Shu-Heng;Du, Y.-R.
陳樹衡
貢獻者 經濟學系
關鍵詞 Artificial intelligence; Cognitive systems; Cognitive ability; Different sizes; Experience-weighted attraction learning; Granularity; Individual Differences; Learning behavior; Learning models; Likelihood ratio tests; nocv1; Reinforcement learning
日期 2017-05
上傳時間 8-May-2017 14:38:52 (UTC+8)
摘要 In this paper, we study the connections between working memory capacity (WMC) and learning in the context of economic guessing games. We apply a generalized version of reinforcement learning, popularly known as the experience-weighted attraction (EWA) learning model, which has a connection to specific cognitive constructs, such as memory decay, the depreciation of past experience, counterfactual thinking, and choice intensity. Through the estimates of the model, we examine behavioral differences among individuals due to different levels of WMC. In accordance with ‘Miller`s magic number’, which is the constraint of working memory capacity, we consider two different sizes (granularities) of strategy space: one is larger (finer) and one is smaller (coarser). We find that constraining the EWA models by using levels (granules) within the limits of working memory allows for a better characterization of the data based on individual differences in WMC. Using this level-reinforcement version of EWA learning, also referred to as the EWA rule learning model, we find that working memory capacity can significantly affect learning behavior. Our likelihood ratio test rejects the null that subjects with high WMC and subjects with low WMC follow the same EWA learning model. In addition, the parameter corresponding to ‘counterfactual thinking ability’ is found to be reduced when working memory capacity is low. © 2016 Elsevier B.V.
關聯 Cognitive Systems Research, 42, 1-22
資料類型 article
DOI http://dx.doi.org/10.1016/j.cogsys.2016.11.001
dc.contributor 經濟學系
dc.creator (作者) Chen, Shu-Heng;Du, Y.-R.
dc.creator (作者) 陳樹衡zh_TW
dc.date (日期) 2017-05
dc.date.accessioned 8-May-2017 14:38:52 (UTC+8)-
dc.date.available 8-May-2017 14:38:52 (UTC+8)-
dc.date.issued (上傳時間) 8-May-2017 14:38:52 (UTC+8)-
dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/109337-
dc.description.abstract (摘要) In this paper, we study the connections between working memory capacity (WMC) and learning in the context of economic guessing games. We apply a generalized version of reinforcement learning, popularly known as the experience-weighted attraction (EWA) learning model, which has a connection to specific cognitive constructs, such as memory decay, the depreciation of past experience, counterfactual thinking, and choice intensity. Through the estimates of the model, we examine behavioral differences among individuals due to different levels of WMC. In accordance with ‘Miller`s magic number’, which is the constraint of working memory capacity, we consider two different sizes (granularities) of strategy space: one is larger (finer) and one is smaller (coarser). We find that constraining the EWA models by using levels (granules) within the limits of working memory allows for a better characterization of the data based on individual differences in WMC. Using this level-reinforcement version of EWA learning, also referred to as the EWA rule learning model, we find that working memory capacity can significantly affect learning behavior. Our likelihood ratio test rejects the null that subjects with high WMC and subjects with low WMC follow the same EWA learning model. In addition, the parameter corresponding to ‘counterfactual thinking ability’ is found to be reduced when working memory capacity is low. © 2016 Elsevier B.V.
dc.format.extent 2256824 bytes-
dc.format.mimetype application/pdf-
dc.relation (關聯) Cognitive Systems Research, 42, 1-22
dc.subject (關鍵詞) Artificial intelligence; Cognitive systems; Cognitive ability; Different sizes; Experience-weighted attraction learning; Granularity; Individual Differences; Learning behavior; Learning models; Likelihood ratio tests; nocv1; Reinforcement learning
dc.title (題名) Heterogeneity in generalized reinforcement learning and its relation to cognitive ability
dc.type (資料類型) article
dc.identifier.doi (DOI) 10.1016/j.cogsys.2016.11.001
dc.doi.uri (DOI) http://dx.doi.org/10.1016/j.cogsys.2016.11.001