Publications-Periodical Articles
Article View/Open
Publication Export
Google ScholarTM
NCCU Library
Citation Infomation
-
Loading...Loading...
Related Publications in TAIR
| Title | Heterogeneity in generalized reinforcement learning and its relation to cognitive ability |
| Creator | Chen, Shu-Heng;Du, Y.-R. 陳樹衡 |
| Contributor | 經濟學系 |
| Key Words | Artificial intelligence; Cognitive systems; Cognitive ability; Different sizes; Experience-weighted attraction learning; Granularity; Individual Differences; Learning behavior; Learning models; Likelihood ratio tests; nocv1; Reinforcement learning |
| Date | 2017-05 |
| Date Issued | 8-May-2017 14:38:52 (UTC+8) |
| Summary | In this paper, we study the connections between working memory capacity (WMC) and learning in the context of economic guessing games. We apply a generalized version of reinforcement learning, popularly known as the experience-weighted attraction (EWA) learning model, which has a connection to specific cognitive constructs, such as memory decay, the depreciation of past experience, counterfactual thinking, and choice intensity. Through the estimates of the model, we examine behavioral differences among individuals due to different levels of WMC. In accordance with ‘Miller`s magic number’, which is the constraint of working memory capacity, we consider two different sizes (granularities) of strategy space: one is larger (finer) and one is smaller (coarser). We find that constraining the EWA models by using levels (granules) within the limits of working memory allows for a better characterization of the data based on individual differences in WMC. Using this level-reinforcement version of EWA learning, also referred to as the EWA rule learning model, we find that working memory capacity can significantly affect learning behavior. Our likelihood ratio test rejects the null that subjects with high WMC and subjects with low WMC follow the same EWA learning model. In addition, the parameter corresponding to ‘counterfactual thinking ability’ is found to be reduced when working memory capacity is low. © 2016 Elsevier B.V. |
| Relation | Cognitive Systems Research, 42, 1-22 |
| Type | article |
| DOI | http://dx.doi.org/10.1016/j.cogsys.2016.11.001 |
| dc.contributor | 經濟學系 | |
| dc.creator (作者) | Chen, Shu-Heng;Du, Y.-R. | |
| dc.creator (作者) | 陳樹衡 | zh_TW |
| dc.date (日期) | 2017-05 | |
| dc.date.accessioned | 8-May-2017 14:38:52 (UTC+8) | - |
| dc.date.available | 8-May-2017 14:38:52 (UTC+8) | - |
| dc.date.issued (上傳時間) | 8-May-2017 14:38:52 (UTC+8) | - |
| dc.identifier.uri (URI) | http://nccur.lib.nccu.edu.tw/handle/140.119/109337 | - |
| dc.description.abstract (摘要) | In this paper, we study the connections between working memory capacity (WMC) and learning in the context of economic guessing games. We apply a generalized version of reinforcement learning, popularly known as the experience-weighted attraction (EWA) learning model, which has a connection to specific cognitive constructs, such as memory decay, the depreciation of past experience, counterfactual thinking, and choice intensity. Through the estimates of the model, we examine behavioral differences among individuals due to different levels of WMC. In accordance with ‘Miller`s magic number’, which is the constraint of working memory capacity, we consider two different sizes (granularities) of strategy space: one is larger (finer) and one is smaller (coarser). We find that constraining the EWA models by using levels (granules) within the limits of working memory allows for a better characterization of the data based on individual differences in WMC. Using this level-reinforcement version of EWA learning, also referred to as the EWA rule learning model, we find that working memory capacity can significantly affect learning behavior. Our likelihood ratio test rejects the null that subjects with high WMC and subjects with low WMC follow the same EWA learning model. In addition, the parameter corresponding to ‘counterfactual thinking ability’ is found to be reduced when working memory capacity is low. © 2016 Elsevier B.V. | |
| dc.format.extent | 2256824 bytes | - |
| dc.format.mimetype | application/pdf | - |
| dc.relation (關聯) | Cognitive Systems Research, 42, 1-22 | |
| dc.subject (關鍵詞) | Artificial intelligence; Cognitive systems; Cognitive ability; Different sizes; Experience-weighted attraction learning; Granularity; Individual Differences; Learning behavior; Learning models; Likelihood ratio tests; nocv1; Reinforcement learning | |
| dc.title (題名) | Heterogeneity in generalized reinforcement learning and its relation to cognitive ability | |
| dc.type (資料類型) | article | |
| dc.identifier.doi (DOI) | 10.1016/j.cogsys.2016.11.001 | |
| dc.doi.uri (DOI) | http://dx.doi.org/10.1016/j.cogsys.2016.11.001 |