學術產出-Periodical Articles

Article View/Open

Publication Export

Google ScholarTM

政大圖書館

Citation Infomation

題名 Automatic Evaluation of Information Provider Reliability and Expertise
作者 Pelechrinis, Konstantinos;Zadorozhny, Vladimir;Kounev, Velin;Oleshchuk, Vladimir;Anwar, Mohd
林怡伶
Lin, Yiling
貢獻者 資管系
關鍵詞 Q&A social networks ; User reliability ; User expertise ; Subjective logic
日期 2013
上傳時間 24-Aug-2018 15:02:23 (UTC+8)
摘要 Q&A social media have gained a lot of attention during the recent years. People rely on these sites to obtain information due to a number of advantages they offer as compared to conventional sources of knowledge (e.g., asynchronous and convenient access). However, for the same question one may find highly contradicting answers, causing an ambiguity with respect to the correct information. This can be attributed to the presence of unreliable and/or non-expert users. These two attributes (reliability and expertise) significantly affect the quality of the answer/information provided. We present a novel approach for estimating these user’s characteristics relying on human cognitive traits. In brief, we propose each user to monitor the activity of his peers (on the basis of responses to questions asked by him) and observe their compliance with predefined cognitive models. These observations lead to local assessments that can be further fused to obtain a reliability and expertise consensus for every other user in the social network (SN). For the aggregation part we use subjective logic. To the best of our knowledge this is the first study of this kind in the context of Q&A SNs. Our proposed approach is highly distributed; each user can individually estimate the expertise and the reliability of his peers using his direct interactions with them and our framework. The online SN (OSN), which can be considered as a distributed database, performs continuous data aggregation for users expertise and reliability assesment in order to reach a consensus. In our evaluations, we first emulate a Q&A SN to examine various performance aspects of our algorithm (e.g., convergence time, responsiveness etc.). Our evaluations indicate that it can accurately assess the reliability and the expertise of a user with a small number of samples and can successfully react to the latter’s behavior change, provided that the cognitive traits hold in practice. Furthermore, the use of the consensus operator for the aggregation of multiple opinions on a specific user, reduces the uncertainty with regards to the final assessment. However, as real data obtained from Yahoo! Answers imply, the pairwise interactions between specific users are limited. Hence, we consider the aggregate set of questions as posted from the system itself and we assess the expertise and realibility of users based on their response behavior. We observe, that users have different behaviors depending on the level at which we are observing them. In particular, while their activity is focused on a few general categories, yielding them reliable, their microscopic (within general category) activity is highly scattered.
關聯 World Wide Web Journal, Vol.18, No.1, pp.33-72
資料類型 article
DOI https://doi.org/10.1007/s11280-013-0249-x
dc.contributor 資管系-
dc.creator (作者) Pelechrinis, Konstantinos;Zadorozhny, Vladimir;Kounev, Velin;Oleshchuk, Vladimir;Anwar, Mohden_US
dc.creator (作者) 林怡伶zh_TW
dc.creator (作者) Lin, Yilingen_US
dc.date (日期) 2013-
dc.date.accessioned 24-Aug-2018 15:02:23 (UTC+8)-
dc.date.available 24-Aug-2018 15:02:23 (UTC+8)-
dc.date.issued (上傳時間) 24-Aug-2018 15:02:23 (UTC+8)-
dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/119531-
dc.description.abstract (摘要) Q&A social media have gained a lot of attention during the recent years. People rely on these sites to obtain information due to a number of advantages they offer as compared to conventional sources of knowledge (e.g., asynchronous and convenient access). However, for the same question one may find highly contradicting answers, causing an ambiguity with respect to the correct information. This can be attributed to the presence of unreliable and/or non-expert users. These two attributes (reliability and expertise) significantly affect the quality of the answer/information provided. We present a novel approach for estimating these user’s characteristics relying on human cognitive traits. In brief, we propose each user to monitor the activity of his peers (on the basis of responses to questions asked by him) and observe their compliance with predefined cognitive models. These observations lead to local assessments that can be further fused to obtain a reliability and expertise consensus for every other user in the social network (SN). For the aggregation part we use subjective logic. To the best of our knowledge this is the first study of this kind in the context of Q&A SNs. Our proposed approach is highly distributed; each user can individually estimate the expertise and the reliability of his peers using his direct interactions with them and our framework. The online SN (OSN), which can be considered as a distributed database, performs continuous data aggregation for users expertise and reliability assesment in order to reach a consensus. In our evaluations, we first emulate a Q&A SN to examine various performance aspects of our algorithm (e.g., convergence time, responsiveness etc.). Our evaluations indicate that it can accurately assess the reliability and the expertise of a user with a small number of samples and can successfully react to the latter’s behavior change, provided that the cognitive traits hold in practice. Furthermore, the use of the consensus operator for the aggregation of multiple opinions on a specific user, reduces the uncertainty with regards to the final assessment. However, as real data obtained from Yahoo! Answers imply, the pairwise interactions between specific users are limited. Hence, we consider the aggregate set of questions as posted from the system itself and we assess the expertise and realibility of users based on their response behavior. We observe, that users have different behaviors depending on the level at which we are observing them. In particular, while their activity is focused on a few general categories, yielding them reliable, their microscopic (within general category) activity is highly scattered.en_US
dc.format.extent 2103453 bytes-
dc.format.mimetype application/pdf-
dc.relation (關聯) World Wide Web Journal, Vol.18, No.1, pp.33-72-
dc.subject (關鍵詞) Q&A social networks ; User reliability ; User expertise ; Subjective logicen_US
dc.title (題名) Automatic Evaluation of Information Provider Reliability and Expertiseen_US
dc.type (資料類型) article-
dc.identifier.doi (DOI) 10.1007/s11280-013-0249-x-
dc.doi.uri (DOI) https://doi.org/10.1007/s11280-013-0249-x-