中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Domain Weighted Majority Voting for Crowdsourcing

文献类型:期刊论文

作者Dapeng Tao; Jun Cheng; Zhengtao Yu; Kun Yue;   Lizhen Wang
刊名IEEE Transactions on Neural Networks and Learning Systems
出版日期2018
文献子类期刊论文
英文摘要Crowdsourcing labeling systems provide an efficient way to generate multiple inaccurate labels for given observations. If the competence level or the ``reputation,'' which can be explained as the probabilities of annotating the right label, for each crowdsourcing annotators is equal and biased to annotate the right label, majority voting (MV) is the optimal decision rule for merging the multiple labels into a single reliable one. However, in practice, the competence levels of annotators employed by the crowdsourcing labeling systems are often diverse very much. In these cases, weighted MV is more preferred. The weights should be determined by the competence levels. However, since the annotators are anonymous and the ground-truth labels are usually unknown, it is hard to compute the competence levels of the annotators directly. In this paper, we propose to learn the weights for weighted MV by exploiting the expertise of annotators. Specifically, we model the domain knowledge of different annotators with different distributions and treat the crowdsourcing problem as a domain adaptation problem. The annotators provide labels to the source domains and the target domain is assumed to be associated with the ground-truth labels. The weights are obtained by matching the source domains with the target domain. Although the target-domain labels are unknown, we prove that they could be estimated under mild conditions. Both theoretical and empirical analyses verify the effectiveness of the proposed method. Large performance gains are shown for specific data sets.
URL标识查看原文
语种英语
源URL[http://ir.siat.ac.cn:8080/handle/172644/13571]  
专题深圳先进技术研究院_集成所
推荐引用方式
GB/T 7714
Dapeng Tao,Jun Cheng,Zhengtao Yu,et al. Domain Weighted Majority Voting for Crowdsourcing[J]. IEEE Transactions on Neural Networks and Learning Systems,2018.
APA Dapeng Tao,Jun Cheng,Zhengtao Yu,Kun Yue,&  Lizhen Wang.(2018).Domain Weighted Majority Voting for Crowdsourcing.IEEE Transactions on Neural Networks and Learning Systems.
MLA Dapeng Tao,et al."Domain Weighted Majority Voting for Crowdsourcing".IEEE Transactions on Neural Networks and Learning Systems (2018).

入库方式: OAI收割

来源:深圳先进技术研究院

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。