Zhang P, Cao W, Obradovic Z. Learning by aggregating experts and filtering novices: a solution to crowdsourcing problems in bioinformatics. BMC Bioinformatics. 2013;14 Suppl 12:S5 pubmed publisher
..In addition, the proposed method can provide further characterization of each annotator that can help in developing more accurate classifiers by identifying the most competent annotators for each data instance. ..