Selective rating: Partisan bias in crowdsourced news rating systems

Abstract

Crowdsourced news rating systems have been suggested as a solution to reducing the amount of misinformation online audiences see. This study expands previous research crowdsourcing by looking at how characteristics of the rating system affect user behavior. In an experiment (N=1,021), two parameters of the rating system were manipulated. First, users were shown different varieties of news brands on the “menu” they were asked to rate. Second, participation was mandatory for half and voluntary for others. Results indicate partisans rated more news brands when they saw an ideologically dissimilar news menu than one that matched their ideology. Further, the trustworthiness rating of the mainstream news menu decreased when participants had a choice to participate rather than were forced. These results have important implications for understanding how users participate in crowdsourcing news credibility.