Beyond the medium: Rethinking information literacy through crowdsourced analysis

Olga Boichak, Jordan Canzonetta, Niraj Sitaula, Brian McKernan, Sarah Taylor, Patrícia Rossini, Benjamin A. Clegg, Kate Kenski, Rosa Mikeal Martey, Nancy McCracken, Carsten Østerlund, Roc Myers, James Folkestad, Jennifer Stromer-Galley

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Information literacy encompasses a range of information evaluation skills for the purpose of making judgments. In the context of crowdsourcing, divergent evaluation criteria might introduce bias into collective judgments. Recent experiments have shown that crowd estimates can be swayed by social influence. This might be an unanticipated effect of media literacy training: encouraging readers to critically evaluate information falls short when their judgment criteria are unclear and vary among social groups. In this exploratory study, we investigate the criteria used by crowd workers in reasoning through a task. We crowdsourced evaluation of a variety of information sources, identifying multiple factors that may affect individual's judgment, as well as the accuracy of aggregated crowd estimates. Using a multi-method approach, we identified relationships between individual information assessment practices and analytical outcomes in crowds, and propose two analytic criteria, relevance and credibility, to optimize collective judgment in complex analytical tasks.

Original languageEnglish (US)
Title of host publicationProceedings of the 52nd Annual Hawaii International Conference on System Sciences, HICSS 2019
EditorsTung X. Bui
PublisherIEEE Computer Society
Pages420-429
Number of pages10
ISBN (Electronic)9780998133126
StatePublished - 2019
Externally publishedYes
Event52nd Annual Hawaii International Conference on System Sciences, HICSS 2019 - Maui, United States
Duration: Jan 8 2019Jan 11 2019

Publication series

NameProceedings of the Annual Hawaii International Conference on System Sciences
Volume2019-January
ISSN (Print)1530-1605

Conference

Conference52nd Annual Hawaii International Conference on System Sciences, HICSS 2019
Country/TerritoryUnited States
CityMaui
Period1/8/191/11/19

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint

Dive into the research topics of 'Beyond the medium: Rethinking information literacy through crowdsourced analysis'. Together they form a unique fingerprint.

Cite this