The data quality on Amazon Mechanical Turk (mTurk) has suffered for years now (Byrd, 2023; Chandler & Paolacci, 2017; Moss & Litman, 2018; Chmielewski & Kucker, 2019; Ahler et al., 2020; Kennedy et al., 2020; MacInnis et al., 2020). There are a few ways to protect online survey data quality. In this post, I will briefly cover five strategies for weeding out junk data in online research (not just via mTurk), from easiest to hardest.
(Note: The featured image at the top is based on data from this paper in Analysis. We deploy these and other data quality methods in this paper in Religious Studies and this preprint. )
Continue reading 5 Ways To Overcome Junk Data From mTurk (and online surveys more generally)