5 Ways To Overcome Junk Data From mTurk (and online surveys more generally)

The data quality on Amazon Mechanical Turk (mTurk) has suffered for years now (Byrd, 2023; Chandler & Paolacci, 2017; Moss & Litman, 2018; Chmielewski & Kucker, 2019; Ahler et al., 2020; Kennedy et al., 2020; MacInnis et al., 2020). There are a few ways to protect online survey data quality. In this post, I will briefly cover five strategies for weeding out junk data in online research (not just via mTurk), from easiest to hardest.

Continue reading 5 Ways To Overcome Junk Data From mTurk (and online surveys more generally)

What good is reflective reasoning?


Philosophers and cognitive scientists tend to think that reflective reasoning will improve our judgments and decisions. The idea reflection will lead us to test our judgments by “looking for their coherence with our beliefs about similar cases and our beliefs about a broader range of …issues” a la reflective equilibrium. This sounds intuitively plausible. But is it true? In this post I briefly present some research suggesting that reflective reasoning often, but does not always improve our judgments and decisions.  Continue reading What good is reflective reasoning?

Upon Reflection, Ep. 5: Reflective Reasoning For Real People (Dissertation Overview)

Welcome to Upon Reflection. In this episode, I review the major take-aways and findings from my dissertation titled, “Reflective Reasoning For Real People”. I explain what cognitive scientists mean by terms like “reflective reasoning”, how reflection is measured empirically, how reflection can either help or hinder our reasoning, how more reflective philosophers tend toward certain philosophical beliefs, and how reflection may help us retrain our implicit biases.

Continue reading Upon Reflection, Ep. 5: Reflective Reasoning For Real People (Dissertation Overview)

New paper: “Your Health vs. My Liberty”

Why did otherwise life affirming people flout public health recommendations during the COVID-19 pandemic?

  • Was it leaders’ messaging? For example, are “flatten the curve” graphs about statistical victims less effective than information about identifiable victims?
  • Was it people’s reasoning? Do some people not think carefully enough about public health? Might people who better at math better understand public health information involving concepts like exponential growth and probability?
  • Was it people’s philosophical preferences? Do some people just care more about preventing harm? Do others prioritize personal liberty over pubic health? Do people’s beliefs about science matter? Religion?

Michał Białek and I investigated. In short, we found that flouting public health recommendations was less about messaging or reasoning than philosophical beliefs, especially beliefs about our duties to others, liberty, and science. The paper is under review now published in Cognition. As always, you can find a free copy of the paper on my CV at byrdnick.com/cv. More details below.

Continue reading New paper: “Your Health vs. My Liberty”

Anders Ericsson (1947-2020)

My colleagues and I are deeply saddened about the unexpected passing of Anders Ericsson on June 17. Dr. Ericsson was not only a massive figure in psychology, philosophy, performance, and beyond but—in my experience—an outstanding person.

Standout Memories

There is much to say about Anders. I can speak only to the past few years—and only a slice of it. Nonetheless, that slice of Anders is rich. Indulge me in just three stories.

Continue reading Anders Ericsson (1947-2020)

On Whether Reflection Is A Skill

In my last post, I considered whether reflective reasoning is a virtue. One possibility was that reflection cannot be a virtue. However, if reflection is not a virtue, then we need another account of why many people value reflection. One such account might be that reflection is a skill. In this post, I’ll briefly consider some reasons for and against thinking that reflection is a skill.

Continue reading On Whether Reflection Is A Skill

On Whether Reflection Is A Virtue


Some philosophers think of rationality in terms of virtue. For them, the rational thing to do is what the epistemically virtuous person would do. One type of reasoning that I study is reflective reasoning in which we step back and reconsider a gut reaction. So I have found myself asking, “Is reflective reasoning a virtue?” In this post, I’ll briefly consider reasons for answering “yes” and reasons for answering “no.” Continue reading On Whether Reflection Is A Virtue

Upon Reflection, Ep. 3: Causal Network Accounts of Ill-being: Depression & Digital Well-being

Welcome to the third episode of Upon Reflection, a podcast about what we think as well as how and why we think it.

In this podcast, I read my chapter, “Causal Network Accounts of Ill-being: Depression & Digital Well-being” from Ethics of Digital Well-being: A Multidisciplinary Approach. In this chapter, I review how well-being and ill-being can be understood in terms of the causal networks studied by economists, neuroscientists, psychologists, and other scientists. As with all of my writing, the free preprint can be found on my CV at byrdnick.com/cv under “Publications“.

If you want to hear more, you can subscribe wherever you find podcasts. You can also find out more about me and my research on Twitter via @byrd_nick, or on Facebook via @byrdnick. If you end up enjoying the Upon Reflection podcast, then feel free to tell people about it, online, in person, or in your ⭐️⭐️⭐️⭐️⭐️ review.

Related posts

Two Years In The Life Of A Grad Student: Time Logging Data

I have had some side gigs in graduate school that involved creating invoices for hourly work—web development, copyediting, research assistance, etc. I used Toggl to log my time. At some point, I realized that I could log all of my work time—not just the billable time. So in 2018 and 2019, I logged all of my work time. In this post, I will summarize the 2018 and 2019 data and mention some take-aways for 2020.

Continue reading Two Years In The Life Of A Grad Student: Time Logging Data