Certain Philosophical Views Correlate with Reasoning Errors …even among PhDs


2022 Update: My own results mentioned below replicated in a paper now published in Review of Philosophy and Psychology. Free paper, audiopaper, and link to the journal’s version here.


Philosophy helps us reason better, right? I mean, taking courses in analytic philosophy and argument mapping does more for students’ critical thinking than even critical thinking courses do (Alvarez-Ortiz 2007). And the more training one has in philosophy, the better one does on certain reasoning tasks (Livengood et al 2010). So it’s no accident that philosophy majors tend to outperform almost every other major on the GRE, the GMAT, and the LSAT (“Why Study Philosophy…“; see also Educational Testing Service 2014). That’s why people like Deanna Kuhn have such high praise for philosophers’ reasoning (Kuhn 1991, 258-262).†

Reasoning expertise: We turn now to the philosophers…. The performance of the philosophers is not included in table form because it is so easily summarized. No variation occurs…philosophers [show] perfect performance in generation of genuine evidence, alternative theories, counterarguments, and rebuttals…. The philosophers display a sophisticated understanding of argumentative structure…. None of the philosophers [had] any special expertise in any of the content domains that the questions address…. The performance of philosophers shows that it is possible to attain expertise in the reasoning process itself, independent of any particular content to which the reasoning is applied.

But there’s much more to say about this. For instance, we might ask two questions about this evidence.

Two Questions

It’s one thing to claim that philosophers are better reasoners, but that’s not the same as being perfect reasoners. After all, philosophers might reason better than others and yet still be vulnerable to systematic reasoning errors. So we need to ask: Are philosophers’ prone to cognitive errors like everyone else?

Also, if philosophers are prone to cognitive error, what is the relationship between their errors and their philosophical views? 

1.  Are Philosophers Prone To Cognitive Error?

In order to understand the rest of the post, you will need to answer the question below. It should only take a moment.

A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost?

The question comes from the Cognitive Reflection Test (CRT) (Frederick 2005). It is designed to elicit a quick answer. What answer first came to your mind?

If you are like most people, one answer quickly came to mind: “10 cents.” And if you are like many people, you had an intuitive sense that this answer was correct. Alas, 10 cents is not correct. You can work out the correct answer on your own if you like. The point I want to make is this: the intuitively correct answer to this question is demonstrably false. This suggests that answering this question intuitively constitutes an error in reasoning. 

It turns out that philosophers are less likely than others to make this error.

Jonathan Livengood and colleagues found that the more philosophical training one had, the less likely one was to make this error (Livengood et al 2010). I replicated this finding a few years later (Byrd 2014). Specifically, I found that people who had — or were candidates for — a Ph.D. in philosophy were significantly less likely than others to make this reasoning error — F(1, 558) = 15.41, p < 0.001, d = 0.32 (ibid.).

Some philosophers performed perfectly on the CRT — even after controlling for whether philosophers were familiar with the CRT. However, many philosophers did not perform perfectly. Many philosophers made the error of responding unreflectively on one or two of the CRT questions. This implies an answer to our first question.

Answer: Yes. Philosophers’ reasoning is susceptible to systematic error.

So what about our second question?

2.  Do Philosopher’s Errors Predict Their Views?

Among lay reasoners, the tendency to make this reasoning error on the CRT has correlated with believing that God exists, that immortal souls exist, that life experiences can count as evidence that a god exists, etc. (Shenhav Rand and Greene 2012). This finding is in line with a common theme in the research on reasoning: unreflective reasoning correlates with a bunch of religious, supernatural, and paranormal beliefs (Aarnio and Lindeman 2005; Bouvet and Bonnefon 2015Giannotti et al 2001, Pennycook et al 2012, Pennycook et al 2013, Pennycook et al 2014a2014b).

And this finding has now been replicated among philosophers. Specifically, the more that philosophers were lured into the intuitively appealing yet incorrect answers on the CRT (e.g., “10 cents”), the more that they leaned toward or accepted theismF(1, 559) = 7.3, p < 0.01, d = 0.16, b = 0.12 (Byrd 2014).

There is also evidence that people who make this error on the CRT are more prone to certain moral judgments. To see what I mean, read the scenario below (Foot 1967).

You see a trolley racing down its track towards five people. You happen to be standing near the switch that would divert the trolley down a sidetrack toward one person. If you pull the switch the trolley will surely kill 1 person. If you do not pull the switch the trolley will surely kill five persons. Do you pull the switch?

So? Would you pull the switch or not? Those who answered unreflectively on the CRT have been less likely to pull the switch (Paxton, Ungar, and Greene 2012).

Once again, it turns out that this finding holds among philosophers as well. Philosophers who were more likely to make a reasoning error on the CRT were less likely to pull the switch — F(1, 559) = 6.93, p < 0.001, d = 0.15, b = 0.17 (Byrd 2014).

Philosophers’ proclivity to make this error was also positively associated with other philosophical views:

  • Physical (as opposed to psychological) views of personal identity — F(1, 558) = 8.57, p < 0.001, d = 0.17.
  • Fregeanism (as opposed to Russelianism) about language — F(1, 558) = 8.59, p < 0.01, d = 0.17.

I have lots of thoughts about these findings, but I want to keep things brief. For now, consider the implied answer to our second question.

Answer: Yes. Philosophers’ reasoning errors are related to their views.

CONCLUSION

So there you have it. It would seem that philosophers are susceptible to systematic reasoning errors. And insofar as philosophers are so susceptible, they tend toward certain views. I’m tempted to say more, but I’ve already done so elsewhere (Byrd 2014) and I am working on a pre-registered replication of these findings for—among other things—my dissertation.††


† Thanks to Greg Ray for pointing me to this passage.

†† What does the rest of the literature suggest about philosophers’ reasoning? Unsurprisingly, the verdict is disputed (Nado 2014, Machery 2015, Mizrahi 2015, Rini 2015). Indeed, philosophers seem susceptible to the same tricks as anyone else (Schwitzgebel and Cushman 2015; Pinillos et al 2011). And second, even if philosophers are better reasoners, it’s not even clear why they are better (Clarke 2013). Why would philosophers be better reasoners than others? I sketch an account in Byrd 2014, Section 3 (see also Weinberg, Gonnerman, Buckner, and Alexander 2010).

Related Posts

Hey Marco Rubio! More philosophy, less rhetoric!

Marco Rubio recently suggested that we need fewer philosophers and more welders because welders make more money. See below:

In case it’s not obvious why this is a foolish suggestion, I’ll explain.

THE MAIN PROBLEM

Here are a couple claims that are probably true:

  1. There is a need for more welders.
  2. Some welders make more money than some philosophers.

Notice, however, that neither of the following follow from those probably true claims:

A. We need fewer philosophers.

B. On average, welders make more than philosophers.

So, insofar as Marco Rubio thinks that A and/or B follows from 1 and 2, Rubio is just wrong. And many people have pointed out that B is just false.†  So insofar as Rubio thinks B is true, he is just wrong.

SOLUTIONS?

What can we learn from this?

  • We need better fact-checking in politics (ideally, politicians would check the facts before they start talking at a public venue).
  • We need more philosophy (viz., a proper understanding and appreciation of good reasoning) — even in the highest ranks of US politics. Maybe we need argument-checking: “Fact-checking is not enough. We need argument-checking“.

TWO MORE PROBLEMS

And for those who still want to point out that we need more welders: fine! Having more welders and having more philosophers is not mutually exclusive! We can have both!††

Finally, there is the implicit suggestion that we should choose careers based on how much money the career offers. Sigh… Look, I get that we need a certain amount of money to flourish. But — contra Rubio’s short argument — surely there are other (more important?) variables involved in a career choice.

 


† “Marco Rubio said wrongly that welders make more money than philosophers” (Politifact). “Marco Rubio says welders make more money than philosophers do. He’s wrong” (Slate). “Philosophy majors actually earn a lot more than welders” (Vox).

†† Thanks to John Ballenger, James Endicott, Andrew Chapman, Cameron Buckner, and Andrew Cullison for making these points (and other points that I haven’t even mentioned). Finally, thanks to my Facebook friends for humoring my Facebook rants about this.

Featured image:  “Gas metal arc welding” via Wikipedia, Public Domain

Implicit Bias | Part 5: Bias Feedback

Apparently, when I impersonate certain political conservatives, I do it with a southern US accent (e.g., “‘Murica!”, “Don’t mess with Texas!”, etc.). I don’t intentionally adopt the accent. In fact, I never even knew I was doing it until my partner pointed it out to me! Without my partner’s third-person perspective, I might never have noticed. I might have just continued mocking people with southern accents. In fact, that wouldn’t be surprising given what we learned in this series [Part 1 – Part 5]. So if we want to do something about our biases, then we would do well to seek this kind of third-personal feedback. Let’s call it bias feedback.

1.  Feedback

The bias feedback I received from my partner can be characterized as bottom-up and informal. Bottom up because it came from a peer rather than from a position of authority. And informal because it happened freely in ordinary conversation rather than as part of some kind of compulsory process. Many people are uncomfortable with informal, bottom-up feedback. So if informal, bottom-up feedback is to be accepted in some contexts, then it might have to be integrated into that context’s culture. There might be a few ways to do this. Continue reading Implicit Bias | Part 5: Bias Feedback

Implicit Bias | Part 3: Workplace Bias


Think about decisions that people make every day. A committee decides who to hire. A supervisor rates an employee’s performance. A teacher grades a student’s assignment. A jury arrives at a verdict. A Supreme Court judge casts their vote. An emergency medical technician decides which victim to approach first. A police officer decides whether to shoot. These are instances in which workplace bias can have significant consequences.

I won’t be able to highlight every area of research on workplace bias. So I cannot delve into the findings that police officers’ sometimes show racial bias in decisions to shoot (Sim, Correll, and Sadler 2013, Experiment 2; see Correll et al 2007, Ma and Correll 2011 Study 2 for findings that indicate no racial bias). And I cannot go into detail about how all-white juries are significantly more likely than other juries to convict black defendants (Anwar, Bayer, Hjalmarsson 2012).

GENDER BIAS AT WORK

Instead, I’ll focus on the instances of workplace bias to which most people can relate. If you’re like most people, then you need to work to live, right? So let’s talk about how bias can affect our chances of being hired. Continue reading Implicit Bias | Part 3: Workplace Bias

Implicit Bias | Part 1: Bias Anxiety

The research on bias is kind of scary. It not only suggests that we are biased; It suggests that we are unaware of many of our biases. Further, it suggests that trying to suppress our biases can easily backfire. So, despite our best efforts, we could be doing harm. And yeah: that might provoke a bit of anxiety. That’ll be the topic of this post.

In future posts, I’ll talk about the theory behind our biases [Part 2], how bias impacts the workplace [Part 3], a dozen debiasing strategies from the research [Part 4], and a few tips for giving (and receiving) feedback about our biases [Part 5].

Related post: The Bias Fallacy (what it is and how to avoid it).

Continue reading Implicit Bias | Part 1: Bias Anxiety

The Willpower Network

(Image from Robeter in the public domain)

I will be presenting a poster about “The Network Theory of Willpower” at the Montreal Neuroethics Conference For Young Researchers on April 17th. You can find the poster hereContinue reading The Willpower Network

Philosophy, Science, and Magic


Being in the hands of a master magician can leave you feeling a bit uneasy. When the magician finishes a trick, you face a jarring disjunction: either your view of the world is deeply mistaken or you’ve failed to understand what happened during the trick. But you’ve no idea what you failed to understand about the trick, so it seems as though the world is not what you think it is.

In this post, I want to argue that something similar can happen when one studies philosophy or science. To explain what I mean, let me offer some context. Continue reading Philosophy, Science, and Magic

Philosophers’ Carnival #171


Welcome to the 171st edition of the Philosophers’ Carnival. Thanks to all those who submitted, to everyone who is reading, and to Tristan Haze for his support. Here we go!

 

Projects

Conceptual Geneology For Analytic Philosophy. Catarina Dutilh Novaes offers a series of four posts in which she defends a “historicist conception of philosophical concepts.” There are helpful links to the literature and to the other posts in the series in this final post.

Degrees of Justification. Luis Rosa begins exploring the claim that degrees of justification will not be satisfactorily captured by probabilities.

Human Errors and My Errata. Anne Jaap Jacobson has written four posts over at The Brains Blog. The overall project: “My intention in planning these four posts was to close on a kind of contribution very developed in feminist thought.  The contribution has concerned how we account for human cognitive successes when we are actually rather error-prone creatures.  The very general approach is to give up a kind of Cartesian picture of the mind.  What is instead emphasized is the extent to which our knowledge depends on our social interactions.” Continue reading Philosophers’ Carnival #171

Exercise, Neuroscience, and the Network Theory of Well-being


Michael Bishop outlines a network theory of well-being in which well-being is constituted by positive causal networks and their fragments (2012, 2015). ‘Positive’ refers to — among other things — experiences that have positive hedonic tones, the affirmation or fulfilment of one’s values, and success in achieving goals. So according to Bishop’s view, we flourish when certain positive causal networks are robust and self-reinforcing. For example, something good happens to us and that improves our motivation and mood, which then helps us achieve more, which improves our motivation and mood even more, and so on.

Bishop’s network account musters philosophical rigor by providing a systematic and coherent account of wellbeing that satisfies many common sense judgments about well-being. But lots of philosophical accounts can do that. So Bishop’s account does even more. It unifies and makes sense of a huge swath of the science. This provides some reason to think that Bishop’s account is superior to its competition.

So what’s this got to do with exercise and neuroscience?

1.  Neuroscience

I am largely persuaded by Bishop’s arguments for the network account of well-being, so I will skip my criticism of the project. Rather, I will add to it. Specifically, I will show how well is makes sense of the neuroscience. While I will not be able to review all of neuroscience, I can accomplish a more modest goal. I can review one part of neuroscience: the effect of exercise on the brain.

2.  Exercise

There is a wealth of evidence suggesting that regular physical activity and exercise forms an important part of one’s positive causal network of well-being by, among other things, increasing positive affect (Harte, Eifert, and Smith 1995), increasing confidence (Klem, Wing, McGuire, Seagle, and Hill 1997), reducing stress, relieving depression (Blumenthal et al 1999; Motl et al 2005) and preventing more than a dozen chronic diseases (Booth, Gordon, Carlson and Hamilton 2000; see also Biddle, Fox and Boutcher 2000 for a review of relationships between exercise and well-being). The mechanisms for all of these results are not entirely clear. But neuroscience is providing, in broad strokes at least, some clues about the mechanisms that can explain, in part, why exercise produces a series of positive effects in a well-being network (e.g., Meeusen 1995Farooqui 2014).

The Positive Effects in the Brain

Let’s start with how exercise produces direct positive effects in the brain. Firstly, exercise and regular physical activity directly improve the brain’s synaptic structure by improving potentiating synaptic strength (Cotman, Berchtold, Christie 2007). Secondly, exercise and regular physical activity strengthen systems that underlie neural plasticity—e.g., neurogenesis, the growth of new neural tissue (ibid., Praag et al 2014). These changes in the brain cause “growth factor cascades” which improve overall “brain health and function” (ibid.; Kramer and Erickson 2007).

Now consider how exercise has indirect positive effects in the brain by producing ancillary positive circumstances. Generally speaking, “exercise reduces peripheral risk factors for cognitive decline” by preventing—among other things—neurodegeneration, neurotrophic resistance, hypertension, and insulin resistance (ibid.; see also Mattson 2014). By preventing these threats to neural and cognitive health, exercise is, indirectly, promoting brain health and function.

Positive Causal Networks

It requires no stretch of the imagination to see how these positive effects will reinforce positive causal networks and thereby increase well-being. Even so, I will do you a favor by trying to demonstrate a connection between exercise, the brain, and the larger network of well-being.

We have already seen how exercise results in, among other things, increased plasticity. And increased plasticity results in improved learning (Geinisman 2000; Rampon and Tsien 2000). Also, the increased plasticity that results in improved learning can produce other positive outcomes: increased motivation, increased opportunities for personal relationships in learning environments, etc. (Zelazo and Carlson 2012, 358). Further, increased motivation and social capital can — coming full circle — result in further motivation (Wing and Jeffery 1999).

That right there is what we call a self-reinforcing positive causal network or positive feedback loop. And that, according to Bishop, is how we increase well-being (see figure 1).

Figure 1. Positive Causal Well-being Network. Exercise promotes outcomes in the brain that promote other positive outcomes outside the brain. Similarly, exercise reduces negatives outcomes that would reduce certain positive outcomes. This is adapted from causal network models found in Cotman, Berchtold, and Christie 2007.
Figure 1. Positive Causal Well-being Network. Exercise promotes outcomes in the brain that promote other positive outcomes outside the brain. Similarly, exercise reduces negatives outcomes that would reduce certain positive outcomes. This is adapted from causal network models found in Cotman, Berchtold, and Christie 2007.
This causal model shows how the neuroscience we just discussed implies a causal network. The nodes and causal connections in this model show how well-being is a matter of positive causal networks.

3.  What about Ill-being?

Obviously, I’ve only mentioned the neuroscience of well-being. But if we want to promote well-being, then we also have to decrease ill-being, right? Right. And once again, the network theory of well-being will fit nicely with the research on ill-being. For example, the research on emotion regulation (see Livingston et al 2015) implies some causal networks that can inhibit ill-being. The same can be said of the research about using deep brain stimulation in treatment-resistance depression (Bewernick et al 2010; Lozano et al 2008; Mayberg et al 2005; Neuner et al 2010).

4.  A Concern: Fitness

You might object by positing that Bishop’s theory of well-being will not fit neuroscience as well as it fits positive psychology. This objection can be dismissed in a few ways. Here are two ways.

First, we can safely accept that Bishop’s network theory of well-being will not fit neuroscience as well as it fits positive psychology. After all, Bishop’s network theory was designed to fit positive psychology, not neuroscience. It’s hardly a fault for a theory to not do what is was not intended to do.

Second, neuroscience is a larger domain than positive psychology. So of course it is harder for a theory to fit it. Allow me to explain. As the domain of discourse increases in scope, it becomes increasingly difficult for us to find a theory that fits all of it. So, because neuroscience is a larger domain than positive psychology, the challenge of providing a theory that fits neuroscience is always more difficult than providing a theory that fits positive psychology. So the fitness objection doesn’t necessarily reflect badly on Bishop’s theory. It might only reflect a difference between positive psychology and neuroscience.

Conclusion

Let me summarize. I mentioned a few cases in which Bishop’s theory of well-being can unifies and makes sense of neuroscience. Then I proposed a few more cases in which Bishop’s theory might do the same. And then I addressed a skeptical worry about the project I propose. So Bishop’s theory of well-being can accomplish even more than Bishop intended.

 

Image credit: “Blues Race Thru Belhaven” from Monumenteer2014, CC BY 2.0

A(nother) Puzzle About Appealing to Intuition?

This is a revised version of an old post about a problem with appealing to intuitions. Many of the original premises were overcomplicated and controversial — and, looking back, I am not even sure that the argument is valid…wow, that’s embarrassing. In this post, I try to make the argument less complicated and less controversial. The new argument yields a new conclusion, I think.

P1. The truth-value of a non-contingent premise is not contingent on anything. [Tautology]

P2. Our intuitions and our ability to imagine (i.e., “conceivability“) are contingent on cognitive capacities [assumption].

P3. Our cognitive capacities are contingent on our physical properties [assumption].

C1. Our intuitions and ability to imagine is contingent on our physical properties [P2, P3: HS]. Continue reading A(nother) Puzzle About Appealing to Intuition?