Not what I expected!
More people preferred high diagnostic uncertainty than low, even though the higher uncertainty caused more worry.
Within- and between-subject, quant and qual results: https://doi.org/10.1136/jme-2024-109932
Not what I expected!
More people preferred high diagnostic uncertainty than low, even though the higher uncertainty caused more worry.
Within- and between-subject, quant and qual results: https://doi.org/10.1136/jme-2024-109932
#Microsoft's viral paper about *correlations* between #AI use and #criticalThinking also has "impact" in the title (despite admitting "Our analysis does not establish #causation").
#Confidence in #GenAI predicted LESS critical thinking.
SELF-confidence predicted MORE critical thinking.
PREDICTED ≠ CAUSED
TL;DR: I think a specific kind of "backward" reasoning, common in conservative religious traditions in the US, is one of the things driving the current crisis.
Long version:.......
First, my experience is with the LDS church, which has spent a few decades trying to be Evangelical enough to be buddies with the actual Evangelicals, and my experiences so far suggest that LDS church members have a lot in common with Evangelical Christians at this point in time, in regards to the issues in this long-ass post.
I was #LDS (i.e., #Mormon) for the first mumblenumbermumble decades of my life. I was taught--expicitly, not by the also-ubiquitous methods of "read-between-the-lines", "pay attention to consequences instead of words," etc.--that the right and proper way to #reason about all things religious was thus:
The first point is a problem, of course, because it comes before any external evidence. There is #evidence of a kind, but it is 100% subjective: the results of your #spiritual promptings or feelings or inspiration. You get these by praying really hard, thinking the right thoughts, etc. Thinking "negative" thoughts (often any kind of skepticism or doubt is included in this category) will drive the Holy Spirit away and he won't be able to tell you how true all the stuff is.
There are many people--and I truly believe they are almost all sincere and well-meaning--to help you navigate this difficult process. This means to help you come to the right conclusions (i.e., that Jesus is God and died for our sins, that Joseph Smith was His prophet, that the LDS church is the only true #church etc.). Coming to the "wrong" conclusions means you aren't doing it right, hard enough, humbly enough, etc. so you will keep at it, encouraged by family, friends, and leaders, until you get the "right" answer.
See, you make up your mind about the truth of things before acquiring any outside #evidence. I was a full-time missionary in Mexico for two years; I am aware that of course evidence does get used, but not the way a scientist or other evidence-informed person would use it. We used scriptures, #logic, personal stories, empirical data, etc. as merely one of many possible tools to bring another soul to Christ. LDS doctrine is clear on this (where its notably unclear on a huge range of other things): belief/#faith/testimony does not come from empirical evidence. It comes from the Holy Spirit, and only if you ask just right.
Empirical evidence, clear reasoning, etc. are nice but they're just a garnish; they're only condiments. The main meal is promptings (i.e., feelings) from the Holy Spirit. That is where true knowledge comes from. All other #knowledge is inferior and subordinate. All of it. If the Holy Spirit tells you the moon is cheese, then by golly you now have a cheesemoon. More disturbingly, if the Holy Ghost tells you to kill your neighbors, you should presumably do that. This kind of "prepare for the worst" thinking is a lot more common in conservative Christian groups than I think some people realize.
Anyway, you get these promptings. They're probably not because you're a sleep-deprived, angsty, sincere teenager who has been bathed and baked in this culture your entire life and has no concept of any outcome other than this. You get the promptings. Now you know. You know that Jesus is your Savior, that Joseph Smith was his prophet, that the LDS Church is the only true and living church on the face of the etc. etc.
You don't believe; you know.
So the next step is... nothing specific, really. You're done learning. That step is over. As we were reminded repeatedly as young missionaries: your job is to teach others, not to be taught by them. You go through the rest of your life with this knowledge, and you share it whenever you can. Of course, some events and facts and speech might make you doubt your hard-won knowledge. What to do?
You put the knowledge first and make the #facts fit it. You arrange the facts you see or read or whatever so that they fit this knowledge you acquired on your knees late at night with tears in your eyes, or in Sacrament Meeting the morning after a drama-filled youth conference. If you can't make the facts fit your knowledge, you reject the facts.
You seriously reject facts, and pretty casually. You might decide they aren't facts, or you might get really interested in the origin of anidea so you can discredit it, etc. Some people reject the theory of evolution. Others reject a history in in which many of the founding fathers of the USA were #atheist, #agnostic, or Not Very Good People. You can reject anything, really. You can reject the evidence of your eyes and ears, as the Party demands. It's kind of easy, in fact.
Millions of people think like this: they explicitly reject information that does not fit the narrative they have acquired through a process that depended 100% on subjective experiences (and, afterward, is heavily dominated by "authority figures" and trusted friends who tell you what to believe this week).
As a psychologist, even though #DecisionScience is not my area of research, I can tell you various ways in which one's #subjective experience can be manipulated, especially with the support of a life-saturating religious worldview and community. Relegating facts to a supporting role (at best) means giving all kinds of biases free rein in influencing your views. Facts were one of the things that might have minimized that process. In fact, I think facts as correctives for human biases was a main motivation underlying the development of the #ScientificMethod.
This becomes how you live your life: find out what's true, then rearrange your worldview, your attitudes, your specific beliefs, your behavior, and potentially even how you evaluate evidence to fit that knowledge. You aren't faking it, you aren't pretending; you simply believe something different. You see the world differently. I'm guessing you'd pass a lie detector test.
Note that nowhere in this process is there ever what a #philosopher, a #scientist, or a mathematician would call an "honest, open inquiry." That would imply uncertainty about the outcome of the inquiry. It would imply a willingness to accept unexpected answers if the evidence or reasoning led there. That's not possible because there can be only one answer: what you already know. Evidence cannot be allowed to threaten knowledge.
Coincidentally, now you're a perfect member of the Trump/Musk/whoever personality cult. All you need are some trusted sources (e.g. friends, neighbors, celebrities, local church leaders) to tell you that #Trump is a Good #Christian, that #AOC is secretly a communist, that #Obama was born in Africa, that Killary is literally eating babies, that a pizza parlor has a torture basement, that Zelensky is a villain and Putin a hero, etc. Literally anything. You haven't just learned how to do this; it is how your brain works, now. This is how "reasoning" happens. This is how belief and worldview and personal commitment are formed and shifted.
Now you casually accept new concepts like "crisis actors", "alternative facts", the "deep state", and "feelings-based reality." You have no problem doing this. Conspiracy theories are a cakewalk; you could fully believe six impenetrable Qanon ravings before breakfast.
I've seen progressives casually assume that Evangelical-type Christians are hypocrites, or lying, or "virtue signaling" as they state their support for whatever value-violating thing Trump or Musk or any national GOP figure has said or done (e.g., "Hey, I now believe that god doesn't love disabled people, after all!"). I've accused conservatives of those things things myself, though I don't actually believe that's what is happening. What we're seeing is not just hypocrisy or dishonesty. What's happening, at least with many religious people, is that a trusted leader has told them they should believe a different thing, so now they do. It's that simple. Many might even die for their new belief in the right circumstances (certain Christians are a little bit obsessed with the possibility of dying for their faith, so this isn't as high a bar as you might think).
Sure, some people who flipflop overnight probably are lying or putting on an act even they don't truly believe. However, many more are simply being who they are, or who they've become by existing in this ideological/cultural system for years.
Obviously, I believe this kind of reasoning is not good and makes the world a better place. I would like to reduce it or even eliminate it. It is embedded, though, with other dynamics: ingroup/outgroup tribalism, authoritarianism (boy howdy do conservative churches train you to be an authoritarian), prejudices of various kinds, and basic cognitive biases (which run rampant in such environments).
It's also bound up with religious #AntiIntellectualism. In the LDS church, for instance, there's a scripture that gets tossed around at election time saying that being educated is good, but only up to a point (any education that leads a person to question God's words, etc. is by definition too much" learning). As a person with a graduate degree, my last decade or so in the LDS church was marked by a more or less constant social tension from the possibility that I might "know too much".
Education reliably reduces this problematic kind of thinking/believing system in many people. Specifically, "liberal arts" education (which isn't about liberalism or necessarily arts) is the special sauce; the classes many students will be forced to take for "general education" at most US universities are pretty good at teaching students different ways of thinking and helping them try on alternative worldviews. Many of the people learning multiple worldviews and getting some tools for reasoning and evidence, etc. tend to use them for the rest of their lives. Even truly exploring one or two wrong alternative worldviews or thinking patterns tends to yield big rewards over time. Notably, the GOP's attacks on higher ed have become much worse, recently.
Anyway, this is (IMO) what progressives are up against in the USA. It is not just that some people believe different things; it's that many of those people have entirely different cognitive/emotional/social structures and processes for how belief happens and what it means.
Undoing this will take generations. In the meantime, I encourage pushing back on conservative flip-flops. No matter what, not even Evangelical congressmen want to look inconsistent. Even the evangelicalest of Christians will sometimes engage with facts and reasoning to some degree, and pressure simply works, sometimes. Keep your expectations for personal change low, however.
Df. "clinical #equipoise describes a situation of evidentiary uncertainty among experts"
Opel et al. argue such equipoise is neither necessary nor sufficient for #SharedDecisionMaking.
Rather SDM is most useful where tradeoffs between options are KNOWN.
What medical problem statement features help or hinder #chatGPT's #diagnosis accuracy?
- more comorbidities and historical items hurt differentials
- more examination items and use of 3-part statement format helped
A former colleague and old friend just got laid off. She has an MS in ITDS (information technology and decision science) and a ton of experience with SQL, and is a very reliable and consistent worker. She's also comfortable with Python and C#. Please let me know of any opportunities you may know of in that area, and I'll pass it along!
#ITDS
#InformationTechnology
#DecisionScience
#SQL
#Python
#CSharp
#FediHire
#FediHired
Good news in our preprint about #polarization:
Demand for BIPARTISAN #news analysis was strong!
People in the #US preferred fact-checking teams that engaged in #AdversarialCollaboration at least as much as copartisan and/or professional teams.
Follow the manuscript or authors on #GoogleScholar: https://scholar.google.com/scholar?oi=bibs&hl=en&cluster=1017561778629165218
If you prefer a link directly to our preprint: https://doi.org/10.31219/osf.io/gp9w7
An adversarial collaboration reports that mathematical reflection tests assess #math ability about as much as anything else.
And what is the evidence that the paper's “independent” measure of reflection actually measured reflection?
Excited for 2025 presentations in #NYC at the #APA (January 8 to 11): apaonline.org/mpage/2025eastern?utm_source=mastodon&utm_medium=social&utm_campaign=fedica-Text-posts
The talk: https://researchgate.net/publication/370132037?utm_source=mastodon&utm_medium=social&utm_campaign=fedica-Text-posts
The poster: https://researchgate.net/publication/371248872?utm_source=mastodon&utm_medium=social&utm_campaign=fedica-Text-posts
I’m sharing talks and posters from this weekend’s Society for #JDM #conference over on #BlueSky: https://bsky.app/profile/byrdnick.com/post/3lbmo4zclhc2d
The first talk’s about the #jobMarket. By the way, I’m hiring a 3-year #postdoc who can do #quant #decisionScience — #WFH or on campus: https://geisinger.wd5.myworkdayjobs.com/GeisingerExternal/job/Danville-PA/Postdoctoral-Fellow---Decision-Sciences--Remote-Capable-_R-69755
@knutson_brain @Andrewpapale @tdverstynen
3/3 But it may also be time to incorporate #sociology studies of world-understanding and news gathering into decision theory practical consequences.
To my knowledge there isn't a strong connection between people studying these consequences of #propaganda and #news eco-systems with modern theories of #DecisionMaking and #DecisionScience.
But if anyone is interested, please reach out to me. It is something I'm very interested in pursuing. #ChangingHowWeChoose
Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): https://www.apaonline.org/mpage/2025eastern
Can't make it?
- More about my talk: https://researchgate.net/publication/370132037
- More about my poster: https://researchgate.net/publication/371248872
Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!
Suppose you ask kids about their school work *while they work on it*: will it help or hurt their learning?
Asking fifth graders about their reading or math improved pre- v. post-test learning, compared to not asking (Ns > 350):
#OpenAccess paper: https://doi.org/10.1016/j.heliyon.2024.e40055
ICYMI: a large language model was better at diagnosis than doctors?
...and letting the doctors use the large language model didn't improve doctor's diagnoses?!
#OpenAccess article in #JAMA: https://doi.org/10.1001/jamanetworkopen.2024.40969
A #health literacy intervention reduced the perceived accuracy of inaccurate #cancer headlines ...as well as *accurate* headlines.
Cheers to the authors and the journal for publishing this less-than-encouraging result: https://doi.org/10.1093/abm/kaae054
Looks like prior (rather than new) beliefs about cancer were the primary predictors of discernment about cancer headlines.
Which subreddits score higher on deliberation metrics?
A new metric of deliberation (designed to overcome prior issues) found that the following subreddits had the highest deliberation scores (across 72 subreddits)
- Subreddits that are based on geographical regions
- Political subreddits
- Sports subreddits
Reflective thinking often improves judgment and decisions, but across three experiments reflective thinking didn't seem to predict FEELING better about one's decision: https://doi.org/10.1017/S1930297500009414
This may help explain why we so often underrate reflective thinking.
Emotion can inhibit reflective thinking, but are all emotions equally inhibitory?
Reflective thinking was inhibited more by a video designed to elicit disgust than a video designed to elicit fear/thrill (among about 50 people who completed 60 reflection tests): https://doi.org/10.2147/PRBM.S471624
Filed under #AI overhype:
#LLMs perform near perfectly on common reflection tests, but slightly altering the #math caused LLMs to fail, suggesting the best models (including #OpenAI's o1) are not great at reflective, mathematical reasoning.
V1 of #preprint: https://doi.org/10.21203/rs.3.rs-5273334/v1
More successful predictions of my #BoundedReflectivism & #EpistemicIdentity article from 2022?
From about 2017 or 2018, I reviewed evidence suggesting that reflective thinking often helps, but may even hinder our judgment depending on factors like whether we are reasoning based on shared identities and epistemic standards (https://doi.org/10.1111/meta.12534).
Years later Robb Willer et al. solicited ideas for debiasing political judgments. After years of testing 25 different interventions, their results are published in #Science: https://doi.org/10.1126/science.adh4764
They found that biased evaluations of politicized facts were impacted by both
- REFLECTION (on potential misperceptions of undemocratic actions) and
- shared IDENTITY cues (which could help *or* hinder!)