this post was submitted on 29 Jun 2023
130 points (100.0% liked)

Science

13017 readers
2 users here now

Studies, research findings, and interesting tidbits from the ever-expanding scientific world.

Subcommunities on Beehaw:

Be sure to also check out these other Fediverse science communities:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
remington
alyaza
Gaywallet
130
[Misleading] First misinformation susceptibility test finds 'very online' Gen Z and millennials are most vulnerable to fake news (phys.org)
submitted 1 year ago* (last edited 1 year ago) by somefool to c/science
184 comments fedilink hide all child comments
 

Researchers want the public to test themselves: https://yourmist.streamlit.app/. Selecting true or false against 20 headlines gives the user a set of scores and a "resilience" ranking that compares them to the wider U.S. population. It takes less than two minutes to complete.

The paper

Edit: the article might be misrepresenting the study and its findings, so it's worth checking the paper itself. (See @realChem 's comment in the thread).

you are viewing a single comment's thread
view the rest of the comments
[–] potsnpans 26 points 1 year ago (1 children)

Hooo boy. This article is wildly misrepresenting both the study and it's findings.

  1. The study did not set out to test ability to judge real/fake news across demographic differences. The study itself was primarily looking to determine the validity of their test.
  2. Because of this, their validation sample is wildly different from the sample observed in the online "game" version. As in, the original sample vetted participants, and also removed any who failed an "attention check", neither of which were present in the second test.
  3. Demographics on the portion actually looking at age differences are... let's say biased. There are far more young participants, with only ~10% over 50. The vast majority (almost 90%!) were college educated. And the sample trended liberal to a significant degree.
  4. All the above suggests that the demographic most typically considered "bad" at spotting fake news (conservative boomers who didn't go to college) was massively underrepresented in the study. Which makes sense given that participation in that portion relies on largely unvetted volunteers to sign up to test their ability to spot fake news.

Most critically, the study itself does not claim that differences between these demographics are representative. That portion is looking at differences in the sample pool before/after the test, to examine its potential for "training" people to spot fake news (this had mixed results, which they acknowledge). This article, ironically, is spreading misinformation about the study itself, and doing the researchers and its readers a great disservice.

[–] GataZapata@kbin.social 5 points 1 year ago* (last edited 1 year ago)

Regarding 3, that is the bane of many studies. College students are a demographic to which researchers tend to have easy access, they have time enough to participate and can be motivated by 20€ Amazon vouchers.