Menu
ACADEMICS ONLY
  • PhD Students
    • Get a PhD?
    • Find an advisor
    • Finish Dissertation
  • New Professors
    • Start Strong
    • Teach Better
    • Publish More
  • Scholars
    • Write for Impact
    • Find a great job
    • Avoid Burnout
  • |
  • One-Pagers
    • 5 Ways to Finish Thesis
  • About
  • PhD Students
    • Get a PhD?
    • Find an advisor
    • Finish Dissertation
  • New Professors
    • Start Strong
    • Teach Better
    • Publish More
  • Scholars
    • Write for Impact
    • Find a great job
    • Avoid Burnout
  • |
  • One-Pagers
    • 5 Ways to Finish Thesis
  • About

Does a Retracted Article Have False Findings?

8/27/2019

 
Note:  This is from an earlier 2018 blog post at BrianWansink.com
Two years ago, I had no real idea what a "retracted" journal article was.  I had never thought of it, or known anyone who had had one.  If someone would have asked me, I would have probably said, "There must be something about it that was wrong."

Two years later, I've had a some journals ask me to rerun analyses and to show original paper-and-pencil surveys from as far back as 2000.  When we haven't been able to do so (didn't save the hard-copy surveys or can't track down the coauthor who did the analysis), some of the papers have been retracted because they can't be fully validated.  

Since then a few people have asked me if they can believe Article X or Y because  they were retracted.  I absolutely believe in these articles.  The general conclusions are the same, and even if the original hard-copy surveys and original analyses done a number of years ago can't be found, new reanalyses (often done with different statisticians) generate similar conclusions.

On Monday, one of my coauthors pointed out an insightful article that Dr. Stephen Holden had written for The Conversation website titled, "Retraction of a Journal Article Doesn't Make It's Findings False."  

One of his many points is that “Retractions may be important signals of reduced confidence in a finding, but they do not prove a finding false. This requires replication.”  Social science moves forward because of replication and not rereanalyses.
 
The Gold Standard of science is when independent researchers can run about the same study and come up with similar conclusions. This is why I wish I had published more detail in the method sections of some of my papers.  Instead, when the editor said “Cut out 1000 words,” we cut it out of the methodology section or the references and stayed focused on the idea.  Today, you can include all of the methodological detail and post on an online appendix if there isn’t room in the paper.  
 
Looking back, I’d also archive all of the analyses of my coauthors instead of assuming they’ll always have them on their computer or assuming they’ll never be needed.  Coauthors can lose laptops, change computers, or leave academia. 
 
As for saving the original pencil-and-paper copy of surveys and coding sheets . . . do so if you have your own warehouse (the photo above was taken in 2005 in Illinois in what was supposed to be my garage).  Otherwise you can collect it in a retrievable electronic form (if you think electronic collection won’t affect the results).
 
Academics is an incredibly enriching calling.  As you move forward in a happy career, I hope this is the only time you have to read about a retraction.
​​

Comments are closed.

    Welcome...

    Academics Only is a how-to community that  helps  us share our best practices as PhD students, new professors, and independent scholars.

    Helpful tools and tips on how to graduate, get tenure, teach better, publish more, and have a super rewarding career.
    Picture

    Relevant Posts

    All
    Independent Scholars
    New Profs
    PhD Students


    Some Older Posts

    Picture
    Develop great judgment

    Picture
    Choose the Best Advisor

    Picture
    Give useful advice

    Picture
    How not to retire

    Picture
    Useful sample syllabus

    Picture
    Party with students!

    Picture
    Stay focused

    Picture
    Get into a PhD Program

    Picture
    One way to write a lot

    Picture
    Use PhD case studies

    Picture
    Thank a mentor

    Picture
    Blow an interview

    Picture
    Teach for impact

    Picture
    Ace an interview

    Picture
    Do solution-based research

    Picture
    Am I a mini-me?


    Archives

    January 2023
    December 2022
    November 2022
    October 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    March 2022
    February 2022
    December 2021
    November 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    August 2019
    July 2019
    June 2019

    RSS Feed



Share Your Insights and Ideas

What have you created or found that's been useful and could be helpful for other PhD students, new professors, or independent scholars?  ​
​
  • A pdf handout on teaching 
  • Tips on surviving grad school
  • Favorite career-advice articles
  • A paper submission checklist 
  • A list of inspirational quotes
  • A productivity aid you use
  • ​​​​The goal-setting system you use
  • Your most useful go-to websites
  • Helpful academic How-to articles
  • A method to keep perspective or manage stress

​Send an email to AcademicsOnly@yahoo.com if you have something you think would be useful to share with others on this website, or if you have ideas on how to make this more useful to you or your students.

Stay in touch


Picture