Sign in

Matthew B. Jané

@matthewbjane.bsky.social
5.3K followers 329 following 349 posts

PhD student at UConn | matthewbjane.com

PostsRepliesMedia
Matthew B. Jané @matthewbjane.bsky.social · 20/09/2026
The Audit Clinical Evidence (ACE) Initiative posted an update to the first audit report (wrt Abdelbasset et al 2019). @gidmk.bsky.social found some additional errors in the baseline tables that have now been included in the report. auditclinicalevidence.org/reports/ACE2...
auditclinicalevidence.org
Audit of Abdelbasset et al. (2019) – ACE
Three 2019 RCTs on exercise for depression in heart failure: overlapping trial arms, duplicated PHQ-9 data, impossible statistics and baseline p-values. 25 integrity violations; retraction recommended...
1134
Reposted by Matthew B. Jané
Health Nerd @gidmk.bsky.social · 15/09/2026
New piece on a great project from @matthewbjane.bsky.social looking at problematic research. Also, extremely worrisome issues in studies of exercise for depression. gidmk.substack.com/p/how-do-we-...
gidmk.substack.com
How Do We Deal With Seriously Problematic Research?
A new solution to a very serious issue
12910
Reposted by Matthew B. Jané
Matthew B. Jané @matthewbjane.bsky.social · 13/09/2026
I’ve been quiet on social media lately, but today I’m launching Audit Clinical Evidence (ACE), an initiative I’ve been developing over the past year. Take a look: AuditClinicalEvidence.org
auditclinicalevidence.org
ACE
Independent audits of published clinical research for statistical errors, data inconsistencies, and research integrity violations.
89132
Matthew B. Jané @matthewbjane.bsky.social · 13/09/2026
I’ve been quiet on social media lately, but today I’m launching Audit Clinical Evidence (ACE), an initiative I’ve been developing over the past year. Take a look: AuditClinicalEvidence.org
auditclinicalevidence.org
ACE
Independent audits of published clinical research for statistical errors, data inconsistencies, and research integrity violations.
89132
Matthew B. Jané @matthewbjane.bsky.social · 15/05/2026
This should be mandatory reading for every graduate student.
Screenshot of a book cover: “Doctored: fraud arrogance, and tragedy in the quest to cure Alzheimer’s” - by Charles Piller
0191
Reposted by Matthew B. Jané
The Unjournal (Unjournal.org) @unjournal.bsky.social · 10/02/2026
As specified and posted here: info.unjournal.org/evaluator-pr... I am making the draw for these now using the closing value of S&P 500 today to 2 decimal places, 6,941.81. --> Winners: @matthewbjane.bsky.social and Anon evaluator (of Wellbeing paper). Will make the payments soon.
021
Matthew B. Jané @matthewbjane.bsky.social · 11/02/2026
Thank you so much @unjournal.bsky.social !!
040
Reposted by Matthew B. Jané
The Unjournal (Unjournal.org) @unjournal.bsky.social · 23/12/2025
Congrats on being nominated Edoardo Masset, Hugh Sharma-Waddington, @davidreiley.bsky.social , @cannoncloud.bsky.social , @matthewbjane.bsky.social, & anon. hero. And thanks for the strong work!
031
Reposted by Matthew B. Jané
The Unjournal (Unjournal.org) @unjournal.bsky.social · 23/12/2025
We want your feedback – which evaluations merit the top award, and why? Total prize pool: $6600 www.unjournal.org/news/unjourn... Anonymous: coda.io/form/The-Unj...
unjournal.org
Unjournal 2024-25 Evaluator Prize Nominations; inviting feedback — The Unjournal
The Unjournal commissions expert public evaluation of research with potential for global impact. We recognize and reward the most useful, insightful, and credible evaluation work, including through ou...
123
Matthew B. Jané @matthewbjane.bsky.social · 19/06/2025
Update on Error Report #2: The impact of acoustic stimulation during sleep on memory and sleep architecture: A meta-analysis The article has been retracted by agreement with the journal editor and authors #metascience
071
Reposted by Matthew B. Jané
Nick Holmes @thehandlab.bsky.social · 26/05/2025
"Meta-meta-analyses trade precision & rigor for expediency. If your aim is rigor, there’s no substitute for doing the hard work." Preach! I once read a #meta-analysis that mistook SE for SD. Since then I am suspicious of all such studies. Do the hard work! matthewbjane.github.io/blog-posts/b...
matthewbjane.github.io
When Evidence Synthesis Obscures: A Critique of Meta-Meta-Analyses – Matthew B. Jané
Meta-analyses are often seen as the gold standard of evidence synthesis–systematic, quantitative, and rigorous (at least when done well). So it’s no surprise that some researchers have taken things a ...
162
Reposted by Matthew B. Jané
Paul Whaley @dangerwhale.bsky.social · 25/05/2025
This is very nice from @matthewbjane.bsky.social as to why umbrella reviews are basically useless (sorry!), essentially because they compound up the issues with the meta analyses they include. I have the same concerns but articulate them less eloquently. matthewbjane.github.io/blog-posts/b...
matthewbjane.github.io
When Evidence Synthesis Obscures: A Critique of Meta-Meta-Analyses – Matthew B. Jané
Meta-analyses are often seen as the gold standard of evidence synthesis–systematic, quantitative, and rigorous (at least when done well). So it’s no surprise that some researchers have taken things a ...
0183
Reposted by Matthew B. Jané
Matthew B. Jané @matthewbjane.bsky.social · 23/05/2025
Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses. Link: matthewbjane.github.io/blog-posts/b... #stats #metascience
68727
Matthew B. Jané @matthewbjane.bsky.social · 23/05/2025
Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses. Link: matthewbjane.github.io/blog-posts/b... #stats #metascience
68727
Reposted by Matthew B. Jané
Brendan Nyhan @brendannyhan.bsky.social · 29/04/2025
I'm calling for a total and complete shutdown of JAMA Pediatrics until we can figure out what is going on goodscience.substack.com/p/the-resear... I mean, come ON
1017445
Matthew B. Jané @matthewbjane.bsky.social · 28/04/2025
(#metascience) A good article by @stuartbuck.bsky.social on the Fluoride and IQ meta-analysis: goodscience.substack.com/p/the-resear.... Summarizes some of the points in our forensic review of it (see the forensic review as a pre-print here: osf.io/preprints/os...). Very nice excerpt below:
174
Reposted by Matthew B. Jané
Matthew B. Jané @matthewbjane.bsky.social · 23/04/2025
Error Report #4: matthewbjane.quarto.pub/meta-analysi... The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os... #metascience
46821
Matthew B. Jané @matthewbjane.bsky.social · 23/04/2025
Error Report #4: matthewbjane.quarto.pub/meta-analysi... The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os... #metascience
46821
Reposted by Matthew B. Jané
Noah Greifer @noahgreifer.bsky.social · 22/04/2025
livefreeordichotomize.com by @lucystats.bsky.social matthewbjane.github.io/blog.html by @matthewbjane.bsky.social www.andrewheiss.com/blog/ by the king @andrew.heiss.phd ngreifer.github.io/blog/ by yours truly (can't resist a self-promotion 😉) Stats blogs are the best!
ngreifer.github.io
Posts | Noah Greifer
Statistical Consultant and Programmer
2197
Matthew B. Jané @matthewbjane.bsky.social · 11/04/2025
Coding RCTs for a meta-analysis…
3353
Reposted by Matthew B. Jané
Matthew B. Jané @matthewbjane.bsky.social · 08/04/2025
The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
osf.io
OSF
49055
Reposted by Matthew B. Jané
Lorenzo Lorenzo-Luaces, PhD @lluaces.bsky.social · 09/04/2025
Another great meta-science contribution by @matthewbjane.bsky.social and others. This and his re-analysis of the “social media causes harm” meta-analysis are great examples of how we can use science to serve society without necessarily having to be “activists”
0162
Matthew B. Jané @matthewbjane.bsky.social · 08/04/2025
Most studies in the meta-analysis are no more detailed than the following: “Area A has low fluoride water levels, Area B has high fluoride water levels, and area A has a higher mean IQ” No matching or balancing of covariates. Distinct geographic areas differ more than just their fluoride levels.
051
Matthew B. Jané @matthewbjane.bsky.social · 08/04/2025
They chose to use the standardized mean difference in IQ between a reference and exposure group however the reference in many studies has more fluoride exposure than the exposure group in other studies! There is no consistent definition for the groupings.
040
Matthew B. Jané @matthewbjane.bsky.social · 08/04/2025
One major finding in our pre-print is that the journal ‘Fluoride’ publishes much larger effects than any other academic journal. Fluoride is published by the International Society for Fluoride Research which is run by anti-fluoride activists and hosts water defluoridation workshops. #metascience
1133
Matthew B. Jané @matthewbjane.bsky.social · 08/04/2025
I saw @epiellie.bsky.social comment on this so I am tagging her here #metascience
020
Matthew B. Jané @matthewbjane.bsky.social · 08/04/2025
The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...
osf.io
OSF
49055
Matthew B. Jané @matthewbjane.bsky.social · 02/04/2025
In probability the following is true by definition Pr(sample space) = 1 Pr(empty set) = 0
020
Matthew B. Jané @matthewbjane.bsky.social · 26/03/2025
👀
0111
Reposted by Matthew B. Jané
Wolfgang Viechtbauer @wviechtb.bsky.social · 19/03/2025
We just published a paper on the performance of various tests and confidence intervals for the scale coefficients in location-scale models in meta-analysis: doi.org/10.3758/s134... Overall, REML-based LRTs and profile-likelihood CIs performed best, but the number of studies typically must be large.
doi.org
Performance of location-scale models in meta-analysis: A simulation study - Behavior Research Methods
Location-scale models in the field of meta-analysis allow researchers to simultaneously study the influence of moderator variables on the mean (location) and variance (scale) of the distribution of tr...
0169
Matthew B. Jané @matthewbjane.bsky.social · 18/03/2025
Error Report #2 (#metascience): t.co/9xyqIVUele The meta-analysis by Stanyer et al. (2022) contains severe data extraction errors. Due to these errors, the meta-analytic results for memory retention scores are incorrect. Reported effects for WPAL outcomes are 5x larger than the corrected effects.
12210
Matthew B. Jané @matthewbjane.bsky.social · 17/03/2025
Error report #1 (#metascience): An influential meta-analysis on mindfulness based stress reduction with ~2,900 citations appears to have severe data extraction and methodological errors that inflate the difference in effects between MBSR & control groups: matthewbjane.quarto.pub/meta-analysi...
matthewbjane.quarto.pub
Error Report #1 – Meta-Analysis Error Reports
33910
Reposted by Matthew B. Jané
Taym @taymalsalti.bsky.social · 25/02/2025
indeed who gave these people taking time to post helpful comments on published research for no reward the power to be largely ignored by the authors of the commented research and the journals the research was published in?!?!
071
Matthew B. Jané @matthewbjane.bsky.social · 13/03/2025
Someone talk me down from the idea to call X a “conditioning variable” #stats
370
Matthew B. Jané @matthewbjane.bsky.social · 10/03/2025
When you say something is an assumption (e.g., linear regression assumes conditional normality) you need to specify what properties are actually being preserved with this assumption. 1/3
1337
Reposted by Matthew B. Jané
Lorenzo Lorenzo-Luaces, PhD @lluaces.bsky.social · 21/02/2025
1: #AcademicSky #PsychSciSky #LatinX/einSTEM #QueerSTEM #Science Please share! I'm running a survey on how *U.S.* academics (grad students, faculty, admin., etc) think and feel about recent executive orders affecting academia (e.g., diversity, funding). Here iu.co1.qualtrics.com/jfe/form/SV_...
iu.co1.qualtrics.com
Online Survey Software | Qualtrics Survey Solutions
Qualtrics sophisticated online survey software solutions make creating online surveys easy. Learn more about Research Suite and get a free account today.
13039
Reposted by Matthew B. Jané
Darren Dahly @statsepi.bsky.social · 28/01/2025
Here's my entry: Hydroxycholoquine treats COVID-19 because a p-value is small.
3242
Reposted by Matthew B. Jané
Julia M. Rohrer @dingdingpeng.the100.ci · 11/01/2025
I’ve heard stories about profs whose BIGGEST FINDING was made by some student clicking through their data in SPSS. I’m coming to believe that being bad at stats must have been adaptive in that field during a certain historical time.
4591
Matthew B. Jané @matthewbjane.bsky.social · 02/12/2024
Pre-prints are a run-of-the-mill modern open science practice. I’d rather a more transparent review process than less. A completely open review process holds reviewers and authors accountable. Let’s not pretend that a blind review is “impartial” and “objective”. #metaresearch
2151
Matthew B. Jané @matthewbjane.bsky.social · 02/12/2024
Chopped all my hair off
3110
Matthew B. Jané @matthewbjane.bsky.social · 27/11/2024
Just saw skimmed a simulation paper and I knew what the results would be by just looking at the authors.
150
Reposted by Matthew B. Jané
Nick Brown @steamtraen.eu · 26/11/2024
A silly little thing in Excel that might be useful for forensic data analysts. Have a look at these numbers. Notice anything? /1
35118
Matthew B. Jané @matthewbjane.bsky.social · 25/11/2024
Since clearly.app is up. Thank you all for including me in so many starter packs! Really appreciate it
130
Reposted by Matthew B. Jané
Rex "garbage in" Douglass @rexdouglass.bsky.social · 24/11/2024
Not sure which of the 60+ data, stats, and ml starter packs to start with? I combined them all and ranked people by how many packs and how many distinct topics they appeared in. These are the 149 people on Bluesky with the broadest importance across quant communities in November, 2024.
85711
Reposted by Matthew B. Jané
Mu Yang, Ph.D. @mumumouse2.bsky.social · 24/11/2024
🥰
0131