Sign in

František Bartoš

@fbartos.bsky.social
923 followers 206 following 135 posts

PhD Candidate | Psychological Methods | UvA Amsterdam | interested in statistics, meta-analysis, and publication bias | once flipped a coin too many times

PostsRepliesMedia
Reposted by František Bartoš
Matthew B. Jané @matthewbjane.bsky.social · 13/09/2026
I’ve been quiet on social media lately, but today I’m launching Audit Clinical Evidence (ACE), an initiative I’ve been developing over the past year. Take a look: AuditClinicalEvidence.org
auditclinicalevidence.org
ACE
Independent audits of published clinical research for statistical errors, data inconsistencies, and research integrity violations.
89132
František Bartoš @fbartos.bsky.social · 04/09/2026
Another meta-analyses on AI in education. > Fig. 2 provides a visual representation of the distribution of effect sizes, indicating that the effect sizes are nearly symmetrically distributed... This distribution suggests that there is no evidence of publication bias present...
121
Reposted by František Bartoš
Beth Clarke @bethclarke.bsky.social · 21/08/2026
I’m hiring a PhD student to work with me on metascience in psychology at @zpid.bsky.social! The position is very open - could cover a wide range of topics/themes 🤸🏻‍♀️✨ If you have questions, please reach out! Applications are open until October 1st. leibniz-psychology.onlyfy.jobs/en/job/fyjwt...
leibniz-psychology.onlyfy.jobs
PhD in Psychological Meta-Science (m/f/d)
Become part of the open science movement The Leibniz Institute for Psychology Information (ZPID) in Trier (Germany) is an internationally recognized research-based psychology service center located in...
36157
Reposted by František Bartoš
Jin X. Goh | 吴晋勋 @jinxungoh.bsky.social · 11/08/2026
Meme of a young person assisting an old lady. The old person said “I remember when you could store data on osf.” The young person said “sure professor. Let’s get you to bed”
315227
František Bartoš @fbartos.bsky.social · 11/08/2026
My supervisor vibecoded a nice visualization for the same-side bias in coin flips effect:
bayesianspectacles.org
Coin precession simulation with same-side fraction
021
František Bartoš @fbartos.bsky.social · 05/08/2026
For the revision for our "Meta-Analysis with JASP, Part I: Classical Approaches" tutorial, I recorder a series of YouTube videos walking through the examples in JASP www.youtube.com/watch?v=mbou... First time doing this. Do you find walkthroughs like this useful? Let me know any suggestions!
youtube.com
Meta-Analysis with JASP, Part I: Classical Approaches (Example 1)
YouTube video by JASP Statistics
095
František Bartoš @fbartos.bsky.social · 21/07/2026
Join the JASP workshops at the last week of August!
000
František Bartoš @fbartos.bsky.social · 18/07/2026
Come to our #IMPS2026 symposium on methodology of simulation studies with Richard Feinberg, @karolinehuth.bsky.social , Mirka Henninger, and David Kronthaler on Tuesdat at 12:45 to room 102. The symposium has the following talks:
151
František Bartoš @fbartos.bsky.social · 11/07/2026
@jaspstats.bsky.social released a new of the Meta-Analysis module -- if you have the latest version of JASP you should see a small blue download icon next to the Meta-Analysis module on the ribbon. You can update it via the Module Store (see screenshot below).
1100
František Bartoš @fbartos.bsky.social · 02/07/2026
I was presenting a poster at ISBA overviewing the RoBMA R package for Bayesian meta-analysis. Check it below to see a brief summary of the latest changes with the new 4.0 version and the future directions!
170
Reposted by František Bartoš
Prof Andy Field @profandyfield.com · 25/06/2026
Want to learn JASP? My colleagues (@ejwagenmakers.bsky.social) at UVA are running workshops in August: jasp-stats.org/2026/02/03/h...
jasp-stats.org
Hybrid Workshop "Discovering Statistics Using JASP", August 24th, 2026 - JASP - Free and User-Friendly Statistical Software
We are happy to announce that the JASP team will offer a week of workshops in Amsterdam this summer.  In this blogpost we’ll highlight the first of four workshops: “Discovering Statistics Using JASP“....
0107
Reposted by František Bartoš
Wolfgang Viechtbauer @wviechtb.bsky.social · 22/06/2026
The standard random-effects model in meta-analysis assumes that the amount of heterogeneity is homoscedastic. This assumption may not be true. I derived and examined various tests for heteroscedastic heterogeneity. See osf.io/cavhy for a preprint describing these methods. #MetaAnalysis #RStats
osf.io
OSF
13112
František Bartoš @fbartos.bsky.social · 18/06/2026
Currenly revising our critique of meta-analyses of AI/LLM on learning. Some of the original meta-analyses are beyond ridicolous. This one has 87 citations since published in 2025. (doi.org/10.1177/0266...)
150
František Bartoš @fbartos.bsky.social · 03/06/2026
We still have a couple of spots left for JASP workshops August! 24: Discovering Statistics using JASP 25: State-of-the-Art Meta-Analysis using JASP 26: A Crash Course in Machine Learning with JASP 27-28: Theory and Practice of Bayesian Hypothesis Testing with JASP jasp-stats.org/workshops/
jasp-stats.org
Workshops - JASP - Free and User-Friendly Statistical Software
The JASP team is excited to support four workshops this year (2026). Each of these workshops can be attended either in person (at the University of Amsterdam) or online: On Monday August 24th, we orga...
071
František Bartoš @fbartos.bsky.social · 02/06/2026
Check out the great program of the *1st Interdisciplinary Symposium on Meta Science for Methods Research* organized 31 August and 1 September in Zürich! Ton of cool speakers and meta-methodological reseach! crsuzh.pages.uzh.ch/msmr/program/ (registration still open)
crsuzh.pages.uzh.ch
index – MSMR 2026
02013
František Bartoš @fbartos.bsky.social · 13/05/2026
The multilevel extension to RoBMA was just published in BRM (link.springer.com/article/10.3...). Together with @maxmaier.bsky.social and EJ Wagenmakers, we developed a 3-level version of RoBMA which allows analysts to adjust for publication bias in meta-analyses with estimates nested within studies.
3163
František Bartoš @fbartos.bsky.social · 12/05/2026
I just found out that a meta-analysis on the effect of ChatGPT on learning that we criticized last year not adjusting for publication bias and overinterpreting the conclussions (osf.io/preprints/ps...) was retracted last month (see notice www.nature.com/articles/s41...)!
182
František Bartoš @fbartos.bsky.social · 08/05/2026
A major release of the RoBMA package (4.0.0) is now on CRAN. Main highlights: - fully redesigned interface closely matching metafor - dedicated brma, bselmodel, bPET, bPEESE for single model fits - fit diagnostics features (residuals, influence, etc) (overview at fbartos.github.io/RoBMA/articl...)
fbartos.github.io
Feature Coverage
174
František Bartoš @fbartos.bsky.social · 07/05/2026
In our new preprint we show how to efficiently compute Bayes factor sensitivity analyses for any model comparison. The computation trick is simple -- it rellies on extend the model by a hyper-prior on the parameter(s) for which sensitivity is desired and using transitivity of Bayes factors.
140
Reposted by František Bartoš
Victor Shiramizu @victorshiramizu.bsky.social · 19/03/2026
Our paper is now out in Hormones and Behaviour. We found little evidence for group differences in 2D:4D ratios by sexual orientation when jointly modeling publication bias and heterogeneity. w/ @fbartos.bsky.social, Ben Jones & @tvpollet.bsky.social www.sciencedirect.com/science/arti... 🧵1/9
sciencedirect.com
Little evidence for group differences in 2D:4D ratios based on sexual orientation after adjusting for publication bias
The ratio between the lengths of the second and fourth digits (2D:4D) has been proposed as a putative marker of prenatal androgen exposure and investi…
185
Reposted by František Bartoš
Prof Andy Field @profandyfield.com · 26/02/2026
Interested in finding out more about @jaspstats.bsky.social? The Psych Methods Group at the University of Amsterdam is running four hands-on workshops (in person or online) this summer (@ejwagenmakers.bsky.social, @fbartos.bsky.social). More information at jasp-stats.org/workshops/ but to sum up:
jasp-stats.org
Workshops - JASP - Free and User-Friendly Statistical Software
The JASP team is excited to support four workshops this year (2026). Each of these workshops can be attended either in person (at the University of Amsterdam) or online: On Monday August 24th, we orga...
1145
Reposted by František Bartoš
Daniel Lakens @lakens.bsky.social · 10/02/2026
Everything is ready for the Perspectives on Scientific Error conference that starts tomorrow in Leiden! I look forward to hanging out with the mix of metascientists, philosophers of science, and statisticians! So many old friends will be there (and hopefully some new ones)! #PSE8
0509
František Bartoš @fbartos.bsky.social · 06/02/2026
Come to Amsterdam or join online for the full week of JASP workshops (24th-28th of August)! If you can't do the full week or you are only interested in meta-analysis, I will be giving the Meta-Analysis workshop on 25th of August. jasp-stats.org/2026/02/05/h...
040
Reposted by František Bartoš
Björn Siepe @bsiepe.bsky.social · 04/02/2026
Does it make sense to preregister simulation studies? This question has sparked a lot of debate. ▶️We* work through the why, when, and how ▶️We discuss different phases of methodological research to clarify where preregistration might (or might not) add value 📝 Preprint: doi.org/10.31234/osf...
Diagram showing four phases of methodological research (Theory, Exploration, Systematic Comparison, Evidence Synthesis) with an arrow indicating that preregistration usefulness increases from early to late phases. Each phase lists its aim, elements, outcome, and an example from factor retention research.
13713
František Bartoš @fbartos.bsky.social · 28/01/2026
We just posted a preprint with a comprehensive meta-meta-analysis of the effects of AI/LLMs on learning. TLDR: - 1,840 effect sizes - extreme between-study heterogeneity - extreme publication bias - small average effects (three times lower than usually reported) (osf.io/preprints/ps...)
181
Reposted by František Bartoš
ejwagenmakers.bsky.social @ejwagenmakers.bsky.social · 14/01/2026
Edgeworth proposed the alpha=.005 criterion 134 years prior to Benjamin et al. (2019). :-) www.bayesianspectacles.org/redefine-sta...
bayesianspectacles.org
Redefine Statistical Significance Part XXI: Edgeworth Proposed the .005 Criterion Back in 1885
The statistical significance test was not invented by Ronald Fisher. The key idea was already laid out by Francis Ysidro Edgeworth (1845-1926), whose 1885 article “Methods of statistics&#8221…
011
Reposted by František Bartoš
ejwagenmakers.bsky.social @ejwagenmakers.bsky.social · 24/12/2025
The world's earliest recorded outlier? Let me know if you have an even older example! www.jasp-services.com/jasp-for-qua...
jasp-services.com
JASP for Quality Control, Example 6: The World's Earliest Recorded Outlier? - JASP Services BV
Information hidden in raw data can be revealed most easily by means of statistical visualization techniques (“always plot your data”). To demonstrate I will now analyze the duration of reign (in years...
021
František Bartoš @fbartos.bsky.social · 23/12/2025
"we did not find any evidence for publication bias (p=0.077)"
130
František Bartoš @fbartos.bsky.social · 23/12/2025
The Robust Bayesian Meta-Analysis package got updated with additional vignettes explaining how to perform Bayesian model-averaged publication bias-adjusted - multilevel meta-analysis (cran.r-project.org/web/packages...) - multilevel meta-regression (cran.r-project.org/web/packages...)
cran.r-project.org
Multilevel Robust Bayesian Meta-Analysis
12511
Reposted by František Bartoš
JASP Services @jasp-services.com · 17/12/2025
I recently bought 20 bags of potato that, according to the Albert Heijn supermarket, should each contain 1 kg. This turns out to be *false*. www.jasp-services.com/at-the-alber...
jasp-services.com
At the Albert Heijn, You Get About 2% More Potatoes Than What it Says on the Label - JASP Services BV
A week ago I started a small quality control project where I measured twenty “1 kg” Albert Heijn (AH) potato bags in order to assess whether or not AH is systematically underfilling them, as some soci...
043
Reposted by František Bartoš
JASP Services @jasp-services.com · 12/12/2025
The suspense is building: do the measurements of 20 units indicate that the Albert Heijn underfills its 1 kg bags of potatoes? An interim post on the importance of articulating your predictions *before* seeing the results. :-) www.jasp-services.com/do-the-1kg-a...
jasp-services.com
Do the 1kg Albert Heijn Potato Bags Really Contain 1kg of Potatoes? - JASP Services BV
A few days ago I announced a small quality control project where I would measure 20 bags of “1 kg” Albert Heijn (AH) potato bags to assess whether or not AH is systematically underfilling them, as som...
064
Reposted by František Bartoš
JASP Services @jasp-services.com · 03/12/2025
This week's blog post features "raincloud plots", a relatively recent development in data visualization. Will the raincloud plot gradually replace the box plot? It just might! Check out the raincloud plot for the planets in our solar system at www.jasp-services.com/jasp-for-qua...
jasp-services.com
JASP for Quality Control, Example 4: The Raincloud Plot - JASP Services BV
In our last post we discussed the boxplot of the distances to the sun for each of the eight planets in our solar system, as measured in astronomical units (AU; AU=1 is the average distance from the ea...
055
František Bartoš @fbartos.bsky.social · 01/12/2025
We just preprinted a huge meta-meta-analysis examining the effects of exercise on cognition, memory, and executive function In short - 2239 effect sizes - extreme between-study heterogeneity - extensive publication bias - some subgroup/exercise-specific effects More below (doi.org/10.31234/osf...)
doi.org
OSF
16330
Reposted by František Bartoš
ejwagenmakers.bsky.social @ejwagenmakers.bsky.social · 26/11/2025
Feb 16-17: JASP Hackathon in Amsterdam! Now open for applications Post with details on the JASP website: jasp-stats.org/2025/11/21/a...
jasp-stats.org
Apply for the eScience JASP Hackathon and Build Your Own Module, in Amsterdam - JASP - Free and User-Friendly Statistical Software
tldr; On 16-17 February 2026 the Netherlands eScience Center is hosting a two-day JASP hackathon in Amsterdam. The purpose of the hackathon is to guide participants into developing their very own JASP...
011
Reposted by František Bartoš
Journal of Robustness Reports @robustnessreports.bsky.social · 11/11/2025
New blogpost on our JRR website! Check out our new blogpost (link below): we highlight a study for re-analysis on whether CEOs are shaped by their daughters. This could be a potential candidate for a robustness report. www.journalofrobustnessreports.org/are-ceos-sha...
journalofrobustnessreports.org
Are CEOs Shaped by Their Daughters? - Journal of Robustness Reports
In this blogpost I wish to highlight the following article as a candidate for a set of Robustness Reports: Cronqvist, H., & Yu, F. (2017). Shaped by their daughters: Executives, female socialization, ...
032
Reposted by František Bartoš
JASP Services @jasp-services.com · 28/10/2025
"Always plot your data" -- an example of using descriptives *before* measuring capability of an instrument. We intend to have regular posts demonstrating how JASP can be useful for quality control and lean six sigma. www.jasp-services.com/jasp-for-qua...
jasp-services.com
JASP for Quality Control, Example 1: Descriptives (aka "Always Plot Your Data") - JASP Services BV
To showcase how JASP can be used for statistical quality control we initiate a series of blog posts in which JASP is used to execute key statistical tasks. In this series’ inaugural post, I will go ov...
023
Reposted by František Bartoš
Journal of Robustness Reports @robustnessreports.bsky.social · 28/10/2025
We just started a website highlighting articles that would make good candidates for a Robustness Report. 🌐 Check out the website: www.journalofrobustnessreports.org 📄 Read our first blog post: www.journalofrobustnessreports.org/inaugural-po...
journalofrobustnessreports.org
Journal of Robustness Reports
The Journal of Robustness Reports The Journal of Robustness Reports (JRR) is a diamond open-access journal that focuses on the reanalysis of high-impact empirical findings. JRR contains collections of...
025
Reposted by František Bartoš
Björn Siepe @bsiepe.bsky.social · 22/10/2025
We built the openESM database: ▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place ▶️Harmonized (meta-)data, fully open-source software ▶️Filter & search all data, simply download via R/Python Find out more: 🌐 openesmdata.org 📝 doi.org/10.31234/osf...
14285146
František Bartoš @fbartos.bsky.social · 23/10/2025
Simulation studies have a conflict of interest problem. The same team: - develops a new method - designs a simulation study to evaluate it However, the new method has to show good performance to get published. We propose living synthetic benchmarks to address the issue (doi.org/10.48550/arX...).
21910
Reposted by František Bartoš
JASP Services @jasp-services.com · 30/09/2025
New blog post! Why companies win by investing in open-source software. With zebra-painted cows, of course. www.jasp-services.com/why-companie...
jasp-services.com
Why Companies Win by Investing in Open-Source Software - JASP Services BV
In 2025, the IgNobel prize in Biology went to research on “whether cows painted with zebra-like striping can avoid being bitten by flies“. Suppose a fictitious company, ZebraCows, wishes to exploit th...
034
Reposted by František Bartoš
Suyog Chandramouli @suyoghc.bsky.social · 30/09/2025
We are pleased to have @fbartos.bsky.social join us today, Tuesday, September 30th, 11am (EST) to talk about Bayesian Hypothesis testing! This is followed by a workshop on using JASP for statistics around 12:10pm. The zoom is open to public with details in the flyer! @PsychPrinceton
021
Reposted by František Bartoš
Richard D. Morey @richarddmorey.bsky.social · 25/09/2025
Simonsohn has now posted a blog response to our recent paper about the poor statistical properties of the P curve. @clintin.bsky.social and I are finishing up a less-technical paper that will serve as a response. But I wanted to address a meta-issue *around* this that may clarify some things. 1/x
27931
Reposted by František Bartoš
JASP @jaspstats.bsky.social · 24/09/2025
Sage created a 44-second promo video for our book "Discovering Statistics Using JASP". Blog post: jasp-stats.org/2025/09/24/d... The video itself: www.youtube.com/watch?v=MP0N...
jasp-stats.org
"Discovering Statistics Using JASP": The Promo Video - JASP - Free and User-Friendly Statistical Software
The shiny new textbook “Discovering Statistics Using JASP” now has a 44-second promo video on YouTube, courtesy of Sage. What I like about the video is that it shows some of the pages, so you get an o...
032
František Bartoš @fbartos.bsky.social · 24/09/2025
Can anyone point me to the simulation studies showing that p-curve performs well under realistic conditions? And any done by someone else than pcurve authors? As far as I know, p-curve fails horrendously as long as any heterogeneity is involved... doi.org/10.1177/1745... doi.org/10.1002/jrsm...
191
František Bartoš @fbartos.bsky.social · 17/09/2025
We released two preprints describing the JASP Meta-Analytic functionality in detail. Meta-Analysis with JASP, Part I: Classical Approaches (arxiv.org/abs/2509.09845) Meta-Analysis with JASP, Part II: Bayesian Approaches (arxiv.org/abs/2509.09850)
arxiv.org
Meta-Analysis with JASP, Part I: Classical Approaches
Meta-analyses play a crucial part in empirical science, enabling researchers to synthesize evidence across studies and draw more precise and generalizable conclusions. Despite their importance, access...
172
František Bartoš @fbartos.bsky.social · 10/09/2025
Z-curve plot is a new visual model fit diagnostic for #metaanalysis with an emphasis on #publicationbias. In contrast to funnel plots, z-curve plots - visualize the distribution of z-statistics (where bias usually occurs) - compare the fit of multiple models simultaneously
2187
Reposted by František Bartoš
Vinni Ott @vlott.bsky.social · 29/08/2025
New paper for anyone working with data: Better data viz - for free, in few clicks. Below, all N = 111, M = 0.04, SD = 0.27. One-sided t-tests vs. 0 yield: t(110) = 1.67, p = .049. Use raincloud plots. Or risk wrong conclusions! Plot w/ @jaspstats.bsky.social today! 🧪 📊 #PsychSciSky #StatsSky 🧵👇
Figure 2 from the linked article.Abstract of the linked article
77320
František Bartoš @fbartos.bsky.social · 11/08/2025
Fair coins tend to land on the same side they started: evidence from 350,757 flips. That's the title of our paper summarizing ~650 hours of coin-tossing experimentation just published in the Journal of the American Statistical Association. doi.org/10.1080/0162...
1199
František Bartoš @fbartos.bsky.social · 09/08/2025
It is a bit funny seing many people outraged about p-curve, after the well deserved critique by Moorey, but completely unfazed about the still dominant practice of using funnel plots and fail-safe n to claim absence of publication bias. With common defense "that’s how other studies did it before"...
0112
Reposted by František Bartoš
Richard D. Morey @richarddmorey.bsky.social · 08/08/2025
Paper drop, for anyone interested in #metascience, #statistics, or #metaanalysis! @clintin.bsky.social and I show in a new paper in JASA that the P-curve, a popular forensic meta-analysis method, has deeply undesirable statistical properties. www.tandfonline.com/doi/full/10.... 1/?
Cover page for the manuscript: Morey, R. D., & Davis-Stober, C. P. (2025). On the poor statistical properties of the P-curve meta-analytic procedure. Journal of the American Statistical Association, 1–19. https://doi.org/10.1080/01621459.2025.2544397Abstract for the paper: The P-curve (Simonsohn, Nelson, & Simmons, 2014; Simonsohn, Simmons, & Nelson, 2015) is a widely-used suite of meta-analytic tests advertised for detecting problems in sets of studies. They are based on nonparametric combinations of p values (e.g., Marden, 1985) across significant (p < .05) studies and are variously claimed to detect “evidential value”, “lack of evidential value”, and “left skew” in p values. We show that these tests do not have the properties ascribed to them. Moreover, they fail basic desiderata for tests, including admissibility and monotonicity. In light of these serious problems, we recommend against the use of the P-curve tests.
17289122