Sign in

Anne Scheel

@annemscheel.bsky.social
3.5K followers 791 following 435 posts

Assistant prof at Utrecht University, trying to make science as reproducible as non-scientists think it is. Blogs at @the100ci.

PostsRepliesMedia
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 15h
Still upset about that highly cited paper in Psych Science you consider deeply flawed? Now is your time to shine ✨
68531
Reposted by Anne Scheel
Sajedeh Rasti @sajedehra.bsky.social · 05/10/2026
We are excited to announce that we are going to broadcast the second day of Meta-Research Symposium 2026 (this Friday on October 9th) for those who were interested but unable to join in person. You can join the meeting using this link: teams.microsoft.com/l/meetup-joi...
teams.microsoft.com
Join conversation
11610
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 02/10/2026
Can we switch off diseases? siRNA drugs are, in my view and @jacobtref.bsky.social’s too, one of the most exciting developments in medicine. So we decided to do an episode!
open.spotify.com
Can we switch off diseases?
Hard Drugs · Episode
13914
Reposted by Anne Scheel
Benjamin @benjaminschneider.ch · 30/09/2026
Werner Herzog will be the last human being whose next word no language model can predict
9568145
Reposted by Anne Scheel
Magnus Johansson @pgmj.bsky.social · 28/09/2026
Our commentary "A Revolution in Search of an Estimand: On the Idionomic Proposal of Hayes et al. (2026)" is now available as a preprint: osf.io/preprints/ps... With @rpsychologist.com, @matti.vuorre.com, and Nils Hentati Isacsson.
osf.io
OSF
03018
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 22/09/2026
Babies be like
Soyjak pointing at a baby friendly high-contrast black and white spiral
1512
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 21/09/2026
static.klipy.com
Sickos Haha Yes
ALT: Sickos Haha Yes
0226
Reposted by Anne Scheel
Beth Clarke @bethclarke.bsky.social · 22/09/2026
Come work on a PhD in Metascience with me! There’s just a little over one week left to apply!
02522
Reposted by Anne Scheel
Mattan S. Ben-Shachar @mattansb.msbstats.info · 31/05/2026
Psychologists doing exploratory factor analysis be like: #statsmeme
611616
Reposted by Anne Scheel
Malte Elson @malte.the100.ci · 18/09/2026
No ground truth, no witnesses. Uh. Yeah. [Verse] Roll up on the dataset, don't standardize a thing, Raw units, mixed scales, let the big variable be king. Pick my k in advance 'cause I already know the story, Three clusters in the grant, so it's three, that's the glory. - Clusta Rhymes
3235
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 18/09/2026
This is an *excellent* post on cluster analysis. If you ever thought about applying cluster, latent class or latent profile analysis to psychological scales, you absolutely should read this!>
511935
Reposted by Anne Scheel
Bill Chopik @chops310.bsky.social · 17/09/2026
45311
Reposted by Anne Scheel
Matthew B. Jané @matthewbjane.bsky.social · 13/09/2026
I’ve been quiet on social media lately, but today I’m launching Audit Clinical Evidence (ACE), an initiative I’ve been developing over the past year. Take a look: AuditClinicalEvidence.org
auditclinicalevidence.org
ACE
Independent audits of published clinical research for statistical errors, data inconsistencies, and research integrity violations.
89232
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 13/09/2026
“The only thing that can stop a bad guy with an LLM…”
2183
Reposted by Anne Scheel
Ruben C. Arslan @ruben.the100.ci · 11/09/2026
To be clear, I'm not against it. It's a bit annoying to have to read so many verbose AI reports, but I still think this is preferable to the regime of before, where most scientific work was never rechecked and many errors languish in code, polluting the record.
1272
Reposted by Anne Scheel
Ruben C. Arslan @ruben.the100.ci · 11/09/2026
An interesting thing is happening to me at the moment. I have a standing bug bounty policy for my first authored scientific work. That means, I've committed to pay people who report bugs in my code, up to 750€ for severe errors. Since GPT-6 Astra came out, I'm now getting several bug reports daily.
39334
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 03/09/2026
Very few people know that this is how it all began @celestialsem.bsky.social
Sewall Wright's guinea pig path diagram, but the guinea pigs are wearing space helmets and there's a space background
27414
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 31/08/2026
I am once again begging everyone who supervises student theses to stop making students conduct mediation analyses because “a regression isn’t complicated enough for a thesis” 😭
1519823
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 27/08/2026
There are entire articles written around the problem of why the prevalence of type 1 diabetes has risen - nutrition? toxins? - that don't even consider whether it might be because fewer patients are dying young & continue to be in the numerator. This should be step 1
4857
Reposted by Anne Scheel
Lukas Röseler @aufdroeseler.bsky.social · 21/08/2026
I meant to post that #FLoRA now has over 2,500 replications and reproductions - but we are already at >2,600! This is only possible due to our team of >200 researchers submitting + validating entries, approving them, and maintaining the search pipeline and validation app. forrt.org/flora-explor...
1106
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 17/08/2026
It's finally here! I gave a TED talk in April in Vancouver, and it was released online today. You can watch it here: ted.com/talks/saloni... I've also adapted it into an article, which was published last week: worksinprogress.co/issue/future...
Me on the TED stage
612023
Reposted by Anne Scheel
Daniel Lakens @lakens.bsky.social · 15/08/2026
New Blog post: Which Data Repository Should you Use? In light of OSF closing down, I compare Zenodo, Dataverse, ResearchBox, PsychArchive, and local repositories on six important dimensions. If you want to know which to pick: It depends! daniellakens.blogspot.com/2026/08/whic...
daniellakens.blogspot.com
Which Data Repository Should You Use?
The Center for Open Science has announced that from November 16, 2026, no new projects can be created on the Open Science Framework. After F...
4198112
Reposted by Anne Scheel
Daniel Lakens @lakens.bsky.social · 12/08/2026
The Metacheck team is busy building an improved version of the osf_download function (www.scienceverse.org/metacheck_bo... ). You will soon be able to use metacheck to download all files, wikis, and meta-data. You will also be able to upload everything to Zenodo.
scienceverse.org
36  Checking Local Files with repo_check and code_check – The Metacheck Manual
A guide to Metacheck, an R package providing a module based tool for checking scientific manuscripts and data repositories for best practices using text search, R code, and optional LLM queries.
03217
Reposted by Anne Scheel
Platform for Young Meta-Scientists (PYMS) @youngmetascience.bsky.social · 13/08/2026
ECRs, sign up now for the 2026 Meta Research Symposium in Eindhoven 8-9 Oct! This year we are collaborating with the Paul Meehl Graduate School to bring together ECRs in meta-science for a workshop, hackathons, social activity, and presentations See you there!
paulmeehlschool.github.io
Paul Meehl Graduate School Meta Research Symposium 2026 | Paul Meehl Graduate School
October 8-9, 2026
074
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 08/08/2026
New blog post in which we discover the secret to immortality: accounting errors. www.the100.ci/2026/08/08/m...
the100.ci
My Immortal Time Bias
Preamble: This shortie is my attempt to come up with an example that makes the problem underlying immortal time bias as obvious as possible.  In Japan, people who reach the age of 100 are handed a co...
128031
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 05/08/2026
Something I learnt recently: Amazon stores all the highlights you make in Kindle here read.amazon.com/notebook which you can copy into an LLM to turn into structured notes. That way I can spend more time doing something I like (reading) and less time on something I don’t (making notes)
3487
Reposted by Anne Scheel
PLOS Biology @plosbiology.org · 29/07/2026
#Preregistration supports #OpenScience, but is uncommon in animal research. This Meta-Research study by @hannowuerbel.bsky.social reveals that despite known benefits, perceived bureaucracy, time costs and inflexibility hinder adoption. 🧪#AcademicSky @unibe.ch @swissrn.bsky.social plos.io/4pL0tXq
Two graphs the worries of participants about preregistration from those who never preregistered, as well as the problems encountered by those who did preregister. Worries were more prevalent than actual problems, although both graphs show highlight the prevalence of responses related to high time costs and bureaucratic burden.
0149
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 30/07/2026
New blog post! Odds ratios are...a bit weird. Here I explain two problems (interpretation, non-collapsibility) and provide some simple recommendations for improved reporting. www.the100.ci/2026/07/30/r...
the100.ci
Reviewer notes: Odds ratios are really odd
When psychological researchers investigate binary outcomes, they routinely report odds ratios to quantify the strength of an effect or an association. This is quite understandable given that psycholog...
2428779
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 24/07/2026
New episode of HARD DRUGS! GLP1 drugs have transformed obesity & diabetes, help treat heart disease, kidney disease and sleep apnea. They're far from the only drug with multiple uses. But sometimes, it takes several decades - and public funding - to learn about new uses.
open.spotify.com
Are miracle drugs hiding in plain sight?
Hard Drugs · Episode
15514
Anne Scheel @annemscheel.bsky.social · 24/07/2026
Bills? I see what they did there
050
Anne Scheel @annemscheel.bsky.social · 24/07/2026
Hah, somehow that one doesn’t seem crunchy to me at all, more like a victory of technology (it just takes a couple of minutes!)
010
Anne Scheel @annemscheel.bsky.social · 24/07/2026
You know that you can make nut butter yourself with a strong enough blender, right? We have a small Vitamix that does the job really well. You literally just put in the (roasted, at least I liked that with almonds) nuts and blend until the desired consistency is reached.
110
Reposted by Anne Scheel
Anne Scheel @annemscheel.bsky.social · 23/07/2026
New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr
tinyurl.com
Career incentives make Registered Reports unattractive under realistic academic conditions
Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...
15934
Anne Scheel @annemscheel.bsky.social · 23/07/2026
This paper has been a long time in the making, but it’s been a super fun and interesting journey. Special thanks to Leo Tiokhin, who convinced me that models from biology can be very fruitful for meta-science and taught me a ton in this process! 17/17
020
Anne Scheel @annemscheel.bsky.social · 23/07/2026
If you’re curious about alternative model configurations (or unhappy with our assumptions or parameter settings), feel free to play with the model yourself: github.com/amscheel/rr-... 16/
github.com
GitHub - amscheel/rr-model
Contribute to amscheel/rr-model development by creating an account on GitHub.
110
Anne Scheel @annemscheel.bsky.social · 23/07/2026
Our goal was to isolate and study the effects of the difference in payoff variance in RRs and standard reports, and those alone produce patterns that are quite different from the ‘RRs are low-risk and therefore attractive to researchers’ story (which I used to believe myself!). 15/
100
Anne Scheel @annemscheel.bsky.social · 23/07/2026
Of course there are important limitations of our findings. This is a very simple model that ignores many important factors influencing authors’ choices IRL, like working in teams or the time it takes to publish a paper. It’s also based on a very simplistic idea of publication bias. 14/
110
Anne Scheel @annemscheel.bsky.social · 23/07/2026
Some potential interventions: * @pci-regreports.bsky.social offers RRs with free journal choice, which increases ‘payoff variance’, especially if more high-IF journals participate. * Provide RR-only paths to tenure and getting a PhD; * Reduce competition in funding calls via partial lotteries. 13/
120
Anne Scheel @annemscheel.bsky.social · 23/07/2026
Our results generally suggest that in many realistic scenarios, RRs may actually be quite unattractive for researchers who need to further their careers in a culture that values long and high-impact publication records. This could mean that further uptake of RRs isn’t just a matter of time! 12/
100
Anne Scheel @annemscheel.bsky.social · 23/07/2026
3) Hard publication targets make RRs unpopular if the target can’t be met with RRs alone. If it can, it makes RRs more attractive than at baseline. 4) Competition is the biggest RR-killer in our model. Intense competition makes them widely unpopular & completely unviable in fields with low pace. 11/
110
Anne Scheel @annemscheel.bsky.social · 23/07/2026
2) Being able to run many studies before being evaluated (e.g., applying for a job) cancels out most other effects. Researchers with 'slow pace', e.g. in fields with slow or costly data collection, are most affected by increasing/decreasing career returns, publication targets, and competition. 10/
110
Anne Scheel @annemscheel.bsky.social · 23/07/2026
Key findings: 1) RRs are more popular when career returns for publications are decreasing, e.g. in advanced career stages. This contradicts data showing that RRs are more often used by ECRs. Our model may miss other important factors (quite possible!), or ECRs don't use optimal strategies yet. 9/
100
Anne Scheel @annemscheel.bsky.social · 23/07/2026
We varied four career-relevant factors: * how much each additional publication increases career success (increasing/decreasing returns) * how many studies researchers can run before being evaluated * hard publication targets (e.g., in tenure agreements) * competition (e.g., for jobs or grants). 8/
110
Anne Scheel @annemscheel.bsky.social · 23/07/2026
In our model, 500 simulated researchers choose between RRs and standard reports using an innate publication strategy. They accumulate payoffs for each publication and then pass their strategies on to the next generation. Strategies evolve based on which choices lead to more 'career fitness'. 7/
100
Anne Scheel @annemscheel.bsky.social · 23/07/2026
Our paper examines what this may mean for the popularity of RRs. We borrowed risk-sensitivity theory from behavioural ecology (which was developed for animals facing a choice between foraging in patches with high vs low food variance) to build an evolutionary agent-based model. 6/
130
Anne Scheel @annemscheel.bsky.social · 23/07/2026
In terms of career incentives, RRs have lower payoff *variance* than standard reports. They’re the safe choice but will ~never get you to the absolute top. By contrast, standard reports are a gamble. RRs should thus be attractive to *risk-averse* researchers, but that’s not necessarily everybody! 5/
110
Anne Scheel @annemscheel.bsky.social · 23/07/2026
Conversely, when taking the standard publication route, authors run the risk of getting no publication at all, but they also retain a (tiny, but non-zero) chance of getting into a blockbuster journal if their study comes up with ground-breaking results. 4/
120
Anne Scheel @annemscheel.bsky.social · 23/07/2026
RRs reduce the risk that a study can't be published at all (no payoff) — good. But authors don't just want publications, they ideally want high-impact publications. RRs lock authors into a specific, usually not high-IF, journal before results are known, which reduces maximum payoff — less good. 3/
110
Anne Scheel @annemscheel.bsky.social · 23/07/2026
How often do you come across a Registered Report? Although they’ve been adopted by lots of journals and numbers of published RRs have risen steeply, they’re still extremely rare compared to e.g. preregistered papers. If they’re so beneficial for authors, then why aren’t they more popular? 2/
110
Anne Scheel @annemscheel.bsky.social · 23/07/2026
New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr
tinyurl.com
Career incentives make Registered Reports unattractive under realistic academic conditions
Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...
15934