Sign in

Anne Scheel

@annemscheel.bsky.social
3.5K followers 791 following 435 posts

Assistant prof at Utrecht University, trying to make science as reproducible as non-scientists think it is. Blogs at @the100ci.

PostsRepliesMedia
Reposted by Anne Scheel
Benjamin @benjaminschneider.ch · 20h
Werner Herzog will be the last human being whose next word no language model can predict
9532138
Reposted by Anne Scheel
Magnus Johansson @pgmj.bsky.social · 28/09/2026
Our commentary "A Revolution in Search of an Estimand: On the Idionomic Proposal of Hayes et al. (2026)" is now available as a preprint: osf.io/preprints/ps... With @rpsychologist.com, @matti.vuorre.com, and Nils Hentati Isacsson.
osf.io
OSF
03118
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 22/09/2026
Babies be like
Soyjak pointing at a baby friendly high-contrast black and white spiral
1512
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 21/09/2026
static.klipy.com
Sickos Haha Yes
ALT: Sickos Haha Yes
0226
Reposted by Anne Scheel
Beth Clarke @bethclarke.bsky.social · 22/09/2026
Come work on a PhD in Metascience with me! There’s just a little over one week left to apply!
02522
Reposted by Anne Scheel
Mattan S. Ben-Shachar @mattansb.msbstats.info · 31/05/2026
Psychologists doing exploratory factor analysis be like: #statsmeme
611616
Reposted by Anne Scheel
Malte Elson @malte.the100.ci · 18/09/2026
No ground truth, no witnesses. Uh. Yeah. [Verse] Roll up on the dataset, don't standardize a thing, Raw units, mixed scales, let the big variable be king. Pick my k in advance 'cause I already know the story, Three clusters in the grant, so it's three, that's the glory. - Clusta Rhymes
3235
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 18/09/2026
This is an *excellent* post on cluster analysis. If you ever thought about applying cluster, latent class or latent profile analysis to psychological scales, you absolutely should read this!>
511835
Reposted by Anne Scheel
Bill Chopik @chops310.bsky.social · 17/09/2026
45311
Reposted by Anne Scheel
Matthew B. Jané @matthewbjane.bsky.social · 13/09/2026
I’ve been quiet on social media lately, but today I’m launching Audit Clinical Evidence (ACE), an initiative I’ve been developing over the past year. Take a look: AuditClinicalEvidence.org
auditclinicalevidence.org
ACE
Independent audits of published clinical research for statistical errors, data inconsistencies, and research integrity violations.
89132
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 13/09/2026
“The only thing that can stop a bad guy with an LLM…”
2183
Reposted by Anne Scheel
Ruben C. Arslan @ruben.the100.ci · 11/09/2026
To be clear, I'm not against it. It's a bit annoying to have to read so many verbose AI reports, but I still think this is preferable to the regime of before, where most scientific work was never rechecked and many errors languish in code, polluting the record.
1272
Reposted by Anne Scheel
Ruben C. Arslan @ruben.the100.ci · 11/09/2026
An interesting thing is happening to me at the moment. I have a standing bug bounty policy for my first authored scientific work. That means, I've committed to pay people who report bugs in my code, up to 750€ for severe errors. Since GPT-6 Astra came out, I'm now getting several bug reports daily.
39233
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 03/09/2026
Very few people know that this is how it all began @celestialsem.bsky.social
Sewall Wright's guinea pig path diagram, but the guinea pigs are wearing space helmets and there's a space background
27414
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 31/08/2026
I am once again begging everyone who supervises student theses to stop making students conduct mediation analyses because “a regression isn’t complicated enough for a thesis” 😭
1519823
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 27/08/2026
There are entire articles written around the problem of why the prevalence of type 1 diabetes has risen - nutrition? toxins? - that don't even consider whether it might be because fewer patients are dying young & continue to be in the numerator. This should be step 1
4857
Reposted by Anne Scheel
Lukas Röseler @aufdroeseler.bsky.social · 21/08/2026
I meant to post that #FLoRA now has over 2,500 replications and reproductions - but we are already at >2,600! This is only possible due to our team of >200 researchers submitting + validating entries, approving them, and maintaining the search pipeline and validation app. forrt.org/flora-explor...
1106
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 17/08/2026
It's finally here! I gave a TED talk in April in Vancouver, and it was released online today. You can watch it here: ted.com/talks/saloni... I've also adapted it into an article, which was published last week: worksinprogress.co/issue/future...
Me on the TED stage
612023
Reposted by Anne Scheel
Daniel Lakens @lakens.bsky.social · 15/08/2026
New Blog post: Which Data Repository Should you Use? In light of OSF closing down, I compare Zenodo, Dataverse, ResearchBox, PsychArchive, and local repositories on six important dimensions. If you want to know which to pick: It depends! daniellakens.blogspot.com/2026/08/whic...
daniellakens.blogspot.com
Which Data Repository Should You Use?
The Center for Open Science has announced that from November 16, 2026, no new projects can be created on the Open Science Framework. After F...
4197111
Reposted by Anne Scheel
Daniel Lakens @lakens.bsky.social · 12/08/2026
The Metacheck team is busy building an improved version of the osf_download function (www.scienceverse.org/metacheck_bo... ). You will soon be able to use metacheck to download all files, wikis, and meta-data. You will also be able to upload everything to Zenodo.
scienceverse.org
36  Checking Local Files with repo_check and code_check – The Metacheck Manual
A guide to Metacheck, an R package providing a module based tool for checking scientific manuscripts and data repositories for best practices using text search, R code, and optional LLM queries.
03217
Reposted by Anne Scheel
Platform for Young Meta-Scientists (PYMS) @youngmetascience.bsky.social · 13/08/2026
ECRs, sign up now for the 2026 Meta Research Symposium in Eindhoven 8-9 Oct! This year we are collaborating with the Paul Meehl Graduate School to bring together ECRs in meta-science for a workshop, hackathons, social activity, and presentations See you there!
paulmeehlschool.github.io
Paul Meehl Graduate School Meta Research Symposium 2026 | Paul Meehl Graduate School
October 8-9, 2026
074
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 08/08/2026
New blog post in which we discover the secret to immortality: accounting errors. www.the100.ci/2026/08/08/m...
the100.ci
My Immortal Time Bias
Preamble: This shortie is my attempt to come up with an example that makes the problem underlying immortal time bias as obvious as possible.  In Japan, people who reach the age of 100 are handed a co...
128031
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 05/08/2026
Something I learnt recently: Amazon stores all the highlights you make in Kindle here read.amazon.com/notebook which you can copy into an LLM to turn into structured notes. That way I can spend more time doing something I like (reading) and less time on something I don’t (making notes)
3487
Reposted by Anne Scheel
PLOS Biology @plosbiology.org · 29/07/2026
#Preregistration supports #OpenScience, but is uncommon in animal research. This Meta-Research study by @hannowuerbel.bsky.social reveals that despite known benefits, perceived bureaucracy, time costs and inflexibility hinder adoption. 🧪#AcademicSky @unibe.ch @swissrn.bsky.social plos.io/4pL0tXq
Two graphs the worries of participants about preregistration from those who never preregistered, as well as the problems encountered by those who did preregister. Worries were more prevalent than actual problems, although both graphs show highlight the prevalence of responses related to high time costs and bureaucratic burden.
0149
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 30/07/2026
New blog post! Odds ratios are...a bit weird. Here I explain two problems (interpretation, non-collapsibility) and provide some simple recommendations for improved reporting. www.the100.ci/2026/07/30/r...
the100.ci
Reviewer notes: Odds ratios are really odd
When psychological researchers investigate binary outcomes, they routinely report odds ratios to quantify the strength of an effect or an association. This is quite understandable given that psycholog...
2428779
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 24/07/2026
New episode of HARD DRUGS! GLP1 drugs have transformed obesity & diabetes, help treat heart disease, kidney disease and sleep apnea. They're far from the only drug with multiple uses. But sometimes, it takes several decades - and public funding - to learn about new uses.
open.spotify.com
Are miracle drugs hiding in plain sight?
Hard Drugs · Episode
15514
Reposted by Anne Scheel
Anne Scheel @annemscheel.bsky.social · 23/07/2026
New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr
tinyurl.com
Career incentives make Registered Reports unattractive under realistic academic conditions
Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...
15934
Anne Scheel @annemscheel.bsky.social · 23/07/2026
New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr
tinyurl.com
Career incentives make Registered Reports unattractive under realistic academic conditions
Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...
15934
Reposted by Anne Scheel
Saloni @scientificdiscovery.dev · 22/07/2026
Strep A kills hundreds of thousands of people per year, but there's no vaccine for it – yet. Some of my wonderful colleagues at Coefficient Giving and lots of great scientists are trying to change that. Please share this with researchers who might be interested in working on it!
1337
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 20/07/2026
New paper out now 🥳 When psychologists discuss generalisability, they often refer to vague notions of representativeness. We provide an accessible intro to the total survey error framework as a tool to reason about this more rigorously. w @taymalsalti.bsky.social @ruben.the100.ci >
Thinking Clearly About Sampling and Representation With the Total Survey Error Framework

Collecting a sample that represents the population of interest well constitutes a challenge across the social and behavioural sciences. Psychology in particular frequently relies on convenience samples—most notably students and, increasingly, online participants—with a tendency to either (implicitly) assume representativeness without substantive justification, or to acknowledge a lack of it only in passing. In contrast, researchers rarely engage with the actual implications for their inferences, which undermines the generalisability of psychological findings. Critically, representativeness must be defined with respect to variables relevant to the target of inference, rather than superficial demographic diversity. Here we present the Total Survey Error (TSE) framework as a methodological tool that systematically addresses the multifaceted sources of error—particularly those related to representation—that emerge throughout the research cycle. Although TSE originated in survey research, its principles are broadly applicable to any psychological study seeking inference from sample to population. We offer practical strategies for identifying, preventing, and mitigating representation errors to improve the credibility and generalisability of psychological research.

Illustration of the total survey error framework with the representation strand highlighted. It shows how coverage error, sampling error and non-response error arise during the sampling process.
1027797
Reposted by Anne Scheel
Katie Corker @katiecorker.bsky.social · 17/07/2026
@mcxfrank.bsky.social named PsyArXiv, per my email records. Anita Eerland made the logo. And, of course, Ben Brown handled the logistics of getting us off the ground. Cannot believe it has been 10 years!
192
Anne Scheel @annemscheel.bsky.social · 18/07/2026
Would be super interesting to know how common this behaviour has been over time and across disciplines. It sounds eerily similar to modern scooping anxiety and opposition to data sharing, but those seem to make more sense in light of modern academic incentives (?).
180
Reposted by Anne Scheel
Jamie Cummins @jamiecummins.bsky.social · 14/07/2026
Today we launch the first stable release of RegCheck: v1.0.0. RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice. A 🧵 on what's new: regcheck.app
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
512783
Reposted by Anne Scheel
Hao Yin @haoyin.bsky.social · 13/07/2026
Thanks a lot for your critique/peer review!😄 And we surely will revise and make our analysis and interpretation more accurate, avoid overstatement!
041
Anne Scheel @annemscheel.bsky.social · 13/07/2026
Looks like a cool analysis, but note that it excludes preprints that were never published. So this last sentence in the abstract amounts to ‘conditioning on preprints accepted by the scientific community, preprints are good enough to be accepted by the scientific community’.
38913
Reposted by Anne Scheel
Ruben C. Arslan @ruben.the100.ci · 09/07/2026
The Chimpy Trinity
45014
Reposted by Anne Scheel
Ruben C. Arslan @ruben.the100.ci · 06/07/2026
Julia Stern is hiring! Strongly recommend this opportunity. I know her from grad student days and am confident she's a good one!
1102
Reposted by Anne Scheel
Beth Clarke @bethclarke.bsky.social · 03/07/2026
The good news is that someone else now gets to join this amazing team! If you're keen to help develop RegCheck, I'd strongly encourage you to apply. Working with @jamiecummins.bsky.social and @malte.the100.ci is reason enough to apply! jobs.unibe.ch/job-vacancie...
jobs.unibe.ch
PhD Student/ Postdoc Position in Meta-Science - Universität Bern
Universität Bern is looking for PhD Student/ Postdoc Position in Meta-Science
12518
Reposted by Anne Scheel
Katie Corker @katiecorker.bsky.social · 03/07/2026
Preprint success story - a preprinted paper attracts an invitation to submit - 4 months later, it's found a home in a journal. ❤️
0122
Reposted by Anne Scheel
Jan R. Wessel @janw.bsky.social · 03/07/2026
The final version of this is now out at Cortex: www.sciencedirect.com/science/arti... Thanks much to @russpoldrack.org and two other reviewers for highly constructive feedback on the earlier version, and especially to @annemscheel.bsky.social, who suggested Cortex and edited the paper.
sciencedirect.com
1225
Reposted by Anne Scheel
Beth Clarke @bethclarke.bsky.social · 03/07/2026
Very excited to announce that I’ll be joining @zpid.bsky.social in Trier, Germany as a tenure-track Jun.-Prof. in Psychological Metascience in November! 🤸🏻‍♀️✨
1812716
Reposted by Anne Scheel
simine vazire @simine.com · 03/07/2026
Beth continues to kick ass. So glad this kind of permanent academic position exists in metascience, and so glad @bethclarke.bsky.social is paving the way. Hopefully there will be lots more departments adding metasciencey people like her in the years to come! A pretty smart move if you ask me.
1357
Anne Scheel @annemscheel.bsky.social · 02/07/2026
People seem to struggle finding fault with this quote. But by the same logic, the more covariates we have, the higher the risk that we’re accidentally conditioning on a collider. The point isn’t that rich observational data are useless, but that RCTs solve problems that observational studies can’t.
3142
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 02/07/2026
Had to read this one to figure out whether it's as click-bait-y as the title. As somebody who has written a lot about causal inference with observational data, I'm quite conflicted about it.> asteriskmag.substack.com/p/the-case-a...
asteriskmag.substack.com
The case against randomized controlled trials
Everyone knows RCTs are the gold standard of evidence...right?
610424
Reposted by Anne Scheel
Olmo van den Akker @denolmo.bsky.social · 05/06/2026
Big news at the META/e conference: metacheck, a promising tool for automatically extracting information from scientific manuscripts is beta-launched today. Has the potential to massively increase the efficiency of meta-science projects. www.scienceverse.org/metacheck/
scienceverse.org
Check Research Outputs for Best Practices
A modular, extendable system for checking research outputs for best practices using text search, R code, and/or (optional) LLM queries.
0136
Reposted by Anne Scheel
Nicholas A. Coles, PhD @nicholascoles.bsky.social · 25/05/2026
A game of whack-a-mole with methodological confounds. We saw the same thing in the Botox-for-depression lit Improvements in attractiveness only matter in Study 1. Expectancies only matter in Study 2. Inability for women to express nonverbal disapproval only matters in Study 3, etc. 🙈
1102
Anne Scheel @annemscheel.bsky.social · 25/05/2026
New estimate for residual bias after study registration just dropped
0122
Anne Scheel @annemscheel.bsky.social · 25/05/2026
What riles me up about “people tried to shut down PP research” is that Cuddy’s own coauthor-turned-critic Carney guest-edited a whole special issue of Registered Reports on Power Posing (incl a meta-analysis), which shows strong evidence against PP even though most authors clearly weren’t sceptics.
25712
Reposted by Anne Scheel
Stephen Wild @stephenjwild.bsky.social · 20/05/2026
Hehehehe
In any case, a failure of imagination is not a very good identification strategy, even if some people like to pretend otherwise.
1295
Reposted by Anne Scheel
Julia M. Rohrer @dingdingpeng.the100.ci · 20/05/2026
New blog post! Let's say an effect you are interested in varies between countries and you want to explain some of that cross-cultural variation. What could possibly go wrong? www.the100.ci/2026/05/20/f...
the100.ci
Friends don’t let friends run moderated cross-country regressions
Header image: Moderate cross-country slopes (Photo: By Erik W. Kolstad - Flickr, CC BY 2.0,) Here’s a particular genre of article that relies on multiple data collection sites, such as studies anal...
1817047