Reposted by Anne ScheelJulia M. Rohrer @dingdingpeng.the100.ci · 15hStill upset about that highly cited paper in Psych Science you consider deeply flawed? Now is your time to shine ✨ 68531
Reposted by Anne ScheelSajedeh Rasti @sajedehra.bsky.social · 05/10/2026We are excited to announce that we are going to broadcast the second day of Meta-Research Symposium 2026 (this Friday on October 9th) for those who were interested but unable to join in person. You can join the meeting using this link: teams.microsoft.com/l/meetup-joi...teams.microsoft.comJoin conversation 11610
Reposted by Anne ScheelSaloni @scientificdiscovery.dev · 02/10/2026Can we switch off diseases? siRNA drugs are, in my view and @jacobtref.bsky.social’s too, one of the most exciting developments in medicine. So we decided to do an episode!open.spotify.comCan we switch off diseases?Hard Drugs · Episode 13914
Reposted by Anne ScheelBenjamin @benjaminschneider.ch · 30/09/2026Werner Herzog will be the last human being whose next word no language model can predict 9568145
Reposted by Anne ScheelMagnus Johansson @pgmj.bsky.social · 28/09/2026Our commentary "A Revolution in Search of an Estimand: On the Idionomic Proposal of Hayes et al. (2026)" is now available as a preprint: osf.io/preprints/ps... With @rpsychologist.com, @matti.vuorre.com, and Nils Hentati Isacsson.osf.ioOSF 03018
Reposted by Anne ScheelJulia M. Rohrer @dingdingpeng.the100.ci · 21/09/2026static.klipy.comSickos Haha YesALT: Sickos Haha Yes 0226
Reposted by Anne ScheelBeth Clarke @bethclarke.bsky.social · 22/09/2026Come work on a PhD in Metascience with me! There’s just a little over one week left to apply! 02522
Reposted by Anne ScheelMattan S. Ben-Shachar @mattansb.msbstats.info · 31/05/2026Psychologists doing exploratory factor analysis be like: #statsmeme 611616
Reposted by Anne ScheelMalte Elson @malte.the100.ci · 18/09/2026No ground truth, no witnesses. Uh. Yeah. [Verse] Roll up on the dataset, don't standardize a thing, Raw units, mixed scales, let the big variable be king. Pick my k in advance 'cause I already know the story, Three clusters in the grant, so it's three, that's the glory. - Clusta Rhymes 3235
Reposted by Anne ScheelJulia M. Rohrer @dingdingpeng.the100.ci · 18/09/2026This is an *excellent* post on cluster analysis. If you ever thought about applying cluster, latent class or latent profile analysis to psychological scales, you absolutely should read this!> 511935
Reposted by Anne ScheelMatthew B. Jané @matthewbjane.bsky.social · 13/09/2026I’ve been quiet on social media lately, but today I’m launching Audit Clinical Evidence (ACE), an initiative I’ve been developing over the past year. Take a look: AuditClinicalEvidence.orgauditclinicalevidence.orgACEIndependent audits of published clinical research for statistical errors, data inconsistencies, and research integrity violations. 89232
Reposted by Anne ScheelJulia M. Rohrer @dingdingpeng.the100.ci · 13/09/2026“The only thing that can stop a bad guy with an LLM…” 2183
Reposted by Anne ScheelRuben C. Arslan @ruben.the100.ci · 11/09/2026To be clear, I'm not against it. It's a bit annoying to have to read so many verbose AI reports, but I still think this is preferable to the regime of before, where most scientific work was never rechecked and many errors languish in code, polluting the record. 1272
Reposted by Anne ScheelRuben C. Arslan @ruben.the100.ci · 11/09/2026An interesting thing is happening to me at the moment. I have a standing bug bounty policy for my first authored scientific work. That means, I've committed to pay people who report bugs in my code, up to 750€ for severe errors. Since GPT-6 Astra came out, I'm now getting several bug reports daily. 39334
Reposted by Anne ScheelJulia M. Rohrer @dingdingpeng.the100.ci · 03/09/2026Very few people know that this is how it all began @celestialsem.bsky.social 27414
Reposted by Anne ScheelJulia M. Rohrer @dingdingpeng.the100.ci · 31/08/2026I am once again begging everyone who supervises student theses to stop making students conduct mediation analyses because “a regression isn’t complicated enough for a thesis” 😭 1519823
Reposted by Anne ScheelSaloni @scientificdiscovery.dev · 27/08/2026There are entire articles written around the problem of why the prevalence of type 1 diabetes has risen - nutrition? toxins? - that don't even consider whether it might be because fewer patients are dying young & continue to be in the numerator. This should be step 1 4857
Reposted by Anne ScheelLukas Röseler @aufdroeseler.bsky.social · 21/08/2026I meant to post that #FLoRA now has over 2,500 replications and reproductions - but we are already at >2,600! This is only possible due to our team of >200 researchers submitting + validating entries, approving them, and maintaining the search pipeline and validation app. forrt.org/flora-explor... 1106
Reposted by Anne ScheelSaloni @scientificdiscovery.dev · 17/08/2026It's finally here! I gave a TED talk in April in Vancouver, and it was released online today. You can watch it here: ted.com/talks/saloni... I've also adapted it into an article, which was published last week: worksinprogress.co/issue/future... 612023
Reposted by Anne ScheelDaniel Lakens @lakens.bsky.social · 15/08/2026New Blog post: Which Data Repository Should you Use? In light of OSF closing down, I compare Zenodo, Dataverse, ResearchBox, PsychArchive, and local repositories on six important dimensions. If you want to know which to pick: It depends! daniellakens.blogspot.com/2026/08/whic...daniellakens.blogspot.comWhich Data Repository Should You Use?The Center for Open Science has announced that from November 16, 2026, no new projects can be created on the Open Science Framework. After F... 4198112
Reposted by Anne ScheelDaniel Lakens @lakens.bsky.social · 12/08/2026The Metacheck team is busy building an improved version of the osf_download function (www.scienceverse.org/metacheck_bo... ). You will soon be able to use metacheck to download all files, wikis, and meta-data. You will also be able to upload everything to Zenodo.scienceverse.org36 Checking Local Files with repo_check and code_check – The Metacheck ManualA guide to Metacheck, an R package providing a module based tool for checking scientific manuscripts and data repositories for best practices using text search, R code, and optional LLM queries. 03217
Reposted by Anne ScheelPlatform for Young Meta-Scientists (PYMS) @youngmetascience.bsky.social · 13/08/2026ECRs, sign up now for the 2026 Meta Research Symposium in Eindhoven 8-9 Oct! This year we are collaborating with the Paul Meehl Graduate School to bring together ECRs in meta-science for a workshop, hackathons, social activity, and presentations See you there!paulmeehlschool.github.ioPaul Meehl Graduate School Meta Research Symposium 2026 | Paul Meehl Graduate SchoolOctober 8-9, 2026 074
Reposted by Anne ScheelJulia M. Rohrer @dingdingpeng.the100.ci · 08/08/2026New blog post in which we discover the secret to immortality: accounting errors. www.the100.ci/2026/08/08/m...the100.ciMy Immortal Time BiasPreamble: This shortie is my attempt to come up with an example that makes the problem underlying immortal time bias as obvious as possible. In Japan, people who reach the age of 100 are handed a co... 128031
Reposted by Anne ScheelSaloni @scientificdiscovery.dev · 05/08/2026Something I learnt recently: Amazon stores all the highlights you make in Kindle here read.amazon.com/notebook which you can copy into an LLM to turn into structured notes. That way I can spend more time doing something I like (reading) and less time on something I don’t (making notes) 3487
Reposted by Anne ScheelPLOS Biology @plosbiology.org · 29/07/2026#Preregistration supports #OpenScience, but is uncommon in animal research. This Meta-Research study by @hannowuerbel.bsky.social reveals that despite known benefits, perceived bureaucracy, time costs and inflexibility hinder adoption. 🧪#AcademicSky @unibe.ch @swissrn.bsky.social plos.io/4pL0tXq 0149
Reposted by Anne ScheelJulia M. Rohrer @dingdingpeng.the100.ci · 30/07/2026New blog post! Odds ratios are...a bit weird. Here I explain two problems (interpretation, non-collapsibility) and provide some simple recommendations for improved reporting. www.the100.ci/2026/07/30/r...the100.ciReviewer notes: Odds ratios are really oddWhen psychological researchers investigate binary outcomes, they routinely report odds ratios to quantify the strength of an effect or an association. This is quite understandable given that psycholog... 2428779
Reposted by Anne ScheelSaloni @scientificdiscovery.dev · 24/07/2026New episode of HARD DRUGS! GLP1 drugs have transformed obesity & diabetes, help treat heart disease, kidney disease and sleep apnea. They're far from the only drug with multiple uses. But sometimes, it takes several decades - and public funding - to learn about new uses.open.spotify.comAre miracle drugs hiding in plain sight?Hard Drugs · Episode 15514
Anne Scheel @annemscheel.bsky.social · 24/07/2026Hah, somehow that one doesn’t seem crunchy to me at all, more like a victory of technology (it just takes a couple of minutes!) 010
Anne Scheel @annemscheel.bsky.social · 24/07/2026You know that you can make nut butter yourself with a strong enough blender, right? We have a small Vitamix that does the job really well. You literally just put in the (roasted, at least I liked that with almonds) nuts and blend until the desired consistency is reached. 110
Reposted by Anne ScheelAnne Scheel @annemscheel.bsky.social · 23/07/2026New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rrtinyurl.comCareer incentives make Registered Reports unattractive under realistic academic conditionsRegistered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish... 15934
Anne Scheel @annemscheel.bsky.social · 23/07/2026This paper has been a long time in the making, but it’s been a super fun and interesting journey. Special thanks to Leo Tiokhin, who convinced me that models from biology can be very fruitful for meta-science and taught me a ton in this process! 17/17 020
Anne Scheel @annemscheel.bsky.social · 23/07/2026If you’re curious about alternative model configurations (or unhappy with our assumptions or parameter settings), feel free to play with the model yourself: github.com/amscheel/rr-... 16/github.comGitHub - amscheel/rr-modelContribute to amscheel/rr-model development by creating an account on GitHub. 110
Anne Scheel @annemscheel.bsky.social · 23/07/2026Our goal was to isolate and study the effects of the difference in payoff variance in RRs and standard reports, and those alone produce patterns that are quite different from the ‘RRs are low-risk and therefore attractive to researchers’ story (which I used to believe myself!). 15/ 100
Anne Scheel @annemscheel.bsky.social · 23/07/2026Of course there are important limitations of our findings. This is a very simple model that ignores many important factors influencing authors’ choices IRL, like working in teams or the time it takes to publish a paper. It’s also based on a very simplistic idea of publication bias. 14/ 110
Anne Scheel @annemscheel.bsky.social · 23/07/2026Some potential interventions: * @pci-regreports.bsky.social offers RRs with free journal choice, which increases ‘payoff variance’, especially if more high-IF journals participate. * Provide RR-only paths to tenure and getting a PhD; * Reduce competition in funding calls via partial lotteries. 13/ 120
Anne Scheel @annemscheel.bsky.social · 23/07/2026Our results generally suggest that in many realistic scenarios, RRs may actually be quite unattractive for researchers who need to further their careers in a culture that values long and high-impact publication records. This could mean that further uptake of RRs isn’t just a matter of time! 12/ 100
Anne Scheel @annemscheel.bsky.social · 23/07/20263) Hard publication targets make RRs unpopular if the target can’t be met with RRs alone. If it can, it makes RRs more attractive than at baseline. 4) Competition is the biggest RR-killer in our model. Intense competition makes them widely unpopular & completely unviable in fields with low pace. 11/ 110
Anne Scheel @annemscheel.bsky.social · 23/07/20262) Being able to run many studies before being evaluated (e.g., applying for a job) cancels out most other effects. Researchers with 'slow pace', e.g. in fields with slow or costly data collection, are most affected by increasing/decreasing career returns, publication targets, and competition. 10/ 110
Anne Scheel @annemscheel.bsky.social · 23/07/2026Key findings: 1) RRs are more popular when career returns for publications are decreasing, e.g. in advanced career stages. This contradicts data showing that RRs are more often used by ECRs. Our model may miss other important factors (quite possible!), or ECRs don't use optimal strategies yet. 9/ 100
Anne Scheel @annemscheel.bsky.social · 23/07/2026We varied four career-relevant factors: * how much each additional publication increases career success (increasing/decreasing returns) * how many studies researchers can run before being evaluated * hard publication targets (e.g., in tenure agreements) * competition (e.g., for jobs or grants). 8/ 110
Anne Scheel @annemscheel.bsky.social · 23/07/2026In our model, 500 simulated researchers choose between RRs and standard reports using an innate publication strategy. They accumulate payoffs for each publication and then pass their strategies on to the next generation. Strategies evolve based on which choices lead to more 'career fitness'. 7/ 100
Anne Scheel @annemscheel.bsky.social · 23/07/2026Our paper examines what this may mean for the popularity of RRs. We borrowed risk-sensitivity theory from behavioural ecology (which was developed for animals facing a choice between foraging in patches with high vs low food variance) to build an evolutionary agent-based model. 6/ 130
Anne Scheel @annemscheel.bsky.social · 23/07/2026In terms of career incentives, RRs have lower payoff *variance* than standard reports. They’re the safe choice but will ~never get you to the absolute top. By contrast, standard reports are a gamble. RRs should thus be attractive to *risk-averse* researchers, but that’s not necessarily everybody! 5/ 110
Anne Scheel @annemscheel.bsky.social · 23/07/2026Conversely, when taking the standard publication route, authors run the risk of getting no publication at all, but they also retain a (tiny, but non-zero) chance of getting into a blockbuster journal if their study comes up with ground-breaking results. 4/ 120
Anne Scheel @annemscheel.bsky.social · 23/07/2026RRs reduce the risk that a study can't be published at all (no payoff) — good. But authors don't just want publications, they ideally want high-impact publications. RRs lock authors into a specific, usually not high-IF, journal before results are known, which reduces maximum payoff — less good. 3/ 110
Anne Scheel @annemscheel.bsky.social · 23/07/2026How often do you come across a Registered Report? Although they’ve been adopted by lots of journals and numbers of published RRs have risen steeply, they’re still extremely rare compared to e.g. preregistered papers. If they’re so beneficial for authors, then why aren’t they more popular? 2/ 110
Anne Scheel @annemscheel.bsky.social · 23/07/2026New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rrtinyurl.comCareer incentives make Registered Reports unattractive under realistic academic conditionsRegistered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish... 15934