Reposted by Annika KülpmannSamantha Joel @datingdecisions.bsky.social · 30/09/2026Meta-science/methods improvement people: What are your favorite conferences? 786
Reposted by Annika KülpmannIan Hussey @ianhussey.mmmdata.io · 28/09/2026Germany has cancelled funding for the German Cochrane Foundation. Bad news all around. Cochrane’s benefit to cost ratio is huge. @cochrane.org www.sueddeutsche.de/politik/wark...sueddeutsche.deBund streicht renommierter Cochrane-Stiftung die FörderungDie Cochrane-Stiftung, die seit Jahren die Nutzen medizinischer Therapien untersucht, soll künftig nicht mehr staatlich gefördert werden. 32914
Reposted by Annika KülpmannIan Hussey @ianhussey.mmmdata.io · 25/09/2026"Systematic reviews are only as credible as the studies they include" INSPECT-SR was published yesterday, giving concrete guidance on how to exclude untrustworthy studies. Cochrane's statement: www.cochrane.org/about-us/new... Article: www.cochrane.org/about-us/new... Guidance: inspect-sr.comcochrane.orgNew tool helps researchers spot problematic trials before they distort evidence | Cochrane 26031
Reposted by Annika KülpmannJulia M. Rohrer @dingdingpeng.the100.ci · 25/09/2026Wake up babe, new Gettier problem just dropped en.wikipedia.org/wiki/Gettier... 2476
Reposted by Annika KülpmannTom Gauld @tomgauld.bsky.social · 24/09/2026My latest @newscientist.com cartoon. many more here: www.newscientist.com/author/tom-gauld/ 332871735
Reposted by Annika KülpmannBeth Clarke @bethclarke.bsky.social · 21/08/2026I’m hiring a PhD student to work with me on metascience in psychology at @zpid.bsky.social! The position is very open - could cover a wide range of topics/themes 🤸🏻♀️✨ If you have questions, please reach out! Applications are open until October 1st. leibniz-psychology.onlyfy.jobs/en/job/fyjwt...leibniz-psychology.onlyfy.jobsPhD in Psychological Meta-Science (m/f/d)Become part of the open science movement The Leibniz Institute for Psychology Information (ZPID) in Trier (Germany) is an internationally recognized research-based psychology service center located in... 36157
Reposted by Annika KülpmannIan Hussey @ianhussey.mmmdata.io · 13/09/2026Article now retracted. Retraction notice focuses on data sharing, but doesn't mention - the ethics review body is the author's own company - the tech used to to collect the data by intercepting users' LLM prompts does not exist ht @grinschglsandra.bsky.social psycnet.apa.org/fulltext/202...psycnet.apa.orgAPA PsycNet 511435
Reposted by Annika KülpmannSaloni @scientificdiscovery.dev · 17/08/2026It's finally here! I gave a TED talk in April in Vancouver, and it was released online today. You can watch it here: ted.com/talks/saloni... I've also adapted it into an article, which was published last week: worksinprogress.co/issue/future... 612023
Reposted by Annika KülpmannJamie Cummins @jamiecummins.bsky.social · 03/08/2026Have you built an LLM-based research tool and had to stumble your way through figuring out how to validate it? Me too! So I wrote a guide on how to systematically approach this. Preprint here: osf.io/preprints/ps... 07214
Reposted by Annika KülpmannJamie Cummins @jamiecummins.bsky.social · 01/08/2026Psychological Science is running a special issue on "Advancing Psychological Science using Large Language Models", co-edited by me and @ruben.the100.ci. Check out the calls for submissions below! www.psychologicalscience.org/publications...psychologicalscience.orgSpecial Issue Call for Submissions: “Advancing Psychological Science using Large Language Models”Editors: Jamie Cummins and Ruben C. ArslanPsychological Science invites submissions for a special issue on psychological science involving large language models. We welcome theoretically and empirical... 14235
Reposted by Annika KülpmannJamie Cummins @jamiecummins.bsky.social · 21/07/2026RegCheck ( regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:regcheck.appRegCheckRegCheck is an AI tool to compare preregistrations with papers instantly. 24710
Reposted by Annika KülpmannSandra Grinschgl, (she/her) @grinschglsandra.bsky.social · 09/07/2026Research on cognitive offloading × AI is booming and getting lots of public attention. Unfortunately, some (or even many) of it raises serious credibility concerns. Like this paper, which others and I recently commented on via @pubpeer.com: pubpeer.com/publications...pubpeer.comPubPeer - AI Tools in Society: Impacts on Cognitive Offloading and the...There are comments on PubPeer for publication: AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking (2025) 1168
Reposted by Annika KülpmannPeter Tennant @pwgtennant.bsky.social · 28/05/2026The methods section is the most important section of a paper. Without knowing the methods, the results are literally meaningless. So it's not OK to relegate the methods to the end. Because this suggests they are an optional afterthought rather than the essential core of the entire paper. 5507
Reposted by Annika KülpmannOlivia Waite @oliviawaite.com · 24/05/2026In sum, skip the Atlantic on this one and read Monstrous Regiment, a great standalone Pratchett and a perfect book for right now, because it takes on propaganda, war, gender, and how religious zealots starve nations and ruin everything. Quote me on that, why don’t you. 61733345
Reposted by Annika KülpmannJesper N. Wulff @jnwulff.bsky.social · 21/05/2026"If I hated to be the bearer of bad news, I wouldn’t have specialized in research methods." 1245
Reposted by Annika KülpmannJamie Cummins @jamiecummins.bsky.social · 20/05/2026Austin et al. (2026) advocated for AI in hypothesis-driven scale validation research. In this preprint, led by @wchiggins.bsky.social, we (@malte.the100.ci @bethclarke.bsky.social) sketch out several weaknesses in this paper, and offer recommendations for avoiding them. osf.io/preprints/ps... 1/🧵osf.ioOSF 11910
Reposted by Annika KülpmannJulia M. Rohrer @dingdingpeng.the100.ci · 20/05/2026New blog post! Let's say an effect you are interested in varies between countries and you want to explain some of that cross-cultural variation. What could possibly go wrong? www.the100.ci/2026/05/20/f...the100.ciFriends don’t let friends run moderated cross-country regressionsHeader image: Moderate cross-country slopes (Photo: By Erik W. Kolstad - Flickr, CC BY 2.0,) Here’s a particular genre of article that relies on multiple data collection sites, such as studies anal... 1817047
Reposted by Annika KülpmannJulia M. Rohrer @dingdingpeng.the100.ci · 19/05/2026There's an interesting conversation unfolding on PubPeer. Inconsistencies were flagged in a paper by a "global keynote speaker on AI&neuroscience" and then the author casually mentions on LinkedIn that she also has pre-post-fMRI for 300 people 👀> pubpeer.com/publications...pubpeer.comPubPeer - Generative artificial intelligence reliance and executive fu...There are comments on PubPeer for publication: Generative artificial intelligence reliance and executive function attenuation: Behavioral evidence of cognitive offload in high-use adults (2026) 78226
Reposted by Annika KülpmannAwais Aftab @awaisaftab.bsky.social · 11/05/2026When patients ask, “What disorder do I really ‘have’?” the honest answer is usually more interesting and messier than a single diagnostic label. I wrote for the @nytimes.com on what I wish people understood about diagnoses and the nature of mental health problems. www.nytimes.com/2026/05/11/o...nytimes.comOpinion | We’re Thinking About Mental Health Diagnoses All Wrong 314360
Reposted by Annika KülpmannKevin Mitchell @wiringthebrain.bsky.social · 09/05/2026Hey psychologists, when you're explaining some psychological phenomenon that's perfectly well captured in psychological terms, maybe you don't need to refer to some shitty neuroimaging study with ten people to make it seem more "sciencey"... 1725643
Reposted by Annika KülpmannBrent W. Roberts @bwroberts.bsky.social · 09/05/2026This...the fetishizing of unreplicable neuroscience in order to legitimize our work is self-defeating. We don't need to know that depression is in the brain (as opposed to what???) to know it is problematic. How much money have we wasted proving something like depression is "real"? 211423
Reposted by Annika KülpmannIan Hussey @ianhussey.mmmdata.io · 07/05/2026@taymalsalti.bsky.social has done trojan work trying to reproduce the results of three meta-analyses, finding the usual host of issues of effect sizes that are apparently incorrect or non-reproducible Our article is out now: doi.org/10.1111/ejn.... 0198
Reposted by Annika KülpmannWolfgang Viechtbauer @wviechtb.bsky.social · 06/05/2026Ian Hussey (@ianhussey.mmmdata.io) contacted me about the recurring problem of unusually large SMD values appearing in published meta-analyses. Very large SMDs can result from using SEs in place of SDs in their calculation, which is a mistake I have also seen in practice. 1/4 53814
Reposted by Annika KülpmannIan Hussey @ianhussey.mmmdata.io · 07/05/2026Eagle-eyed @grinschglsandra.bsky.social spotted this mess of a plot, with bars that don't match percentages. We, with @malte.the100.ci, quantify a host of other issues we spotted here. pubpeer.com/publications... 4358
Reposted by Annika KülpmannTim Kaiser @tkaiser.science · 28/04/2026If you are interested in EMDR, you probably heard the story about Francine Shapiro "discovering" the method during a walk in the park. This story is largely wrong.skepticalinquirer.orgA Photograph Exposes EMDR’s True Origins | Skeptical InquirerSometimes if you keep searching, digging, and sifting, you’ll find a nugget that is bigger than anything you expected. That happened to us when we looked fo ... 2169
Reposted by Annika KülpmannSaloni @scientificdiscovery.dev · 28/04/2026You ever try the 'Reading the Mind in the Eyes test' and wonder, how is that any of them?! 21544
Reposted by Annika KülpmannDirk Wulff @dirkwulff.bsky.social · 27/04/2026📣 PsychLing-101 — Deadline May 1 Join us in building a large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation. So far: 36 submissions and 40M+ observations All contributors become coauthors 🤝 🔗 Visit github.com/Data-X01/Psy...github.comGitHub - Data-X01/PsychLing-101: Large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation, driven by the community.Large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation, driven by the community. - Data-X01/PsychLing-101 172
Reposted by Annika KülpmannJamie Cummins @jamiecummins.bsky.social · 23/04/2026All the more reason to use systematic software designed to tackle this very problem, like RegCheck (regcheck.app)regcheck.appRegCheckRegCheck is an AI tool to compare preregistrations with papers instantly. 0239
Reposted by Annika KülpmannIan Hussey @ianhussey.mmmdata.io · 18/04/2026I’m hiring a PhD student! The candidate will work alongside @zefreeman.bsky.social, who is joining our research group as postdoc. jobs.unibe.ch/job-vacancie...jobs.unibe.chPhD Student in Meta-Science and Clinical Psychology - Universität BernUniversität Bern is looking for PhD Student in Meta-Science and Clinical Psychology 47358
Reposted by Annika KülpmannDaniel Lakens @lakens.bsky.social · 16/04/2026Good blog post that perfectly voices the frustration early career researchers can have when they hear senior researchers discuss preregistration. The continuing lack of understanding among senior researchers who keep voicing the same misunderstandings *is* frustrating and embarrassing. 1121
Reposted by Annika KülpmannSaloni @scientificdiscovery.dev · 15/04/2026I gave a TED talk today! 1827716
Reposted by Annika KülpmannAndrew Ho @andrewdeanho.bsky.social · 14/04/2026I wrote about how I teach statistics. As I redesign for the AI era, I won't forget the benefits of multimodal, tangible representations. The Five Gs: Greek, Graphs, Grammar, Gadgets, and Games. In the new journal, Teaching Educational Research Methods: doi.org/10.5149/term... 2244
Reposted by Annika KülpmannRuben C. Arslan @ruben.the100.ci · 14/04/2026New post on The 100% CI: Science needs downvotes. www.the100.ci/2026/04/13/s... In which I make the case that grant funders should add funding lines that include a module for bug bounties.the100.ciScience needs downvotesA bug bounty module in grants would give criticism a leg up The Soviet Union was good at producing shoes. Factories made 800 million pairs a year, twice as many as Italy, three times as many as the... 45714
Reposted by Annika KülpmannSandra Grinschgl, (she/her) @grinschglsandra.bsky.social · 13/04/2026For a short (German) summary of SCORE, check out @briannosek.bsky.social and my interview for @deutschlandfunk.de.web.brid.gy www.deutschlandfunk.de/glaubwuerdig...deutschlandfunk.deGlaubwürdige Forschung: Sozialwissenschaftliche Studien oft nicht replizierbar 0157
Reposted by Annika KülpmannJamie Cummins @jamiecummins.bsky.social · 06/04/2026Very pleasantly surprised to see my recent preprint being discussed in this NYT article on silicon sampling and its implications for opinion polling. More forthcoming work on this coming soon! (H/T @rohanalexander.bsky.social) www.nytimes.com/2026/04/06/o...nytimes.comOpinion | It’s Called Silicon Sampling, and It’s Going to Ruin Public Opinion Polling 22811
Reposted by Annika KülpmannIan Hussey @ianhussey.mmmdata.io · 07/04/2026Fun facts - The original study reported 23 IQ point gains - Jordan Peterson tweeted about it (sort of) - @jamiecummins.bsky.social new preregistered RCT shows null effects 0273
Reposted by Annika KülpmannMegan Fox @glassbottommeg.bsky.social · 03/04/2026So you're telling me Claude functions by screaming at itself "WRITE GOOD CODE NO BUGS SECURE VERY STABLE", mashes compile button, reads back the error and yells ONLY GOOD CODE NO BUGS at itself again while crying and copying random things from Stack Overflow until it compiles? it just like me fr fr 422184265
Reposted by Annika KülpmannCenter for Open Science @cos.io · 01/04/2026Today, the SCORE program releases its primary results! 865 researchers examined research credibility across the social and behavioral sciences, publishing three papers in Nature + five preprints. 📑 Explore the papers: www.nature.com/colle... ℹ️ Read more about SCORE: www.cos.io/scorenature.comReliable research in the social and behavioural and sciencesSweeping new investigations probe the replication, robustness and reproducibility of results across the behavioural and social sciences. 36445
Reposted by Annika KülpmannBrian Nosek @briannosek.bsky.social · 01/04/2026SCORE, a collaboration of 865 researchers, is now released as three papers in Nature, six preprints, and a lot of data (cos.io/score/). SCORE examined repeatability of findings from the social-behavioral sciences and tested whether human and automated methods could predict replicability.cos.ioSCORE | Center for Open ScienceSCORE shows that there is no shortcut to producing credible research findings, and there is no single indicator of trustworthiness. Research progress depends on transparency, rigor, and establishing r... 1190107
Reposted by Annika KülpmannIan Hussey @ianhussey.mmmdata.io · 01/04/2026Majestic, well done @rickcarlsson.bsky.social 26827
Reposted by Annika KülpmannDermot Lynott @dermotlynott.bsky.social · 29/03/2026I have a new favourite bar chart 0233
Reposted by Annika KülpmannJulia M. Rohrer @dingdingpeng.the100.ci · 26/03/2026Am I reading this right, did they fill like a whole plane with people who suffer from phobic fear of flying ✈️ 5317
Reposted by Annika KülpmannBrett Karlan @oldjerryfodor.bsky.social · 23/03/2026If you are a professor and someone asks you for advice about how to get a job/into grad school and you do anything else but send them the survivorship bias meme, you are spreading misinformation 0331
Reposted by Annika KülpmannPeter Eibich @peibich.bsky.social · 22/03/2026Three scales were constructed for the theorists. Seven were given to the clinicians in their halls of stone. Nine scales for the social psychologists, doomed to publish. But they were all deceived, for another scale was made. 2355
Reposted by Annika KülpmannSaloni @scientificdiscovery.dev · 22/03/2026I didn't think I'd watch someone with 30 tabs open in the same window trying to look for a tab, failing to find it, and then opening the same page in a new tab, but I did and it was very uncomfortable to watch. 7401
Reposted by Annika KülpmannWill Lowe @conjugateprior.org · 22/03/2026The unidimensionality epidemic, also caused by the cellphone. 193
Reposted by Annika KülpmannJulia M. Rohrer @dingdingpeng.the100.ci · 22/03/2026u r not going to believe this 4295