Sign in

Annika Külpmann

@anniria.bsky.social
151 followers 127 following 66 posts

M. Sc. psychologist, doctoral researcher (she/her) interested in meta science, psychological research methods, measurement, open science, #rstats

PostsRepliesMedia
Reposted by Annika Külpmann
Samantha Joel @datingdecisions.bsky.social · 30/09/2026
Meta-science/methods improvement people: What are your favorite conferences?
786
Reposted by Annika Külpmann
Ian Hussey @ianhussey.mmmdata.io · 28/09/2026
Germany has cancelled funding for the German Cochrane Foundation. Bad news all around. Cochrane’s benefit to cost ratio is huge. @cochrane.org www.sueddeutsche.de/politik/wark...
sueddeutsche.de
Bund streicht renommierter Cochrane-Stiftung die Förderung
Die Cochrane-Stiftung, die seit Jahren die Nutzen medizinischer Therapien untersucht, soll künftig nicht mehr staatlich gefördert werden.
32914
Reposted by Annika Külpmann
Ian Hussey @ianhussey.mmmdata.io · 25/09/2026
"Systematic reviews are only as credible as the studies they include" INSPECT-SR was published yesterday, giving concrete guidance on how to exclude untrustworthy studies. Cochrane's statement: www.cochrane.org/about-us/new... Article: www.cochrane.org/about-us/new... Guidance: inspect-sr.com
cochrane.org
New tool helps researchers spot problematic trials before they distort evidence | Cochrane
26031
Reposted by Annika Külpmann
Julia M. Rohrer @dingdingpeng.the100.ci · 25/09/2026
Wake up babe, new Gettier problem just dropped en.wikipedia.org/wiki/Gettier...
Gettier attempts to illustrate by means of two counterexamples that there are cases where individuals can have a justified true belief regarding a claim but still fail to know it because the reasons for the belief, while justified, turn out to be false.
2476
Reposted by Annika Külpmann
Tom Gauld @tomgauld.bsky.social · 24/09/2026
My latest @newscientist.com cartoon. many more here: www.newscientist.com/author/tom-gauld/
Image: A graph with lots of red dots clustered together in a curve. The are all looking upwards at a single red dot wearing sunglasses. 

Caption: Mike was an outlier and would probably be excluded from the study, but all the other data points secretly thought he was really cool.
332871735
Reposted by Annika Külpmann
Beth Clarke @bethclarke.bsky.social · 21/08/2026
I’m hiring a PhD student to work with me on metascience in psychology at @zpid.bsky.social! The position is very open - could cover a wide range of topics/themes 🤸🏻‍♀️✨ If you have questions, please reach out! Applications are open until October 1st. leibniz-psychology.onlyfy.jobs/en/job/fyjwt...
leibniz-psychology.onlyfy.jobs
PhD in Psychological Meta-Science (m/f/d)
Become part of the open science movement The Leibniz Institute for Psychology Information (ZPID) in Trier (Germany) is an internationally recognized research-based psychology service center located in...
36157
Reposted by Annika Külpmann
Ian Hussey @ianhussey.mmmdata.io · 13/09/2026
Article now retracted. Retraction notice focuses on data sharing, but doesn't mention - the ethics review body is the author's own company - the tech used to to collect the data by intercepting users' LLM prompts does not exist ht @grinschglsandra.bsky.social psycnet.apa.org/fulltext/202...
psycnet.apa.org
APA PsycNet
511435
Reposted by Annika Külpmann
Saloni @scientificdiscovery.dev · 17/08/2026
It's finally here! I gave a TED talk in April in Vancouver, and it was released online today. You can watch it here: ted.com/talks/saloni... I've also adapted it into an article, which was published last week: worksinprogress.co/issue/future...
Me on the TED stage
612023
Reposted by Annika Külpmann
Jamie Cummins @jamiecummins.bsky.social · 03/08/2026
Have you built an LLM-based research tool and had to stumble your way through figuring out how to validate it? Me too! So I wrote a guide on how to systematically approach this. Preprint here: osf.io/preprints/ps...
07214
Reposted by Annika Külpmann
Jamie Cummins @jamiecummins.bsky.social · 01/08/2026
Psychological Science is running a special issue on "Advancing Psychological Science using Large Language Models", co-edited by me and @ruben.the100.ci. Check out the calls for submissions below! www.psychologicalscience.org/publications...
psychologicalscience.org
Special Issue Call for Submissions: “Advancing Psychological Science using Large Language Models”
Editors: Jamie Cummins and Ruben C. ArslanPsychological Science invites submissions for a special issue on psychological science involving large language models. We welcome theoretically and empirical...
14235
Reposted by Annika Külpmann
Jamie Cummins @jamiecummins.bsky.social · 21/07/2026
RegCheck ( regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
24710
Reposted by Annika Külpmann
Sandra Grinschgl, (she/her) @grinschglsandra.bsky.social · 09/07/2026
Research on cognitive offloading × AI is booming and getting lots of public attention. Unfortunately, some (or even many) of it raises serious credibility concerns. Like this paper, which others and I recently commented on via @pubpeer.com: pubpeer.com/publications...
pubpeer.com
PubPeer - AI Tools in Society: Impacts on Cognitive Offloading and the...
There are comments on PubPeer for publication: AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking (2025)
1168
Reposted by Annika Külpmann
Peter Tennant @pwgtennant.bsky.social · 28/05/2026
The methods section is the most important section of a paper. Without knowing the methods, the results are literally meaningless. So it's not OK to relegate the methods to the end. Because this suggests they are an optional afterthought rather than the essential core of the entire paper.
5507
Reposted by Annika Külpmann
Olivia Waite @oliviawaite.com · 24/05/2026
In sum, skip the Atlantic on this one and read Monstrous Regiment, a great standalone Pratchett and a perfect book for right now, because it takes on propaganda, war, gender, and how religious zealots starve nations and ruin everything. Quote me on that, why don’t you.
61733345
Reposted by Annika Külpmann
Jesper N. Wulff @jnwulff.bsky.social · 21/05/2026
"If I hated to be the bearer of bad news, I wouldn’t have specialized in research methods."
1245
Reposted by Annika Külpmann
Jamie Cummins @jamiecummins.bsky.social · 20/05/2026
Austin et al. (2026) advocated for AI in hypothesis-driven scale validation research. In this preprint, led by @wchiggins.bsky.social, we (@malte.the100.ci @bethclarke.bsky.social) sketch out several weaknesses in this paper, and offer recommendations for avoiding them. osf.io/preprints/ps... 1/🧵
osf.io
OSF
11910
Reposted by Annika Külpmann
Julia M. Rohrer @dingdingpeng.the100.ci · 20/05/2026
New blog post! Let's say an effect you are interested in varies between countries and you want to explain some of that cross-cultural variation. What could possibly go wrong? www.the100.ci/2026/05/20/f...
the100.ci
Friends don’t let friends run moderated cross-country regressions
Header image: Moderate cross-country slopes (Photo: By Erik W. Kolstad - Flickr, CC BY 2.0,) Here’s a particular genre of article that relies on multiple data collection sites, such as studies anal...
1817047
Reposted by Annika Külpmann
Julia M. Rohrer @dingdingpeng.the100.ci · 19/05/2026
There's an interesting conversation unfolding on PubPeer. Inconsistencies were flagged in a paper by a "global keynote speaker on AI&neuroscience" and then the author casually mentions on LinkedIn that she also has pre-post-fMRI for 300 people 👀> pubpeer.com/publications...
pubpeer.com
PubPeer - Generative artificial intelligence reliance and executive fu...
There are comments on PubPeer for publication: Generative artificial intelligence reliance and executive function attenuation: Behavioral evidence of cognitive offload in high-use adults (2026)
78226
Reposted by Annika Külpmann
Awais Aftab @awaisaftab.bsky.social · 11/05/2026
When patients ask, “What disorder do I really ‘have’?” the honest answer is usually more interesting and messier than a single diagnostic label. I wrote for the @nytimes.com on what I wish people understood about diagnoses and the nature of mental health problems. www.nytimes.com/2026/05/11/o...
nytimes.com
Opinion | We’re Thinking About Mental Health Diagnoses All Wrong
314360
Reposted by Annika Külpmann
Kevin Mitchell @wiringthebrain.bsky.social · 09/05/2026
Hey psychologists, when you're explaining some psychological phenomenon that's perfectly well captured in psychological terms, maybe you don't need to refer to some shitty neuroimaging study with ten people to make it seem more "sciencey"...
1725643
Reposted by Annika Külpmann
Brent W. Roberts @bwroberts.bsky.social · 09/05/2026
This...the fetishizing of unreplicable neuroscience in order to legitimize our work is self-defeating. We don't need to know that depression is in the brain (as opposed to what???) to know it is problematic. How much money have we wasted proving something like depression is "real"?
211423
Reposted by Annika Külpmann
Ian Hussey @ianhussey.mmmdata.io · 07/05/2026
@taymalsalti.bsky.social has done trojan work trying to reproduce the results of three meta-analyses, finding the usual host of issues of effect sizes that are apparently incorrect or non-reproducible Our article is out now: doi.org/10.1111/ejn....
0198
Reposted by Annika Külpmann
Wolfgang Viechtbauer @wviechtb.bsky.social · 06/05/2026
Ian Hussey (@ianhussey.mmmdata.io) contacted me about the recurring problem of unusually large SMD values appearing in published meta-analyses. Very large SMDs can result from using SEs in place of SDs in their calculation, which is a mistake I have also seen in practice. 1/4
53814
Reposted by Annika Külpmann
Ian Hussey @ianhussey.mmmdata.io · 07/05/2026
Eagle-eyed @grinschglsandra.bsky.social spotted this mess of a plot, with bars that don't match percentages. We, with @malte.the100.ci, quantify a host of other issues we spotted here. pubpeer.com/publications...
4358
Reposted by Annika Külpmann
Tim Kaiser @tkaiser.science · 28/04/2026
If you are interested in EMDR, you probably heard the story about Francine Shapiro "discovering" the method during a walk in the park. This story is largely wrong.
skepticalinquirer.org
A Photograph Exposes EMDR’s True Origins | Skeptical Inquirer
Sometimes if you keep searching, digging, and sifting, you’ll find a nugget that is bigger than anything you expected. That happened to us when we looked fo ...
2169
Reposted by Annika Külpmann
Saloni @scientificdiscovery.dev · 28/04/2026
You ever try the 'Reading the Mind in the Eyes test' and wonder, how is that any of them?!
A woman turning and looking at the viewer. Pick the word that fits best. 1. aghast, 2. baffled, 3. distrustful, 4. terrified.
21544
Reposted by Annika Külpmann
Dirk Wulff @dirkwulff.bsky.social · 27/04/2026
📣 PsychLing-101 — Deadline May 1 Join us in building a large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation. So far: 36 submissions and 40M+ observations All contributors become coauthors 🤝 🔗 Visit github.com/Data-X01/Psy...
github.com
GitHub - Data-X01/PsychLing-101: Large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation, driven by the community.
Large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation, driven by the community. - Data-X01/PsychLing-101
172
Reposted by Annika Külpmann
Jamie Cummins @jamiecummins.bsky.social · 23/04/2026
All the more reason to use systematic software designed to tackle this very problem, like RegCheck (regcheck.app)
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
0239
Annika Külpmann @anniria.bsky.social · 20/04/2026
I... I started a side project just recently...
360
Reposted by Annika Külpmann
Ian Hussey @ianhussey.mmmdata.io · 18/04/2026
I’m hiring a PhD student! The candidate will work alongside @zefreeman.bsky.social, who is joining our research group as postdoc. jobs.unibe.ch/job-vacancie...
jobs.unibe.ch
PhD Student in Meta-Science and Clinical Psychology - Universität Bern
Universität Bern is looking for PhD Student in Meta-Science and Clinical Psychology
47358
Reposted by Annika Külpmann
Daniel Lakens @lakens.bsky.social · 16/04/2026
Good blog post that perfectly voices the frustration early career researchers can have when they hear senior researchers discuss preregistration. The continuing lack of understanding among senior researchers who keep voicing the same misunderstandings *is* frustrating and embarrassing.
1121
Reposted by Annika Külpmann
Saloni @scientificdiscovery.dev · 15/04/2026
I gave a TED talk today!
me on the TED stageMe giving the TED talkMe, still talkin'
1827716
Reposted by Annika Külpmann
Andrew Ho @andrewdeanho.bsky.social · 14/04/2026
I wrote about how I teach statistics. As I redesign for the AI era, I won't forget the benefits of multimodal, tangible representations. The Five Gs: Greek, Graphs, Grammar, Gadgets, and Games. In the new journal, Teaching Educational Research Methods: doi.org/10.5149/term...
Side-by-side image. Left: the first page of an article in T.E.R.M. (Teaching Educational Research Methods), Volume 1 Issue 1 (Spring 2026), titled ‘The Five Gs for Teaching Statistics: Greek, Graphs, Grammar, Gadgets, and Games’ by Andrew Dean Ho (Harvard Graduate School of Education), with the abstract visible. Right: a photo of a pegboard-style learning "gadget" with colored pins and elastic bands forming a scatterplot, with a best-fit regression line as a dowel and rubber bands representing ordinary least squares residuals.
2244
Reposted by Annika Külpmann
Ruben C. Arslan @ruben.the100.ci · 14/04/2026
New post on The 100% CI: Science needs downvotes. www.the100.ci/2026/04/13/s... In which I make the case that grant funders should add funding lines that include a module for bug bounties.
the100.ci
Science needs downvotes
A bug bounty module in grants would give criticism a leg up The Soviet Union was good at producing shoes. Factories made 800 million pairs a year, twice as many as Italy, three times as many as the...
45714
Reposted by Annika Külpmann
Sandra Grinschgl, (she/her) @grinschglsandra.bsky.social · 13/04/2026
For a short (German) summary of SCORE, check out @briannosek.bsky.social and my interview for @deutschlandfunk.de.web.brid.gy www.deutschlandfunk.de/glaubwuerdig...
deutschlandfunk.de
Glaubwürdige Forschung: Sozialwissenschaftliche Studien oft nicht replizierbar
0157
Reposted by Annika Külpmann
Jamie Cummins @jamiecummins.bsky.social · 06/04/2026
Very pleasantly surprised to see my recent preprint being discussed in this NYT article on silicon sampling and its implications for opinion polling. More forthcoming work on this coming soon! (H/T @rohanalexander.bsky.social) www.nytimes.com/2026/04/06/o...
nytimes.com
Opinion | It’s Called Silicon Sampling, and It’s Going to Ruin Public Opinion Polling
22811
Annika Külpmann @anniria.bsky.social · 07/04/2026
Depluralize a movie: The king‘s soliloquy
020
Reposted by Annika Külpmann
Ian Hussey @ianhussey.mmmdata.io · 07/04/2026
Fun facts - The original study reported 23 IQ point gains - Jordan Peterson tweeted about it (sort of) - @jamiecummins.bsky.social new preregistered RCT shows null effects
0273
Reposted by Annika Külpmann
Megan Fox @glassbottommeg.bsky.social · 03/04/2026
So you're telling me Claude functions by screaming at itself "WRITE GOOD CODE NO BUGS SECURE VERY STABLE", mashes compile button, reads back the error and yells ONLY GOOD CODE NO BUGS at itself again while crying and copying random things from Stack Overflow until it compiles? it just like me fr fr
422184265
Reposted by Annika Külpmann
Center for Open Science @cos.io · 01/04/2026
Today, the SCORE program releases its primary results! 865 researchers examined research credibility across the social and behavioral sciences, publishing three papers in Nature + five preprints. 📑 Explore the papers: www.nature.com/colle... ℹ️ Read more about SCORE: www.cos.io/score
nature.com
Reliable research in the social and behavioural and sciences
Sweeping new investigations probe the replication, robustness and reproducibility of results across the behavioural and social sciences.
36445
Reposted by Annika Külpmann
Brian Nosek @briannosek.bsky.social · 01/04/2026
SCORE, a collaboration of 865 researchers, is now released as three papers in Nature, six preprints, and a lot of data (cos.io/score/). SCORE examined repeatability of findings from the social-behavioral sciences and tested whether human and automated methods could predict replicability.
cos.io
SCORE | Center for Open Science
SCORE shows that there is no shortcut to producing credible research findings, and there is no single indicator of trustworthiness. Research progress depends on transparency, rigor, and establishing r...
1190107
Reposted by Annika Külpmann
Ian Hussey @ianhussey.mmmdata.io · 01/04/2026
Majestic, well done @rickcarlsson.bsky.social
The alt text for this image is available upon reasonable request.
26827
Reposted by Annika Külpmann
Dermot Lynott @dermotlynott.bsky.social · 29/03/2026
I have a new favourite bar chart
0233
Reposted by Annika Külpmann
Julia M. Rohrer @dingdingpeng.the100.ci · 26/03/2026
Am I reading this right, did they fill like a whole plane with people who suffer from phobic fear of flying ✈️
5317
Reposted by Annika Külpmann
Jordan Nafa @ajordannafa.com · 24/03/2026
Happy "large enough n" day
Screenshot of a famous tweet from March 24, 2020 of an idiot saying "with very large numbers of n's you don't need randomization"
29816
Reposted by Annika Külpmann
Brett Karlan @oldjerryfodor.bsky.social · 23/03/2026
If you are a professor and someone asks you for advice about how to get a job/into grad school and you do anything else but send them the survivorship bias meme, you are spreading misinformation
0331
Reposted by Annika Külpmann
Peter Eibich @peibich.bsky.social · 22/03/2026
Three scales were constructed for the theorists. Seven were given to the clinicians in their halls of stone. Nine scales for the social psychologists, doomed to publish. But they were all deceived, for another scale was made.
2355
Reposted by Annika Külpmann
Saloni @scientificdiscovery.dev · 22/03/2026
I didn't think I'd watch someone with 30 tabs open in the same window trying to look for a tab, failing to find it, and then opening the same page in a new tab, but I did and it was very uncomfortable to watch.
7401
Reposted by Annika Külpmann
Will Lowe @conjugateprior.org · 22/03/2026
The unidimensionality epidemic, also caused by the cellphone.
Why does the rate of latent constructs increase after the introduction of the iPhone? Jonathan Haidt, developer of Measurement foundations theory and author the Righteous Mindicator and the Anxious Generative Model, knows.
193
Reposted by Annika Külpmann
Julia M. Rohrer @dingdingpeng.the100.ci · 22/03/2026
u r not going to believe this
4295