Sign in

Felix Thoemmes

@felixthoemmes.bsky.social
1.2K followers 219 following 175 posts
PostsRepliesMedia
Reposted by Felix Thoemmes
Ken Paller @paller.bsky.social · 6h
Did you know that your speed — in a simple task of quickly pressing a button every time you see a yellow square — is faster when you are exhaling or pausing then when you are inhaling? Dr. Erika Yamazaki figured this out, did all the work, and published on it this week www.cell.com/iscience/ful...
cell.com
Response speed is modulated by respiratory phase
Behavioral neuroscience; Cognitive neuroscience
03410
Reposted by Felix Thoemmes
bergelsonlab @bergelsonlab.bsky.social · 15h
hey #CogSciSky, wake up, a new class demo just dropped
0143
Reposted by Felix Thoemmes
iBartomeus @ibartomeus.bsky.social · 12h
How open science is silently destroyed: 1st) Use open and closed datasets, but only offer co-authorship to researchers with closed data in exchange for sharing their data. 2nd) Don't even bother to make the data used openly available upon publication.
2184
Reposted by Felix Thoemmes
David A. Sbarra @dsbarra.bsky.social · 17h
#AMPPS has a series of papers out about the methods used in a specific mind-body healing study. From a metascience perspective, the exchange is highly informative and interesting-- use the set of papers for a lab meeting discussion or in your methods classes? Read on...
141
Reposted by Felix Thoemmes
Publish-Review-Curate (PRC) Alliance @prcalliance.bsky.social · 17h
Would you like to learn about the vision for research communication that places openness, transparency, community participation, and scholarly judgment at its core? Then join us for the PRC Alliance launch event on the 28th October 2026! Register: publish-review-curate.org/2026/09/07/l...
publish-review-curate.org
Launch Event – Publish, Review, Curate (PRC): Shaping the future of scholarly publishing – Registration now open!
Join us for an engaging discussion about one of the most exciting new developments in scholarly publishing in decades! The scholarly publishing system is under intense pressure. Researchers face in…
033
Reposted by Felix Thoemmes
Noah Haber @whaleactually.com · 29/09/2026
Up on the COS.io blog now: "What is in the Registered Revisions Meta Trial Development Report" www.cos.io/blog/what-is... Yeah this is a post about a post about a report. But it's an unusual report worth a read, since it focuses on all the lessons learned, dead ends, straight up errors, etc.
cos.io
What is in the Registered Revisions Meta Trial Development and Pilot Report?
COS Principal Research Scientist Noah Haber shares how the SCORE project developed a collaborative reproducible manuscript workflow, walks through two different approaches, and introduces an open-sour...
032
Reposted by Felix Thoemmes
Martin Huber @causalhuber.bsky.social · 29/09/2026
📦 Very happy to announce a new release of our causalweight R package for causal inference combined with machine learning! New: continuous treatments, mediation with DiD, direct/indirect quantile effects, learning instruments & controls, effect homogeneity tests. cran.r-project.org/package=caus...
cran.r-project.org
causalweight: Estimation Methods for Causal Inference Based on Inverse Probability Weighting and Doubly Robust Estimation
Various estimators of causal effects based on inverse probability weighting, doubly robust estimation, and double machine learning. Specifically, the package includes methods for estimating average tr...
0104
Reposted by Felix Thoemmes
Ingo Rohlfing @ingorohlfing.bsky.social · 29/09/2026
Excel now supports multiple values in a single cell | Microsoft Community Hub techcommunity.microsoft.com/blog/excelbl... Who wouldn't love an additional challenge in processing spreadsheets?
042
Reposted by Felix Thoemmes
Lukas Röseler @aufdroeseler.bsky.social · 30/04/2026
Introducing the #ReplicationAtlas: The FLoRA (FORRT Library of Reproduction and Replication Attempts) lets you browser over two thousand (!) pairs of original and replication studies. Search by DOIs/keywords and find out about replications from your field, maybe even replications of your own work.
35634
Reposted by Felix Thoemmes
Lukas Röseler @aufdroeseler.bsky.social · 29/09/2026
@lukaswallrich.bsky.social is doing a hands-on: Doing an AI-led reproduction and comparing models. Here is a random example from his slights about how agents perform on the "deadly femal hurricanes" study (10.1073/pnas.1402786111).
021
Reposted by Felix Thoemmes
Center for Open Science @cos.io · 29/09/2026
COS researchers and collaborators have developed and piloted Registered Revisions—an approach designed to reduce uncertainty and publication bias when substantive changes to a study’s analysis are requested during peer review Noah Haber previews what's in the report:
cos.io
What is in the Registered Revisions Meta Trial Development and Pilot Report?
COS Principal Research Scientist Noah Haber shares how the SCORE project developed a collaborative reproducible manuscript workflow, walks through two different approaches, and introduces an open-source R package created from that work.
034
Reposted by Felix Thoemmes
Max Hinne @maxhinne.bsky.social · 29/09/2026
Bayesian analyses are great, but making the right model is very challenging. Come work with me on implementing efficient Bayesian multiverses, where we help researchers across empirical domains to improve their models! More information on the Radboud University website: www.ru.nl/en/working-a...
ru.nl
Research Assistant at the Donders Centre for Cognition: Computational Modelling and Scientific Software | Radboud University
Do you want to work as a Research Assistant at the Donders Centre for Cognition: Computational Modelling and Scientific Software? Check our vacancy!
074
Reposted by Felix Thoemmes
Collabra: Psychology @collabrapsychology.bsky.social · 29/09/2026
A Systematic Literature Review of Causal Mediation Analysis in Social Psychology, from @jiwoo-kim.bsky.social and @felixthoemmes.bsky.social doi.org/10.1525/coll...
doi.org
A Systematic Literature Review of Causal Mediation Analysis in Social Psychology
Mediation analysis has been widely used in social psychology to investigate the mechanisms linking independent and dependent variables. However, conducting a proper mediation analysis is challenging, ...
0176
Reposted by Felix Thoemmes
Ian Hussey @ianhussey.mmmdata.io · 28/09/2026
Germany has cancelled funding for the German Cochrane Foundation. Bad news all around. Cochrane’s benefit to cost ratio is huge. @cochrane.org www.sueddeutsche.de/politik/wark...
sueddeutsche.de
Bund streicht renommierter Cochrane-Stiftung die Förderung
Die Cochrane-Stiftung, die seit Jahren die Nutzen medizinischer Therapien untersucht, soll künftig nicht mehr staatlich gefördert werden.
32813
Reposted by Felix Thoemmes
Mark Rubin @markrubin.bsky.social · 27/09/2026
New "Research Handbook on the Replication Crisis" Edited by David Trafimow with 17 chapters covering issues such as results-blind publishing, preregistration, theory development, and statistical inference. www.e-elgar.com/shop/gbp/res...
083
Reposted by Felix Thoemmes
Katie Corker @katiecorker.bsky.social · 27/09/2026
What "self-correction" looks like in action. We need more Pauls, and tooling that supports them.
075
Reposted by Felix Thoemmes
Paul Gardner @ppgardne.bsky.social · 08/09/2026
I'm happy to say I have managed to report all 12 faked systematic reviews that we discovered on PubPeer. The corresponding URLs are in the ALT text. I'm awaiting responses from most of the publishers/authors -- other than one author admission:
1. https://pubpeer.com/publications/E858A6B3492DB679121B1358E1CDEA#null
2. https://pubpeer.com/publications/E223A9D5CF9F48D2BA6E31A5B7B163
3. https://pubpeer.com/publications/5EA00303B5EDCCDAF82304D93F0A1C
4. https://pubpeer.com/publications/339F22D24DEBFB96025FC31675A9F4
5. https://pubpeer.com/publications/650876481D7FC858E2F95148AB264C#null
6. https://pubpeer.com/publications/BE8365B6373075786A0DE05323125A#null
7. https://pubpeer.com/publications/ABE3AB3258181CD400EDFC900E3851
8. https://pubpeer.com/publications/A87CFEBAA1950F2D96195B8B8088B8
9. https://pubpeer.com/publications/233E9B0E67EAB1C92CD3904F5587C2#null
10. https://pubpeer.com/publications/365A43971AC6C7292696BA05F2300D
11. https://pubpeer.com/publications/A8F0DC88104363F2E9334CE67A03EA
12. https://pubpeer.com/publications/FFC531637B4932529E46082BC0004E
2229
Reposted by Felix Thoemmes
Brady West @bradytwest.bsky.social · 22/09/2026
The University of Michigan National Survey Panel (M-Panel) is now openly accepting questionnaire content from researchers. Would you like to ask questions to a national probability-based panel of adults in the U.S., with an oversample from Michigan? Tap below! mpanel.isr.umich.edu/for-research...
mpanel.isr.umich.edu
For Researchers | M-Panel: National Survey PanelFor Researchers – M-Panel: National Survey Panel
12118
Reposted by Felix Thoemmes
Thùy Vy T Nguyễn @thuyvytnguyen.bsky.social · 25/09/2026
Hey #openscience people, have you come across any registered reports on existing datasets to test new hypotheses? By definition (www.cos.io/initiatives/...), it applies to where data collection has not begun, so I am asking whether it can be used for secondary data analysis.
cos.io
Registered Reports
Peer review before results are known to align scientific values and practices.
4112
Reposted by Felix Thoemmes
Saloni @scientificdiscovery.dev · 25/09/2026
Happy Friday! Iʼve created a game for you to play! Will AI cure all diseases in 10 years? Inspired by bottlenecks discourse, I created a game to help build your intuitions. Play it here: game.clinicaltrialsabundance.blog Naturally, it’s bottle-themed with bubbles and there are leaderboards too.
33810
Reposted by Felix Thoemmes
Ian Hussey @ianhussey.mmmdata.io · 25/09/2026
"Systematic reviews are only as credible as the studies they include" INSPECT-SR was published yesterday, giving concrete guidance on how to exclude untrustworthy studies. Cochrane's statement: www.cochrane.org/about-us/new... Article: www.cochrane.org/about-us/new... Guidance: inspect-sr.com
cochrane.org
New tool helps researchers spot problematic trials before they distort evidence | Cochrane
26031
Reposted by Felix Thoemmes
Jamie Cummins @jamiecummins.bsky.social · 24/09/2026
I sincerely hope this paper will be seen as a turning point in how the medical sciences think and approach the issue of trustworthiness assessment (and I hope the social sciences follow suit!). Congrats to @jdwilko.bsky.social and colleagues (incl. @ianhussey.mmmdata.io and @lhdjung.bsky.social)!
12210
Reposted by Felix Thoemmes
Carsten Schwemmer @cschwem2er.bsky.social · 28/07/2026
1/6 What happens when you tell an AI browser: “Fill out this survey”? It fills out the survey. In our new study, led by @rtopinkova.bsky.social, we tested three consumer-facing agentic browsers without lengthy prompts, custom code, or technical fine-tuning.
33728
Reposted by Felix Thoemmes
Universität Trier @unitrier.bsky.social · 24/09/2026
💯 @dfg.de fördert die FOR "Beyond Crazy" mit @kaisassenberg.bsky.social vom @zpid.bsky.social & der #UniTrier für 4️⃣Jahre! Ziel: Untersuchen, welche Vorteile der Glaube an Verschwörungstheorien deren Anhängern bringt & so helfen zu verhindern, dass er überhaupt entsteht. Mehr: tinyurl.com/57ascsn4
leibniz-psychology.org
DFG-Forschungsgruppe untersucht Verschwörungstheorien aus neuer Perspektive
Rund vier Millionen Euro für Verbundprojekt in Psychologie und Kommunikationswissenschaft
052
Reposted by Felix Thoemmes
Mattan S. Ben-Shachar @mattansb.msbstats.info · 24/09/2026
This quote by haunts me. From Wilcox's "Introduction to Robust Estimation and Hypothesis Testing" #stats
To begin, distributions are never normal. For some this seems obvious, hardly worth mentioning, but an aphorism given by Cram´er (1946) and attributed to the mathematician Poincar´e remains relevant: “Everyone believes in the [normal] law of errors, the experimenters because they think it is a mathematical theorem, the mathematicians because they think it is an experimental fact.”
310422
Reposted by Felix Thoemmes
Magnus Johansson @pgmj.bsky.social · 24/09/2026
This is worth reposting once in a while. bsky.app/profile/rpsy...
0145
Reposted by Felix Thoemmes
The Cochrane Collaboration @cochrane.org · 24/09/2026
INSPECT-SR – a tool for assessing the trustworthiness of randomized controlled trials – has been published today in @bmj.com, giving researchers a structured way to identify problematic studies before they're included in systematic reviews. 🔗 www.cochrane.org/about-us/new... #ResearchIntegrity
“Systematic reviews are only as credible as the studies they include.” — phrased as a Cochrane senior research integrity editor; a magnifying glass rests on stacked papers in the background to emphasize careful scrutiny of research.
03124
Reposted by Felix Thoemmes
moin syed @syeducation.bsky.social · 24/09/2026
Folks, the lead author of this paper, Abby Person, just joined Bluesky, @abbyperson26.bsky.social. Give her a follow! Lots more good work to come.
2151
Reposted by Felix Thoemmes
Association for Psychological Science @psychscience.bsky.social · 23/09/2026
Submissions for our 2027 Annual Convention open on October 15! There's a few changes for 2027, including submission types: Empirical Research Systematic Review Meta-Analysis and Meta-Synthesis Methods and Applications www.psychologicalscience.org/conventions/...
042
Reposted by Felix Thoemmes
Jamie Cummins @jamiecummins.bsky.social · 23/09/2026
We just published a new paper (led by Love von Schreeb) demonstrating how large language models can be used to link published results to trial registrations with very high accuracy! Now out in Journal of Clinical Epidemiology - check it out: www.jclinepi.com/article/S089...
jclinepi.com
TrialScout links published results to trial registrations using a large language model
Multiple stakeholders need to locate results of registered clinical trials but frequently struggle to find them. Summary results of clinical trials are often not published in trial registries, and pub...
1187
Reposted by Felix Thoemmes
Randy Ellis @randalljellis.bsky.social · 23/09/2026
Here’s my conversation with Chris Chambers on Metascience Matters. Chris was the first journal editor to offer registered reports, starting in 2013 at Cortex. youtu.be/PgZjgZlxsYw?...
youtu.be
Registered reports | Chris Chambers
YouTube video by Metascience Matters
11812
Reposted by Felix Thoemmes
Nick DeVito @ndevito1.bsky.social · 22/09/2026
🫠
042
Reposted by Felix Thoemmes
David A. Sbarra @dsbarra.bsky.social · 22/09/2026
Great paper alert!
133
Reposted by Felix Thoemmes
Tobias Dienlin @tobiasdienlin.com · 22/09/2026
A hammer does not guarantee successful nailing, successful nailing does not require a hammer, & the [generalizability] of the claim is in principle separate from which tool was used. The same is true of methods in the social and behavioral sciences. Shadish (1995, p. 421) Banger start to the paper!
082
Reposted by Felix Thoemmes
Sanjay Srivastava @sanjaysrivastava.com · 23/09/2026
I predict that this will make Moin as many friends in the qual research community as his metascience work on quant has made him there
2162
Reposted by Felix Thoemmes
moin syed @syeducation.bsky.social · 22/09/2026
New paper! Despite qualitative researchers claiming that generalizability is not a goal, their published work does indeed contain generalizable claims. We document this and provide recommendations for how all researchers can better calibrate their generalizability claims. doi.org/10.1177/2515...
article header for, "Qualitative Researchers Can and Do Generalize: Generalizability Claims in Qualitative Psychological Research". Metascience!
619255
Reposted by Felix Thoemmes
Dan Quintana @dsquintana.bsky.social · 20/09/2026
Check how reusable your OSF materials are with my new app, which is part of my latest preprint. Plug in up to ten OSF repo links, and you’ll get a brief report + tips for fixing issues ⬇️
1188
Reposted by Felix Thoemmes
Wes Bonifay @wesbonifay.bsky.social · 19/09/2026
0294
Reposted by Felix Thoemmes
Angelika Stefan @ephemeralidea.bsky.social · 19/09/2026
Top-notch German rage bait 😂
121
Reposted by Felix Thoemmes
Dan Quintana @dsquintana.bsky.social · 19/09/2026
If you want to look at (or download) this dataset, check out the paper's data explorer shiny app dsquintana.shinyapps.io/osf-material...
Screenshot of a searchable data table web app companion to the paper. A left sidebar holds filters: journal (Cognition, Journal of Experimental Social Psychology, Journal of Memory and Language, Psychological Science), year (2015, 2020, 2025), article type (all, empirical only, non-empirical only, has a repository link, has OSF downloads only), and documentation (all, documented, has a README file), plus a button to download the filtered rows as CSV. The main table lists one row per paper with columns for DOI, title, journal, year, type, platform, OSF link, downloads, citations, altmetric, support percentage, README, documented, doc level, hard-coded path, missing file, codebook, and columns documented. Visible rows are 2015 Cognition papers with download counts from 170 to 401.
162
Reposted by Felix Thoemmes
Dan Quintana @dsquintana.bsky.social · 19/09/2026
New preprint! 🎉 I analysed 1660 papers from 4 psychology journals and found materials sharing went from 9% of papers in 2015 to 82% in 2025, and these materials *do* get downloaded — a median of 135 times each. BUT shared code is often hard to run. doi.org/10.31234/osf... Let's walk through it 🧵
Two-panel figure. Panel a is a flow diagram tracking 1,611 empirical psychology articles from publication year (545 in 2015, 552 in 2020, 514 in 2025) to repository-link type: 785 link an OSF project, 85 link another platform, and 741 link no repository. Of those with an OSF link, download counts were retrieved for 670 and not retrieved for 115. Panel b is a line chart of the share of empirical papers linking OSF across 2015, 2020 and 2025. The overall rate, shown as a dashed black line, rises from 9% to 57% to 82%. All four journals rise steeply and end close together: Psychological Science 92%, JESP 89%, JML 83%, Cognition 76%, with Psychological Science highest throughout.Three-panel figure. Panel a: ridgeline plot of downloads per file by material type on a log scale, with the percentage never downloaded labelled for each — archive 16% of 545 files, documents 20% of 2,970, code 12% of 3,471, other 17% of 1,646, data 21% of 10,051, media 35% of 2,120, images 35% of 4,102. Most files cluster between 1 and 10 downloads, with long right tails past 100. Panel b: ridgeline plot of downloads per paper by journal, log scale, with dashed median lines; Psychological Science is highest, then JESP, JML and Cognition. Panel c: stacked bars showing, for documents, data and code separately, the share of papers by download band (0, 1–10, 11–100, more than 100) in 2015, 2020 and 2025. The share exceeding 100 downloads falls sharply over time in all three types, from roughly two-thirds in 2015 to a quarter or less in 2025, as the 1–10 band grows.Four-panel figure. Panel a: statistical languages detected among 333 papers with retrievable code — R 88%, SPSS 12%, Stata 4%, SAS 1%. Panel b: code red flags among those 333 papers — 34% hard-code an absolute path, 40% reference a missing file — above documentation among 672 OSF-linked papers — 21% have a README, 30% are documented by README, description or wiki. Panel c: among 562 Elsevier papers with no repository link, 44% (245) host at least one journal supplementary file but only 14% (77) host data, code or an archive. Panel d: composition of those 448 hosted files — documents 52%, data 21%, media 9%, other 7%, archive 6%, code 3%, images 1%. The code panels are green, the journal-supplement panels blue.Coefficient plot (download predictors)

Dot-and-whisker plot of three standardised predictors of OSF download volume, each with a 95% confidence interval. Repository size (number of files) has the largest effect at about 0.76, citations about 0.38, and altmetric attention about 0.12. All three intervals sit entirely above zero, so each predicts more downloads, with repository size roughly twice the effect of citations and six times that of attention. X-axis: standardised effect, −0.2 to 1.0.
4264111
Reposted by Felix Thoemmes
MORPHSS @morphss.bsky.social · 16/09/2026
'The word traceability, in place of reproducibility, [...] refers to the extent to which the decisions made by the researcher are transparently documented, allowing readers to see how conclusions were reached' @maddipow.bsky.social in new paper 'Can open science speak qualitative?' ⬇️
doi.org
Can open science speak qualitative? Rearticulating open science vocabulary for qualitative research
‘Open research’ (or ‘open science’) has substantially reshaped conversations surrounding rigor, transparency, and accountability, yet its vocabulary remains largely rooted in quantitative, positivi...
03419
Reposted by Felix Thoemmes
Richard McElreath 🐈‍⬛ @rmcelreath.bsky.social · 18/09/2026
Happy to see others emphasizing traceability (Nachvollziehbarkeit) over simple reproducibility. Let’s make fetch happen!
15511
Reposted by Felix Thoemmes
Hadas Weiss @hadas.bsky.social · 18/09/2026
the "awards and honors" section of my cv
5914
Reposted by Felix Thoemmes
Michael Friendly @datavisfriendly.bsky.social · 18/09/2026
Vision science: The difference between Rod Stewart and Cone Stewart finally clarified
Two photos of the singer Rod Stewart, left: B/W labelled Rod Stewart; right: color, labelled Cone Stewart
1467
Reposted by Felix Thoemmes
Malte Elson @malte.the100.ci · 18/09/2026
No ground truth, no witnesses. Uh. Yeah. [Verse] Roll up on the dataset, don't standardize a thing, Raw units, mixed scales, let the big variable be king. Pick my k in advance 'cause I already know the story, Three clusters in the grant, so it's three, that's the glory. - Clusta Rhymes
3235
Reposted by Felix Thoemmes
Ruben C. Arslan @ruben.the100.ci · 18/09/2026
I just posted a comment on Pubpeer and a new blog post. A journalist had asked me to comment on a new menstrual cycle paper on conspicuous consumption. After a brief investigation, I found severe errors that changed the conclusions. rubenarslan.github.io/posts/2026-0...
rubenarslan.github.io
One lives only to make blunders: HIBAR: Fertility and Conspicuous Consumption
Had I Been a Reviewer.
1123
Reposted by Felix Thoemmes
Julia M. Rohrer @dingdingpeng.the100.ci · 18/09/2026
This is an *excellent* post on cluster analysis. If you ever thought about applying cluster, latent class or latent profile analysis to psychological scales, you absolutely should read this!>
511835
Reposted by Felix Thoemmes
Jan Vanhove @janhove.bsky.social · 18/09/2026
New blog post: "Cluster analysis: A skeptic’s guide". In which I ask a few questions that social scientists wishing to identify hidden classes in their data ought to address. janhove.github.io/posts/2026-0...
A two-dimensional scatterplot showing a three-cluster solution.

Caption: "Figure 2: A visualisation of a Latent Profile Analysis fit. Such visualisations may help readers appreciate that the clusters aren’t nicely separated and that the researchers’ notion of clusters may not correspond to their own."Table of contents:

Refresher: What is cluster analysis?
What are the clusters for?
What clusters, exactly?
Does the pipeline work?
What does the solution look like?
When running follow-up analyses, how is the uncertainty in the cluster assignments taken into account?
Was it worth it?
Conclusion
References
416145