iiinova — where your digital self keeps evolving

Reposted by Daniel Lakens

Peer Community In @peercommunityin.bsky.social · 21h

It’s today! Join us today for a webinar with Daniël Lakens on: “Essential aspects of well-designed studies” 🕐 4 PM (GMT+1) 👉 Register now and find out more: univ-cotedazur.zoom.us/meeting/regi... More information on PCI Webinar series: peercommunityin.org/pci-webinar-...

univ-cotedazur.zoom.us

https://univ-cotedazur.zoom.us/meeting/register/IMJIOCUDSzajhO6qQFXYqQ

063

Reposted by Daniel Lakens

Matthew Russell @matteomics.bsky.social · 28/09/2026

Sometime the real potential benefit of "reproducibility" is really auditability. The possibility of laying out the data and the steps for critical appraisal. The reproducibility makes that audit possible, it is not a magic test on its own.

081

Reposted by Daniel Lakens

ingmarvisser.bsky.social @ingmarvisser.bsky.social · 28/09/2026

New paper 🍼📄 ManyBabies 3 is out (open access, registered report in Developmental Science). 30 labs, 33 languages, 839 infants set out to replicate a textbook finding: 7-month-olds learn abstract rules from speech (@garymarcus.bsky.social et al., 1999). We didn’t find it. 🧵

37646

Reposted by Daniel Lakens

Marek Vranka @mvranka.bsky.social · 26/09/2026

no need for AI to be better at peer review than humans, it could complement human reviewers especially in parts humans suck at / are too lazy to do thouroughly - like checking reporting, stats, preregistration deviations etc. let's leave the "not original enough" judgment for human Rev 2...

162

Reposted by Daniel Lakens

Peer Community In @peercommunityin.ecoevo.social.ap.brid.gy · 21/09/2026

Don’t miss our next PCI Webinar! Join us for a webinar with Daniël Lakens on: “Essential aspects of well-designed studies” 📅 October 1st | 🕐 4 PM (GMT+1) Want to learn more about the quality of science, sample size justifications and best pratices in science? Join the discussion and discover […]

ecoevo.social

Original post on ecoevo.social

012

Reposted by Daniel Lakens

Constantin Späth @cspaeth.bsky.social · 19/09/2026

Great thoughts on replications! @uyguntunc.bsky.social I’d vote for an additional educational version that is, as far as possible, jargon-free and suitable for undergraduate students. :) bsky.app/profile/phil...

152

Reposted by Daniel Lakens

Dan Quintana @dsquintana.bsky.social · 19/09/2026

New preprint! 🎉 I analysed 1660 papers from 4 psychology journals and found materials sharing went from 9% of papers in 2015 to 82% in 2025, and these materials *do* get downloaded — a median of 135 times each. BUT shared code is often hard to run. doi.org/10.31234/osf... Let's walk through it 🧵

Two-panel figure. Panel a is a flow diagram tracking 1,611 empirical psychology articles from publication year (545 in 2015, 552 in 2020, 514 in 2025) to repository-link type: 785 link an OSF project, 85 link another platform, and 741 link no repository. Of those with an OSF link, download counts were retrieved for 670 and not retrieved for 115. Panel b is a line chart of the share of empirical papers linking OSF across 2015, 2020 and 2025. The overall rate, shown as a dashed black line, rises from 9% to 57% to 82%. All four journals rise steeply and end close together: Psychological Science 92%, JESP 89%, JML 83%, Cognition 76%, with Psychological Science highest throughout.

Three-panel figure. Panel a: ridgeline plot of downloads per file by material type on a log scale, with the percentage never downloaded labelled for each — archive 16% of 545 files, documents 20% of 2,970, code 12% of 3,471, other 17% of 1,646, data 21% of 10,051, media 35% of 2,120, images 35% of 4,102. Most files cluster between 1 and 10 downloads, with long right tails past 100. Panel b: ridgeline plot of downloads per paper by journal, log scale, with dashed median lines; Psychological Science is highest, then JESP, JML and Cognition. Panel c: stacked bars showing, for documents, data and code separately, the share of papers by download band (0, 1–10, 11–100, more than 100) in 2015, 2020 and 2025. The share exceeding 100 downloads falls sharply over time in all three types, from roughly two-thirds in 2015 to a quarter or less in 2025, as the 1–10 band grows.

Four-panel figure. Panel a: statistical languages detected among 333 papers with retrievable code — R 88%, SPSS 12%, Stata 4%, SAS 1%. Panel b: code red flags among those 333 papers — 34% hard-code an absolute path, 40% reference a missing file — above documentation among 672 OSF-linked papers — 21% have a README, 30% are documented by README, description or wiki. Panel c: among 562 Elsevier papers with no repository link, 44% (245) host at least one journal supplementary file but only 14% (77) host data, code or an archive. Panel d: composition of those 448 hosted files — documents 52%, data 21%, media 9%, other 7%, archive 6%, code 3%, images 1%. The code panels are green, the journal-supplement panels blue.

Coefficient plot (download predictors)

Dot-and-whisker plot of three standardised predictors of OSF download volume, each with a 95% confidence interval. Repository size (number of files) has the largest effect at about 0.76, citations about 0.38, and altmetric attention about 0.12. All three intervals sit entirely above zero, so each predicts more downloads, with repository size roughly twice the effect of citations and six times that of attention. X-axis: standardised effect, −0.2 to 1.0.

4265113

Daniel Lakens @lakens.bsky.social · 18/09/2026

Lovely day at the start-up meeting for OpenScienceNL funded projects at Leiden. Great day for networking, and being inspired by what Dutch (meta)scientists are up to.

040

Reposted by Daniel Lakens

Jan van Gemert @jvgemert.bsky.social · 14/09/2026

Our fifth workshop on Meta-science for Machine Learning is on Sept 22. metascienceforml.github.io Registration info in the link.

metascienceforml.github.io

Metascience for Machine Learning

A repository for collecting information about Metascience for machine learning.

044

Reposted by Daniel Lakens

European Journal of Political Research @ejprjournal.bsky.social · 16/09/2026

Research is strongest 💪 when others can understand, evaluate, and build on it 🏗️ That's why our new Reproducibility Guidelines provide clear guidance on transparency, data, code, and research material requirements 🤩 Read the policy here: buff.ly/SdtAPcB

cambridge.org

Research transparency

Welcome to Cambridge Core

033

Reposted by Daniel Lakens

Johannes Breuer @johannesbreuer.com · 16/09/2026

Keynote by @lakens.bsky.social + roundtable w/ Hella von Unger & Christian Merz. 📍 @cais-research.bsky.social (Bochum, Germany) & online 🔗 Further info & registration: eveeno.com/320501318

eveeno.com

Symposium: More than compliance checks and harm prevention?

033

Reposted by Daniel Lakens

Horizons Magazine @horizons-en.bsky.social · 16/09/2026

Both basic and applied research suffer from overpromising rhetoric, says integrity researcher and psychiatrist Joeri Tijdink. He calls for more honest communication in which #reliability, #rigour and #reproducibility are the main product of science. 👇 www.horizons-mag.ch/2026/09/03/a...

horizons-mag.ch

Admitting uncertainty is the real breakthrough

Horizons (EN) - Back to basic research

0115

Reposted by Daniel Lakens

Daniel Lakens @lakens.bsky.social · 15/09/2026

we discuss how 1) most scientists would agree with the problems in the 'Science: A Golden Age' document if you didn't tell them the Trump administration wrote it, and 2) there are only 3 or 4 references to actual metascientists (from 170+ references). They didn't need any of our work.

131

Reposted by Daniel Lakens

Daniel Lakens @lakens.bsky.social · 15/09/2026

The fact that 2 different continents (Europe and the US) respond so differently to exactly the same literature should be a very important datapoint for the people trying to accuse metascientists of 'giving ammunition' to the US Government. Also, in nulliusinverba.podbean.com/e/episode-82...

nulliusinverba.podbean.com

Episode 82: Scientia: Nova Aetas Aurea | Nullius in Verba

In this episode, we will reflect on how governments should support science, from the 1945 policy report Science: The Endless Frontier by Vannevar Bush, and then move on to the recent policy document b...

171

Reposted by Daniel Lakens

Daniel Lakens @lakens.bsky.social · 15/09/2026

I think it *is* worth noting that metascientists who point out systemic lack of statistical power, publication bias, and analytic flexibility (as people have done since the 1960's) is a real problem that reduces reproducibility more than scientists themselves consider desirable is *fine*.

111

Daniel Lakens @lakens.bsky.social · 15/09/2026

This is such a nice thread about whether metascientists have provided ammunition to US Government (ignoring how in Europe, the same metascience has just led to widespread improvements) where 2 people have an actual nuanced discussion about the topic (so rare) I just wanted to highlight it. 😍

191

Daniel Lakens @lakens.bsky.social · 15/09/2026

On the 1st of October I will give a talk on sample size justification for the PCI webinar series. I'll discuss the importance of considering a smallest effect size of interest when planning a study, and how to use sequential designs when there is uncertainty. peercommunityin.org/pci-webinar-...

peercommunityin.org

PCI Webinar Series - Peer Community In

The PCI webinar series is a series of seminars on research practices, publication practices, evaluation, scientific integrity, meta-research, organised by Peer Community In

0149

Reposted by Daniel Lakens

eLife @elife.bsky.social · 15/09/2026

Working on a replication study? Publish it with eLife. We publish Replication Studies as part of our commitment to reproducibility and transparency in science. buff.ly/3fmaWfl

0185

Reposted by Daniel Lakens

Daniel Lakens @lakens.bsky.social · 14/09/2026

Two weeks left to sign up for the Meta-Research Symposium 2026 organized by the Paul Meehl Graduate School paulmeehlschool.github.io/2026-08-04-s... If you've attended previous years, you know this is a lovely day full of cutting edge meta-science, and a great opportunity to network.

paulmeehlschool.github.io

Registration Now Open: Meta-Research Symposium 2026 | Paul Meehl Graduate School

We are delighted to announce that registration is now open for the third Paul Meehl Graduate School Meta-Research Symposium! In...

0149

Reposted by Daniel Lakens

PCI Archaeology @pciarchaeology.bsky.social · 14/09/2026

Do not hesitate to register for the next @peercommunityin.bsky.social webinar by @lakens.bsky.social! We all need more information on how to correctly design a study (maybe even more in archaeology... sample size... you know...): peercommunityin.org/pci-webinar-...

peercommunityin.org

PCI Webinar Series - Peer Community In

The PCI webinar series is a series of seminars on research practices, publication practices, evaluation, scientific integrity, meta-research, organised by Peer Community In

053

Daniel Lakens @lakens.bsky.social · 14/09/2026

paulmeehlschool.github.io

Registration Now Open: Meta-Research Symposium 2026 | Paul Meehl Graduate School

We are delighted to announce that registration is now open for the third Paul Meehl Graduate School Meta-Research Symposium! In...

0149

Reposted by Daniel Lakens

Ian Hussey @ianhussey.mmmdata.io · 13/09/2026

Article now retracted. Retraction notice focuses on data sharing, but doesn't mention - the ethics review body is the author's own company - the tech used to to collect the data by intercepting users' LLM prompts does not exist ht @grinschglsandra.bsky.social psycnet.apa.org/fulltext/202...

psycnet.apa.org

APA PsycNet

511435

Reposted by Daniel Lakens

Matthew B. Jané @matthewbjane.bsky.social · 13/09/2026

I’ve been quiet on social media lately, but today I’m launching Audit Clinical Evidence (ACE), an initiative I’ve been developing over the past year. Take a look: AuditClinicalEvidence.org

auditclinicalevidence.org

ACE

Independent audits of published clinical research for statistical errors, data inconsistencies, and research integrity violations.

89132

Reposted by Daniel Lakens

Brian Nosek @briannosek.bsky.social · 12/09/2026

The cover-up is always worse than the crime? Harvard's latest filing says that Gino manipulated a file to cover-up fabrication, hid the laptop used to do it during the discovery process, and did more [redacted] destruction of evidence after being compelled by the court to share the laptop.

38130

Daniel Lakens @lakens.bsky.social · 12/09/2026

AI makes a lot of things more transparent. Researchers who didn't read what they cite, now have fake references. People who didn't write good articles, now have AI written text. And, also, researchers who had rather uninformed opinions, now have really uninformed opinions about AI.

0241

Reposted by Daniel Lakens

Bryan Gee @koskinonodon.bsky.social · 11/09/2026

SI is truly the bane of research data librarians' jobs, and then many journals also lazy on their sharing policies and let people put all the data/code, not just appendices, supp figs, etc., in SI + the large publishers who automatically funnel the SI to figshare without telling authors 🙃

071

Reposted by Daniel Lakens

Felipe Fontana Vieira @felipefv.bsky.social · 11/09/2026

Next week I will give a free webinar about how I have been using Nix (by itself) but mainly through {rix} for my current articles. If anyone is intested, my plan for the structure of the webinar (in the comments):

11913

Reposted by Daniel Lakens

Dr Beth @drbeth.bsky.social · 11/09/2026

100% - if you share things as supplemental data at the Crick it's not data sharing according to our policy. Because it's nearly always in a form that's difficult to use (tables as pdfs etc.)

161

Reposted by Daniel Lakens

Thomas Kesteman🦠🧫🔬🌏 @tomk.eurosky.social · 11/09/2026

2️⃣Aren’t you afraid that, by starting a blame game between us scientists, we just risk to play more cards into the hands of those who are already attacking us? Instead of pointing fingers at each other, shouldn’t focus on pointing all fingers at those who are actually assaulting us?😬 Thanks! 🙏

131

Reposted by Daniel Lakens

Ingo Rohlfing @ingorohlfing.bsky.social · 11/09/2026

100%. There is no reason to treat a supplement differently than code and data. Some journals insist on hosting the supplement on the article website. I would still include a DOI for the supplement in the paper to be on the safe side.

071

Daniel Lakens @lakens.bsky.social · 11/09/2026

Journals should stop offering to store supplemental information. Everything that is shared with a paper should have it's own DOI, and live in a proper repository. As authors, link to files (e.g., Zenodo), but never add them as supplemental files.

5469

Reposted by Daniel Lakens

Ruben C. Arslan @ruben.the100.ci · 11/09/2026

An interesting thing is happening to me at the moment. I have a standing bug bounty policy for my first authored scientific work. That means, I've committed to pay people who report bugs in my code, up to 750€ for severe errors. Since GPT-6 Astra came out, I'm now getting several bug reports daily.

39234

Reposted by Daniel Lakens

Jamie Cummins @jamiecummins.bsky.social · 10/09/2026

Machine learning and generative LLMs are subject to many of the same drawbacks and issues as general empirical research in the typical publishing system. In this piece now published at NHB we argue that, like for empirical research, ML and LLMs can benefit from the use of Registered Reports.

02210

Reposted by Daniel Lakens

Casper Albers 🟥 @casperalbers.nl · 11/09/2026

The booklet starts with a quote by Zimbardo. 🤷 Stunning to see how much the field has changed in 25 years. If other fields of science had similar levels of self-reflection as psychology, science would be in a much better place

092

Daniel Lakens @lakens.bsky.social · 11/09/2026

I think that one reason why psychologists are interested in metascience is that you are trying to improve a system full of scientists who don't want to be told what to do.

0102

Reposted by Daniel Lakens

Katie Corker @katiecorker.bsky.social · 09/09/2026

Looking forward to the public launch of the PRC Alliance - hope you can join us!

063

Reposted by Daniel Lakens

Per Engzell @pengzell.bsky.social · 09/09/2026

Two Assistant Professorships in Sustainability Studies at Uni Twente: Position 1: Social science, quant and qual methods, participatory approaches, co-creation. Position 2: Spatial data science, quant methods, modelling incl ABM, dataviz. Apply by 30 Sep www.academictransfer.com/en/jobs/3638...

0912

Reposted by Daniel Lakens

Dalmeet Singh Chawla @dalmeet.bsky.social · 08/09/2026

This week, @nature.com features the World Bank's reproducibility project, under which the Bank is publishing 'reproducibility packages' alongside all their reports, papers and technical notes. www.nature.com/articles/d41...

nature.com

The World Bank is right to prioritize reproducibility

The development bank and others are starting to publish and verify the raw data and code accompanying their research-based reports and papers. Other agencies should do the same.

0189

Reposted by Daniel Lakens

Allison Lombardi @allisonlombardi.bsky.social · 08/09/2026

The latest issue of CDTEI 49(3) is all about #Preregistration. All articles included in this issue were preregistered and many include open data and materials in the spirit of #OpenScience. We also feature an In Memoriam piece on Michael J. Ward. Check it out journals.sagepub.com/doi/epub/10....

journals.sagepub.com

Sage Journals: Discover world-class research

Subscription and open access journals from Sage, the world's leading independent academic publisher.

042

Reposted by Daniel Lakens

European Journal of Political Research @ejprjournal.bsky.social · 08/09/2026

We’ve introduced our new reproducibility guidelines to fuel transparency and strengthen #PoliSci research! 📊 Over the coming weeks, we want to share more about the guidelines, what they mean for authors, and what’s changing 🆕 Why not have a look here first 📰 👉️ buff.ly/W91rjHA

buff.ly

EJPR introduces new reproducibility guidelines

European Consortium for Political Research

093

Reposted by Daniel Lakens

Quentin André @quentinandre.bsky.social · 08/09/2026

Hilarious stuff from hypocrite-in-chief Bill Ackman, currently bankrolling Francesca Gino, who has *check notes* sued three brave scholars for telling the truth.

511928

Reposted by Daniel Lakens

Ana Martinovici @anamartinovici.bsky.social · 07/09/2026

I am giving a workshop on "good (enough) practices for computational reproducibility" tomorrow. Can't wait to share how much fun it is to use Git

static.klipy.com

Elaine Benes' Excited Celebration

ALT: Elaine Benes' Excited Celebration

3213

Reposted by Daniel Lakens

CHORUS @chorusaccess.bsky.social · 07/09/2026

Data availability builds trust and supports reproducibility in research. With our centralized resource for publisher data policies, CHORUS helps you uphold the highest standards of research integrity: chorusaccess.org/resources/chorus-for-publishers/publisher-data-availability-policies-index

011

Reposted by Daniel Lakens

Jeff Clements 🦪 @biolumijeffence.bsky.social · 04/09/2026

Back in 2020, I candidly wrote about how harsh reviewer comments questioning some of my results drove extreme imposter syndrome and a severe bout of anxiety and depression that had me questioning my very existence as a PhD student (see doi.org/10.1038/d415...).

doi.org

Is the reproducibility crisis fuelling poor mental health in science?

An inability to focus during a weekend trip forced Jeff Clements to ponder often-overlooked drivers of academic mental health.

131

Daniel Lakens @lakens.bsky.social · 04/09/2026

Such a creative way to study selection bias. Honestly, is there any place in academia where selection bias is not operating? It seems like the air we breathe - except, it's like toxic air that prevents you from seeing reality clearly.

0100

Reposted by Daniel Lakens

Gordon Hodson @gordonhodsonphd.bsky.social · 03/09/2026

#AcademicSky #PsychSciSky #MetaScience Article worth reading, & sharing w/ your student researchers. Can't get this out of my head: "Bishop’s law: The better designed a study is, the more likely it is to obtain a null result" journals.sagepub.com/doi/10.1177/... Meimoun & @lakens.bsky.social

310134