iiinova — where your digital self keeps evolving

Randy Ellis @randalljellis.bsky.social · 23/09/2026

Here’s my conversation with Chris Chambers on Metascience Matters. Chris was the first journal editor to offer registered reports, starting in 2013 at Cortex. youtu.be/PgZjgZlxsYw?...

youtu.be

Registered reports | Chris Chambers

YouTube video by Metascience Matters

11912

Reposted by Randy Ellis

Lukas Röseler @aufdroeseler.bsky.social · 18/09/2026

I just published my German Open Science book with @uni-muenster.de's library. It contains most of what I know about open science, can be understood by undergraduates, and is free. - published PDF: www.uni-muenster.de/Ebooks/index... - Quarto version: lukasroeseler.github.io/openscienceb...

12613

Reposted by Randy Ellis

Brian Nosek @briannosek.bsky.social · 12/09/2026

The cover-up is always worse than the crime? Harvard's latest filing says that Gino manipulated a file to cover-up fabrication, hid the laptop used to do it during the discovery process, and did more [redacted] destruction of evidence after being compelled by the court to share the laptop.

38130

Reposted by Randy Ellis

Beth Clarke @bethclarke.bsky.social · 02/09/2026

Really enjoyed chatting with Randy! I highly recommend checking out his podcast if you haven’t already @metasciencematters.bsky.social

0156

Randy Ellis @randalljellis.bsky.social · 02/09/2026

Here's my conversation with @bethclarke.bsky.social, incoming Junior Professor of Psychological Metascience at the Leibniz-Institut für Psychologie. www.youtube.com/watch?v=2Hak... We discussed direct replications, how study limitations are ignored, and p-curving social and personality psychology.

youtube.com

Direct replications, P-curves, and Acknowledging Limitations | Beth Clarke

YouTube video by Metascience Matters

1199

Reposted by Randy Ellis

JsonGeller @jgeller1phd.bsky.social · 02/09/2026

Are preregs just a way for people to virtual signal now? Comparing pregregs to published papers is very sobering. Also shout out to @debruine.bsky.social and @lakens.bsky.social for metacheck and regcheck @ianhussey.mmmdata.io for making this easy!

5175

Reposted by Randy Ellis

vincentholst.bsky.social @vincentholst.bsky.social · 13/08/2026

In 2023, @nature.com published 'Papers and patents are becoming less disruptive over time', receiving world-wide media attention. Our Matters Arising, published after a 32 month delay (more on that soon), shows that the reported decline can largely be attributed to dataset artefacts. 🧵

The average CD_5 index per year for Web of Science. The original Park et al. decline (top curve) becomes essentially flat (bottom curve) when removing papers with CD_5=1. Those papers largely correspond to dataset artefacts.

9352173

Reposted by Randy Ellis

Gilad Feldman @giladfeldman.bsky.social · 21/07/2026

Looking for open-science and meta-research events? Been tracking these in the past month, manual and automated. Encouraging to see that there are quite a few. If you want to see what I'm keeping track of: metaventory.vercel.app/events?view=...

3199

Reposted by Randy Ellis

Brian Nosek @briannosek.bsky.social · 20/07/2026

Metascience 2027 is scheduled for June 14-16 in Montreal. We are delighted to partner with the Tanenbaum Open Science Institute for this important meeting. Join the mailing list for updates at: metascience.info

metascience.info

Metascience 2027

A global gathering for knowledge sharing, community building, and opportunities to define a roadmap of research and intervention priorities to improve science.

12613

Randy Ellis @randalljellis.bsky.social · 15/07/2026

Massive fraud, ESP, and a roadmap of misconduct - 2011-2012 was a big time for psychology. Diederik Stapel had a career's worth of fraud exposed. Daryl Bem published a study claiming ESP is real. A trio of researchers detailed how to find support for any hypothesis.

030

Randy Ellis @randalljellis.bsky.social · 15/07/2026

The call of metascience - Brian Nosek learned in grad school that science is actually about getting papers and grants, but reading luminaries in the field enlightened him to the solutions to the problems he encountered.

082

Randy Ellis @randalljellis.bsky.social · 13/07/2026

Brian Nosek has led some of the most impactful replication projects in psychology. Hear him tell the story of how he switched his undergrad focus from computer engineering to psychology, and how he ported his computational skills to his newfound research discipline.

151

Randy Ellis @randalljellis.bsky.social · 12/07/2026

What is the future of science? Let's imagine that more research is rigorous, incentives for positive data are fixed, and publish or perish is a thing of the past. What does that world look like? How is the academic career trajectory reimagined? Tim Errington gives his thoughts.

031

Reposted by Randy Ellis

Lukas Röseler @aufdroeseler.bsky.social · 03/07/2026

I asked Claude to boil down my conversation with @randalljellis.bsky.social on his podcast Metascience Matters to its absolute essence so here is an 80 minutes conversation in two minutes with all the instances of us saying "replicate" and "reproduce". youtu.be/KgCsCR1vbK8

youtu.be

Replication Supercut

YouTube video by Replications, Replications

162

Reposted by Randy Ellis

Lukas Röseler @aufdroeseler.bsky.social · 29/06/2026

I really like @randalljellis.bsky.social's conversations for being about things that you would not read in a paper and I was honored to be one of his guests. We talked about replications, publishing, research assesment, @r2journal.bsky.social, @forrt.bsky.social, power posing, and many more things.

052

Randy Ellis @randalljellis.bsky.social · 27/06/2026

From Chapter 1 of the new Bayesian Workflow book by @statmodeling.bsky.social, @avehtari.bsky.social, @rmcelreath.bsky.social. Two chapters in it already feels like the BDA-SR synthesis the world needed.

091

Reposted by Randy Ellis

Randy Ellis @randalljellis.bsky.social · 26/06/2026

Open science for the weekend! Here's my conversation with Lukas Röseler, Managing Director of the Münster Center for Open Science at the University of Münster. We discussed his experience leading a department dedicated to open science, youtu.be/PSVNZ-OFj3U?...

youtu.be

Replication research, diamond open access publishing | Lukas Röseler

YouTube video by Metascience Matters

183

Randy Ellis @randalljellis.bsky.social · 26/06/2026

youtu.be

Replication research, diamond open access publishing | Lukas Röseler

YouTube video by Metascience Matters

183

Reposted by Randy Ellis

Daniel Lakens @lakens.bsky.social · 26/06/2026

What is interesting about psychology is that they did the whole replication crisis one time before in the 1970s. It is so similar to the 2010 one, you would not be able to tell if a paper on the replication crisis was published in 1972 or 2012. See rips-irsp.com/articles/10....

rips-irsp.com

Concerns About Replicability Across Two Crises in Social Psychology | International Review of Social Psychology

45920

Reposted by Randy Ellis

Michael Okun @michael-okun.bsky.social · 10/06/2026

I’ve officially resigned as Associate Editor for Frontiers in Systems Neuroscience. It used to be a reputable journal, but became a case study in how forced automation destroys academic integrity. 👇

5435871430

Reposted by Randy Ellis

Reese Richardson @reeserichardson.bsky.social · 06/06/2026

Thermo Fisher now has a page up in response to our observations. They flatly deny that images were manipulated or fabricated while repeating that images were "optimized for presentation and clarity on the website", no lie, six times. www.thermofisher.com/us/en/home/l...

thermofisher.com

1917577

Reposted by Randy Ellis

Tamar Haspel @tamarhaspel.bsky.social · 04/06/2026

I don't get why this is a big deal. Why can't we have exploratory results, clearly labeled and separate from registered results, and treated accordingly?

151

Reposted by Randy Ellis

Richard McElreath 🐈‍⬛ @rmcelreath.bsky.social · 28/05/2026

Thinking about how this might go Listener: My chains aren't converging Andrew: Your model is bad Aki: Your parameterization is bad Richard: The Buddha teaches us that numerical integration is suffering

215725

Randy Ellis @randalljellis.bsky.social · 27/05/2026

Happy to share my conversation with Alexander Gibson about unreliable datasets and why they're so damaging to science! youtu.be/blNIZKYKo_Q Alex's work was recently covered at Nature: www.nature.com/articles/d41...

youtu.be

Data Provenance in Medical Machine Learning | Alexander Gibson

YouTube video by Metascience Matters

140

Reposted by Randy Ellis

Nature @nature.com · 27/05/2026

Registered Reports improve the credibility of scientific claims by rewarding big questions, sound methods and solid analyses. They need to become a standard tool in research. go.nature.com/4dP1rwk

go.nature.com

Nature is expanding Registered Reports to all the fields in which we publish

Registered Reports improve the credibility of scientific claims by rewarding big questions, sound methods and solid analyses. They need to become a standard tool in research.

15624

Randy Ellis @randalljellis.bsky.social · 13/05/2026

What's wrong with peer review? We are obsessed with "narrative", replacing the science with the story. Devaluing the paper in favor of a researcher’s contribution is the first step to fixing this. #science #research #stem #metascience #ethics

130

Randy Ellis @randalljellis.bsky.social · 12/05/2026

Why AI for Science Will Never Work Training AI on scientific literature is a "Garbage In, Garbage Out" trap of 1) false positive data, and 2) lack of null data. Firms are spending millions to redo experiments because they don't trust the literature. #AI #MachineLearning #Science #Research #STEM

120

Randy Ellis @randalljellis.bsky.social · 12/05/2026

“The United Kingdom should establish a committee to monitor efforts by the nation’s universities to properly conduct misconduct investigations, a parliamentary inquiry recommends.” Removing incentives for positive data >> better policing of research misconduct The latter is the War on Drugs model.

010

Randy Ellis @randalljellis.bsky.social · 11/05/2026

How to Fix Peer Review Open data, predicting replicability, checking antibody validation, and not treating peer review as a simple binary are among the new initiatives at @cos.io and their new platform, LifeCycle Journal. #science #biology #stem #research #publishing

174

Randy Ellis @randalljellis.bsky.social · 10/05/2026

Why are drug costs so high? Part of the reason is low replicability rates in preclinical research. Tim Errington breaks down the "clinical vs. preclinical" divide and where different types of institutions fit in the translational ecosystem. #Metascience #Innovation #Academia #DrugDiscovery

121

Randy Ellis @randalljellis.bsky.social · 09/05/2026

Science Has Too Many Pet Theories, Not Enough Falsification Science rewards positive findings, but how do we decide what not to keep pursuing? “Fail faster” research models may make science more reliable. #ReplicationCrisis #Falsification #OpenScience #ScientificMethod #MetaScience

131

Randy Ellis @randalljellis.bsky.social · 08/05/2026

The "magical" science scam Why do scientists always get the results reviewers want? The Center for Open Science is introducing Registered Reports at the revision stage to bring transparency to peer review #science #research #stem #ethics #registeredreports

121

Randy Ellis @randalljellis.bsky.social · 07/05/2026

Part 2. Registered reports remove the incentive for positive data (the original sin of science). Publication is conditional on following peer-reviewed methodology, not having "novel" results or p<0.05. This is Part 2, check out Part 1 if you missed it. #science #research #stem #ethics #podcast

1167

Randy Ellis @randalljellis.bsky.social · 06/05/2026

Registered reports remove the incentive for positive data (the original sin of science). Publication is conditional on following peer-reviewed methodology, not having "novel" results or p<0.05. This is Part 1 of this clip, stay tuned for Part 2. #science #research #stem #ethics #podcast

110

Randy Ellis @randalljellis.bsky.social · 05/05/2026

Why Science is like The War On Drugs Positive data -> Papers -> Grants Scolding one bad apple won't fix a system that rewards noise over truth. We can’t just attack individual fraud; we have to enable a global change in how science is practiced. #science #research #stem #ethics

100

Reposted by Randy Ellis

JJ @jjodx.eurosky.social · 05/05/2026

This is what happens when the primary goal is the individual one of making a career instead of the societal one of discovering the scientific truth.

131

Reposted by Randy Ellis

Clare Conry-Murray, Ph.D. @cconrymurray.bsky.social · 05/05/2026

Yeah, I think people know data fabrication is fraud. But selective reporting to make the effect size seem larger is not seen as fraud, even though it has a terrible effect on science.

171

Reposted by Randy Ellis

Dorothy Bishop @deevybee.bsky.social · 05/05/2026

it’s all about sins of omission seeming OK, whereas sins of commission seem more culpable

151

Reposted by Randy Ellis

Clare Conry-Murray, Ph.D. @cconrymurray.bsky.social · 05/05/2026

People justify selective reporting like this by saying (1) they need to support early career researchers, and/or (2) they don't want to have to cut staff. But the harm from bad science--especially when it becomes the norm--is larger than than impact on one lab.

021

Reposted by Randy Ellis

Austen Lamacraft @austen.uk · 05/05/2026

Apart from careerism, I think that part of the story here is our core scientific dogma that big robust phenomena exist and it’s our job to uncover them. Once you’ve bought into that it’s not too difficult to start selecting the data that show the sought-for effect in the cleanest way

132

Reposted by Randy Ellis

Richard McElreath 🐈‍⬛ @rmcelreath.bsky.social · 05/05/2026

The normative fraud that Errington describes is something I've seen my whole career. A biologist once told me, if p is very small, it can't be a false positive. Teams condition on null being false, see anything that makes p small as truth-seeking. These traditions spread bc they get you published.

still from quoted video with caption "It's a norm in the field." Where "it" in context means data fraud.

16919

Randy Ellis @randalljellis.bsky.social · 04/05/2026

SHOCKING stories of data fabrication Tim Errington shares a never-before-told story of data fabrication in cancer biology. Scientists go to extreme measures, even engaging in data fabrication, to secure a publication in prestigious journals. #science #truth #medicine #stem #shorts

83314

Randy Ellis @randalljellis.bsky.social · 03/05/2026

The need for positive data is the original sin of science. To exist in science, you need grants. To get grants, you need to publish papers. To publish papers, you need positive data. This leads to null data staying in file drawers, and false or misleading positive data being published.

153

Reposted by Randy Ellis

Amirreza Bahramani @amir137.bsky.social · 30/04/2026

For many Iranian students, Neuromatch was one of the few bridges to the international neuroscience community. Iranian students and TAs have contributed so much to it. Many of us, including me, found neuroscience through Neuromatch. This decision by Trump’s gov is cruel, unjust and a loss for science

14712

Reposted by Randy Ellis

Konrad Kording @kordinglab.bsky.social · 30/04/2026

Neuroscience is a global endeavor whose main promise is curing the many brain related diseases. Global collaboration is the key to that. I am so sad that our Iranian friends will, once again, be excluded.

25512

Randy Ellis @randalljellis.bsky.social · 22/04/2026

Here’s my conversation with Charles Piller, investigative correspondent at Science, and author of Doctored. We discussed his reporting, reactions from the field, his process working with a team of sleuths, and his opposition to the Trump administration’s attacks on science.

110

Reposted by Randy Ellis

Aki Vehtari @avehtari.bsky.social · 07/04/2026

More details about the Bayesian Workflow book and case studies now available on the book web site avehtari.github.io/Bayesian-Wor... (but you still need to wait a bit for the book)

avehtari.github.io

Bayesian Workflow book: Website – Bayesian Workflow book

210328

Reposted by Randy Ellis

Brian Nosek @briannosek.bsky.social · 01/04/2026

It was great fun to chat with Randy about metascience and replicability. Check out his podcast!

031