iiinova — where your digital self keeps evolving

Olmo van den Akker @denolmo.bsky.social · 05/06/2026

Some examples by Dvija Mehta of how AI can shake up the foundations of science

Olmo van den Akker @denolmo.bsky.social · 05/06/2026

Big news at the META/e conference: metacheck, a promising tool for automatically extracting information from scientific manuscripts is beta-launched today. Has the potential to massively increase the efficiency of meta-science projects. www.scienceverse.org/metacheck/

scienceverse.org

Check Research Outputs for Best Practices

A modular, extendable system for checking research outputs for best practices using text search, R code, and/or (optional) LLM queries.

0136

Reposted by Olmo van den Akker

Lisa DeBruine @debruine.bsky.social · 05/06/2026

@crist14n.bsky.social presented some of the capabilities of metacheck, which has its first beta release today! See an example report that demonstrates all of the current modules. www.scienceverse.org/metacheck/re...

103

Reposted by Olmo van den Akker

Daniel Leising @leising.bsky.social · 06/05/2026

Our paper "An analysis of functional relationships between systemic conditions and unethical behavior in German academia" has just been published in Meta-Psychology: open.lnu.se/index.php/me...

open.lnu.se

LnuOpen | Meta-Psychology

1143

Reposted by Olmo van den Akker

European MS Platform @emspofficial.bsky.social · 24/04/2026

#EMSP2026 “Patient registries must reflect patients’ preferences — it all comes down to trust.” A powerful takeaway from @denolmo.bsky.social at the #EMSP2026 Conference. Watch the livestream- eu-admin.eventscloud.com/website/1909...

012

Reposted by Olmo van den Akker

Katie Corker @katiecorker.bsky.social · 07/04/2026

The governing body for 14 Dutch universities (UNL) has published a "Vision on Publication Culture" that is so inspiring and forward thinking. Worth a read for those trying to changes publishing and research assessment practices. Take a read: www.universiteitenvannederland.nl/files/public...

Screen shot of section 1.1 of the report "vision for a new publication culture"

43928

Olmo van den Akker @denolmo.bsky.social · 26/03/2026

Come join this project to study a form of peer review that focuses on the methods instead of the results. I'm already a postdoc on the team so hit me up if you have any questions!

011

Reposted by Olmo van den Akker

Platform for Young Meta-Scientists (PYMS) @youngmetascience.bsky.social · 24/03/2026

📢 New from PYMS! We're launching online lunch meetings. A chance to present your work to other metascience ECRs Share your work in any form: finished projects, preliminary results, a trial-run conference presentation, or ideas you'd love feedback on Want to present? Sign up using the form!

forms.gle

PYMS - Lunch Presentations

Between 20 and 24 April, PYMS will be hosting a series of online lunch meetings. During these sessions, you can present one of your completed research projects, an ongoing study, or early‑stage ideas ...

0610

Olmo van den Akker @denolmo.bsky.social · 10/03/2026

On 24 April, I will speak at the @emspofficial.bsky.social conference about making studies using patient registry data more transparent. It means a lot to me because a close friend was diagnosed with Multiple Sclerosis just last year. Hope to learn a lot there! #EMSP2026

040

Reposted by Olmo van den Akker

Sajedeh Rasti @sajedehra.bsky.social · 06/02/2026

You still have time to sign up for the upcoming workshop of PMGS. @denolmo.bsky.social will guide you through evaluating and writing high quality preregistration. See more and sign up here: paulmeehlschool.github.io/workshops/pr...

paulmeehlschool.github.io

Preregistration in Practice | Paul Meehl Graduate School

February 19, 2026

034

Reposted by Olmo van den Akker

Michèle Nuijten @michelenuijten.bsky.social · 03/02/2026

I wrote a blog for the Meta-Research Center expressing my infinite frustration about not getting data. What else is new, you might think? Well, I added an extra layer of annoyance directed at the journals who do NOTHING to enforce promised data sharing. metaresearch.nl/blog/2026/2/...

metaresearch.nl

Promised Data Unavailable? – I’m Sorry, Ma’am, There’s Nothing We Can Do — Meta-Research Center

This blogpost has been written by Michèle Nuijten. Michèle is an assistant professor of our research group who investigates reproducibility and replicability in psychology. Also, she is the developer ...

75937

Reposted by Olmo van den Akker

Center for Open Science @cos.io · 29/01/2026

Now available on the OSF as part of a growing collection of preregistration resources, the new EEG & ERP Methods template guides researchers through every stage of ERP study planning. In our Q&A, two of its creators share how the template can help researchers at all stages:

cos.io

Introducing the EEG and ERP Methods Template: Q&A with Gisela Govaart and Antonio Schettino

Interview with Gisela Govaart and Antonio Schettino, developers of the new ERP preregistration template on the Open Science Framework (OSF).

01610

Reposted by Olmo van den Akker

AusHSI @aushsi.bsky.social · 30/01/2026

“If fabricated studies make their way into the evidence base, they can mislead real scientists and ultimately slow progress for patients." Published in The BMJ, a new AI tool developed by @aidybarnett.bsky.social and colleagues has exposed the scale of fake studies flooding cancer research.

qut.edu.au

New tool exposes scale of fake research flooding cancer science

A new machine learning tool has identified more than 250,000 cancer research papers that may have been produced by so-called “paper mills”.

03119

Reposted by Olmo van den Akker

Peer Review Congress #PRC11 Coming 2029! @peerreviewcongress.bsky.social · 02/01/2026

#OA articles are cited more, help citizen scientists learn more about the topic they've helped on, but there’s little strong evidence they have other long-lasting effects on research, or many economic and social benefits www.science.org/content/arti... @jeffreybrainard.bsky.social @science.org

science.org

Is ‘open science’ delivering benefits? Major study finds proof is sparse

It’s hard to measure social and economic impacts of making papers and data free, researchers say

044

Olmo van den Akker @denolmo.bsky.social · 20/11/2025

Proposal to use more nicknames when talking about scientific researchers, the fun of which is nicely illustrated by James "cheaters' bane" Heathers in his acknowledgement slide. #AIMOS2025 @jamesheathers.bsky.social

050

Olmo van den Akker @denolmo.bsky.social · 18/11/2025

Slide by Lisa Bero on commercial funding of research. No further comment necessary, I think. #AIMOS2025

0112

Reposted by Olmo van den Akker

Research on Research Institute (RoRI) @rorinstitute.bsky.social · 09/09/2025

🔓 It's great to see authors sharing their experiences with publishing on MetaROR (MetaResearch Open Review) — our open review platform for metascience using the publish–review–curate model: www.openscience.nl/en/cases/the...

043

Reposted by Olmo van den Akker

Brian Nosek @briannosek.bsky.social · 04/09/2025

We are about a month away from releasing a complete refresh of the OSF user interface. The team has been working on this for a very long time, and we are very excited to be able to share it soon. A preview picture:

914830

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

Many interesting tidbits in @simine.com's talk. A selection: - Journal prestige depends on factors like aims and scope, selectivity, and impact factor, but changes in these factors do not always lead to changes in journal prestige - journal prestige is sticky #PRC10

120

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

eLife (talk by Nicola Adamson) uses a publish-review-curate method and uses common terms to assess manuscripts. For strength of evidence: exceptional, compelling, convincing, solid, incomplete, & inadequate For significance of findings: landmark, fundamental, important, valuable, & useful #PRC10

251

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

New peer review dataset incoming! Involves authors, topic area, editorial decision, author characteristics (institutional prestige, region, gender), BoRE evaluations, review characteristics (length, sentiment, z-score, reviewer gender). (Talk by Aaron Clauset) #PRC10

040

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

Christos Kotanidis checked differences in abstracts between submissions and published papers & assessed whether these differences indicated higher or lower research quality. Abstracts typically improved, especially in big five medical journals. Evidence for the effectiveness of peer review? #PRC10

010

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

Andrea Corvillon on distributed vs. panel peer review at the ALMA Observatory: Most experienced PIs no longer have the best ranks in a distributed review system, but why that is remains unclear. #PRC10

010

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

Interesting to see that the conference review process (and publishing norms) are do different in the field of computer science compared to other fields. How do these differences come about? Fundamental differences between fields or chance and inertia? #PRC10

110

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

Di Girolamo explains why the use of the phrase "to our knowledge" lacks reproducibility and accountability. Good trigger to make an edit in a grant proposal I'm writing. #PRC10

030

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

Data repurposing: taking existing data and reusing it for a different purpose. (Presentation by Yulin Yu) Studies repurposing data are at higher risk of bias, so make sure to preregister them (check here for a template): research.tilburguniversity.edu/en/publicati... #PRC10

191

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

Ian Bulovic used OpenAI's GPT to assess selective outcome reporting. Findings: - Much outcome switching but decrease over time - Industry-sponsored trials most at risk - Assessing outcome switching may seem trivial but is even hard for human coders #PRC10

100

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

A meta-perspective by Malcolm Macleod on the presentations at #PRC10. Are we going for low hanging fruit too much in research on peer review / publication?

143

Olmo van den Akker @denolmo.bsky.social · 04/09/2025

A question to kickstart day 2 of #PRC10: How would you measure the quality of peer reviews in a scientific study? Single question? Scale? How many raters? AI?

120

Olmo van den Akker @denolmo.bsky.social · 03/09/2025

Leslie McIntosh: Markers of (dis)trust in science: Pay attention to email addresses (use of hotmail.com and underscores) and institutional affiliations (new and unknown organizations without verifiable addresses) #PRC10

161

Olmo van den Akker @denolmo.bsky.social · 03/09/2025

John Ioannidis: "We need more RCTs" I agree, so here is an urgent call to the representatives of journals at #PRC10: Let's empirically test suggested improvements to peer review like open reports, open identities, structured review, results-free review, collaborative review, etc. Get in touch!

4144

Olmo van den Akker @denolmo.bsky.social · 03/09/2025

How do paper mills operate? I always thought they were in cahoots with illegitimate journals but apparently they target normal journals as well, with the editors of those journals playing no role. (Talk by Tim Kersjes from Springer Nature) Could open review reports solve this issue? #PRC10

0105

Olmo van den Akker @denolmo.bsky.social · 03/09/2025

@royperlis.bsky.social based on a study using Pangram to detect AI use in papers: "Less than 25% of authors using GenAI are disclosing its use" Why is this the case? Do people feel shame for using AI to improve their studies / papers? Do journals discourage (disclosure of) AI use? #PRC10

110

Olmo van den Akker @denolmo.bsky.social · 03/09/2025

Start of the talk by @mariomalicki.bsky.social: "Only 0.1% of journals provide some sort of open peer review" Shockingly low number for something that should be standard given that reviews are part of the scientific discourse and therefore should be public. #PRC10

120

Olmo van den Akker @denolmo.bsky.social · 03/09/2025

What do researchers use AI for? Talk by Isamme Al Fayyad on the first study from his PhD @maastrichtu.bsky.social #PRC10

000

Olmo van den Akker @denolmo.bsky.social · 03/09/2025

TIL: In biomedicine there is a thing called "medical writers" who are hired to prepare papers for publication, and write regulatory documents and grant proposals. Questions: Why aren't the researchers writing papers themselves? Should medical writers be authors on the resulting papers? #PRC10

140

Reposted by Olmo van den Akker

Daniel Lakens @lakens.bsky.social · 07/08/2025

We found that the results of 42% of registered studies on the OSF are never publicly shared journals.sagepub.com/doi/10.1177/.... Most common reasons are null results and bad logistics. Plan your studies carefully (equivalence testing and good time management) to prevent research waste!

1133

Reposted by Olmo van den Akker

Center for Open Science @cos.io · 29/07/2025

Simulation studies are widely used, but have historically lacked clear guidance around preregistration. In response to this gap, a team of researchers have developed a new template for preregistering simulation studies, now available on OSF. 🚀 Read our Q&A: www.cos.io/blog/intr...

cos.io

Introducing the Simulation Studies Preregistration Template: Q&A with Björn S. Siepe, František Bartoš, and Samuel Pawel

Initially submitted through COS’s open call for community-designed preregistration templates, the Simulation Studies Template is now part of the expanding collection of preregistration resources available on the OSF.

23514

Reposted by Olmo van den Akker

Daniel Lakens @lakens.bsky.social · 22/07/2025

New blog post: Easily download files from the Open Science Framework with Papercheck daniellakens.blogspot.com/2025/07/easi... Downloading all files in an OSF project can be a hassle. Not anymore, with Papercheck! Just run: osf_file_download("6nt4v")

daniellakens.blogspot.com

Easily download files from the Open Science Framework with Papercheck

Researchers increasingly use the Open Science Framework (OSF) to share files, such as data and code underlying scientific publications, or ...

45925

Reposted by Olmo van den Akker

MetaROR @metaror.bsky.social · 23/07/2025

When MetaROR launched at the end of last year, we published four articles. One of these has now returned to our platform for another round of peer review. 👇 Read the editorial assessment, reviews & full manuscript text at MetaROR (incl. links to the first version and first round of reviews) [1/3]

metaror.org

Peer Review at the Crossroads

242

Reposted by Olmo van den Akker

Nicolas Galtier @nicolasgaltier.bsky.social · 17/07/2025

Non-profit publishers (PLoS, Oxford, Cambridge) and publishers partnering a lot with academia (Wiley) are much more committed to open science than the others - MDPI being the worst by large. (4/5)

figure showing nine data points (each for a distinct publisher) in a graph where Y-axis is our open science index and X-axis is academia friendliness (=proportion of published journals co-owned by an academic entity); strong positive relationship

43727

Olmo van den Akker @denolmo.bsky.social · 03/07/2025

Registration now open for this big meta-science unconference in Berlin, hosted by the QUEST Center for Responsible Research! Take your pick from 10 projects to collaboratively work on a tangible output that will make science better: rr-in-action2025.org/programme/ #metascience2025

rr-in-action2025.org

Programme -

Preliminary programme overview Sept. 22, 2025 Sept. 23, 2025 Sept. 24, 2025 1 pm – 2 pmArrival 9 am – 5 pmUnconference projects 9 am – 1 pmUnconference projects 2 pm – 5 pmPre-conference workshops 7 p...

186

Reposted by Olmo van den Akker

Einstein Foundation Berlin @einsteinberlin.bsky.social · 01/07/2025

Shape research culture + practices! Join the Responsible Research in Action Unconference 2025, Sept 22–24, Berlin, to collaborate on innovative solutions – from reproducibility checks to researcher-driven funding models. rr-in-action2025.org @dfg.de @ucoimbra.bsky.social @berlinualliance.bsky.social

rr-in-action2025.org

Responsible Research | In Action -

An Unconference exploring the world of responsible research with Responsible Research in Action. Learn about ethical practices, principles, and innovations in impactful science

12217

Olmo van den Akker @denolmo.bsky.social · 03/07/2025

Be part of the future and submit your metascience work to MetaROR! #metascience2025

1175

Reposted by Olmo van den Akker

Platform for Young Meta-Scientists (PYMS) @youngmetascience.bsky.social · 02/07/2025

We had a great time at our session at #metascience2025 on Monday! We got a lot of new members and connections that joined our community over the last days. Missed our talk, and want to join PYMS or learn more? Find one of our board members at the last day of the conference!

0104

Olmo van den Akker @denolmo.bsky.social · 01/07/2025

Hot topic at the moment: AI in peer review. Ashia Livaudais from startup SymbyAI discussed this during a session on peer review at #metascience2025 Conclusion 1: the reviews of human-AI combinations were rated higher in quality than reviews of humans or AI by themselves

353