iiinova — where your digital self keeps evolving

Ben Meghreblian @benmeg.com · 28/05/2026

Great news! Nature expands Registered Reports to all fields it publishes: www.nature.com/articles/d41... RRs aim to: • mitigate publication bias • improve research quality • guard against questionable research practices • address limits of standard preregistration #openscience

Image of linked Nature article, announcing that Nature is expanding Registered Reports to all the fields in which they publish. Registered Reports are an academic publishing format which aim to: a) mitigate publication bias, b) improve research quality, c) guard against questionable research practices, and d) address limits of standard preregistration.

160

Reposted by Ben Meghreblian

Research on Research Institute (RoRI) @rorinstitute.bsky.social · 12/12/2024

Call for Proposals: Metascience 2025 Be part of the biggest Metascience meeting yet! We're inviting proposals for: ✅ Virtual symposia ✅ In-person panels ✅ Talks & posters ⏰ Submit by 7 Feb 2025 🔗 Full details: metascience.info/call-for-pro...

metascience.info

Call for Proposals - Metascience

The call for proposals for Metascience 2025 is open with a deadline of 7 February 2025.

04227

Reposted by Ben Meghreblian

Erick Turner @eturnermd1.bsky.social · 10/12/2024

Wouldn't it be nice if u could read a published pharma-sponsored clinical trial about some new drug & be confident that the results are what they appear to be? @chrisdc77 & I think it's very achievable using the @RegReports peer review model. Our proposal ⬇️ www.openpharma.blog/blog/transpa...

openpharma.blog

Leveraging Registered Reports to increase transparency in trial publication – Open Pharma - Innovations in medical publishing

Publication bias undermines the credibility of clinical trial reporting and negatively affects the reputation of pharma sponsors. Registered Reports (RR) is a peer review process designed to eradicate...

1511035

Reposted by Ben Meghreblian

Charlotte Pennington 🌻 @drcpennington.bsky.social · 06/12/2024

Happy Friday! Following on from my guide on preregistration, here is the second exciting instalment: “Registered Reports: A How-To Guide” 📖🔓 osf.io/preprints/ps... #OpenScience #OpenResearch #AStudentsGuide #Metaresearch #ResearchTraining #RegisteredReports #Preregistration #AcademicSky (1/6)

osf.io

OSF

11911

Reposted by Ben Meghreblian

Florian Naudet @floriannaudet.bsky.social · 24/11/2024

A first starting pack for metaresearch and open science now counts 150 accounts. I will star a second for those who are not in (sorry but it is difficult to be exhaustive). Please jus answer 👋 to this post. go.bsky.app/R8RNJgc

122812

Reposted by Ben Meghreblian

Center for Open Science @cos.io · 18/09/2024

We're excited to announce a major update to the Transparency and Openness Promotion (TOP) Guidelines—TOP 2025! These guidelines streamline research practices and provide greater clarity around openness in research. The preprint is now available. Your feedback is welcome! www.cos.io/blog/new-pre...

23821

Reposted by Ben Meghreblian

Carl T. Bergstrom @carlbergstrom.com · 13/08/2024

Taylorism is a management philosophy based on using scientific optimization to maximize labor productivity and economic efficiency. Here's the result of making the false Taylorist assumption that the output of scientific research is scientific papers—the more, faster, and cheaper, the better.

The AI Scientist: Towards Fully Automated
Open-Ended Scientific Discovery
Chris Lu1,2,*, Cong Lu3,4,*, Robert Tjarko Lange1,*, Jakob Foerster2,, Jeff Clune3,4,5, and David Ha1,
*Equal Contribution, 1Sakana AI, 2FLAIR, University of Oxford, 3University of British Columbia, 4Vector Institute, 5Canada CIFAR
AI Chair, Equal Advising
One of the grand challenges of artificial general intelligence is developing agents capable of conducting
scientific research and discovering new knowledge. While frontier models have already been used as aids
to human scientists, e.g. for brainstorming ideas, writing code, or prediction tasks, they still conduct
only a small part of the scientific process. This paper presents the first comprehensive framework for
fully automatic scientific discovery, enabling frontier large language models (LLMs) to perform research
independently and communicate their findings. We introduce The AI Scientist, which generates
novel research ideas, writes code....

21410164

Reposted by Ben Meghreblian

Anne Scheel @annemscheel.bsky.social · 15/05/2024

Exciting news: I will be teaching a 4-day summer school on open science this August! The course is for ECRs in the social & behavioural sciences who want to get up to speed with open & reproducible practices and/or learn how to handle specific problems. utrechtsummerschool.nl/courses/data...

utrechtsummerschool.nl

Open Science Bootcamp | Utrecht Summer School

This course offers hands-on training in transparent and reproducible research practices. These include preregistration, analysis blinding, FAIR but safe data sharing, dynamic documents, and version co...

35037

Reposted by Ben Meghreblian

PsyArXivBot @psyarxivbot.bsky.social · 26/03/2024

The Benefits of Preregistration and Registered Reports: osf.io/dqap7

033

Reposted by Ben Meghreblian

Priya Silverstein @priyasilverstein.com · 25/03/2024

Very pleased to share our new paper "A registered report survey of open research practices in psychology departments in the UK and Ireland" 🎉 doi.org/10.1111/bjop... We examined open research practices and self-reported capability, opportunity, and motivation to engage in open research practices.

13020

Reposted by Ben Meghreblian

Mark Rubin @markrubin.bsky.social · 20/03/2024

“While both replication and theory crises have caused concern for scientists and philosophers alike, the reforms that so far have resulted allow for cautious optimism.” New chapter by Tomos ap Sion & @briandavidearp.bsky.social www.researchgate.net/profile/Bria... #MetaSci #PhilSci #Methodology

064

Reposted by Ben Meghreblian

moin syed @syeducation.bsky.social · 15/03/2024

New blog post! "Preregistration: More Promises than Pitfalls," some thoughts inspired by the recent meeting at the Royal Society. I don't find many pitfalls with preregistration itself, but there are plenty of problems with how we talk about it. getsyeducated.substack.com/p/preregistr...

getsyeducated.substack.com

Preregistration: More Promises than Pitfalls

Or, maybe the real pitfalls are different from what we usually think

106942

Reposted by Ben Meghreblian

Brian Nosek @briannosek.bsky.social · 15/03/2024

New Managing Editor position! COS is conducting a research and development project on a new model of scholarly communication called Lifecycle Journals to evaluate its strengths and weaknesses and suitability for transition into a scalable and sustainable solution. jobs.lever.co/cos/1db59b80...

jobs.lever.co

Center For Open Science - Managing Editor

The Center for Open Science (COS) is seeking a founding Managing Editor for a new model of scholarly communication called Lifecycle Journals. COS has received funds to conduct a 3-year research and de...

22833

Reposted by Ben Meghreblian

Anne Scheel @annemscheel.bsky.social · 06/02/2024

Very interesting and encouraging pilot at the University of Sussex — hope this can spread to other departments and universities! h/t @deevybee.bsky.social www.ukrn.org/2024/01/30/p...

05830

Ben Meghreblian @benmeg.com · 23/01/2024

Are you a researcher? Please participate in our global survey (5-10mins) and share it with other researchers in your network - thanks! 🙏 ➡ cardiffunipsych.eu.qualtrics.com/jfe/form/SV_... #AcademicSky #metasci #PhDSky #PsychSkySci #STS 🧪

Screenshot of survey front page, explaining its aims, participant information, ethics, and contact information.

Survey aim reads:

"This survey aims to look at the extent to which the results of a research study influence publication in the peer-reviewed literature. The survey should take between 5 to 10 minutes to complete, depending on the answers you provide."

034

Reposted by Ben Meghreblian

Tom Hardwicke @tomhardwicke.bsky.social · 20/12/2023

A preliminary agenda is available for our meeting on "The promises and pitfalls of preregistration". We've also extended the submission deadline for lightning talks and posters to 29th January. Registration and submission details on the meeting website: royalsociety.org/science-even...

Advert for a Royal Society Meeting on "The promises and pitfalls of preregistration" (4-5 March, 2024). Organised by Tom Hardwicke, Marcus Munafó, Sophia Crüwell, Dorothy Bishop, and Eric-Jan Wagenmakers

44528

Reposted by Ben Meghreblian

Brendan Nyhan @brendannyhan.bsky.social · 12/12/2023

Our new review article in Current Opinion in Psychology -- Interventions to Counter Misinformation: Lessons from the Global North and Applications to the Global South authors.elsevier.com/a/1iDnO_,5MJ... Part of special issue on "The Psychology of Misinfo." www.sciencedirect.com/journal/curr...

15229

Reposted by Ben Meghreblian

Daniel Lakens @lakens.bsky.social · 18/12/2023

New preprint: When and How to Deviate from a Preregistration osf.io/preprints/ps... I hope this helps researchers to reflect on the consequence of deviations from preregistrations by evaluating the test's severity and the validity of the inference.

48945

Reposted by Ben Meghreblian

Beth Clarke @bethclarke.bsky.social · 16/12/2023

We’ve spent the last decade talking a lot about replications, but to what extent has this talk translated to a tangible change in how often replications are published in psychology journals? osf.io/preprints/ps... /w Katherine Lee, Sarah Schiavone, @mijke.bsky.social @simine.com (1/9)

osf.io

OSF

14921

Reposted by Ben Meghreblian

simine vazire @simine.com · 15/12/2023

I’m a fan of trying to quantify how often reviewers & editors check authors’ preregistrations (eg, by @syeducation.bsky.social), but also we should not forget that reviewers fail to check for deviations from a priori plans in 100% of unpreregistered studies. Because they can’t.

210633

Reposted by Ben Meghreblian

Daniel Lakens @lakens.bsky.social · 12/12/2023

Remember best practice in a power analysis is to plan not for the effect you expect, but for the smallest effect size of interest. The type 2 error is a conditional inference: If there is an effect I care about, I would have X probability to detect it. lakens.github.io/statistical_...

33510

Reposted by Ben Meghreblian

simine vazire @simine.com · 08/12/2023

Finally! New policies for Psych Science in 2024 (part 1): Editorial 1: www.psychologicalscience.org/public… Editorial 2 w/ @tomhardwicke.bsky.social : www.psychologicalscience.org/public…

psychologicalscience.org

311262

Reposted by Ben Meghreblian

moin syed @syeducation.bsky.social · 08/12/2023

New preprint! How often do editors/reviewers actually compare preregistrations to the reporting in the article? Almost never. This figure sums up all of the results. Not good.

A two-panel figure showing the rate at which editors/reviewers mention the preregistration in their reviews, indicate accessing the prereg, and directly compare the prereg to the paper. The left panel is at the article-level and shows percentages of 43, 14, and 10, respectively. The right panel is the editor/reviewer level and shows percentages of 18, 5, and 3, respectively. These are very low levels.

1210071

Reposted by Ben Meghreblian

Everything Hertz podcast @everythinghertz.com · 07/12/2023

175: Defending against the scientific dark arts We chat about a recent post from @deevybee.bsky.social, in which she proposes a Master course that will provide training in fraud detection—what should such a course teach & where would these graduates work? everythinghertz.com/175

everythinghertz.com

Everything Hertz: 175: Defending against the scientific dark arts

We chat about a recent blogpost from Dorothy Bishop, in which she proposes a Master course that will provide training in fraud detection—what should such a course specifically teach and where would ...

21914

Reposted by Ben Meghreblian

Registered Reports Community Feedback @rrcf.bsky.social · 06/12/2023

📢 Have you authored or reviewed a Registered Report? ✏️ Please give feedback about your experience (takes 5-10mins): registeredreports.cardiff.ac.uk/feedback 📊 So far authors & reviewers have given 345 pieces of feedback across 73 journals - see our dashboards! #AcademicSky #metasci 🧪

Screenshot of main website dashboard, listing journals which offer (or have offered) the Registered Reports manuscript format. Author/reviewer ratings across the speed and quality categories are aggregated, allowing website users to sort by either category.

098

Reposted by Ben Meghreblian

Ben Meghreblian @benmeg.com · 26/10/2023

Calling all researchers - please participate in our survey (5-10mins) and share with your networks - thanks! 🙏 ➡ cardiffunipsych.eu.qualtrics.com/jfe/form/SV_... #AcademicSky #metasci #PhDSky #PsychSkySci #STS 🧪

069

Reposted by Ben Meghreblian

PsyArXivBot @psyarxivbot.bsky.social · 05/12/2023

Registered Reports in Sport, Exercise, and Performance Psychology (Editorial): osf.io/rs4t2

011

Reposted by Ben Meghreblian

Steve Haroz @steveharoz.com · 30/11/2023

The ACLU filed an incredible amicus brief in defense of @datacolada.bsky.social last week. storage.courtlistener.com/recap/gov.us...

So long as they disclose the factual basis on which they rely, researchers must be free to independently opine on academic and scientific findings—including, crucially on the veracity of research methodologies, analyses, and conclusions—without fear that doing so will subject them to costly litigation. A culture where researchers self-censor ultimately deprives the public of the benefits that come with robust academic and scientific collaboration, debate, and independent
review.

25831

Ben Meghreblian @benmeg.com · 24/11/2023

For anyone interested, the website can be found here: registeredreports.cardiff.ac.uk/feedback/das... Authors/reviewers of Registered Reports manuscripts can add their feedback too!

0137

Reposted by Ben Meghreblian

Jess Butler @jessbutler.bsky.social · 21/11/2023

"NHS England has awarded the £480m contract for its federated data platform (FDP) to the US spy technology firm Palantir, in the face of opposition from the BMA, the Doctors’ Association UK, patients’ groups, and privacy campaigners" www.bmj.com/content/383/...

bmj.com

Palantir gets £480m contract to run NHS data platform

NHS England has awarded the £480m contract for its federated data platform (FDP) to the US spy technology firm Palantir, in the face of opposition from the BMA, the Doctors’ Association UK, patient...

032

Reposted by Ben Meghreblian

Jess Butler @jessbutler.bsky.social · 22/11/2023

"government is creating a new metascience unit. The unit will be jointly run across DSIT and UKRI, with an initial funding commitment of £10 million" assets.publishing.service.gov.uk/media/655e2a...

assets.publishing.service.gov.uk

053

Reposted by Ben Meghreblian

Brian Nosek @briannosek.bsky.social · 20/11/2023

Special issue: "Is psychology self-correcting? Reflections on the Credibility Revolution in Social and Personality Psychology." Edited by @simine.com and I. Check out the nine articles with diverse perspectives and approaches to examining the reform movement: spb.psychopen.eu/index.php/sp...

05342

Reposted by Ben Meghreblian

simine vazire @simine.com · 17/11/2023

A cool paper on an important topic: Questionable research practices in student projects. Students may engage in QRPs not knowing that they’re questionable, or not thinking that the data would be used for a real article. See full thread 👇 spb.psychopen.eu/index.php/spb/arti…

spb.psychopen.eu

Evading Open Science: The Black Box of Student Data Collection| Social Psychological Bulletin

03117

Reposted by Ben Meghreblian

moin syed @syeducation.bsky.social · 15/11/2023

I'm looking to recruit a new Ph.D. student for Fall 2024, particularly someone interested in meta-science, and preferably intersections with diversity/structural perspectives. Full consideration given to applicants from inside or outside the U.S. Deadline is Dec 1. cla.umn.edu/psychology/g...

cla.umn.edu

How to Apply

See detailed application information, admissions requirements, and statistics.

15662

Reposted by Ben Meghreblian

Brian Nosek @briannosek.bsky.social · 09/11/2023

Our paper "High replicability of newly discovered social-behavioral findings is achievable" appears today in Nature Human Behaviour. Just as the large replications provided an inflection point in identifying replicability challenges, this paper does so for solutions. www.nature.com/articles/s41...

29859

Reposted by Ben Meghreblian

Tom Hardwicke @tomhardwicke.bsky.social · 26/10/2023

Royal Society meeting “The promises and pitfalls of preregistration” to be held in London (and online) March 4th-5th, 2024. Free to attend. Call for posters and lightning talks now open. Details: royalsociety.org/science-even... w/ @cruwelli.bsky.social EJ Wagenmakers, Marcus Munafò & Dorothy Bishop

02323

Ben Meghreblian @benmeg.com · 26/10/2023

069

Reposted by Ben Meghreblian

Elisabeth Bik @elisabethbik.bsky.social · 25/10/2023

A big congratulations to Dr NancyOlivieri and @cbpolis.bsky.social for winning the 2023 #MaddoxPrize and #EarlyCareerMaddoxPrize from Sense About Science and Nature. Two fantastic women who stood up for good science despite lots of pushback. senseaboutscience.org/activities/m...

14610

Reposted by Ben Meghreblian

Carl T. Bergstrom @carlbergstrom.com · 08/10/2023

Erick Turner is now here at BlueSky: @eturnermd1.bsky.social He wrote a superb paper on publication bias that we discussed in our book and that now is going to be the centerpiece of a training unit on research rigor that we are developing for NIH/NINDS. Welcome, Erick.

nejm.org

Selective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy | NEJM

Special Article from The New England Journal of Medicine — Selective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy

36416

Reposted by Ben Meghreblian

Brian Nosek @briannosek.bsky.social · 04/10/2023

Open data sharing is a good thing; Protecting participant privacy is a good thing. Sometimes these two good things are in conflict. Our new preprint introduces a decision-making framework and open source tools to help share as openly as possible and as closed as necessary. osf.io/preprints/me...

26635

Ben Meghreblian @benmeg.com · 03/10/2023

Researchers! As part of my PhD, I'm collecting data to help build a better picture of how the results of a research study influence publication in the literature. The survey take 5-10mins - please participate & share with your networks: cardiffunipsych.eu.qualtrics.com/jfe/form/SV_... Thanks :)

0511

Ben Meghreblian @benmeg.com · 01/10/2023

#HiSciSky! I'm a PhD student in Metascience, focusing on the Registered Reports publishing format. Looking forward to connecting with old and new faces on here! #AcademicSky #metasci #PhDSky #PsychSkySci #STS 🧪

0405