Sign in

Research on Research Institute (RoRI)

@rorinstitute.bsky.social
3K followers 455 following 261 posts

RoRI’s mission is to accelerate transformational research on research systems, cultures & decision-making.

PostsRepliesMedia
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 24/09/2026
Join us on 16 Nov for our rescheduled webinar on how Narrative CVs are reshaping research evaluation in practice: www.eventbrite.co.uk/e/how-narrat... We'll share empirical findings from inside European funding panels and launch our new practical guide for funders.
011
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 24/09/2026
The second issue of Meta Morsels by @scurry.bsky.social is live on RoRI's Substack, where we've gathered a selection of new writing on AI’s impact on social science, open-source hardware, and a proposed global panel on inequality: researchonresearchinstitute.substack.com/p/meta-morse...
researchonresearchinstitute.substack.com
Meta Morsels 2
A selection of new and notable writing on metascience
002
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 21/09/2026
As a new Google study reveals the limits of AI productivity in labs, RoRI’s Basil Mahfouz speaks to @resprofnews.bsky.social on how review and validation bottlenecks risk driving less diverse, less innovative science: www.researchprofessionalnews.com/rr-news-worl...
researchprofessionalnews.com
AI saves scientists seven hours a week, Google paper finds - Research Professional News
But study also highlights extra time spent verifying AI-generated results and push towards “safer” projects
010
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 17/09/2026
We’re launching Meta Morsels, a new series sharing think pieces from across our field that made us stop and think. First up, @scurry.bsky.social gathers 3 insightful reads on human friction, AI narratives, and science policy: researchonresearchinstitute.substack.com/p/meta-morse...
researchonresearchinstitute.substack.com
Meta Morsels 1
A selection of new and notable writing on metascience
001
Reposted by Research on Research Institute (RoRI)
Stephen Curry @scurry.bsky.social · 17/09/2026
*NEW* on the @rorinstitute.bsky.social Substack - the first of an occasional series of posts highlighting recent articles, essays etc to whet the appetite of people with a taste for research on research. researchonresearchinstitute.substack.com/p/meta-morse...
researchonresearchinstitute.substack.com
Meta Morsels 1
A selection of new and notable writing on metascience
042
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 16/09/2026
Can applicants serve as effective reviewers for grant competitions? Our study with @volkswagenstiftung.de in Research Integrity and Peer Review evaluates a live trial of Distributed Peer Review (DPR) vs traditional panels. Read the open-access paper: doi.org/10.1186/s410...
193
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 15/09/2026
Measure the soil before the fruits fail. 🌱 Researcher wellbeing is a leading indicator of research capacity - it moves before outputs fail. A new framework from NISTEP (Japan) maps research culture across 6 dimensions: doi.org/10.31222/osf...
010
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 14/09/2026
Following UK Science Minister’s call for fewer and longer-term research grants, RoRI’s @scurry.bsky.social warns in @resprofnews.bsky.social that such funding models risk favoring established researchers over early-career academics: www.researchprofessionalnews.com/rr-news-uk-p...
researchprofessionalnews.com
Fewer, longer research grants ‘could exacerbate inequalities’ - Research Professional News
Science minister’s call for larger, longer-term investments prompts fears around benefits for “big hitters”
000
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 14/09/2026
This morning at the OECD Blue Sky Forum in Paris, RoRI convened a session bringing together perspectives from the UK, the US, Austria, Ireland, Japan, and the international research evidence ecosystem to explore the drivers, opportunities, risks, and policy implications of metascience.
001
Reposted by Research on Research Institute (RoRI)
Adam Golberg @cash4questions.bsky.social · 02/09/2026
In an article I wrote for @rorinstitute.bsky.social - mainly about how to reduce the numbers of uncompetitive applications - I suggested the idea of 'silver medals' for proposals that were very highly rated, but not funded. researchonresearchinstitute.substack.com/p/reducing-w...
researchonresearchinstitute.substack.com
Reducing waste in the competition for research grants
A call to cull
121
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 10/09/2026
Delighted to welcome a delegation from South Korea’s R&I system to RoRI this week for an engaging discussion on funding allocation and the RoRI model 🇰🇷
002
Reposted by Research on Research Institute (RoRI)
Stephen Curry @scurry.bsky.social · 01/09/2026
NEW on the @rorinstitute.bsky.social Substack: @ludowaltman.bsky.social & I discuss the need for more open metascience practices in the light of an ongoing dispute over what the consolidation-disruption index tells us about innovation trends. researchonresearchinstitute.substack.com/p/disruption...
researchonresearchinstitute.substack.com
Disruption eruption
Dispute about the validity of a metric for scientific innovation highlights the need for open research approaches in metascience
164
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 01/09/2026
Is science losing its disruptive edge, or is the metric flawed? @scurry.bsky.social and @ludowaltman.bsky.social look at the debate over measuring scientific disruption and make the case for fully open metadata and modern peer engagement: researchonresearchinstitute.substack.com/p/disruption...
researchonresearchinstitute.substack.com
Disruption eruption
Dispute about the validity of a metric for scientific innovation highlights the need for open research approaches in metascience
164
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 19/08/2026
We have signed Science Works' open letter to UKRI calling for reformed eligibility rules to support greater institutional diversity across the UK research ecosystem: science.works/writing/open...
science.works
Reforming UKRI Eligibility — Science Works
An open letter to UK Research and Innovation on reforming eligibility rules to promote greater institutional diversity.
000
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 12/08/2026
“We already know that the awards are a lottery,” says RoRI's @tomstafford.mastodon.online.ap.brid.gy. “We should just make it a formal lottery, rather than an unofficial one.” A new @nature.com piece looks at funders using partial lotteries to break ties: www.nature.com/articles/d41...
nature.com
When the best decision is no decision: the rise of randomization in grant funding
If reviewers can’t reliably tell the difference between top grant proposals, why should they pretend they can? A new wave of funders is turning to lotteries to break the tie.
1178
Reposted by Research on Research Institute (RoRI)
James Wilsdon @jameswilsdon.bsky.social · 30/07/2026
Churn, not crisis, for UK science @profgeraintrees.bsky.social & I have written the editorial in this week’s @science.org, reflecting on early moves by the Burnham government + scope for US-UK cooperation on scale-up finance & AI for science www.science.org/doi/10.1126/... @rorinstitute.bsky.social
An extract from our editorial in this week’s Science on reforms to UK science & scope for US-UK cooperation
074
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 30/07/2026
Churn, not crisis, for UK science | Science www.science.org/doi/10.1126/... Editorial just out by @profgeraintrees.bsky.social & RoRI’s @jameswilsdon.bsky.social
science.org
Churn, not crisis, for UK science
When Andy Burnham became the United Kingdom’s prime minister last week, among his first acts was to abolish the Department for Science, Innovation and Technology (DSIT), folding it into a new supermin...
011
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 29/07/2026
As publishers crack down on unapproved AI use in peer review, @jameswilsdon.bsky.social advocates for a more realistic approach in @resprofnews.bsky.social (£): www.researchprofessionalnews.com/rr-news-uk-o...
researchprofessionalnews.com
Warning system cracks down on peer reviewers’ AI use - Research Professional News
Experts debate whether peer reviewers should be allowed to use generative AI as supportive tool
000
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 27/07/2026
Utilising language models to examine citation timelines, a new study co-authored by RoRI Metascience AI Fellow Basil Mahfouz explores the "evidence lag" in emergency policymaking, revealing how COVID-19 education policies frequently overlooked newly available research: www.cell.com/star-protoco...
cell.com
COVID-19 education policy often relied on older research despite available new evidence
Policymakers are increasingly relying on scientific research, but it remains unclear whether policy decisions reflect the latest available evidence. Building on a previously developed semantic matchin...
001
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 24/07/2026
LLMs are better at expressing novelty than understanding it. Carlos Arleo shares his work on the Disruption & Novelty Indicator: an experimental tool exploring how structured, constrained AI judgment might evaluate scientific novelty: open.substack.com/pub/research...
open.substack.com
Can AI tell if your research is actually new?
What I learned from building an AI novelty detector
051
Reposted by Research on Research Institute (RoRI)
Metascience 2027 @metascienceconf.bsky.social · 21/07/2026
📌 Save the date: Metascience 2027 is heading to Montreal, June 14–16, 2027! The Tanenbaum Open Science Institute (@theneuro.bsky.social) and @cos.io are bringing the global metascience community together in one of the world's top research cities. Updates: metascience.info #Metascience2027
Save the Date graphic for Metascience 2027 Conference, June 14–16, 2027, in Montreal, Canada. Dark blue background with an abstract red and pink crystalline shape. Text reads "Save the Date," "June 14-16, 2027," and "Montreal, Canada."
01510
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 22/07/2026
DSIT is dead, but UK science will be fine - writing in @theconversation.com, RoRI’s @jameswilsdon.bsky.social breaks down the UK government's latest Whitehall reorganisation and why the research community shouldn't be alarmed by closer proximity to business: theconversation.com/what-the-sud...
theconversation.com
What the sudden demise of the UK’s department of science means for the future of research
If we want to be reminded what real damage to a science system looks like, we only need to glance across the Atlantic.
014
Reposted by Research on Research Institute (RoRI)
James Wilsdon @jameswilsdon.bsky.social · 22/07/2026
DSIT is dead, but UK science will be fine. Keep your eyes on the AI prize. A few thoughts by me @theconversation.com on the reorganisation of Whitehall science theconversation.com/what-the-sud... @ersatzben.com @hetanshah.bsky.social @rorinstitute.bsky.social @profgeraintrees.bsky.social
theconversation.com
What the sudden demise of the UK’s department of science means for the future of research
If we want to be reminded what real damage to a science system looks like, we only need to glance across the Atlantic.
084
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 22/07/2026
We have expanded RoRI's Atlas of Research Assessment to include expert-curated data on national research assessment systems in Finland 🇫🇮 and South Korea 🇰🇷. Browse the Atlas here: researchonresearch.org/atlas/#atlas...
022
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 17/07/2026
Writing in @financialtimes.com (£) Anjana Ahuja warns of new US proposals to allow political appointees to veto research grants; RoRI’s @jameswilsdon.bsky.social argues that restricting international partnerships on climate and health is a major blow to global cooperation: www.ft.com/content/e003...
ft.com
Trump is driving another nail into the coffin of US science
Under proposed reforms, political appointees will review grants to ensure they “advance the President’s priorities”
057
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 16/07/2026
"Evidence and analysis are necessary for good policy making... but they are not sufficient" - Andy Stirling argues that metascience must embrace plural values and uncertainty to truly strengthen both science and democracy: researchonresearchinstitute.substack.com/p/illuminati...
researchonresearchinstitute.substack.com
Illuminating neglected uncertainties
How metascience can help rather than hinder democracy
010
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 16/07/2026
In a new piece for @wonkhe.bsky.social , RoRI’s André Brasil and Peter Kolarz draw on our latest report to argue that a healthy research system doesn’t strictly need peer review as we know it: wonkhe.com/blogs/peer-r...
wonkhe.com
How to reduce review burden, improve research culture and strengthen public trust in science
André Brasil and Peter Kolarz set out why we really don't need peer review
001
Reposted by Research on Research Institute (RoRI)
Stephen Curry @scurry.bsky.social · 15/07/2026
Outstanding and important *NEW* post on the @rorinstitute.bsky.social Substack from Andy Stirling on the democratic challenges for metascience and its role in informing science policy. open.substack.com/pub/research...
open.substack.com
Illuminating neglected uncertainties
How metascience can help rather than hinder democracy
1156
Reposted by Research on Research Institute (RoRI)
James Wilsdon @jameswilsdon.bsky.social · 16/07/2026
‘…political appointees patrolling the borders of knowledge.’ @anjahuja.bsky.social on the US OMB’s attempt to rewrite the rules of federal grantmaking giftarticle.ft.com/giftarticle/... t
giftarticle.ft.com
Trump is driving another nail into the coffin of US science
Under proposed reforms, political appointees will review grants to ensure they “advance the President’s priorities”
012
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 13/07/2026
What happens when research funders treat failure not as a flaw, but as part of the model? Anete Vingre @technopolis-group.com shares data from FWF's 1000 Ideas programme to show how partial randomisation and lotteries change what gets funded: researchonresearchinstitute.substack.com/p/funding-hi...
researchonresearchinstitute.substack.com
Funding high-risk research
What changes when the funding rules change?
021
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 08/07/2026
If scientific discovery relies on a whole ecosystem, why do we only reward the individual? Similo Ngwenya & Nelius Boshoff view metascience through the African philosophy of Ubuntu ("I am because we are"): researchonresearchinstitute.substack.com/p/i-am-becau...
researchonresearchinstitute.substack.com
I am because we are
Ubuntu and what it means for metascience
031
Reposted by Research on Research Institute (RoRI)
Rik Henson @rhens.bsky.social · 07/07/2026
Fantastic perspective on peer review by @rorinstitute.bsky.social, with some great ideas for future improvements to the current limping system: doi.org/10.6084/m9.f...
doi.org
The Future of Peer Review: A system-wide perspective
This report presents the main outcomes of the PEER REVIEW project conducted by the Research on Research Institute (RoRI) from 2023 to 2026. It draws on the substantial literature on peer review as well as 39 in-depth interviews with experts from across the research system, including policymakers, funders, publishers, editors, researchers and others. Peer review is often seen as one of the cornerstones of the research system. At the same time, many researchers and other actors in the system have expressed deep concerns about dysfunctions of peer review. In response to this, much work has been done to assess and improve peer review in individual domains, notably within research funding, scholarly publishing, career advancement, and assessment of research units.However, by considering peer review in each domain in isolation, knowledge about peer review has remained fragmented, offering a weak basis for strengthening the organisation of peer review.In this report, we take a systemic perspective on peer review across domains. Rather than focusing on incremental process-level innovations in individual domains, we conclude there is a need for system-wide reform in peer review. We outline future pathways for such reform.
1113
Reposted by Research on Research Institute (RoRI)
Robin Bisson @robinbisson.bsky.social · 08/07/2026
@rorinstitute.bsky.social also called for this in a recent paper, amid fears of a break down in peer review, saying it would require political "bravery" (See www.researchprofessionalnews.com/rr-news-uk-r...) Call me cynical but that level of reform feels like a very distant prospect
researchprofessionalnews.com
‘Bravery’ needed to ditch grants for individual researchers - Research Professional News
Research on Research Institute urges shift to institution-level funding and move beyond “laissez-faire” research system
132
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 08/07/2026
Great to be among friends at the UK Metascience Unit’s annual cohort meeting, where Ben Steyn is kicking us off with a review of progress. @ukri.org
Ben Steyn, co-head of UK Metascience Unit, speaking at the MSU 2026 Cohort event at Wellcome Collection in London, 8 July 2026Ben Steyn, Metascience Unit cohort event, 8 July 2026
100
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 07/07/2026
In a recent piece, @vtraag.bsky.social writes about how finding equal research funding rates between men and women doesn't necessarily mean the academic system is free of gender bias: researchonresearchinstitute.substack.com/p/we-found-n...
012
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 06/07/2026
A new RoRI study finds no gender differences in funding rates – but warns equal numbers can mask bias, with women representing only 36% of all applicants. Read the paper here: rori.figshare.com/articles/pre...
042
Reposted by Research on Research Institute (RoRI)
James Wilsdon @jameswilsdon.bsky.social · 30/06/2026
A great start yesterday to RoRI’s 3-day summit on ‘augmented assessment’ in Cambridge, where we’ve been joined by the architects of research assessment systems from 11 countries, and a fantastic team of metascience experts & facilitators.
Rob Doubleday (CSaP) and James Wilsdon (RoRI) welcoming participants at the start of the meetingDelegates at RoRI’s Summit on Augmented Assessment at Jesus College, Cambridge
141
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 29/06/2026
RoRI’s @jameswilsdon.bsky.social and @profgeraintrees.bsky.social warn that autonomous AI agents pose an existential threat to research funding by driving grant application costs to zero. They argue assessment must urgently shift away from AI-optimized text to what technology cannot simulate.
youtube.com
LERU Talks - AI and research grants: is the system doomed to collapse?
YouTube video by The League of European Research Universities (LERU)
173
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 26/06/2026
Speaking to @resprofnews.bsky.social (£), RoRI's Peter Kolarz explains why plummeting success rates and AI pressures mean the current funding treadmill is unsustainable, drawing on solutions from our latest report, The Future of Peer Review: www.researchprofessionalnews.com/rr-news-uk-r...
researchprofessionalnews.com
‘Bravery’ needed to ditch grants for individual researchers - Research Professional News
Research on Research Institute urges shift to institution-level funding and move beyond “laissez-faire” research system
000
Reposted by Research on Research Institute (RoRI)
Research Professional News @resprofnews.bsky.social · 26/06/2026
‘Bravery’ needed to ditch grants for individual researchers. Research on Research Institute urges shift to institution-level funding and move beyond “laissez-faire” research system. www.researchprofessionalnews.com/rr-news-uk-r...
researchprofessionalnews.com
‘Bravery’ needed to ditch grants for individual researchers - Research Professional News
Research on Research Institute urges shift to institution-level funding and move beyond “laissez-faire” research system
033
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 25/06/2026
Is equity in science a beautiful lie? At a high-level summit in Germany, RoRI & British Academy Fellow Similo Ngwenya discussed the structural inequalities embedded in global research systems: researchonresearch.org/equity-in-sc...
022
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 23/06/2026
Driven by AI surges and tight budgets, global science has become an unsustainable competition machine. @ludowaltman.bsky.social & co-authors argue we must move away from micro-managing individual survival towards strategic leadership: researchonresearchinstitute.substack.com/p/from-hyper...
researchonresearchinstitute.substack.com
From hyper-competition to strategic leadership
The role of funders and research institutions in 21st-century science
022
Reposted by Research on Research Institute (RoRI)
Andy Tattersall @andytattersall.bsky.social · 18/06/2026
Latest episode of my Under Review podcast is out and this time we look at how generative AI has changed the research funding landscape beyond recognition with @jameswilsdon.bsky.social @rorinstitute.bsky.social Ep 7: The death of the funding bid as we know it. www.youtube.com/watch?v=xWbp... 1/2
youtube.com
Under Review with Professor James Wilsdon - The death of the funding bid as we know it
YouTube video by Andy Tattersall
141
Reposted by Research on Research Institute (RoRI)
Ludo Waltman @ludowaltman.bsky.social · 18/06/2026
In this panel I will discuss some of the ideas developed in the RoRI Future of Peer Review report, to be published early next week! @rorinstitute.bsky.social @cwts.nl
089
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 22/06/2026
📢 New RoRI Report: The Future of Peer Review Peer review is at a breaking point. Strained by hyper-competition & AI, we need system-wide reform. Read here: rori.figshare.com/articles/report/The_Future_of_Peer_Review_A_system-wide_perspective/32685351?file=65684898
0810
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 12/06/2026
Roughly half of social science findings fail to replicate, but tracking them is notoriously difficult. New community-led tools make replication a routine feedback loop rather than research "policing": researchonresearchinstitute.substack.com/p/did-you-kn...
researchonresearchinstitute.substack.com
Did you know this study was replicated?
Tracking and disseminating replications and reproductions
012
Reposted by Research on Research Institute (RoRI)
Stephen Curry @scurry.bsky.social · 10/06/2026
*NEW* on the @rorinstitute.bsky.social Substack: @alexrushforth.bsky.social, @ludowaltman.bsky.social & Paul Wouters examine the threat that AI brings to the conduct of national research assessment exercises. substack.com/home/post/p-...
substack.com
Can national research assessment systems survive the AI storm?
Different types of national assessment systems face different threat levels
064
Reposted by Research on Research Institute (RoRI)
Andy Tattersall @andytattersall.bsky.social · 11/06/2026
A new episode of my Under Review podcast is out and we're discussing how generative AI has changed the research funding landscape beyond recognition with @jameswilsdon.bsky.social from @rorinstitute.bsky.social Ep 7: The death of the funding bid as we know it. www.youtube.com/watch?v=xWbp... 1/2
youtube.com
Under Review with Professor James Wilsdon - The death of the funding bid as we know it
YouTube video by Andy Tattersall
132
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 10/06/2026
RoRI’s @jameswilsdon.bsky.social joins @andytattersall.bsky.social’s Under Review podcast to discuss how generative AI could transform research funding, challenge traditional grant systems, and force a rethink of how excellence is assessed: www.youtube.com/watch?v=xWbp...
youtube.com
Under Review with Professor James Wilsdon - The death of the funding bid as we know it
YouTube video by Andy Tattersall
003
Research on Research Institute (RoRI) @rorinstitute.bsky.social · 10/06/2026
@alexrushforth.bsky.social, Paul Wouters, and @ludowaltman.bsky.social (RoRI & @cwts.nl) warn that national research assessment systems face a dual legitimacy crisis: AI is polluting published literature and infiltrating evaluation itself: researchonresearchinstitute.substack.com/p/can-nation...
researchonresearchinstitute.substack.com
Can national research assessment systems survive the AI storm?
Different types of national assessment systems face different threat levels
143