Sign in

MetaROR

@metaror.bsky.social
456 followers 129 following 137 posts

MetaROR is a community initiative led jointly by RoRI and AIMOS. It provides a platform that leverages the publish–review-curate model to improve the dissemination and evaluation of metaresearch.

PostsRepliesMedia
MetaROR @metaror.bsky.social · 01/10/2026
How sustainable are the databases that life sciences researchers depend on? This new study examined 9 of them to find out. Both reviewers find the study timely and valuable. One reviewer suggests another level of synthesis in the thematic analysis would be helpful. 👉 Read now on MetaROR
metaror.org
Sustainability during instability: Long-lived life science databases and science funding outlook in the United States - MetaROR
133
MetaROR @metaror.bsky.social · 30/09/2026
This article by Yu Zhu and Jiyuan Ye presents a theoretical framework for research evaluation developed in China, highlighting the current binary opposition between qualitative & quantitative methods in evaluation practices. 👉 Read the assessment, reviews, author response & full article on MetaROR
metaror.org
Beyond the binary: The system of all-round evaluation of research and its practices in China - MetaROR
112
MetaROR @metaror.bsky.social · 22/09/2026
This new study takes a meta-perspective on reproducibility by examining replication projects themselves. The reviewers agree the manuscript addresses an important and worthwhile question but identify fundamental problems that currently prevent confidence in the study results. 👉 Read now on MetaROR
metaror.org
A meta-perspective on reproducibility and replication rates - MetaROR
132
MetaROR @metaror.bsky.social · 08/09/2026
This new MetaROR-evaluated paper introduces "the innovation annulus: the zone between freely available structured data and the advancing frontier of commercially refined knowledge products," which is "a permanent, functional feature of the ecosystem -- not a pathology to eliminate." 👇 Read now
metaror.org
Market dynamics, governance and open research metadata in the AI era - MetaROR
112
MetaROR @metaror.bsky.social · 07/09/2026
Here is the evaluation for "an empirical assessment of the inferential reproducibility of linear regression analyses in health and biomedical research". It demonstrates "substantial violations of key modelling assumptions" that often went unnoticed by authors and reviewers. 👇 Read it on MetaROR
metaror.org
An empirical assessment of inferential reproducibility of linear regression in health and biomedical research papers - MetaROR
112
MetaROR @metaror.bsky.social · 02/09/2026
2️⃣ Here is a revision of one of our first articles - a large-scale data-driven analysis of the use of initials vs. full first names in the author lists of scientific publications. Reviewers were satisfied with the revisions made, though two of them still raised a few minor issues. 👇 Read it now
metaror.org
The rise and fall of the initial era - MetaROR
101
MetaROR @metaror.bsky.social · 01/09/2026
After two rounds of MetaROR evaluation, this article was just published in Scientometrics! 👏 Congratulations to the authors and everyone else involved.
link.springer.com
Modeling the global citation network using the scalable agent-based simulator for citation analysis with recency-emphasized sampling (SASCA-ReS) - Scientometrics
The global science literature, represented as a network with articles as nodes and citations as edges, is a rich artifact for scientometric studies. The structure of this network depends on its count ...
011
MetaROR @metaror.bsky.social · 27/08/2026
2️⃣ The revision of this one is now up! Both reviewers are highly satisfied with the (substantial) changes made to the article, and have no further comments. 🙏 Thanks and congratulations to all involved. 👇 Read both versions, including reviews and assessments, here metaror.org/article/rest...
metaror.org
Restructuring scientific papers for human and AI readers - MetaROR
023
MetaROR @metaror.bsky.social · 25/08/2026
[1 / 3] 🔀 This study by @eumsoohong.bsky.social examines the interoperability between the South Korean national funder database and two bibliographic databases (Web of Science & OpenAlex). 👇 Read the full evaluation now on MetaROR
metaror.org
Assessing funders’ databases against bibliographic sources: A study of interoperability, metadata quality, and coverage using South Korea’s national R&D database - MetaROR
113
MetaROR @metaror.bsky.social · 18/08/2026
♻️ How to detect reuse of data at scale? This article studies reuse of data sets shared by researchers from a biomedical research institution. 📝 The 3 reviewers are generally positive, calling the work 'thorough' & 'exciting' while providing detailed suggestions to improve it. 👇 Read now on MetaROR
metaror.org
Matching data references and institutional output to map the reuse of biomedical research data - MetaROR
101
MetaROR @metaror.bsky.social · 12/08/2026
🌍 Can the polarity of sustainable development goals within news text be detected? That is the question raised by a new article, evaluated on the MetaROR platform. 👇 Read the full evaluation now on MetaROR [1 / 3]
metaror.org
Polarity detection of Sustainable Development Goals in news text - MetaROR
122
MetaROR @metaror.bsky.social · 11/08/2026
🔓 "Who chooses open peer review and is it an indicator of article quality?" That's the subject of "an observational study of PLOS journals" evaluated on MetaROR. 👇 Read on MetaROR
metaror.org
Who chooses open peer review and is it an indicator of article quality? An observational study of PLOS journals - MetaROR
112
MetaROR @metaror.bsky.social · 06/08/2026
2️⃣ This one came back for a second evaluation round! Both reviewers agree comments were well-addressed and commend authors on on a well-written article, yet still express some doubts. 👇 Read the full second (and first!) evaluation now on MetaROR
metaror.org
Citation accuracy, citation noise, and citation bias: A foundation of citation analysis - MetaROR
040
MetaROR @metaror.bsky.social · 03/08/2026
Here is the revision of an article presenting an agent-based model of citation behavior and compares citation networks generated by this model with real-world citation networks. Reviewers feel most of their comments were addressed, though 1 reviewer mentions two more issues. 👇 Read now on MetaROR
metaror.org
Modeling the global citation network using the scalable agent-based simulator for citation analysis with recency-emphasized sampling (SASCA-ReS) - MetaROR
111
MetaROR @metaror.bsky.social · 30/07/2026
This one has come back from (extensive) revision! The reviewers applaud the changes, yet still highlight some issues; in particular with regard to the title suggesting generic as opposed to specifically biomedical application. 🙏 Thanks again to all those involved! 👇 Read the evaluation on MetaROR
metaror.org
Use of diverse data sources to control which topics emerge in a science map - MetaROR
001
MetaROR @metaror.bsky.social · 29/07/2026
🌐 How accessible are preprint services and where are they located? That is the question addressed by this article evaluated by MetaROR. The two reviewers are generally positive, though they have some notes on some of the figures and would like to see more statistical tests. 👇 Read it now
metaror.org
The localisation and accessibility of preprint services: implications for Open Science - MetaROR
243
MetaROR @metaror.bsky.social · 28/07/2026
💭 Why is change in scholarly communication so hard to imagine? This article presents findings from a consultation for cOAlition S proposal Towards Responsible Publishing. Reviewers were generally positive but urged the authors to include more detail and potential solutions. 👇 Read now on MetaROR
metaror.org
Why is change in scholarly communication so hard to imagine? Findings from a stakeholder consultation for the cOAlition S proposal ‘Towards Responsible Publishing’ - MetaROR
132
MetaROR @metaror.bsky.social · 27/07/2026
👏 Great initiative by our friends at PREreview!
010
MetaROR @metaror.bsky.social · 23/07/2026
This research plan outlines a study investigating how people perceive researchers who commit questionable research practices (investigators) compared to those who report them (inspectors). 👇 Full evaluation - including reviews, editorial assessment & full research plan text - is on MetaROR [1/3]
metaror.org
From misconduct to reform: Understanding perceptions of those who commit & call out questionable research practices - MetaROR
154
MetaROR @metaror.bsky.social · 22/07/2026
What is the relative efficiency of one- and two-stage research funding processes? This article studies that, concluding that two-stage processes “may lead to significant cost savings”. 👇 Read the editorial assessment, reviews, the author's response, and the full article text on the MetaROR website
metaror.org
Insights into the relative efficiency of one- and two-stage research funding processes using an Agent Based Modelling approach - MetaROR
132
MetaROR @metaror.bsky.social · 05/06/2026
This article proposes restructuring scientific papers, with front-loaded narratives for humans as well as machine-readable appendices. Reviewers found the idea worthwhile & timely, while suggesting engagement with previous work & needing an update on the AI processing. 👇 Full assessment on MetaROR
metaror.org
Restructuring scientific papers for human and AI readers - MetaROR
242
MetaROR @metaror.bsky.social · 04/06/2026
📝 Do preregistration & registered reports restrict exploratory research? This research plan aims to find out. The two reviewers agree the question is important but think the proposal as-is doesn't support its claims yet. 👇 Read the full research plan, editorial assessment & reviews now on MetaROR
metaror.org
Evaluating the claim that preregistration and registered reports restrict exploratory research - MetaROR
122
MetaROR @metaror.bsky.social · 29/05/2026
A second version of this article has now been evaluated - one of the reviewers of the original deems it "very good" and feels comments were adequately addressed. 🙏 Thanks again for everyone involved in making this happen! 📝 Read both evaluations now on MetaROR: metaror.org/article/the-...
metaror.org
The state of bronze open access in Web of Science - MetaROR
020
MetaROR @metaror.bsky.social · 06/05/2026
🔖 Now up on MetaROR: a full evaluation of the Handbook for Reproduction and Replication Studies, which enables researchers to conduct high-quality reproductions & replications across social science disciplines. Reviewers praised it as timely & useful while providing recommendations. Read it now 👇
metaror.org
Handbook for Reproduction and Replication Studies - MetaROR
2109
MetaROR @metaror.bsky.social · 21/04/2026
Today we publish the evaluation of a bibliometric analysis of (bilateral & multilateral) scientific collaboration intensity between Russia and other countries. Reviewers recognize the approach's value & also provide (literature) suggestions. 👇 Read the assessment, reviews and full text on MetaROR
metaror.org
The relative intensity of bilateral and multilateral co-authorship with Russia since 1995 - MetaROR
101
MetaROR @metaror.bsky.social · 08/04/2026
This article, which went through two rounds of MetaROR evaluation, just got published in Quantitative Science Studies! 👏 Congratulations to the authors! Read it here: direct.mit.edu/qss/article/...
direct.mit.edu
The varying perceptions of a statistician’s value, from “critical” to “not needed for 99.9% of applications”: A study of human research ethics committees in Australia
Abstract. Currently, much medical research is wasted due to inappropriate study design or analysis. Qualified statisticians are essential for ensuring ideal study design and analysis, and the ethical ...
010
MetaROR @metaror.bsky.social · 31/03/2026
🗨️ This article's authors announce expansion of CRediT into 36 languages & describe how translations from English were made. Reviewers commended the method & praised the project for being inclusive. They raise issues on automatic translation and limitations of CRediT. 👇 Read the full evaluation
metaror.org
Facilitating multilingual research publishing: Translations of the Contributor Roles Taxonomy (CRediT) - MetaROR
155
MetaROR @metaror.bsky.social · 30/03/2026
🔗 This new evaluation attempts to trace causal linkages from research funding towards societal outcomes. Researchers praise it for showing how targeted funding can foster mutually beneficial academia–industry collaborations. They also identify problems in framing, clarity & depth. 👇 Read now
metaror.org
Tracing causal mechanisms for the impact of societally targeted funding - MetaROR
121
Reposted by MetaROR
ASAPbio @asapbio.bsky.social · 26/03/2026
We are delighted to see the growth of the ‘Publish, Review, Curate’ (PRC) initiatives in recent years!🚀 One of them is @metaror.bsky.social (MetaResearch Open Review). This platform focuses on open peer review and curation of metaresearch articles. Learn more about MetaROR👉️ metaror.org
metaror.org
Home - MetaROR
MetaResearch Open Review MetaResearch Open Review MetaResearch Open Review A new platform designed to transform how we review and share metaresearch A new platform designed to transform
164
MetaROR @metaror.bsky.social · 24/03/2026
Who owns the knowledge? Our latest evaluation is a call for researchers to act in response to AI models using their research. Reviewers consider it a good primer on the topic yet suggest more focus on the political/commercial context & greater precision in the legal analysis. 👇 Read now on MetaROR
metaror.org
Who owns the knowledge? Copyright, genAI, and the future of academic publishing - MetaROR
111
MetaROR @metaror.bsky.social · 16/03/2026
🔍 Academic search engine optimisation (A-SEO) vital for enhancing research visibility. Our latest evaluation is a study comparing four leading A-SEO tools. Reviewers emphasize the topic's relevance but do point out the limitation of including only 2 publishers in the study. 👇 Read now on MetaROR
metaror.org
SEO Metrics for Enhanced Academic Research Visibility: A Comparative Study of Global and Country-Level Traffic - MetaROR
132
MetaROR @metaror.bsky.social · 12/03/2026
2️⃣ The authors of this article on preprint adoption across discipline and region returned for a 2nd evaluation. Our editor found changes corresponding to most suggestions made in the reviews and reasonable and convincing arguments for why specific suggestions were declined. 👇 Read it all on MetaROR
112
Reposted by MetaROR
Austrian Platform for Research and Technology Policy Evaluation @fteval.bsky.social · 12/03/2026
#Excited for the fteval Journal for Research and Technology Policy Evaluation X @metaror.bsky.social collaboration. We, @fteval, @rorinstitute.bsky.social @aimosinc.bsky.social, are joined by the mission for open & transparent peer review and strengthening international the field of meta-research.
032
MetaROR @metaror.bsky.social · 10/03/2026
2️⃣ After the initial review, the authors returned to MetaROR for a second round. Reviewers believe that their concerns have been addressed, though one of them still prefers the author to drop three references. 👇 Read the 2nd evaluation round, incl. reviews, assessment and full article now on MetaROR
111
MetaROR @metaror.bsky.social · 04/03/2026
Today, author @tomhardwicke.bsky.social argues "that without safeguards, Synchronous Robustness Reports could inadvertently create more confusion than clarity about robustness. The reviewer, among other things, suggests distinguishing between different types of reports. 👇 Read it now on MetaROR
metaror.org
Risk of Bias in Robustness Reports - MetaROR
103
MetaROR @metaror.bsky.social · 02/03/2026
🔓 Our latest article presents an analysis of bronze open access publications in the Web of Science database. Reviewers did not identify major weaknesses, calling it solid, timely & sound, and suggested expanding the discussion on the concept of bronze OA. 👇 Read the full evaluation now on MetaROR
metaror.org
The State of Bronze Open Access in Web of Science - MetaROR
112
MetaROR @metaror.bsky.social · 26/02/2026
🤝 We are happy to announce another new partner journal: @jcre.bsky.social The Journal of Comments and Replications in Economics "aims for articles that comment on or replicate previously published articles in economics & closely related disciplines" 👇 See our full list of partners on our website
metaror.org
Partnership with journals - MetaROR
About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...
021
MetaROR @metaror.bsky.social · 25/02/2026
🇬🇧 Our latest paper "uses broad bibliometrics to compare the STEM and SHAPE sectors over time in the UK, with comparisons to other countries" Reviewers find it timely & useful, yet suggest a different analytical approach as well as a tighter definition of SHAPE 👇 Find the full evaluation on MetaROR
metaror.org
Understanding the importance of SHAPE to the UK research ecosystem - MetaROR
123
MetaROR @metaror.bsky.social · 19/02/2026
🤝 MetaROR is happy to announce Replication Research as its new partner journal! @r2journal.bsky.social is an interdisciplinary journal for replication research focusing on reproductions, close replications and conceptual replications. 👇 See our full list of partners on our website
metaror.org
Partnership with journals - MetaROR
About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...
035
MetaROR @metaror.bsky.social · 18/02/2026
We published a 2nd round of reviews for a paper on preprint review services' "potential to turn peer review into a more transparent and rewarding experience and to improve publishing and peer review workflows" Reviewers see improvements while still highlighting a potential issue. 👇 Read on MetaROR
metaror.org
Preprint review services: Disrupting the scholarly communication landscape? - MetaROR
151
MetaROR @metaror.bsky.social · 16/02/2026
🤝 MetaROR is happy to announce Psychology, Public Policy, & Law as its partner. @pppl-journal.bsky.social "provides a forum to critically evaluate contributions of psychology & related disciplines to public policy & legal issues & vice versa." 👇 See our list of partners metaror.org/partner-jour...
metaror.org
Partnership with journals - MetaROR
About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...
031
MetaROR @metaror.bsky.social · 11/02/2026
For the University of Helsinki's comprehensive research assessment, researchers designed a dedicated module to capture interdisciplinarity. Reviewers called their approach "inspiring" and did not identify major weaknesses, but do provide recommendations. 👇 Read the assessment, reviews & full text
metaror.org
Exploring interdisciplinarity – raising self-awareness through a comprehensive research assessment - MetaROR
265
Reposted by MetaROR
Replication Research (R2) @r2journal.bsky.social · 04/02/2026
We are now a partner journal of @metaror.bsky.social, @jcre.bsky.social, and The Tromsø Repository of Language and Linguistics (TROLLing). Read the full announcement here: www.uni-muenster.de/Ejournals/in...
024
Reposted by MetaROR
Ludo Waltman @ludowaltman.bsky.social · 05/02/2026
Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach doi.org/10.64000/vfe... Together with @andre-brasil.bsky.social I just published this blog post about @crossref.bsky.social DOI registration practices for @metaror.bsky.social.
MetaROR’s approach to Crossref DOI registration
11613
Reposted by MetaROR
AIMOS @aimosinc.bsky.social · 04/02/2026
@metaror.bsky.social has made some major decisions about its deployment of DOIs:We will mint separate DOIs for peer-reviewed preprints using the 'article' reference type. @ludowaltman.bsky.social and André Brasil lay out our reasoning here: www.crossref.org/blog/innovat...
crossref.org
Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach - Crossref
A couple of months ago, Ludo Waltman and André Brasil raised some questions about good practices for Crossref DOI registration, asking for input from the scholarly communication community. In this pos...
022
MetaROR @metaror.bsky.social · 04/02/2026
Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach metaror.org/innovation-in-scientifi…
000
MetaROR @metaror.bsky.social · 03/02/2026
Publication bias poses a serious challenge to clarity and precision in scientific research & meta-analyses. This article by Paweł Lenartowicz poses a way to deal with this: the Likelihood Ratio Test for Publication Bias. 👇 Read the editorial assessment, peer reviews, and full article on MetaROR now
metaror.org
Likelihood Ratio Test for Publication Bias – a proof of concept - MetaROR
083
MetaROR @metaror.bsky.social · 11/12/2025
Our latest article argues that citation noise "represents an [...] underexplored challenge in citation analysis". Reviewers appreciate the fresh/innovative approach but question its conceptual underpinning: can citation accuracy be determined objectively? 👇 Read the assessment, reviews & full text
metaror.org
Citation accuracy, citation noise, and citation bias: A foundation of citation analysis - MetaROR
176