Sign in

The Metascience Observatory

@metascienceobs.bsky.social
42 followers 46 following 29 posts

metascienceobservatory.org

PostsRepliesMedia
The Metascience Observatory @metascienceobs.bsky.social · 1h
PSA!
000
The Metascience Observatory @metascienceobs.bsky.social · 22/09/2026
Seems like a solvable problem! Surprised someone hasn't already written a script and a wikibot to solve this issue.
001
The Metascience Observatory @metascienceobs.bsky.social · 09/09/2026
THREAD OF IMAGE DUPLICATION FINDINGS (will be continually updated) #1 Nature Medicine 18, 892–901 (2012). 10.1038/nm.2772 The cells in Fig. 1 are described as from a human patient, while the matching cells in Fig. 6 are described as from a tumor grown subcutaneously in a mouse from human cells.
100
The Metascience Observatory @metascienceobs.bsky.social · 09/09/2026
We ran our simple image duplication detection system on 1,000 papers. The papers 1. have 1 author who has a image-related retraction according to @retractionwatch.com, 2. are not retracted, and 3. have no image-related @pubpeer.com comments. We use AI to screen findings & suppress false pos.. (1/3)
132
The Metascience Observatory @metascienceobs.bsky.social · 02/09/2026
What do people think? Should scientists who release old raw data (ie from papers more than 2 years old) get preferential treatment by funders? Releasing datasets is especially valuable in the age of AI - agentic AI systems can be sleuths at scale, flagging things for more detailed human review.
010
The Metascience Observatory @metascienceobs.bsky.social · 01/09/2026
Great news! You can now pip install our fetchPDF library! pip install fetchpdf it's the world's best command-line PDF-getter, using completely legal channels!
121
The Metascience Observatory @metascienceobs.bsky.social · 01/09/2026
Another Dan Ariely paper contains tampered (fraudulent) data, and it looks like Ariely was responsible (the file says "last saved by Ariely" and the only other author, Wertenbroch, claims he never had access to the dataset) datacolada.org/138
datacolada.org
[138] Artificial Deadlines (Part 1): Evidence of Fraud in an Influential Study About Procrastination
A new paper in Psychological Science (.htm) reports a failure to replicate Study 2 of Ariely and Wertenbroch’s influential article entitled, “Procrastination, Deadlines, and Performance: Self-Contr…
011
The Metascience Observatory @metascienceobs.bsky.social · 27/08/2026
Three different AIs were asked to predict how AI might impact science. This was one of the scenarios they arrived at - "The Slop Singularity". (ai-will-do-science.surge.sh) We don't think it will get quite so bad, but something along these lines is happening. AI will help in the end.
000
The Metascience Observatory @metascienceobs.bsky.social · 27/08/2026
AI for metascience is booming, and @lukaswallrich.bsky.social and the huge volunteer team at the superb @forrt.bsky.social project are hosting this very timely online conference. Metascience Observatory Founder @delton.bsky.social will be speaking Sept 28-30 along w/ 33 other speakers. Link 👇
121
The Metascience Observatory @metascienceobs.bsky.social · 24/08/2026
The fraud problem in science, summarized. This is part of our motivation for building the Forensic Metascience Agent, a AI agent orchestration system designed to enable a thorough audit of a scientific paper, including images, tables/data, statistics, and supplementary files. (🔗 w/ more info below)
511
The Metascience Observatory @metascienceobs.bsky.social · 24/08/2026
We believe PubPeer can re-invigorate scientific self-criticism. “PubPeer exists & thrives precisely because of a frustration, shared by its initiators and its users, at the failures of traditional scientific institutions to administer well-organised scepticism.”-Wytske et al. osf.io/preprints/me...
142
The Metascience Observatory @metascienceobs.bsky.social · 06/08/2026
The NIH recently released a RFI seeking public input on new ways to measure and reward scientific impact. The agency is evaluating whether traditional metrics such as publication counts and citation indexes adequately capture the value of biomedical research. => grants.nih.gov/grants/guide...
grants.nih.gov
NOT-OD-26-087: Request for Information on Measuring and Rewarding Scientific Impact
NIH Funding Opportunities and Notices in the NIH Guide for Grants and Contracts: Request for Information on Measuring and Rewarding Scientific Impact NOT-OD-26-087. NIH
011
The Metascience Observatory @metascienceobs.bsky.social · 05/08/2026
Yesterday we published a detailed report about what we've learned so far from our replication database about reproducibility and correlates of reproducibility. => open.substack.com/pub/moreisdi...
021
Reposted by The Metascience Observatory
Lukas Röseler @aufdroeseler.bsky.social · 10/10/2025
ReplicationResearch.org is now open for submissions! Submit replications and reproductions from many different fields, as well as conceptual contributions. With diamond OA, open and citable peer review reports, and reproducibility checks, we push the boundaries of open and fair publishing.
39354
Reposted by The Metascience Observatory
Dan Elton @delton.bsky.social · 20/06/2026
I've created a new @metascienceobs.bsky.social "Bird's Eye Review" dashboard for human clinical trials on antiviral nasal sprays. Check it out ➡️ metascienceobservatory.org/birds-eye-re... Let me know what you think! There's also a #LongCOVID dashboard too: metascienceobservatory.org/birds-eye-re...
132
The Metascience Observatory @metascienceobs.bsky.social · 29/01/2026
Read our first newsletter on Substack: metascienceobservatory.substack.com/p/metascienc... You can subscribe on Substack or on our conventional mailing list: metascienceobservatory.eo.page/kdntv
metascienceobservatory.substack.com
Metascience Observatory Newsletter #1
Happy New Year from the Metascience Observatory! This newsletter will go out either bimonthly or quarterly.
031