Sign in

Ian Hutchins

@bihutchins.bsky.social
45 followers 44 following 40 posts

Assistant Professor at UW-Madison’s Information School. Previously NIH data scientist-developed iCite (icite.od.nih.gov) & NIH Open Citation Collection hutchinslab.github.io

PostsRepliesMedia
Ian Hutchins @bihutchins.bsky.social · 24/09/2026
Would scientists prefer their article level citations be taken into account more than they currently are? In general, yes, but it depends on the field: arxiv.org/abs/2609.244...
arxiv.org
The illusion of neutrality in metric-based research evaluation
Venue prestige and citation counts are two widely used, albeit imperfect, signals of research quality. When the two signals conflict, evaluators must decide how much weight to assign each. Yet, it rem...
000
Ian Hutchins @bihutchins.bsky.social · 22/09/2026
Does giving reviewers a "golden ticket" to greenlight acceptance in #PeerReview yield more influential papers than accepting the runners-up? Not in computer science, apparently: arxiv.org/abs/2609.19552
arxiv.org
Funding the runners-up beats a golden ticket
A golden ticket allows one reviewer to advance a proposal that the rest of a panel would reject. We assess its score-based rationale by comparing minority-support ranking with other rules for allocati...
021
Ian Hutchins @bihutchins.bsky.social · 04/09/2026
Only relevant if NIH’s budget isn’t siphoned away by interagency agreements, of course…
000
Reposted by Ian Hutchins
eLife @elife.bsky.social · 03/09/2026
Comparing the outputs of intramural and extramural grants funded by National Institutes of Health
buff.ly
Comparing the outputs of intramural and extramural grants funded by National Institutes of Health
Funding mechanisms impact the cost effectiveness of the science conducted, as extramural NIH grants to universities excel at producing papers and citations, while intramural NIH hiring more effectively...
021
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 18/08/2026
Nice work by @bihutchins.bsky.social using public data to forecast what lines of investigation will lead to new FDA-approved therapeutics, in many cases before phase 2 clinical trials are even started. 🧪 www.nature.com/articles/s43...
nature.com
Forecasting novel therapeutic development in biomedical research - Communications Medicine
Arabi and Hutchins develop a machine learning model to predict which scientific research topics are likely to result in new FDA-approved therapeutics. Their model predicts which disease will receive a...
132
Reposted by Ian Hutchins
matthew @pahuski.com · 10/08/2026
The ads alone are worth the price of The Onion’s print edition
Ad in The Onion: a stock photo of a man holding his neck in pain, with the United Healthcare logo and the text: “Walk it off.”
6298461364
Reposted by Ian Hutchins
Drug Monkey @drugmonkey.bsky.social · 05/08/2026
NIH intramural versus extramural research efficiency drugmonkey.wordpress.com/2026/08/05/n...
drugmonkey.wordpress.com
NIH intramural versus extramural research efficiency
hattip to one of our OG blog commenters pinus who is trolling me today with a new paper in eLife. Comparing the outputs of intramural and extramural grants funded by National Institutes of Health. …
022
Ian Hutchins @bihutchins.bsky.social · 29/07/2026
How cost-effective are NIH Extramural vs Intramural mechanisms? We did internal analysis at NIH but never published results. Happy to share some answers: Extramural is better for measures like publications and citations; Intramural is better at basic -> clinical translation doi.org/10.7554/eLif...
doi.org
Comparing the outputs of intramural and extramural grants funded by National Institutes of Health
Funding mechanisms impact the cost effectiveness of the science conducted, as extramural NIH grants to universities excel at producing papers and citations, while intramural NIH hiring more effectivel...
073
Reposted by Ian Hutchins
Nicholas A. Christakis @nachristakis.bsky.social · 02/07/2026
How much does a scientific claim change between the preprint and the final published paper, post peer review? LLM was used to track 72,644 bioRxiv/journal pairs from 2018-25 The primary claim was unchanged in 39.9% of papers, mildly revised in 50.0%, and substantially changed in only 10.2%.
biorxiv.org
Tracking claim changes from preprint to publication across 72,644 biomedical studies using large language models
Preprints now disseminate a large share of biomedical research before peer review. Because they have not yet passed peer review, some scientists regard preprint claims as unverified or potentially unr...
01910
Ian Hutchins @bihutchins.bsky.social · 01/07/2026
A thought-provoking interpretation of the disruption index as a measurement of active forgetting in the scientific community at #ICSSI2026 today @icssi.org
110
Reposted by Ian Hutchins
Mallory Harris, PhD @malar0ne.bsky.social · 29/06/2026
Looking forward to sharing the work we've been doing at @scienceimpacts.org mapping impacts of science funding cuts during the next parallel session on Data, Infrastructure & Software @icssi.org! scienceimpacts.org
scienceimpacts.org
SCIMaP - Impacts of Federal Cuts to Science and Medical Research
Developed by an interdisciplinary research team, this website shows how funding cuts reduce economic activity and employment nationwide
15423
Reposted by Ian Hutchins
ICSSI @icssi.org · 01/05/2026
🔬 #ICSSI2026 Speaker Spotlight 4: Chaoqun Ni Co-Director of the Metascience Research Lab at Wisconsin, Prof Ni studies how science is produced, evaluated, and rewarded, with key recent work on AI-assisted writing and miscitation detection. Learn more about Ni and our entire lineup at icssi.org !
Co-Director of the Metascience Research Lab at Wisconsin, Prof Ni studies how science is produced, evaluated, and rewarded, with key recent work on AI-assisted writing and miscitation detection.
082
Reposted by Ian Hutchins
Misha Teplitskiy | Science of science | on LinkedIn mostly @innovation.bsky.social · 29/06/2026
Alright boys and girls, let's reboot this account and see what's going on over at #ICSSI2026! A thread 🧵... 1. Gross and Bergstrom with a deep slide: incentives for early stage evaluations (grants) different from late stage (papers)
0142
Reposted by Ian Hutchins
Mark D. Garfinkel, Ph.D. @mdgarfinkel.bsky.social · 26/06/2026
The credit downgrade risk would extend to ALL parties exposed to Federal grant funding. Not just state & municipal agencies, but all kinds of private, charitable, & not-for-profits. You’re a religious/community-service organization that gets money from the DHS SCN for public safety aid? *thwack*
021
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 26/06/2026
I wrote a new thing over at Macroscience for @andrewgerard.bsky.social about predicting scientific breakthroughs. If you missed it yesterday, go check it out and let me know what you think: open.substack.com/pub/macrosci...
open.substack.com
Making Our Own Luck
What if we could predict transformative scientific breakthroughs before they happen?
152
Ian Hutchins @bihutchins.bsky.social · 26/06/2026
“a lot of companies and Dems might like the idea of a trillion-dollar slush fund.” And I can’t imagine a President who wouldn’t be tempted to use arbitrary cancellations of, for example, cancellable transportation grants, as a way to whip votes. Same-party legislators wouldn’t enjoy immunity
000
Reposted by Ian Hutchins
Cole Donovan @colesci.bsky.social · 26/06/2026
The credit rating agency issue with the OMB rule is all too obvious in hindsight, but worth taking time to spell out. Let’s talk a bit about the Moody’s warning (need an account to access). www.moodys.com/research/Pub... 🧵
moodys.com
Moody's - credit ratings, research, and data for global capital markets
134
Reposted by Ian Hutchins
DORA @dorassessment.bsky.social · 17/06/2026
It's that time of year when the JIFs are out. Over-reliance on it fuels integrity risks like papermills & fraud. Everything is connected! Join us in shifting the focus from venue prestige to merit. Explore RRA resources & course: sfdora.org/reports/ & bit.ly/DORA-Intro-Course
22226
Reposted by Ian Hutchins
Cole Donovan @colesci.bsky.social · 10/06/2026
No, you do not need to cite the CFR change for a comment to “count.” Where are people getting this info?
111
Reposted by Ian Hutchins
Altmetric @altmetric.com · 06/06/2026
Sometimes an Altmetric attention score reflects the Streisand Effect.
193
Reposted by Ian Hutchins
Michael D. Green, PhD @michaeldgreen.phd · 06/06/2026
If the goal was to not let them share reprints of an editorial, maybe having the police escort them out was not the best choice 😭😭 @altmetric.com www.altmetric.com/details/1954...
America showing 818 BlueSky posts, 7 news outlets, and 93 X users.
47127
Reposted by Ian Hutchins
ASAPbio @asapbio.bsky.social · 27/05/2026
👏 MIT's Graduate Student Council passed a resolution calling for: ✅️"adoption of preprints and other innovative scholar communication methods," ✅️a healthier, more open-access, and less journal-focused system, ✅️improvements to the way researchers are evaluated.
buff.ly
Reshaping Scholarly Communications | News
In March 2026, MIT’s Graduate Student Council (GSC) passed a Resolution on Scientific Publishing and MIT Libraries, a wide-ranging document that calls upon the MIT community, as well as federal…
194
Reposted by Ian Hutchins
Vincent Traag @vtraag.bsky.social · 25/05/2026
To me, this looks like a classic case of collider bias (aka selection bias): if papers are still published after having a major revision it's more likely to be papers with a higher latent citation rate compared to papers with a minor revision.
252
Reposted by Ian Hutchins
Drug Monkey @drugmonkey.bsky.social · 15/05/2026
Will you survive? drugmonkey.wordpress.com/2026/05/15/w...
drugmonkey.wordpress.com
Will you survive?
There was a distressed post that flew by on Blüski this week. How are we to survive this? How will academic scientists get through this chaos and assault on our profession? You either will, or you …
81410
Reposted by Ian Hutchins
Drug Monkey @drugmonkey.bsky.social · 29/04/2026
Current events are reminding me of this old guest post. As the disruption of NIH continues to grind, PIs break. From the Archive: Sacrifice means you too. drugmonkey.wordpress.com/2009/12/22/s...
drugmonkey.wordpress.com
Sacrifice means you too.
“Do it to Julia”
153
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 18/03/2026
I’m building a new independent research organization, the Woodley Park Institute, that will study how scientific progress occurs, how funding systems shape discovery, and how to distribute funding to best support breakthrough research. 2/ bsky.app/profile/wp-i...
2125
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 18/03/2026
Friends, as many of you know, I recently left the NIH to embark on the next chapter in my career. Today I’m excited to share what I’ve been working on, and what it means for the way we support research and produce scientific advances. 1/
2138
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 08/03/2026
New survey shows biomedical researchers in US/Canada report their top reasons to author a preprint are to accelerate dissemination & establish priority; readers of preprints rely on author reputation as a heuristic to evaluate reliability of reported results: www.biorxiv.org/content/10.6...
biorxiv.org
011
Reposted by Ian Hutchins
Sciences @sciences.skyfleet.blue · 06/03/2026
Career effects of preprints get mixed reviews from biomedical researchers
science.org
Career effects of preprints get mixed reviews from biomedical researchers
Junior researchers are more likely to embrace preprints; grant reviewers and hiring committees express doubts
001
Reposted by Ian Hutchins
Drug Monkey @drugmonkey.bsky.social · 06/03/2026
NIH FY2025 funding data finally emerges on RePORT drugmonkey.wordpress.com/2026/03/06/n...
drugmonkey.wordpress.com
NIH FY2025 funding data finally emerges on RePORT
The FY2025 funding picture was disrupted significantly by the mandate for Multi-Year Funding of about half of the budget for extramural awards. This produced a mid-year declaration by NCI that thei…
02719
Reposted by Ian Hutchins
Data Rescue Project #DataRescue @datarescueproject.org · 09/02/2026
We are excited to celebrate Love Data Week with the world & @icpsr.bsky.social ! We are presenting at and attending events all week long. You can check out some of those on our public Google Calendar, including our DRP office hours this week. Join the ❤️ 🛟 bit.ly/4kniYOR #LoveData26
1125
Ian Hutchins @bihutchins.bsky.social · 06/02/2026
“Higher LLM involvement predicts greater publication output, though concentrated in non-hit papers… One possible interpretation is that NIH funding and review norms more strongly reward incremental, executable projects” arxiv.org/html/2601.15...
arxiv.org
The Rise of Large Language Models and the Direction and Impact of US Federal Research Funding
011
Reposted by Ian Hutchins
Ludo Waltman @ludowaltman.bsky.social · 05/02/2026
Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach doi.org/10.64000/vfe... Together with @andre-brasil.bsky.social I just published this blog post about @crossref.bsky.social DOI registration practices for @metaror.bsky.social.
MetaROR’s approach to Crossref DOI registration
11613
Reposted by Ian Hutchins
Jeremy Berg @jeremymberg.bsky.social · 12/01/2026
The hardest hit would not be universities that the administration seems to be believe use indirect costs to run programs they find objectionable, but children's hospitals and cancer research institutes. Talk about making America healthy... 14/14
media.tenor.com
a cartoon character from south park is in the snow and says " are you sure this is a good idea "
ALT: a cartoon character from south park is in the snow and says " are you sure this is a good idea "
1169
Reposted by Ian Hutchins
AZ Faust @azfaust.bsky.social · 12/01/2026
If you're an NSF funded investigator, it is a huge win. We went from a proposed 60% cut to a proposed 25% cut (in initial House budget) to a 3.9% cut (which should not affect NSF extramural appropriations). This means that most NSF directorates will continue funding at last year's rates and levels.
1188
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 12/01/2026
New at The Progress Bar: The system for funding science is fundamentally broken. To fix it, we need to do more than change who gets funded, we need to change how funding decisions are made. theprogressbarwpi.org/p/doing-expe... 🧪
theprogressbarwpi.org
Doing experiments
evolving decision-making in an era of uncertainty
266
Ian Hutchins @bihutchins.bsky.social · 09/01/2026
A valuable addition to open citations: the Open Social Science Citation Index! #OpenScience @opencitations.bsky.social zenodo.org/records/1817...
zenodo.org
Open Social Science Citation Index (OpenSSCI)
Description:  The dataset OpenSSCI comprises reference metadata and citation links derived from 63,070 full-text academic documents archived in the SSOAR (Social Science Open Access Repository). The d...
022
Ian Hutchins @bihutchins.bsky.social · 06/01/2026
Interesting analysis on how researcher-degrees-of-freedom creep into analytical results. I especially liked the analysis of which design choices led to different outcome estimates: www.science.org/doi/full/10....
science.org
Ideological bias in the production of research findings
There is a robust statistical relation between ideology and research findings when researchers test a policy-relevant hypothesis.
010
Reposted by Ian Hutchins
Alejandro Montenegro @aemonten.bsky.social · 29/12/2025
"We also find that approximately half of researchers never publish in a venue with an impact factor above 15, which, under journal-level evaluation regimes, may exclude them from consideration for opportunities. Many of these researchers publish equally influential work"
journals.plos.org
Most researchers would receive more recognition if assessed by article-level metrics than by journal-level metrics
Are authors fairly judged by assessment of the prestige of the journals in which their work is published? This study compares article level metrics with journal level metrics, finding that the vast ma...
0124
Reposted by Ian Hutchins
PLOS @plos.org · 23/12/2025
What defines research impact? New research shows that many of the most influential papers appear in lower-tier journals, highlighting why article-level metrics matter for recognizing individual contributions. Read more in @plosbiology.org: plos.io/4p5jRfH
084
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 22/12/2025
Happy Monday before Christmas! We’ve almost made it through the year. But before we wrap it up, I have one more paper to add to your holiday reading list 1/
122
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 22/12/2025
I want to point out this is consistent with our recent paper on breakthroughs in biomedical science, which found that transformative advances made 2014-2017 were more clinically oriented than those made 1994-1997 (read that paper here) 9/ www.biorxiv.org/content/10.6...
biorxiv.org
Prediction of transformative breakthroughs in biomedical research
The ability to predict scientific breakthroughs at scale would accelerate the pace of discovery and improve the efficiency of research investments. Recent advances in artificial intelligence, graph th...
111
Reposted by Ian Hutchins
Kris Willis @kawillis.bsky.social · 22/12/2025
To start developing an understanding of how to support scientific advances, we analyzed the funding opportunities offered over a span of 32 years, together with the resulting portfolio of applications and awards. Read the whole story here: 7/ www.biorxiv.org/content/10.6...
biorxiv.org
A thirty-year trend of increasing clinical orientation at the National Institutes of Health
It is widely recognized that funding for biomedical research supports the development of major medical advances. However, little systematic effort has been made to determine whether a link exists betw...
132
Reposted by Ian Hutchins
bioRxivpreprint @biorxivpreprint.bsky.social · 18/12/2025
Prediction of transformative breakthroughs in biomedical research www.biorxiv.org/content/10.64898/20…
011
Reposted by Ian Hutchins
Alison Hoens @physioktbroker.bsky.social · 20/12/2025
Article-level metrics preferable for author recognition than journal-level metrics 🧪 journals.plos.org/plosbiology/...
journals.plos.org
Most researchers would receive more recognition if assessed by article-level metrics than by journal-level metrics
Are authors fairly judged by assessment of the prestige of the journals in which their work is published? This study compares article level metrics with journal level metrics, finding that the vast ma...
093
Reposted by Ian Hutchins
eLife @elife.bsky.social · 20/12/2025
Do the journals you publish in align with your values? We push for an alternative to traditional journals that perpetuate a system of prestige and skewed incentives.
062
Reposted by Ian Hutchins
Ethan (Chee Kiang) Ewe @ethanewe.bsky.social · 19/12/2025
"In other words, basing our approach on journallevel metrics would generate enough noise to make the signal of a future breakthrough difficult or impossible to detect. " On a similar note: journals.plos.org/plosbiology/...
journals.plos.org
Most researchers would receive more recognition if assessed by article-level metrics than by journal-level metrics
Are authors fairly judged by assessment of the prestige of the journals in which their work is published? This study compares article level metrics with journal level metrics, finding that the vast ma...
152
Reposted by Ian Hutchins
Chris Pickett @chrispickett5.bsky.social · 18/12/2025
This is a very cool story
032
Reposted by Ian Hutchins
Needhi Bhalla 💅🏽 @needhibhalla.bsky.social · 18/12/2025
"A combination of features produces these diagnostic signals: a burst of papers exploring a novel scientific concept, an unusually high number of very influential papers in specialty journals, and low topical cohesion of the associated content."
252