Sign in

Shahan Ali Memon

@shahanmemon.bsky.social
3.2K followers 1.5K following 1.1K posts

Researching {science of AI for science, AI governance, science of science & innovation #SciSci, #AI4Science, AI agents, alignment} PhD Candidate @ UW. Visiting Scholar @ NYU & MSR Alum @ Carnegie Mellon Academic webpage: samemon.github.io

PostsRepliesMedia
Reposted by Shahan Ali Memon
Cailin O’Connor @cailinmeister.bsky.social · 3h
New substack about our new paper looking at how the impact of a paper shapes its retraction! @jevinwest.bsky.social @shahanmemon.bsky.social
cailinoconnor.substack.com
Are famous scientific findings easier to retract?
It may paradoxically be easier to claw back well-known findings, since they’re the ones people like to talk about.
273
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 25/09/2026
New post on the @cosmik.network blog! A creative new use of @semble.so by @paperpilot.dev inspired a sequel to "Sensors, not Bookmarks" from the writer's perspective - the Connections you make on Semble can help your writing find its natural audience
blog.cosmik.network
Connecting with your readers on Semble [Patterns of Sensemaking #2]
On how the references you make help your writing find its natural audience
2309
Reposted by Shahan Ali Memon
ae @aelkus.bsky.social · 24/09/2026
People really need to go back to the original Jurassic Park and look at the rather disturbing ways in which InGen's management of it now looks prescient
330887
Shahan Ali Memon @shahanmemon.bsky.social · 22/09/2026
Had an interesting panel discussion on "Where Should #AI Stop in #Science?" with fellow panelists David Resnik, Rory McGreal, Catherine Chen, and Javier Ramirez. Here is the link to the video: www.youtube.com/live/VqcnZbf... #metascience #responsibleAI #ScAISci #scisci #academia #publishing
youtube.com
The Open Question Ep. 01: Where should AI stop?
YouTube video by The Open Question
130
Reposted by Shahan Ali Memon
Shahan Ali Memon @shahanmemon.bsky.social · 20/09/2026
More than 50,000 submissions to @iclr-conf.bsky.social this year? That's more than all the previous iterations combined. This is after the limit they imposed of 20 max paper per author. With this rate, we will have more than 100k next year. Need better reforms urgently. #SciSci #Academia
184
Shahan Ali Memon @shahanmemon.bsky.social · 20/09/2026
More than 50,000 submissions to @iclr-conf.bsky.social this year? That's more than all the previous iterations combined. This is after the limit they imposed of 20 max paper per author. With this rate, we will have more than 100k next year. Need better reforms urgently. #SciSci #Academia
184
Shahan Ali Memon @shahanmemon.bsky.social · 18/09/2026
"Hallu-citations are so 2023." Yet, I just got an @arxiv.bsky.social cs.AI endorsement request for a paper on -prompt optimization- Checked the references. Most were hallucinated. I guess the prompt still needs some optimization... PS. If you’re going to use AI, at least be better at using AI.
140
Reposted by Shahan Ali Memon
Iyad Rahwan | إياد رهوان @iyadrahwan.bsky.social · 16/09/2026
Introducing: Time Machine Experiments? 🚀 ⏳ in which participants 'travel' to the past, and interact with a mind from the year 1930 (simulated by an AI with knowledge cut-off). Preprint: arxiv.org/pdf/2609.15468
2157
Shahan Ali Memon @shahanmemon.bsky.social · 11/09/2026
Rumor has it that every professor is issued a magic wand as part of the faculty onboarding packet, specifically for trimming down their advisees' @chi.acm.org papers... don't forget to use them today 🪄✂️ 🫣 #CHI #GottaFitWithin12kWords #OMGOMGOMGOMGOMGOMG
000
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 09/09/2026
This is a really thought provoking piece on a topic I think about a lot these days - what does it mean to be a human researcher in the age of powerful AI? So I also created an open @semble.so collection - contributions welcome!
semble.so
science in the age of AI (by Ronen Tamari) — Semble
What does it mean to be a human researcher in the age of powerful AI?
1141
Reposted by Shahan Ali Memon
Trevor A. Branch @trevorabranch.bsky.social · 08/09/2026
Millennium math problem solved by OpenAI may have "regurgitated" competitors unpublished work... also they spent more than $22 million in computing power in one week to scoop them. techcrunch.com/2026/09/08/o...
techcrunch.com
OpenAI fought dirty on career-making math problem, says NYU mathematician | TechCrunch
There is a $1 million bounty for the first person providing a solution to the Navier-Stokes existence and smoothness problem.
391331459
Reposted by Shahan Ali Memon
Benjamin Riley @benjaminjriley.bsky.social · 08/09/2026
SPECIAL REPORT Last month, Alpha School invited people to follow student social media accounts "if curious about life in our high schools." I accepted their offer. What I've found shocks me. Forget the AI and ask instead: Is Alpha Schools a cult? Follow along for a summary of my findings.
buildcognitiveresonance.substack.com
SPECIAL REPORT: My So-Called Alpha School
What is it like to be a student in Alpha School’s high school boot camp?
481006385
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 07/09/2026
@atproto.berlin maybe a relevant funding opportunity for the community (happy to brainstorm @atproto.science connections for the proposal if relevant) foresight.org/grants/ai-sc...
foresight.org
AI for Science & Safety Nodes - Request for Proposals
162
Shahan Ali Memon @shahanmemon.bsky.social · 07/09/2026
This is fantastic. Wish more labs started doing this.
061
Reposted by Shahan Ali Memon
M.J. Crockett @mjcrockett.bsky.social · 07/09/2026
I'll be considering PhD applicants for a Fall 2027 start date. I'd love to hear from prospective students interested in critical projects about AI, knowledge production, cultural narratives, and epistemic power. More info about our lab, and how to apply, here: www.crockettlab.org/joining-the-...
crockettlab.org
Joining the Lab — Crockett Lab
03321
Shahan Ali Memon @shahanmemon.bsky.social · 06/09/2026
May your AI agents unionize, demand weekends, and slow the paper factory down. I am all for raising the AI Wellbeing Index this way if that encourages people to slow down a bit. #AIWelfare
111
Shahan Ali Memon @shahanmemon.bsky.social · 04/09/2026
"Research as a service (RaaS)" aka modern paper mills(?) are here. For only $100k, submit a paper in Neurips/ICML/ICLR. Unfortunately, acceptance -NOT- guaranteed. #SciSci #Metascience #PredatoryPublishing
170
Reposted by Shahan Ali Memon
Carl T. Bergstrom @carlbergstrom.com · 17/08/2026
1. Recently I’ve received lots of emails from people I don’t know personally, asking for my feedback on their books or papers. They explain the connection between my work and theirs and ask me to take a look. The catch, of course, is that the emails are transparently, obviously, written by AI.
16685152
Shahan Ali Memon @shahanmemon.bsky.social · 07/08/2026
#Academia has an empathy problem. #LongRant We train people to be rigorous thinkers, and productive researchers (or at least claim to). But we do far less to train ourselves to listen, uplift others, and be good members of an intellectual community. We should actively practice empathy too. 🧵
67722
Shahan Ali Memon @shahanmemon.bsky.social · 01/08/2026
Are you on academic job market for #Postdoc or #TT Assistant/Assoc. Prof/Lecturer/ #AP /Research Scholar/ #fellowship jobs for 2026-2027 in #CS/ #SocSci/ #InfoSci/ Management Science/ #Psych & similar? Like last year, I am maintaining a list (so far ~200 positions) docs.google.com/spreadsheets...
docs.google.com
2026-2027 Postdoc/TT/Research Scientist Positions in Information/CS/Social Science + Related Fields
32811
Shahan Ali Memon @shahanmemon.bsky.social · 29/07/2026
This week I am @ic2s2.bsky.social in Burlington, Vermont. I will be presenting our work @ischool.uw.edu on detection of AI mediation in scientific software as a parallel talk, as well as our work on red-teaming AI models using speculative "silly" tasks as a poster. Come say /hi! #IC2S2 #CSS
172
Reposted by Shahan Ali Memon
Shahan Ali Memon @shahanmemon.bsky.social · 23/07/2026
What if paper reading and reviewing was interactive and visual? Tools today assume a very passive way of engaging with a paper: you open a PDF and read linearly, top to bottom. But most of us already break that assumption: results first, figures before text, abstract then conclusion. 🧵 #scisci
1134
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 23/07/2026
1/ Lots of thoughts about the new White House science and tech policy report, meanwhile just a few quick notes (I only skimmed it so far but plan to read through it)
whitehouse.gov
Science: A New Golden Age
President Trump seeks to lay the foundations for a new Golden Age of American Innovation. The Trump administration is working to revitalize the national science enterprise, to secure U.S. leadership i...
1102
Shahan Ali Memon @shahanmemon.bsky.social · 23/07/2026
What if paper reading and reviewing was interactive and visual? Tools today assume a very passive way of engaging with a paper: you open a PDF and read linearly, top to bottom. But most of us already break that assumption: results first, figures before text, abstract then conclusion. 🧵 #scisci
1134
Reposted by Shahan Ali Memon
Cailin O’Connor @cailinmeister.bsky.social · 20/07/2026
Retractions in science don't work well. In our *new paper* we find widely known findings are easier to retract, possibly bc the retraction is relevant to more people, allowing information about it to spread socially @jevinwest.bsky.social @shahanmemon.bsky.social www.cambridge.org/core/journal...
cambridge.org
Are Widely Known Findings Easier to Retract? | Philosophy of Science | Cambridge Core
Are Widely Known Findings Easier to Retract?
23913
Shahan Ali Memon @shahanmemon.bsky.social · 16/07/2026
“May your day be filled with sunshine and smiles.” ☀️ I am neither a professor nor qualified to submit in a biomedical journal, but with this greeting I might just submit something. 🤷‍♂️ Wish more people in academia started their emails this way.
The email from biomedical journal starts with the greeting “May your day be filled with sunshine and smiles”
020
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 14/07/2026
New Boston/Cambridge area AI for science fellowship fellowship.transfyr.ai (also is it possible to tag posts with geo location? 🤔)
fellowship.transfyr.ai
Transfyr AI Fellowship
A 1 year Transfyr AI Fellowship for exceptional graduate students leading projects on frontier machine learning problems that impact real-world science.
1141
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 14/07/2026
I've been a @zotero.org user for more than 6 years and have thousands of references - I've always dreamed of being able to see who else was reading those references on my virtual bookshelves. That dream is starting to come true ✨ With Zemble, every reference becomes a portal 🌀 >
14410
Reposted by Shahan Ali Memon
Emily M. Bender @emilymbender.bsky.social · 10/07/2026
A beautiful essay indeed, and great jumping off point for people across all fields of scholarship to reflect on what it is we are doing and why. A short thread >>
410929
Shahan Ali Memon @shahanmemon.bsky.social · 10/07/2026
The video for our paper on "AI Welfare is Bullshit," presented this week @icmlconf.bsky.social, is now available here: icml.cc/virtual/2026... Also a short thread below. #AIWelfare
icml.cc
ICML Poster Position: AI Welfare Is BullshitICML 2026
031
Shahan Ali Memon @shahanmemon.bsky.social · 02/07/2026
This year's @icssi.org in Boulder, Colorado was a blast. It was a full three-day conference (including a hackathon). Congratulations to this year's organizers for making this year's ICSSI a success. I had the opportunity to present 3 of my ongoing projects. 🧵 #Scisci #metascience
150
Shahan Ali Memon @shahanmemon.bsky.social · 29/06/2026
Favorite joke/play on words at @icssi.org. @sampat.bsky.social, introducing the panelist, Lisa Margonelli, who is editor of issues in Science Technology: “You’re the editor of Issues in Science Technology…” beat “…well, science certainly has issues. Let’s talk about them” #SciSci #metascience
041
Reposted by Shahan Ali Memon
M.J. Crockett @mjcrockett.bsky.social · 22/06/2026
Some new work on AI & science: A reporting checklist for LLMs in behavioral science Thanks to @sfeuerriegel.bsky.social for spearheading. As LLMs become more common in research, transparency is essential. We developed a reporting checklist for reporting how LLMs were used - please share! 1/4
nature.com
A reporting checklist for large language models in behavioural science - Nature Human Behaviour
Large language models offer new opportunities for behavioural science, but their rapid evolution poses challenges for research rigour. We introduce a consensus-based reporting checklist to improve tra...
47930
Reposted by Shahan Ali Memon
Nathan Lambert @natolambert.bsky.social · 19/06/2026
Banning Open Source AI Would Be A Mistake A general audience PSA with Kevin Xu of Interconnected, while AI regulation is in the air in DC www.interconnects.ai/p/banning-op...
interconnects.ai
Banning Open Source AI Would Be A Mistake
This post was originally an op-ed co-authored with Kevin Xu of Interconnected for a general, non-technical audience.
1657
Reposted by Shahan Ali Memon
Mel Andrews @bayesianboy.bsky.social · 17/06/2026
Here is work showing some of this effect. It is important, however, to see the form that this takes ‘in the wild’ in terms of the erasure of actual women-led scholarship in LLMs by multiple modalities, so I intend to run some bibliometrics myself and put the results out. arxiv.org/abs/2508.02740
arxiv.org
Who Gets Cited? Gender- and Majority-Bias in LLM-Driven Reference Selection
Large language models (LLMs) are rapidly being adopted as research assistants, particularly for literature review and reference recommendation, yet little is known about whether they introduce demogra...
5545118
Reposted by Shahan Ali Memon
Iyad Rahwan | إياد رهوان @iyadrahwan.bsky.social · 09/06/2026
LLMs are used widely in the behavioral sciences. But we have no good standards for how to do so. We introduce a consensus-based reporting checklist to improve transparency, reproducibility and ethical accountability of LLM-based research in the behavioural sciences. www.nature.com/articles/s41...
nature.com
A reporting checklist for large language models in behavioural science - Nature Human Behaviour
Large language models offer new opportunities for behavioural science, but their rapid evolution poses challenges for research rigour. We introduce a consensus-based reporting checklist to improve tra...
0199
Reposted by Shahan Ali Memon
Mel Andrews @bayesianboy.bsky.social · 05/06/2026
Industry is parasitic on academia for research, innovation, and training. The sweeping attacks on academia currently underway in the US are going to gut industry in the years to come. hbr.org/2026/06/the-...
hbr.org
The U.S. Research Talent Pipeline Is in Trouble
Policy shifts, funding instability, and visa uncertainty are causing a sharp decline in the willingness of young scientists trained in the United States to stay in academia—or even remain in the count...
05318
Reposted by Shahan Ali Memon
Daniel Gorelick @danielgorelick.bsky.social · 03/06/2026
Paying peer reviewers works. Expanded Fast & Fair experiment @biologyopen.bsky.social: • 5.5 vs 37.7 working days to decision with reviews • ~3 vs ~9 reviewer invitations per manuscript • no reduction in editor-assessed review quality • similar acceptance rates www.biorxiv.org/content/10.6...
Scatter plot showing that Fast & Fair peer review reached first decision with reviews much faster than conventional peer review: mean 5.5 versus 37.7 working days. Most Fast & Fair manuscripts met the 7-working-day target, while conventional manuscripts were slower and more variable, up to 116 working days.
8232117
Shahan Ali Memon @shahanmemon.bsky.social · 30/05/2026
What's going on with #OpenAlex? I searched for api.openalex.org/works/W43852... which used to refer to the "Attention is all you need" paper. However, it now points to a paper: "MizAR 60 for Mizar 50" which according to OA has 75k cites, but really has about 15 (according to google and sem. scholar)
150
Reposted by Shahan Ali Memon
Thomas Dietterich @tdietterich.bsky.social · 29/05/2026
Interesting post by Jessica Hullman. In a future where autonomous research is possible at scale, one can imagine companies building their own bodies of scientific knowledge and not sharing it. Unlike human scientists, AI scientists are not motivated to share their work.
4283
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 28/05/2026
Had a great conversation today with @jortscity.bsky.social @wesleyfinck.org about the attention economy and how we can connect personal tools for thought like @obsidian.md into tools for collective thought with @semble.so and #atproto "seize the means of sensemaking"
4212
Reposted by Shahan Ali Memon
ICSSI @icssi.org · 28/05/2026
Students are critical to a vibrant ICSSI community. Today, thanks to support from the Alfred P. Sloan Foundation and the NSF, we're thrilled to announce: FREE ICSSI 2026 registration for ALL trainees! Registration reopened: icssi.org/register/ Already registered? Look for a refund soon!
Students are critical to a vibrant ICSSI community. Today, thanks to support from the Alfred P. Sloan Foundation and the NSF, we're thrilled to announce:

FREE ICSSI 2026 registration for ALL trainees!

Registration reopened: https://icssi.org/register/
Already registered? Look for a refund soon!
0166
Reposted by Shahan Ali Memon
Jay Patel @infotainment.bsky.social · 14/05/2026
#ATProtoScience tools can enable sensemaking and maybe some nerdy jobs in the near future: "Similar to how social media made influencers... maybe there'll be influencers [as scholarly] sensemakers... [attendee: high need for cognition people]..." Yep, that's my dream job, @ronentk.me
youtube.com
From Social Network to Sense Making
YouTube video by Complex Data Lab
1124
Reposted by Shahan Ali Memon
Mark Riedl @markriedl.bsky.social · 14/05/2026
ArXiV has a new LLM policy (Screenshots with alt text so you don’t have to click through to the other place and see all the stupid responses)
Attention @arxiv authors: Our Code of Conduct states that by signing your name as an author of a paper, each author takes full responsibility for all its contents, irrespective of how the contents were generated. 1/If generative AI tools generate inappropriate language, plagiarized content, biased content, errors, mistakes, incorrect references, or misleading content, and that output is included in scientific works, it is the responsibility of the author(s). 2/

We have recently clarified our penalties for this. If a submission contains incontrovertible evidence that the authors did not check the results of LLM generation, this means we can't trust anything in the paper. 3/The penalty is a 1-year ban from arXiv followed by the requirement that subsequent arXiv submissions must first be accepted at a reputable peer-reviewed venue. 4/

Examples of incontrovertible evidence: hallucinated references, meta-comments from the LLM ("here is a 200 word summary; would you like me to make any changes?"; "the data in this table is illustrative, fill it in with the real numbers from your experiments") end/
8312105
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 14/05/2026
The one who controls the medium, controls the message
2172
Reposted by Shahan Ali Memon
Shahan Ali Memon @shahanmemon.bsky.social · 30/04/2026
Our position paper, "AI Welfare Is Bullshit" just got accepted to ICML 2026 @icmlconf.bsky.social! The AI welfare agenda has already begun to attract institutional investment at organizations such an @anthropic.com. We argue that this idea is essentially Frankfurtian Bullshit.
56219
Reposted by Shahan Ali Memon
Ronen Tamari @ronentk.me · 09/05/2026
So good! And @atproto.science is the perfect place to realize this vision
1174
Reposted by Shahan Ali Memon
Richard Van Noorden @richvn.bsky.social · 06/05/2026
Well, well. A science publisher (Elsevier) decides to sue an AI firm over copyright infringement. Lawsuit with other publishers (Macmillan, Hachette etc.) vs Meta for training Llama models on copyrighted content, in Common Crawl and then from Sci-Hub among others. www.reuters.com/sustainabili...
reuters.com
Major publishers sue Meta for copyright infringement over AI training
Publishers Elsevier, Cengage, Hachette , Macmillan and McGraw Hill sued Meta Platforms in Manhattan federal court on Tuesday, alleging ​that the tech giant misused their books and journal articles to ...
0810
Reposted by Shahan Ali Memon
Shahan Ali Memon @shahanmemon.bsky.social · 04/05/2026
On AI-mediated software and #vibecoding. The way we work is deeply personal, but most of the software we use is not. With agentic AI systems, could the future of software be more personal? Some thoughts 🧵 1/14
121
Reposted by Shahan Ali Memon
M.J. Crockett @mjcrockett.bsky.social · 04/05/2026
🧵
2113