iiinova — where your digital self keeps evolving

Sanjeev Arora

@profsanjeevarora.bsky.social

1.3K followers 29 following 8 posts

Director, Princeton Language and Intelligence. Professor of CS.

Posts Replies Media

Reposted by Sanjeev Arora

Peter Henderson @peterhenderson.bsky.social · 14/07/2025

Check out our new blogpost and policy brief on our recently updated lab website! ❓Are we actually capturing the bubble of risk for cybersecurity evals? Not really! Adversaries can modify agents by a small amount and get massive gains.

111

Sanjeev Arora @profsanjeevarora.bsky.social · 26/05/2025

Would it make sense to also track how often this happened in pre-2023 cases? Humans "hallucinate" by making cut-and-paste mistakes, or other types of errors.

110

Sanjeev Arora @profsanjeevarora.bsky.social · 22/04/2025

The paper seems to reflect reflect a fundamental misunderstanding about how LLMs work. One cannot (currently) tell an LLM to "ignore pretraining data from year X onwards". The LLM doesn't have data stored neatly inside it in sortable format. It is not like a hard drive.

020

Sanjeev Arora @profsanjeevarora.bsky.social · 16/03/2025

Great comment by my colleague @randomwalker.bsky.social

030

Reposted by Sanjeev Arora

Peter Henderson @peterhenderson.bsky.social · 11/03/2025

Understanding and extrapolating benchmark results will become essential for effective policymaking and informing users. New work identifies indicators that have high predictive power in modeling LLM performance. Excited for it to be out!

1113

Reposted by Sanjeev Arora

Shayne Longpre @shaynelongpre.bsky.social · 13/03/2025

What are 3 concrete steps that can improve AI safety in 2025? 🤖⚠️ Our new paper, “In House Evaluation is Not Enough” has 3 calls-to-actions to empower evaluators: 1️⃣ Standardized AI flaw reports 2️⃣ AI flaw disclosure programs + safe harbors. 3️⃣ A coordination center for transferable AI flaws. 1/🧵

1118

Sanjeev Arora @profsanjeevarora.bsky.social · 29/01/2025

A new path forward for open AI (note the space between the two words). Looking forward to seeing how it enables great research in the open.

140

Sanjeev Arora @profsanjeevarora.bsky.social · 08/01/2025

x.com/parksimon080... Can VLMs do difficult reasoning tasks? Using new dataset for evaluating Simple-to-Hard generalization (a form of OOD generalization) we study how to mitigate the dreaded "modality gap" VLM vs its base LLM. (note: the poster, Simon Park, applied to PhD programs this spring)

x.com

000

Sanjeev Arora @profsanjeevarora.bsky.social · 03/12/2024

SimPO: new method from Princeton PLI for improving chat models via preference data. Simpler than DPO and widely adopted within weeks by top models in the chatbot arena. Excellent and elementary account by author @xiamengzhou.bsky.social (she's also on job market!). tinyurl.com/pepcynaxFully

tinyurl.com

3111

Reposted by Sanjeev Arora

Sadhika Malladi @sadhika.bsky.social · 26/11/2024

I'll be giving a talk on my two recent preference learning works (led by Angelica Chen and @noamrazin.bsky.social) in the AI Tinkerers Paper Club today (11/26) at noon ET. Excited to share this talk with a broader audience! paperclub.aitinkerers.org/p/join-paper...

paperclub.aitinkerers.org

Join Paper Club with Princeton University on Model Alignment Challenges in Preference Learning [AI Tinkerers - Paper Club]

Join Our Paper Club Event Series! Meet with Sadhika Malladi, AI Researcher at Princeton University and discuss the challenges of aligning language models with human preferences. Don’t miss this unique...

051