iiinova — where your digital self keeps evolving

Reposted by Niranjan

Jaemin Cho @jmincho.bsky.social · 20/05/2025

Some personal updates: - I've completed my PhD at @unccs.bsky.social! 🎓 - Starting Fall 2026, I'll be joining the CS dept. at Johns Hopkins University @jhucompsci.bsky.social as an Assistant Professor 💙 - Currently exploring options for my gap year (Aug 2025 - Jul 2026), so feel free to reach out! 🔎

3305

Reposted by Niranjan

Pegah پگاه @itspegah.bsky.social · 16/05/2025

Our paper "Misattribution Matters: Quantifying Unfairness in Authorship Attribution" got accepted to #ACL2025! @niranjanb.bsky.social @ajayp95.bsky.social Arxiv link coming hopefully soon!

022

Reposted by Niranjan

Mohit Bansal @mohitbansal.bsky.social · 05/05/2025

🔥 BIG CONGRATS to Elias (and UT Austin)! Really proud of you -- it has been a complete pleasure to work with Elias and see him grow into a strong PI on *all* axes 🤗 Make sure to apply for your PhD with him -- he is an amazing advisor and person! 💙

1124

Reposted by Niranjan

Ahmad Beirami @abeirami.bsky.social · 03/05/2025

If you are at #AISTATS2025 and are interested in concept erasure, talk to @somnathbrc.bsky.social at Poster Session 1 on Saturday May 3.

0164

Reposted by Niranjan

Lisa Alazraki @lisaalaz.bsky.social · 30/04/2025

I’ll be presenting Meta-Reasoning Improves Tool Use in Large Language Models at #NAACL25 tomorrow Thursday May 1st from 2 until 3.30pm in Hall 3! Come check it out and have a friendly chat if you’re interested in LLM reasoning and tools 🙂 #NAACL

151

Reposted by Niranjan

Kaitlyn Zhou @kaitlynzhou.bsky.social · 29/04/2025

Thrilled that our paper won 🏆 Best Paper Runner-Up 🏆 at #NAACL25!! Our work (REL-A.I.) introduces an evaluation framework that measures human reliance on LLMs and reveals how contextual features like anthropomorphism, subject, and user history can significantly influence user reliance behaviors.

1303

Reposted by Niranjan

Nishant Subramani @ ACL @nsubramani23.bsky.social · 29/04/2025

🚀 Excited to share a new interp+agents paper: 🐭🐱 MICE for CATs: Model-Internal Confidence Estimation for Calibrating Agents with Tools appearing at #NAACL2025 This was work done @msftresearch.bsky.social last summer with Jason Eisner, Justin Svegliato, Ben Van Durme, Yu Su, and Sam Thomson 1/🧵

1128

Niranjan @niranjanb.bsky.social · 29/04/2025

I'll do the advisory advertising: @ykl7.bsky.social‬ is a fantastic researcher and is passionate about being in academia. He has this amazing ability to simply get things done! Happy to say more in a letter or over a chat but if you are going to @naaclmeeting.bsky.social (#NAACL2025) ping him.

131

Reposted by Niranjan

Abhilasha Ravichander @lasha.bsky.social · 31/01/2025

We are launching HALoGEN💡, a way to systematically study *when* and *why* LLMs still hallucinate. New work w/ Shrusti Ghela*, David Wadden, and Yejin Choi 💫 📝 Paper: arxiv.org/abs/2501.08292 🚀 Code/Data: github.com/AbhilashaRav... 🌐 Website: halogen-hallucinations.github.io 🧵 [1/n]

3348

Reposted by Niranjan

NAACL @naaclmeeting.bsky.social · 25/04/2025

🟢 Announcing the #NAACL2025 Award Winners! The Best Paper and Best Theme Paper winners will present at our closing session 2025.naacl.org/blog/best-pa...

0177

Reposted by Niranjan

Archiki Prasad @archiki.bsky.social · 18/04/2025

🚨Real-world retrieval is messy: queries are ambiguous or docs conflict & have incorrect/irrelevant info. How can we jointly address these problems? ➡️RAMDocs: challenging dataset w/ ambiguity, misinformation & noise ➡️MADAM-RAG: multi-agent framework, debates & aggregates evidence across sources 🧵⬇️

3167

Reposted by Niranjan

Greg Durrett @gregdnlp.bsky.social · 16/04/2025

Check out @juand-r.bsky.social and @wenxuand.bsky.social 's work on improving generator-validator gaps in LLMs! I really like the formulation of the G-V gap we present, and I was pleasantly surprised by how well the ranking-based training closed the gap. Looking forward to following up in this area!

0112

Reposted by Niranjan

Ai2 @ai2.bsky.social · 09/04/2025

For years it’s been an open question — how much is a language model learning and synthesizing information, and how much is it just memorizing and reciting? Introducing OLMoTrace, a new feature in the Ai2 Playground that begins to shed some light. 🔦

45712

Reposted by Niranjan

Pasquale Minervini @neuralnoise.com · 13/03/2025

Please share it within your circles! edin.ac/3DDQK1o

0139

Reposted by Niranjan

Conference on Language Modeling @colmweb.org · 10/03/2025

Excited to announce the COLM 2025 keynote speakers: Shirley Ho, Nicholas Carlini, @lukezettlemoyer.bsky.social, and Tom Griffiths! See you in October in Montreal!

0243

Niranjan @niranjanb.bsky.social · 09/12/2024

Thanks @mohitbansal.bsky.social for the wonderful Distinguished Lecture on agents and multimodal generation. This got so many of us here at Stony Brook excited for the potential in these areas. Also, thanks for spending time with our students & sharing your wisdom. It was a pleasure hosting you!

1103

Niranjan @niranjanb.bsky.social · 03/12/2024

Excited to host the wonderful @mohitbansal.bsky.social as part of Stony Brook CS Distinguished Lecture Series on Dec 6th. Looking forward to hearing about his team's fantastic work on Planning Agents for Collaborative Reasoning and Multimodal Generation. More here: tinyurl.com/jkmex3e9

A flyer announcing that Professor Mohit Bansal from the University of North Carolina Chapel Hill will present a Distinguished Lecture on Planning Agents for Collaborative Reasoning and Multimodal Generation at 2:30 PM in the New Computer Science Room 120 on Dec 6th 2024. The flyer also has a head shot of Mohit Bansal.

130

Reposted by Niranjan

Marc Marone @marcmarone.com · 23/11/2024

I noticed a lot of starter packs skewed towards faculty/industry, so I made one of just NLP & ML students: go.bsky.app/vju2ux Students do different research, go on the job market, and recruit other students. Ping me and I'll add you!

10117654

Reposted by Niranjan

Catherine Arnett @catherinearnett.bsky.social · 22/11/2024

✨New pre-print!✨ Successful language technologies should work for a wide variety of languages. But some languages have systematically worse performance than others. In this paper we ask whether performance differences are due to morphological typology. Spoiler: I don’t think so! #NLP #linguistics

27614

Reposted by Niranjan

Orion Weller @orionweller.bsky.social · 15/09/2023

Using LLMs for query or document expansion in retrieval (e.g. HyDE and Doc2Query) have scores going 📈 But do these approaches work for all IR models and for different types of distribution shifts? Turns out its actually more 📉 🚨 📝 (arxiv soon): orionweller.github.io/assets/pdf/L...

A plot: the x axis is baseline score of rankers, in ndcg@10. y axis is delta of model score after an expansion is applied.

There are three sets of results, one dataset for each shift type: TrecDL (no shift), FiQA (domain shift), ArguAna (query shift). For each set of result, the chart shows a scatter plot with a trend line. We observe the same trend for all: as the baseline score increases, the delta when using expansion decreases.

On TREC DL, worst models have a base score of ~40, and improve by 10 points w/expansion. the best models have a score of >70, and their performance decreases by -5 points w/expansion.

On FiQA, worse models have a base score of ~15, and improve by 5 points w/expansion. the best models have a score of ~45, and their performance decreases by -3 point w/expansion.

On ArguAna, worst models have a base score of ~25, and improve by >20 points w/expansion. the best models have a score of >55, and their performance decreases by -1 point w/expansion.

3436

Reposted by Niranjan

Harsh Trivedi @harsh3vedi.bsky.social · 21/11/2024

🚨 We are refreshing the 🌎 AppWorld (appworld.dev) leaderboard with all the new coding and/or tool-use LMs. ❓ What would you like to be included? 🔌 Self-plugs are welcome!! x.com/harsh3vedi/s...

072