iiinova — where your digital self keeps evolving

BlackboxNLP @blackboxnlp.bsky.social · 09/09/2026

🎉 Thrilled to announce the keynote speakers for BlackboxNLP 2026 @emnlpmeeting, with three incredible perspectives on interpretability: 🔍 Ivan Titov 🔍 Sheridan Feucht @sfeucht.bsky.social 🔍 Michael Hahn @m-hahn.bsky.social Join us on October 29th! 🇭🇺

0104

BlackboxNLP @blackboxnlp.bsky.social · 31/08/2026

Due to the unprecedented amount of submissions to BlackboxNLP 2026, we will announce the decisions for Main, Special and ARR commitments on September 2 AoE. Thanks for your patience!

063

Reposted by BlackboxNLP

Nils Feldhus @nfel.bsky.social · 17/08/2026

Looking for emergency reviewers for BlackboxNLP 2026. Please sign up through the form linked in the post below if you have time to review 1-2 papers before Aug 20 AoE. bsky.app/profile/blac...

025

BlackboxNLP @blackboxnlp.bsky.social · 21/07/2026

With a high volume of submissions this year, we're recruiting additional reviewers for BlackboxNLP 2026! 🗓 Review deadline: August 17 (AoE) 🗓 Review load: 2-4 papers 📝 Sign up: forms.gle/tha166UQZYqX...

065

BlackboxNLP @blackboxnlp.bsky.social · 16/07/2026

Note: this extension applies only to the Reproducibility Track. The direct submission deadline remains July 17 (AoE). 🔗 blackboxnlp.github.io/2026/reproducibility

blackboxnlp.github.io

BlackboxNLP 2026

The Ninth Workshop on Analyzing and Interpreting Neural Networks for NLP

010

BlackboxNLP @blackboxnlp.bsky.social · 16/07/2026

⏳ The BlackboxNLP 2026 Reproducibility Challenge deadline has been extended to July 24 (AoE) ⏳ If you've been working on a robustness check, ablation, or replication of recent NLP interpretability work, you have a bit more time to get your submission in.

186

BlackboxNLP @blackboxnlp.bsky.social · 11/07/2026

⏳ One week left! The submission deadline for BlackboxNLP 2026 is July 17 (AoE). If you're working on analyzing or interpreting neural networks for NLP, now's the time to get your paper in. 📍 Co-located with #EMNLP2026 in Budapest 🔗 blackboxnlp.github.io

062

BlackboxNLP @blackboxnlp.bsky.social · 01/07/2026

We thank @ndif-team.bsky.social for the generous support of the National Deep Inference Fabric (NDIF). ⏰ Deadline: July 17 (AoE) blackboxnlp.github.io/2026/reprodu...

blackboxnlp.github.io

BlackboxNLP 2026

The Ninth Workshop on Analyzing and Interpreting Neural Networks for NLP

030

BlackboxNLP @blackboxnlp.bsky.social · 01/07/2026

🏆 Announcing the NDIF Best Paper Award for the BlackboxNLP 2026 Reproducibility Challenge! @ndif-team.bsky.social Reproduce an interp. finding with nnsight + NDIF, open-source it, and push it further. Winners will receive a $500 prize, and will be invited to present at the workshop!

183

Reposted by BlackboxNLP

Martin Tutek @mtutek.bsky.social · 02/06/2026

With the large influx of submissions and a faster pace of research, reproducibility is more important than ever. With this reproducibility challenge, we want to put the focus on best practices wrt. baselines🧱, ablations🌈, eval🔎 and generalizability🗺️ of interpretability!

073

Reposted by BlackboxNLP

Yonatan Belinkov @boknilev.bsky.social · 17/06/2026

Are you wondering if LLM interpretability results generalize, reproduce, etc.? Check out the reproducibility challenge and submit your work reproducing papers in this area: bsky.app/profile/blac...

1156

BlackboxNLP @blackboxnlp.bsky.social · 28/05/2026

Interested? Submit a short Expression of Interest naming the paper you'd like to revisit and which theme(s) you'll target. It helps us coordinate efforts and avoid overlap across teams. 🔗 blackboxnlp.github.io/2026/reprodu... 📝 EoI form: forms.gle/gn2auMLagc6k...

blackboxnlp.github.io

BlackboxNLP 2026

The Ninth Workshop on Analyzing and Interpreting Neural Networks for NLP

020

BlackboxNLP @blackboxnlp.bsky.social · 28/05/2026

Inspired by similar efforts like the ML Reproducibility Challenge, we invite the community to revisit and enrich recent interpretability papers - not to question their validity, but to clarify where findings hold, where they break, and what truly drives the reported findings.

130

BlackboxNLP @blackboxnlp.bsky.social · 28/05/2026

📣 Announcing the BlackboxNLP 2026 Reproducibility Challenge! A new track dedicated to rigorous robustness checks of NLP interpretability work - stress-testing baselines, ablations, generalizability, and evaluation.

1165

Reposted by BlackboxNLP

Gabriele Sarti @gsarti.com · 18/03/2026

BlackboxNLP is back once again at EMNLP'26! Very happy to be part of the team again, and excited for our new reproducibility track! Check it out ⬇️

0143

BlackboxNLP @blackboxnlp.bsky.social · 18/03/2026

BlackboxNLP will be co-located with EMNLP 2026 in 🇭🇺 Budapest 🇭🇺 this October! This edition will feature a special reproducibility track, investigating generalization and robustness of established results from interpretability research 👷‍♂️ Stay tuned for more details!

1167

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Nicolò & Mingyang: Can we understand which circuits emerge in small models and reasoning-tuned systems, and how do they compare with default systems? Are there methods that generalize better across all tasks?

000

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Q: What's next for interpretability benchmarks? Michal: People sitting together and planning how to extend tests to multimodal, diverse contexts. @michaelwhanna.bsky.social: For circuit finding, integrating sparse features circuits could help us better understand our models.

100

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Nicolò & Mingyang: Starting to explore notebooks and public libraries can be very helpful in gaining early intuitions about what's promising.

100

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

@michaelwhanna.bsky.social: Don't try to read everything. Find Qs you really care about, and go a level deeper to answer meaningful questions.

100

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Q: How would one go about approaching interpretability research these days? Michal: "When things don't work out of the box, it's a sign to double down and find out why. Negative results are important!"

110

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

@danaarad.bsky.social: As deep learning research converges on similar architectures for different modalities, it will be interesting to determine which interpretability method will remain useful across various models and tasks.

110

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

@michaelwhanna.bsky.social, Nicolò & Mingyang: Counterfactuals in minimal settings can be helpful, but they do not capture the whole story. Extending current methods to long contexts, and finding practical applications in safety-related areas are exciting challenges ahead.

110

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Michal: Mechanistic interpretability has heavily focused on toy tasks and text-only models. The next step is scaling to more complex tasks that involve real-world reasoning.

110

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Our panel moderated by @danaarad.bsky.social "Evaluating Interpretability Methods: Challenges and Future Directions" just started! 🎉 Come to learn more about the MIB benchmark and hear the takes of @michaelwhanna.bsky.social, Michal Golovanevsky, Nicolò Brunello and Mingyang Wang!

1101

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Next up: Kentaro Ozeki presenting "Normative Reasoning in Large Language Models: A Comparative Benchmark from Logical and Modal Perspectives" aclanthology.org/2025.blackbo...

010

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

After a productive poster session, BlackboxNLP returns with the second keynote "Memorization: Myth or Mystery?" by @vernadankers.bsky.social!

070

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Nadav Shani is giving the first oral presentation of the day: Language Dominance in Multilingual Large Language Models. Find the paper here: aclanthology.org/2025.blackbo...

030

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Next up: Circuit-Tracer: A New Library for Finding Feature Circuits presented by @michaelwhanna.bsky.social! Paper: aclanthology.org/2025.blackbo...

030

Reposted by BlackboxNLP

Victor Morand @victormorand.eurosky.social · 22/10/2025

I'll be presenting this work at @blackboxnlp.bsky.social in Suzhou, happy to chat there or here if you are interested !

111

Reposted by BlackboxNLP

Nils Feldhus @nfel.bsky.social · 06/11/2025

Nov 9, @blackboxnlp.bsky.social , 11:00-12:00 @ Hall C – Interpreting Language Models Through Concept Descriptions: A Survey (Feldhus & Kopf) @lkopf.bsky.social 🗞️ aclanthology.org/2025.blackbo... bsky.app/profile/nfel...

aclanthology.org

Interpreting Language Models Through Concept Descriptions: A Survey

Nils Feldhus, Laura Kopf. Proceedings of the 8th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP. 2025.

142

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

Quanshi Zhang is giving the first keynote of the day: Can Neural Network Interpretability Be the Key to Breaking Through Scaling Law Limitations in Deep Learning?

000

BlackboxNLP @blackboxnlp.bsky.social · 09/11/2025

BlackboxNLP is up and running! Here's the topics covered by this year's edition at a glance. Excited to see so many interesting topics, and the growing interest in reasoning!

020

BlackboxNLP @blackboxnlp.bsky.social · 12/08/2025

📢 Call for Papers! 📢 #BlackboxNLP 2025 invites the submission of archival and non-archival papers on interpreting and explaining NLP models. 📅 Deadlines: Aug 15 (direct submissions), Sept 5 (ARR commitment) 🔗 More details: blackboxnlp.github.io/2025/call/

091

BlackboxNLP @blackboxnlp.bsky.social · 06/08/2025

Writing your technical report for the MIB shared task? Take a look at the task page for guidelines and tips!

020

BlackboxNLP @blackboxnlp.bsky.social · 06/08/2025

The report deadline was also extended to August 10th! Note that this is a final extension. We look forward to reading your reports! ✍️

021

BlackboxNLP @blackboxnlp.bsky.social · 03/08/2025

Just 5 days left to submit your method to the MIB Shared Task at #BlackboxNLP! Have last-minute questions or need help finalizing your submission? Join the Discord server: discord.gg/n5uwjQcxPR

011

BlackboxNLP @blackboxnlp.bsky.social · 30/07/2025

Results + technical report deadline: August 8, 2025 Full task details: blackboxnlp.github.io/2025/task/

blackboxnlp.github.io

BlackboxNLP 2025

The Eight Workshop on Analyzing and Interpreting Neural Networks for NLP

000

BlackboxNLP @blackboxnlp.bsky.social · 30/07/2025

With the new extended deadline, there's still plenty of time to submit your method to the MIB Shared Task! We welcome submissions of existing methods, experimental POCs, or any approach addressing circuit discovery or causal variable localization 💡

121

BlackboxNLP @blackboxnlp.bsky.social · 29/07/2025

Results deadline extended by one week! Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week. 🗓️ New deadline: August 8, 2025 Submit your method via the MIB leaderboard!

031

BlackboxNLP @blackboxnlp.bsky.social · 28/07/2025

📝 Technical report guidelines are out! If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/

031

BlackboxNLP @blackboxnlp.bsky.social · 23/07/2025

Just 10 days to go until the results submission deadline for the MIB Shared Task at #BlackboxNLP! If you're working on: 🧠 Circuit discovery 🔍 Feature attribution 🧪 Causal variable localization now’s the time to polish and submit! Join us on Discord: discord.gg/n5uwjQcxPR

031

Reposted by BlackboxNLP

Martin Tutek @mtutek.bsky.social · 17/07/2025

Are you attending ICML? 👀 I'm sadly not, but if you are, you should check out the MIB 🕶️poster at 11AM: icml.cc/virtual/2025... The benchmark is used as the shared task at this year's @blackboxnlp.bsky.social (blackboxnlp.github.io/2025/task/) - there's still time to participate 🏆

icml.cc

ICML Poster MIB: A Mechanistic Interpretability BenchmarkICML 2025

041

BlackboxNLP @blackboxnlp.bsky.social · 13/07/2025

⏳ Three weeks left! Submit your work to the MIB Shared Task at #BlackboxNLP, co-located with @emnlpmeeting.bsky.social Whether you're working on circuit discovery or causal variable localization, this is your chance to benchmark your method in a rigorous setup!

042

BlackboxNLP @blackboxnlp.bsky.social · 09/07/2025

Have you started working on your submission for the MIB shared task yet? Tell us what you’re exploring! New featurization methods? Circuit pruning? Better feature attribution? We'd love to hear about it 👇

021

BlackboxNLP @blackboxnlp.bsky.social · 08/07/2025

🗓️ Deadline: August 1 📜 Full task details: blackboxnlp.github.io/2025/task/ 💬 Join the discussion: discord.gg/n5uwjQcxPR

blackboxnlp.github.io

BlackboxNLP 2025

The Eight Workshop on Analyzing and Interpreting Neural Networks for NLP

020

BlackboxNLP @blackboxnlp.bsky.social · 08/07/2025

Working on feature attribution, circuit discovery, feature alignment, or sparse coding? Consider submitting your work to the MIB Shared Task, part of this year’s #BlackboxNLP We welcome submissions of both existing methods and new or experimental POCs!

153

BlackboxNLP @blackboxnlp.bsky.social · 07/07/2025

New to mechanistic interpretability? The MIB shared task is a great opportunity to experiment: ✅ Clean setup ✅ Open baseline code ✅ Standard evaluation Join the discord server for ideas and discussions: discord.gg/n5uwjQcxPR

093

Reposted by BlackboxNLP

Gabriele Sarti @gsarti.com · 04/07/2025

The wait is over! 🎉 Our speakers for #BlackboxNLP 2025 are finally out!

052