Sign in

*SHROOM Shared Task

@shroom-st.bsky.social
5 followers 10 following 22 posts

*SHROOM Shared-Task Series on Hallucinations and Related Observable Overgeneration Mistakes. This year we go for multimodal: SHROOM-Visions 2026.

PostsRepliesMedia
*SHROOM Shared Task @shroom-st.bsky.social · 22/09/2026
Excited to share that our overview paper is accepted to #UncertaiNLP workshop! We will present it on October 29th @emnlpmeeting.bsky.social #EMNLP2026 #SHROOM #shared_task
000
*SHROOM Shared Task @shroom-st.bsky.social · 07/09/2026
🎉Paper notifications OUT! Congratulations on your system description paper! Please prepare and submit your camera-ready version by taking the reviewers’ suggestions into account. - Camera-ready due: Sep 11 - Page limite: 5 - Make sure to include our overview and dataset papers #SHROOM_ST #EMNLP26
010
*SHROOM Shared Task @shroom-st.bsky.social · 27/08/2026
🥳Our overview paper "Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models" is available on line! arxiv.org/abs/2608.25662 Participants, please check your team names and descriptions in case of mistakes. #UncertainNLP #EMNLP
arxiv.org
Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models
In 2026, we held the fourth iteration of the SHROOM Shared Task series: SHROOM-Visions (\textbf{S}hared-task on \textbf{H}allucinations and \textbf{R}elated \textbf{O}bservable \textbf{O}vergeneration...
011
*SHROOM Shared Task @shroom-st.bsky.social · 25/08/2026
Follow the instructions and register for EMNLP if you wish to attend SHROOM-V shared task!! Looking forward to seeing many of you 🤗🤗 #emnlp2026 #SHROOM_ST #NLProc
011
*SHROOM Shared Task @shroom-st.bsky.social · 24/08/2026
Reminder: reciprocal review deadline is in one week, on August 31st. Please remember to keep your comments constructive and respectful, with a focus on how the authors could improve the readability of their paper. #review #NLProc #sharedtask
010
*SHROOM Shared Task @shroom-st.bsky.social · 21/08/2026
🥳Happy to share that SHROOM-Vision dataset paper, SHEEP, has been accepted to the EMNLP Main conference! Congrats to all the co-authors and big thank to the #SHROOM_ST organization team! Can't wait to read it? arxiv.org/abs/2608.01021 #NLProc #sharedtask #datasets #emnlp
042
*SHROOM Shared Task @shroom-st.bsky.social · 17/08/2026
☑️Reviewing process starts! The nominated reciprocal reviewers will review 1-2 papers. The assignments have now been released on OpenReview. - Review deadline: **August 31** - Notification of acceptance: September 4 - Camera ready: September 11 #NLPreview #NLProc #shared_task
010
*SHROOM Shared Task @shroom-st.bsky.social · 10/08/2026
⌛️~28 hours left to submit your system paper! Kindly follow this template for your paper title: “Team X at SHROOM-Visions: ” - Ddl: Aug 10th, AoE - Submission: openreview.net/group?id=EMN... - Please cite the dataset paper SHEEP: arxiv.org/abs/2608.01021 #NLProc #emnlp2026 #SHROOM_ST
openreview.net
EMNLP 2026 Workshop SHROOM-Visions
Welcome to the OpenReview homepage for EMNLP 2026 Workshop SHROOM-Visions
021
*SHROOM Shared Task @shroom-st.bsky.social · 08/08/2026
3️⃣ days left to submit your system paper 💪 Please use this template for your paper title “Team X at SHROOM-Visions”. Looking forward to learn about your systems! #NLProc #emnlp2026 #SHROOM_ST
012
*SHROOM Shared Task @shroom-st.bsky.social · 06/08/2026
Join our SHROOM shared task at EMNLP 2026 @emnlpmeeting.bsky.social in Budapest, and pushing the limites of hallucination detection in LVLMs !!
010
Reposted by *SHROOM Shared Task
Timothee Mickus @linguistickus.bsky.social · 06/08/2026
The *SHROOM series is designed to stress-test core issues in hallucination evaluation, like black- v. white-box (SHROOM) or multilinguality (mu-SHROOM). For SHROOM-Visions, the hidden angle was benchmark obsolescence. Making the SHEEP dataset to answer that was a lot of work, but also a lot of fun 🐑
021
*SHROOM Shared Task @shroom-st.bsky.social · 06/08/2026
⏳5 days left to submit your system description paper. Hope it goes well! Note: you can safely refer to your team's name and ranking in the paper, but please keep the author as "anonymous". Platform: openreview.net/group?id=EMN... #NLProc #SHROOM_ST
openreview.net
EMNLP 2026 Workshop SHROOM-Visions
Welcome to the OpenReview homepage for EMNLP 2026 Workshop SHROOM-Visions
011
*SHROOM Shared Task @shroom-st.bsky.social · 04/08/2026
Keep in mind that we are also open to “shared un-task” paper submissions from groups who either didn’t manage to submit to the official platform on time or used the dataset for different purposes! helsinki-nlp.github.io/shroom/2026 Reach out to organizers directly for more info ;)
helsinki-nlp.github.io
shroom
011
*SHROOM Shared Task @shroom-st.bsky.social · 04/08/2026
🌟Final leaderboard available: helsinki-nlp.github.io/shroom/2026 📰 SHEEP dataset paper available on arXiv: arxiv.org/abs/2608.01021 Deadline for system description paper: Aug. 10 AoE. Happy writing! #SHROOM_ST #NLProc @emnlpmeeting.bsky.social
helsinki-nlp.github.io
shroom
010
*SHROOM Shared Task @shroom-st.bsky.social · 01/08/2026
🌟The rankings are now publicly available on the submission website: shroom.pythonanywhere.com/submission/ Congrats to all winners 👏 Next step: write a short system description paper and submit in by Aug 10! openreview.net/group?id=EMN... Don't hesitate if you have any questions! #NLP #SHROOM_ST
shroom.pythonanywhere.com
SHROOM-Visions
010
*SHROOM Shared Task @shroom-st.bsky.social · 29/07/2026
🗓️ 3 days left to submit your results! Show us how well your systems perform. You will have 10 more days to finish the description papers: - Evaluation phase ends: 7.31 - System description papers due: 8.10 openreview.net/group?id=EMN.... #EMNLP #sharedtask #SHROOM_ST
openreview.net
EMNLP 2026 Workshop SHROOM-Visions
Welcome to the OpenReview homepage for EMNLP 2026 Workshop SHROOM-Visions
021
*SHROOM Shared Task @shroom-st.bsky.social · 17/07/2026
OpenReview website for system descriptions is open! openreview.net/group?id=EMN.... - Accept submissions starts: July 24th - Deadline of submission: August 10th - Follow the ACL template Join our mailing list for updates! groups.google.com/g/shroom-vis... #NLProc #sharedtask #emnlp2026
openreview.net
EMNLP 2026 Workshop SHROOM-Visions
Welcome to the OpenReview homepage for EMNLP 2026 Workshop SHROOM-Visions
010
*SHROOM Shared Task @shroom-st.bsky.social · 16/07/2026
Second CFP: SHROOM-Visions Shared Task Identify and classify hallucination spans in image-grounded outputs across 4 languages (ZH, EN, FR, IT)! ✨20K annotated examples 📍 Co-located with UncertaiNLP @emnlpmeeting.bsky.social ⏰ Evaluation ends July 31 More info: helsinki-nlp.github.io/shroom/2026
helsinki-nlp.github.io
shroom
021
*SHROOM Shared Task @shroom-st.bsky.social · 05/07/2026
Apparently ACL is absolutely loaded with mushrooms, and our organizers seem way too enthusiastic about them 🙈 Can someone keep an eye on these guys, plz? We’ve got a shared task to finish for EMNLP before they disappear into the forest. 😳🍄 #SHROOM_ST #NLP @emnlpmeeting.bsky.social
121
*SHROOM Shared Task @shroom-st.bsky.social · 04/07/2026
Some of our organizers @linguistickus.bsky.social and Aman are @aclmeeting.bsky.social this week. Don’t be shy—reach out if you have any questions, or even just to say hi! 👋
011
*SHROOM Shared Task @shroom-st.bsky.social · 04/07/2026
⚙️ Hi SHROOMers! Participant kit is available : a3s.fi/mickusti-2007780-pub/participant_kit.shroom_visions.zip The kit contains a format checker, the scoring program, a constant-baseline, and a more involved setup for more realistic system. #sharedtask #hallucination @emnlpmeeting.bsky.social
a3s.fi
010
*SHROOM Shared Task @shroom-st.bsky.social · 18/06/2026
*SHROOM is on Bluesky 🦋! This year we are going multimodal: check out SHROOM-visions 2026, collocated at UnicertaiNLP @emnlpmeeting.bsky.social helsinki-nlp.github.io/shroom/2026 #sharedtask #NLP #SHROOM_ST #hallucination #emnlp2026
helsinki-nlp.github.io
shroom
093