Sign in

Maik Fröbe

@maik-froebe.bsky.social
513 followers 383 following 30 posts

PhD-Student in the webis.de group. Interested in IR and NLP.

PostsRepliesMedia
Reposted by Maik Fröbe
Ingo Frommholz @frommholz.org · 06/10/2026
Information Retrieval people, we need you! Yes, YOU! 🫵 Due to the huge number of ECIR short paper submissions we are seeking additional PC members who can help us review. If you'd like to help us, please register at docs.google.com/forms/d/e/1F.... Thanks!! 🙏 (w/ @suzanv.bsky.social)
docs.google.com
Reviewer volunteer form for ECIR 2027 short papers
We are seeing a more than 100% increase in submissions compared to last year and are therefore recruiting additional PC members. If you are interested in helping us and the community, please fill in t...
035
Reposted by Maik Fröbe
Webis Group @webis.de · 30/09/2026
Call for Participation: Deadlines extended for UniAgent, the 1st Shared Task on Agentic AI in University Administration at the CIKM 2026 AnalytiCup in Rome. Registration until Oct 3, submission Oct 20. Real administrative cases; we host the LLMs. Details: uniagent.webis.de/cikm26/uniag...
uniagent.webis.de
UniAgent at CIKM 2026 - Agentic AI in University Administration
A shared task on agentic AI in university administration, part of the CIKM 2026 AnalytiCup: build agents that solve standardized administrative tasks under controlled tool access and expert-judged ref...
032
Reposted by Maik Fröbe
Webis Group @webis.de · 03/09/2026
Call for Participation: UniAgent, the 1st Shared Task on Agentic AI in University Administration, at the CIKM 2026 AnalytiCup in Rome. Registration closes Sep 30. Submission deadline Oct 23. Details: uniagent.webis.de/cikm26/uniag...
uniagent.webis.de
UniAgent at CIKM 2026 - Agentic AI in University Administration
A shared task on agentic AI in university administration, part of the CIKM 2026 AnalytiCup: build agents that solve standardized administrative tasks under controlled tool access and expert-judged ref...
033
Maik Fröbe @maik-froebe.bsky.social · 21/07/2026
Today I proxy presented the paper by @fschlatt.bsky.social on "Comparing Token Pruning Approaches for Multi-Vector Retrieval" at #SIGIR2026 :) downloads-cf.webis.de/publications...
030
Reposted by Maik Fröbe
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 12/05/2026
We've released test queries for NTCIR Tip-of-the-Tongue (ToT) Shared Task (languages: Chinese, Japanese, Korean, and English). ntcir-tot.github.io/guidelines Register: research.nii.ac.jp/ntcir/ntcir-... (DEADLINE: JUNE 1ST) Submissions due: July (TBA) #NTCIR2026 #NTCIRToT #NTCIR2026ToT
ntcir-tot.github.io
NTCIR 2026 Tip-of-the-Tongue (ToT) Shared Task
Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.
034
Reposted by Maik Fröbe
Jan Heinrich Merker @heinrich.merker.id · 30/03/2026
I've already collected my first two stickers for the @ecir2026.eu Collab-a-thon. If you're in Delft today, don't muss out the first collab-a-thon session at 4pm in LAB.115 🤝 #collab-a-thon #collaboration #research #ecir
053
Reposted by Maik Fröbe
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 27/03/2026
Announcing the release of the NTCIR Tip-of-the-Tongue (ToT) Shared Task participation guidelines: ntcir-tot.github.io/guidelines. Please reshare and spread the word. #NTCIR2026 #NTCIRToT #NTCIR2026ToT /1
ntcir-tot.github.io
NTCIR 2026 Tip-of-the-Tongue (ToT) Shared Task
Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.
146
Maik Fröbe @maik-froebe.bsky.social · 26/03/2026
I am happy to share that I defended my PhD thesis this week. I want to thank all the people I collaborated with and met at conferences and workshops over the years! Especially a big thank you to my PhD supervisor, Matthias Hagen, and to Laura Dietz and Udo Kruschwitz for reviewing my thesis.
3244
Reposted by Maik Fröbe
Health NLP Lab @health-nlp.com · 28/01/2026
Last week, we had the pleasure of hosting Maik Fröbe @maik-froebe.bsky.social, from Friedrich Schiller University Jena, who was invited to give a guest lecture and a talk to our group about his recent work on evaluation in information retrieval.
141
Reposted by Maik Fröbe
UofGNews @uofgnews.bsky.social · 02/12/2025
PyTerrier, a software platform developed at @uofgcompsci.bsky.social which helps facilitate the development of AI-powered search engines, has won a national award from @wearebcs.bsky.social! Read more here: www.gla.ac.uk/news/headlin...
Dr Sean MacAvaney receives the Best Search Project of the Year Award at the BCS Search Industry Awards on Wednesday 26 November.
094
Reposted by Maik Fröbe
Webis Group @webis.de · 27/10/2025
We just released "German Commons", the largest openly-licensed German text dataset for LLM training: 154B tokens with clear usage rights for research and commercial use. huggingface.co/datasets/coral-nlp/german-commons
huggingface.co
coral-nlp/german-commons · Datasets at Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
1209
Reposted by Maik Fröbe
Djoerd Hiemstra 🍉 @djoerd.idf.social.ap.brid.gy · 27/10/2025
Dutch-Belgian Information Retrieval workshop #DIR3025 today in Nijmegen! Opening by the great Harrie Oosterhuis informagus.nl/dir2025/schedule
Harrie on stage
061
Reposted by Maik Fröbe
Svitlana Vakulenko @vendi12.bsky.social · 09/09/2025
Check out the slides from our SCAI'2025 #convsearch workshop collocated with @ijcai.org #IJCAI2025 on LLMs, retrieval & QA, recommendations, negotiations, evaluation and transparency scai.info/scai-2025 @patuchen.bsky.social @maik-froebe.bsky.social @tuetschek.bsky.social @mila-quebec.bsky.social
scai.info
SCAI 2025
Online Event on Search-Oriented Conversational AI.
093
Reposted by Maik Fröbe
Johanne Trippas @jtrippas.bsky.social · 02/09/2025
🌟Really excited to share the fourth Strategic Workshop on Information Retrieval (SWIRL) report published in SIGIR Forum! Paper 👉🏻 www.johannetrippas.com/papers/tripp... More info 👉🏻 sites.google.com/view/swirl20... #SWIRL2025 #SIGIR2026 #IR #GenAI #Research #CHIIR2026
01310
Reposted by Maik Fröbe
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 01/09/2025
Some exciting news! 🤗 After 3 amazing years at TREC, the Tip-of-the-Tongue (ToT) shared task will be a core task at NTCIR-19 in 2026. The new track will focus on tip-of-the-tongue information needs in English and East Asian languages. More details coming soon. See you all in Tokyo next year!
media.tenor.com
an aerial view of tokyo at night with lots of lights
ALT: an aerial view of tokyo at night with lots of lights
053
Reposted by Maik Fröbe
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 25/08/2025
Hello TREC-ToTers! 👋🏽 📆 Good news! We are extending the run submission deadline by 2 weeks. Please submit your runs by **September 10 (Wednesday)** and spread the word. More info: trec-tot.github.io/guidelines #TREC2025 #TRECToT #TREC2025ToT
trec-tot.github.io
TREC 2025 Tip-of-the-Tongue (ToT) Track
Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.
111
Reposted by Maik Fröbe
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 19/08/2025
Gentle reminder 📢 All run submissions for the Tip-of-the-Tongue (ToT) Track are due next week Wednesday (Aug 27). More info: trec-tot.github.io/guidelines #TREC2025 #TRECToT #TREC2025ToT
trec-tot.github.io
TREC 2025 Tip-of-the-Tongue (ToT) Track
Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.
022
Maik Fröbe @maik-froebe.bsky.social · 18/07/2025
Here are some impressions from our ReNeuIR workshop on "Reaching Efficiency in Neural IR" that we had yesterday at #SIGIR2025.
181
Reposted by Maik Fröbe
Webis Group @webis.de · 16/07/2025
Happy to share that our paper "The Viability of Crowdsourcing for RAG Evaluation" received the Best Paper Honourable Mention at #SIGIR2025! Very grateful to the community for recognizing our work on improving RAG evaluation.  📄 webis.de/publications...
22710
Maik Fröbe @maik-froebe.bsky.social · 16/07/2025
Now @fschlatt.bsky.social presents "TITE: Token-Independent Text Encoder for Information Retrieval" at #SIGIR2025 Paper: webis.de/publications...
083
Reposted by Maik Fröbe
Ferdinand Schlatt @fschlatt.bsky.social · 16/07/2025
Want to know how to make bi-encoders more than 3x faster with a new backbone encoder model? Check out our talk on the Token-Independent Text Encoder (TITE) #SIGIR2025 in the efficiency track. It pools vectors within the model to improve efficiency dl.acm.org/doi/10.1145/...
0105
Maik Fröbe @maik-froebe.bsky.social · 15/07/2025
To Eun Kim just presented the work on "Tip of the Tongue Query Elicitation for Simulated Evaluation" at #SIGIR2025. The approach will be used in the #TREC2025 Tip-of-the-Tongue track, and we had some sweets at the poster :) The paper is available online: dl.acm.org/doi/10.1145/...
0123
Maik Fröbe @maik-froebe.bsky.social · 15/07/2025
Lukas Gienapp presents "The Viability of Crowdsourcing for RAG Evaluation" at #SIGIR2025 The paper is available at: webis.de/publications...
0106
Reposted by Maik Fröbe
Ferdinand Schlatt @fschlatt.bsky.social · 14/07/2025
@mrparryparry.bsky.social presenting our work on reproducing TREC DL 2019 judgements and the implications for evaluating modern ranking models on modern collections. Paper: arxiv.org/abs/2502.20937
arxiv.org
Variations in Relevance Judgments and the Shelf Life of Test Collections
The fundamental property of Cranfield-style evaluations, that system rankings are stable even when assessors disagree on individual relevance decisions, was validated on traditional test collections. ...
143
Maik Fröbe @maik-froebe.bsky.social · 14/07/2025
Here are some of the statistics that I found very interesting from the #SIGIR2025 opening session. (Over 1000 attendees!)
151
Reposted by Maik Fröbe
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 13/07/2025
Hello TREC-ToTers! We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: trec-tot.github.io/guidelines. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT Please spread the word!
trec-tot.github.io
TREC 2025 Tip-of-the-Tongue (ToT) Track
Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.
033
Reposted by Maik Fröbe
Ferdinand Schlatt @fschlatt.bsky.social · 13/07/2025
Thank you Carlos for the shout-out of Lightning IR in the LSR tutorial at #SIGIR2025 If you want to fine your own LSR models, check out our framework at github.com/webis-de/lig...
075
Reposted by Maik Fröbe
IRRJ @irrj.sigmoid.social.ap.brid.gy · 01/07/2025
Never seen our editor in chief, Djoerd Hiemstra, more happy than today, holding a copy of the first issue of #IRRJ
Djoerd Hiemstra proudly holding a copy of the first issue
0146
Maik Fröbe @maik-froebe.bsky.social · 27/06/2025
Do not forget to participate in the #TREC2025 Tip-of-the-Tongue (ToT) Track :) The corpus and baselines (with run files) are now available and easily accessible via the ir_datasets API and the HuggingFace Datasets API. More details are available at: trec-tot.github.io/guidelines
Dory from finding nemo with the quote: "I remember it like it was yesterday. Of course, I dont remember yesterday."
0117
Maik Fröbe @maik-froebe.bsky.social · 21/05/2025
The deadline for submissions to the ReNeuIR workshop at #SIGIR2025 is extended to June 10 😸 Details: reneuir.org #ReNeuIr2025 #SIGIR25
reneuir.org
ReNeuIR’25
Workshop on Reaching Efficiency in Neural Information Retrieval
033
Reposted by Maik Fröbe
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 09/05/2025
Hello TREC-ToTers! 👋🏽 Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guidelines. We will release test queries in July and run submission deadline will be in August. #TREC2025 #TRECToT #TREC2025ToT Please register to participate:
trec-tot.github.io
TREC 2025 Tip-of-the-Tongue (ToT) Track
Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.
042
Maik Fröbe @maik-froebe.bsky.social · 10/04/2025
Today I had the pleasure to talk about child-safe search at #ECIR2025. We created an cranfield-style evaluation dataset to contrast relevance with harm in web search scenarios. Details: webis.de/publications...
062
Maik Fröbe @maik-froebe.bsky.social · 10/04/2025
The Workshop on Open Web Search just finished #WOWS2025 #ECIR2025. It was a very cool experience with many interesting talks. Lets hope we can do it again next year at #ECIR2026 in Delft :)
085
Maik Fröbe @maik-froebe.bsky.social · 10/04/2025
The Workshop on Open Web Search at #ECIR2025 just starts with a keynote by @claclarke.bsky.social on Annotative Indexing. #WOWS25 #WOWS2025 #ECIR25
0105
Reposted by Maik Fröbe
Ferdinand Schlatt @fschlatt.bsky.social · 09/04/2025
Honored to receive the best short paper award and best paper honourable mention award at #ECIR2025. Thank you to all co-authors @maik-froebe.bsky.social, @hscells.bsky.social, Shengyao Zhuang, @bevankoopman.bsky.social, Guido Zuccon, Benno Stein, @martin-potthast.com, @matthias-hagen.bsky.social 🥳
1174
Maik Fröbe @maik-froebe.bsky.social · 09/04/2025
Now we have @fschlatt.bsky.social on the #ECIR2025 stage predenting the research on the Set-Encoder. The paper is online at: webis.de/publications...
093
Maik Fröbe @maik-froebe.bsky.social · 09/04/2025
An cool example of the Circle of Research at #ECIR2025 (or was it the Circle of Life?): Yesterday, I saw Ronak presenting research to Ferdi, today it was the other way around :)
040
Maik Fröbe @maik-froebe.bsky.social · 07/04/2025
I was very happy to talk about corpus subsampling at #ECIR2025 today. Please find the paper at webis.de/publications... And lat bur not least, here are some of my favorite impressions of the first day of ECIR :)
082
Reposted by Maik Fröbe
Webis Group @webis.de · 07/04/2025
📢 Our paper "The Viability of Crowdsourcing for RAG Evaluation" has been accepted to #SIGIR2025 ! We compared how good humans and LLMs are at writing and judging RAG responses, assembling 1800+ responses across 3 styles, and 47K+ pairwise judgments in 7 quality dimensions. 🧵➡️
1127
Reposted by Maik Fröbe
IRRJ @irrj.sigmoid.social.ap.brid.gy · 06/04/2025
Paper accepted at #SIGIR2025, but you had a hard time keeping the page limit? Congratulations, you can now submit an extended version with 50% "new" material to #IRRJ! irrj.org/second-call-for-papers
irrj.org
Call for Papers for Issue 2 | Information Retrieval Research
044
Maik Fröbe @maik-froebe.bsky.social · 03/04/2025
Some impressions from #WSDM2025 from two weeks ago :)
140
Maik Fröbe @maik-froebe.bsky.social · 14/03/2025
The panel at the #LLM4Eval2025 workshop just start #WSDM2025
The LLM4Eval panel discussion.
060
Reposted by Maik Fröbe
Danny To Eun Kim @teknology.bsky.social · 05/03/2025
🚨New Breakthrough in Tip-of-the-Tongue (TOT) Retrieval Research! We address data limitations and offer a fresh evaluation method for these complex queries. Curious how TREC TOT track test queries are created? Check out this thread 🧵 and our paper 📄: arxiv.org/abs/2502.17776
arxiv.org
Tip of the Tongue Query Elicitation for Simulated Evaluation
Tip-of-the-tongue (TOT) search occurs when a user struggles to recall a specific identifier, such as a document title. While common, existing search systems often fail to effectively support TOT scena...
2188
Reposted by Maik Fröbe
Webis Group @webis.de · 05/03/2025
PAN 2025 Call for Participation: Shared Tasks on Authorship Analysis, Computational Ethics, and Originality We'd like to invite you to participate in the following shared tasks at PAN 2025 held in conjunction with the CLEF conference in Madrid, Spain. Find out more at pan.webis.de/clef25/pan25...
pan.webis.de
197
Reposted by Maik Fröbe
IRRJ @irrj.sigmoid.social.ap.brid.gy · 03/03/2025
At #IRRJ, everyone gets a chance to publish #OpenAccess. Our article processing charges are: zero dollar, zero euro, zero yuan, zero real, zero ruble, zero rand, zero yen, zero rupees, zero pound, zero rial, zero peso, ...
Oprah Winfrey screaming "and you get an access! And you! Everyone gets an access!
062
Reposted by Maik Fröbe
Arjen P. de Vries Timmers 🕊️ @arjen.idf.social.ap.brid.gy · 03/03/2025
Deadline for #ossym25 was extended to March 17h! the #ossym25 Open Search Symposium brings together the European and international Open Search community for the seventh time. 8-10 October 2025 Helsinki, Finland indico.cern.ch/event/1477549
indico.cern.ch
OSSYM 2025 - 7th International Open Search Symposium
8 - 10 October 2025 Continuing the successful conference series from the past 6 years, the #ossym25 Open Search Symposium brings together the European and international Open Search community for the seventh time. The hybrid conference provides a forum to discuss and further develop the ideas and concepts of open web search and related topics in various formats including scientific talks, panels, workshops, demonstrations, student challenges and informal discussion spaces. Participants...
033
Reposted by Maik Fröbe
mrparryparry.bsky.social @mrparryparry.bsky.social · 03/03/2025
🚨 New Pre-Print! 🚨 Reviewer 2 has once again asked for DL’19, what can you say in rebuttal?  To help, we have re-annotated DL’19. Work done with @maik_froebe.bsky.social, @hscells.bsky.social, @fschlatt1.bsky.social, Guglielmo Faggioli, Saber Zerhoudi, @macavaney.bsky.social, Eugene Yang 🧵
163
Reposted by Maik Fröbe
Webis Group @webis.de · 08/01/2025
2nd International Workshop on Open Web Search: CfP We invite you to the #ECIR2025 Workshop on Open Web Search #wows2025. Please consider to submit to the scientific track or the WOWS-Eval shared task to enrich the Open Web Index with relevance judgments. Details: opensearchfoundation.org/wows2025
opensearchfoundation.org
1st International Workshop on Open Web Search #wows2024 - 28 March 2024
Discuss ideas and approaches to open up the web search ecosystem!
0133
Reposted by Maik Fröbe
arxiv cs.IR @arxiv-cs-ir.bsky.social · 24/12/2024
Charles L. A. Clarke, Laura Dietz LLM-based relevance assessment still can't replace human relevance assessment arxiv.org/abs/2412.17156
061
Reposted by Maik Fröbe
iroldie.bsky.social @iroldie.bsky.social · 24/12/2024
What a team of keynote speakers. I must confess seeing that Steve Robertson will be there is a thrill. One of the legends of information retrieval reflecting on the field. #sigir2025 sigir2025.dei.unipd.it/keynote-spea...
sigir2025.dei.unipd.it
SIGIR 2025, Padua, 13-18 July | Keynotes
The SIGIR 2025 keynotes are held by esteemed speakers: Robertson S., Gurevych I. and Frieder O., who will cover topics that range from AI in medical search and ecommendation to BM25 and probabilistic ...
0105