Sign in

iroldie.bsky.social

@iroldie.bsky.social
170 followers 327 following 30 posts
PostsRepliesMedia
iroldie.bsky.social @iroldie.bsky.social · 10/06/2025
"From Foundations to GPT in Text Classification: A Comprehensive Survey on Current Approaches and Future Trends", the latest review article from FnTIR www.nowpublishers.com/article/Deta...
nowpublishers.com
now publishers - From Foundations to GPT in Text Classification: A Comprehensive Survey on Current Approaches and Future Trends
Publishers of Foundations and Trends, making research accessible
110
Reposted by @iroldie.bsky.social
ADM+S Centre @admscentre.org.au · 14/05/2025
Are search engines getting worse—or is it time to rethink how we search? ADM+S researchers Oleg Zendel, Ashwin Nagappa & Johanne Trippas share insights on search quality, AI & what it means for how we find trustworthy information online @olegzendel.bsky.social @ashwinnag.bsky.social bit.ly/3F8sx44
bit.ly
Is Google search getting worse? Maybe what we want from it has changed
Has the simple search become less useful in a world of low-information, SEO-optimised sites, and often faulty AI summaries? Are there better ways to navigate the web?
056
Reposted by @iroldie.bsky.social
Damiano Spina @damianospina.com · 26/03/2025
Excellent presentation by @admscentre.org.au @rmitcomputing.bsky.social master’s student Kun Ran m at #chiir2025 @marwahalaofi.com @iroldie.bsky.social www.damianospina.com/publication/...
133
Reposted by @iroldie.bsky.social
Damiano Spina @damianospina.com · 26/03/2025
Our @theconversation.com article discussing 4 ethical models of search engines is out! theconversation.com/what-makes-a... @admscentre.org.au @rmitcomputing.bsky.social @umbrellacorpn.bsky.social
theconversation.com
What makes a good search engine? These 4 models can help you use search in the age of AI
To make sure search engines serve us well, it’s helpful to imagine these tools having different roles – whether it’s a “librarian” or a “teacher”.
083
iroldie.bsky.social @iroldie.bsky.social · 01/03/2025
"Two Heads Are Better Than One: Improving Search Effectiveness Through LLM Generated Query Variants", preprint is up marksanderson.org/publications... Awesome work by @rmitcomputing.bsky.social Masters student @rankun203.bsky.social with Marwah Alaofi and @damianospina.com Presented ACM CHIIR.
marksanderson.org
041
iroldie.bsky.social @iroldie.bsky.social · 23/02/2025
For the first time, Nature publishes a list of "retraction hotspots": academic institutions where a great many papers have been withdrawn post publication. www.nature.com/articles/d41...
nature.com
Exclusive: These universities have the most retracted scientific articles
A first-of-its-kind analysis by Nature reveals which institutions are retraction hotspots.
010
iroldie.bsky.social @iroldie.bsky.social · 20/02/2025
The TREC website has been updated for the first time in... decades? Looking good. trec.nist.gov/index.html
150
iroldie.bsky.social @iroldie.bsky.social · 03/02/2025
"Illusions of Relevance: Using Content Injection Attacks to Deceive Retrievers, Rerankers, and LLM Judges". Inject unrelated toxic content into a relevant passage, an LLM judge still says the passage is relevant arxiv.org/abs/2501.18536 from Manveer Tamber & Jimmy Lin.
arxiv.org
Illusions of Relevance: Using Content Injection Attacks to Deceive Retrievers, Rerankers, and LLM Judges
Consider a scenario in which a user searches for information, only to encounter texts flooded with misleading or non-relevant content. This scenario exemplifies a simple yet potent vulnerability in ne...
010
Reposted by @iroldie.bsky.social
Johanne Trippas @jtrippas.bsky.social · 22/01/2025
"Multi-stage Large Language Model Pipelines Can Outperform GPT-4o in Relevance Assessment" w/@Julian S. @danulah.bsky.social @umbrellacorpn.bsky.social accepted at #webconf2025! 😱🌟 We present an LLM-based pipeline that boosts relevance assessment accuracy through modular classification. #SIGIR2025
052
iroldie.bsky.social @iroldie.bsky.social · 22/01/2025
Two SIGIR Information Retrieval greats were made ACM Fellows this year: Maarten de Rijke and Justin Zobel. Many congratulations to both! www.acm.org/media-center...
acm.org
2024 ACM Fellows Celebrated for transformative contributions to computing science and technology.
ACM has named 55 of its members ACM for transformative contributions to computing science and technology. All the 2024 inductees are longstanding ACM Members whose accomplishments were selected by the...
050
iroldie.bsky.social @iroldie.bsky.social · 17/01/2025
Building on four successful workshops in the last few years, it was decided to create the Inaugural SEASON conference of the Search Engines and Society Network, starting in 2025. Submissions, April 30th. Held in Hamburg. easychair.org/cfp/SEASON2025
easychair.org
CFP
051
iroldie.bsky.social @iroldie.bsky.social · 14/01/2025
Thanks @hscells.bsky.social for pointing me to this
020
iroldie.bsky.social @iroldie.bsky.social · 14/01/2025
Using LLMs for pairwise relevance decisions, I haven't seen that tried before, but it makes perfect sense to try them here. My impression is that pairwise relevance hasn't been used much in the past because of the cost of lablelling.
150
iroldie.bsky.social @iroldie.bsky.social · 01/01/2025
There have been a number of investigations on whether LLMs can replace humans for relevance assessment. I think the evidence is showing LLMs have a strong role, but won't replace. This recent paper from @claclarke.bsky.social & Laura Dietz supports this view arxiv.org/abs/2412.17156
arxiv.org
LLM-based relevance assessment still can't replace human relevance assessment
The use of large language models (LLMs) for relevance assessment in information retrieval has gained significant attention, with recent studies suggesting that LLM-based judgments provide comparable e...
071
iroldie.bsky.social @iroldie.bsky.social · 24/12/2024
What a team of keynote speakers. I must confess seeing that Steve Robertson will be there is a thrill. One of the legends of information retrieval reflecting on the field. #sigir2025 sigir2025.dei.unipd.it/keynote-spea...
sigir2025.dei.unipd.it
SIGIR 2025, Padua, 13-18 July | Keynotes
The SIGIR 2025 keynotes are held by esteemed speakers: Robertson S., Gurevych I. and Frieder O., who will cover topics that range from AI in medical search and ecommendation to BM25 and probabilistic ...
0105
iroldie.bsky.social @iroldie.bsky.social · 17/12/2024
"Two Heads Are Better Than One: Improving Search Effectiveness Through LLM Generated Query Variants", short paper accepted #chiir2025. Led by our Masters student Kun Ran with Marwah Alaofi, myself, and @damianospina.com. Awesome result Kun! @admscentre.org.au @rmitcomputing.bsky.social
171
iroldie.bsky.social @iroldie.bsky.social · 14/12/2024
We invite PhD students to submit your work and join us at PhD Symposium @TheWebConf 2025, (www2025.thewebconf.org/phd-symposium). The submission due date is 18 Dec, 2024 (AOE)! We will see you in the beautiful and amazing Sydney down under! #WWW2025 #WebConf2025
www2025.thewebconf.org
International World Wide Web Conference 2025 ( WWW2025 | The Web Conf 2025 )
28 April - 2 May 2025
062
iroldie.bsky.social @iroldie.bsky.social · 10/12/2024
Thanks to the #sigirap2024 people for giving us a mention on the conference bag, brought a smile to our faces.
041
iroldie.bsky.social @iroldie.bsky.social · 10/12/2024
So many aspects of evaluation including fully synthetic test collections, loved it.
011
iroldie.bsky.social @iroldie.bsky.social · 09/12/2024
I enjoyed attending the thought provoking two day gathering that helped drive the creation of this document. I look forward to reading it. "Future of Information Retrieval Research in the Age of Generative AI" arxiv.org/pdf/2412.02043
arxiv.org
032
iroldie.bsky.social @iroldie.bsky.social · 08/12/2024
In her talk, @katecrawford.bsky.social delved into the history of Large Language Models, she rightly highlighted the pioneering work of Fred Jelinek who kicked off language models in 1972, however, I wouldn't be faithful to my handle (IR Oldie) if I didn't highlight some IR history...
110
iroldie.bsky.social @iroldie.bsky.social · 07/12/2024
Just in case you didn't see this shared elsewhere. Maarten writes "I am asking for donations because our daughter Emma passed away". epilepsie.digicollect.nl/maarten-de-r...
epilepsie.digicollect.nl
Maarten de Rijke kan het niet alleen. Help jij mee?
Epilepsie verstoort levens! Steun je mij met een donatie in mijn collectebus? Met de opbrengst kunnen we samen op zoek naar de oplossing van de verstorende aanvallen. Ik ben je eeuwig dankbaar!
110
iroldie.bsky.social @iroldie.bsky.social · 06/12/2024
What a magnificent communicator @katecrawford.bsky.social is. Loved her talk at the State Library of Victoria on Thursday broadening the perspectives we have about AI. The non-techy who accompanied me was buzzing about this event.
040
Reposted by @iroldie.bsky.social
Alan Said @alansaid.com · 26/11/2024
And we have a #Dagstuhl Report! Evaluation Perspectives of #RecSys. Edited by @christinebauer.bsky.social, @evazangerle.bsky.social, and myself. Written by a whole host of fantastic #recsys people. Too many to mention (pic here www.dagstuhl.de/en/seminars/...) drops.dagstuhl.de/entities/doc...
drops.dagstuhl.de
Evaluation Perspectives of Recommender Systems: Driving Research and Education (Dagstuhl Seminar 24211)
0107
iroldie.bsky.social @iroldie.bsky.social · 25/11/2024
A cool blog post from Ellese Cotterill on her work at Canva to spin up a known item test collection from scratch generated entirely from an LLM. www.canva.dev/blog/enginee...
canva.dev
How to improve search without looking at queries or results - Canva Engineering Blog
How we improved Canva’s private design search while respecting the privacy of our community.
011
iroldie.bsky.social @iroldie.bsky.social · 22/11/2024
"Metamorphic Evaluation of ChatGPT as a Recommender System" a cool short paper from an @RMITComputing student, Madhurima Khirbat, showing how superficial changes in prompts can result in substantial change in #gpt #recsys style output @admscentre.org.au arxiv.org/abs/2411.12121
arxiv.org
Metamorphic Evaluation of ChatGPT as a Recommender System
With the rise of Large Language Models (LLMs) such as ChatGPT, researchers have been working on how to utilize the LLMs for better recommendations. However, although LLMs exhibit black-box and probabi...
062
iroldie.bsky.social @iroldie.bsky.social · 17/11/2024
We invite contributions to PhD Symposium at #TheWebConf 2025. PhD students are encouraged to submit ongoing research related to broad topic of the World Wide Web. www2025.thewebconf.org/phd-symposium Co-chairing this with Gabriella Pasi and Ruihong Qiu
www2025.thewebconf.org
International World Wide Web Conference 2025 ( WWW2025 | The Web Conf 2025 )
28 April - 2 May 2025
0114