Sign in

Fernando Diaz

@841io.bsky.social
1.8K followers 649 following 160 posts

Associate Professor, CMU. Researcher, Google. Evaluation and design of information retrieval and recommendation systems, including their societal impacts.

PostsRepliesMedia
Fernando Diaz @841io.bsky.social · 05/08/2026
may be time to resurface this <squints> ten year old FATML paper that explored the ethics of automatic experimentation, say by agents. 841.io/doc/ethics-o...
041
Fernando Diaz @841io.bsky.social · 02/07/2026
Please try to look deeper than success rate for agent evaluation. Thank you. arxiv.org/abs/2606.17541
131
Fernando Diaz @841io.bsky.social · 22/06/2026
Nice work led by @teknology.bsky.social where we develop a memory system to support a heterogeneous population of independently acting agents by sharing experience through retrieval/personalization, contrasting it with memory confined to a single agent or cooperative team. arxiv.org/abs/2606.19911
052
Reposted by Fernando Diaz
Alex Goldman @agoldman.bsky.social · 02/06/2026
Clive Barker is a great name for a dog
17810
Reposted by Fernando Diaz
Alexandra Olteanu @aolteanu.bsky.social · 30/05/2026
Sometimes it feels like some folks are losing the plot about what the goal of publishing research actually is. The goal is certainly not meant to be the productions of papers, but rather the production and communication of science.
1173
Reposted by Fernando Diaz
Hadas Weiss @hadas.bsky.social · 15/05/2026
15980171
Reposted by Fernando Diaz
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 12/05/2026
We've released test queries for NTCIR Tip-of-the-Tongue (ToT) Shared Task (languages: Chinese, Japanese, Korean, and English). ntcir-tot.github.io/guidelines Register: research.nii.ac.jp/ntcir/ntcir-... (DEADLINE: JUNE 1ST) Submissions due: July (TBA) #NTCIR2026 #NTCIRToT #NTCIR2026ToT
ntcir-tot.github.io
NTCIR 2026 Tip-of-the-Tongue (ToT) Shared Task
Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.
034
Reposted by Fernando Diaz
Mikko Tolonen @tolonen.bsky.social · 05/05/2026
Excellent opportunity for researchers in computational humanities and AI: a 3-year Research Fellow/Postdoctoral Researcher position in Helsinki focusing on trustworthy AI across linguistic and cultural diversity. jobs.helsinki.fi/job/Helsinki... Please spread the word!
jobs.helsinki.fi
Research Fellow/Postdoctoral Researcher in trustworthy AI across linguistic and cultural diversities
Research Fellow/Postdoctoral Researcher in trustworthy AI across linguistic and cultural diversities
11715
Reposted by Fernando Diaz
Nick Seaver @nickseaver.website · 29/04/2026
thank you to a student for sharing this bookmark from the campus library, which attributes a point made by Herbert Simon in the 1970s to Mr. Beast
"We don't live in the information age — we live in the age of attention, drowning in information".
Mr Beast
734180
Fernando Diaz @841io.bsky.social · 23/04/2026
hey, @mrblackfrancis.bsky.social can you help me out?
100
Reposted by Fernando Diaz
Danny To Eun Kim @teknology.bsky.social · 17/04/2026
🎉 Excited to share a new agent evaluation perspective with our newly accepted #SIGIR2026 paper: "Evaluation of Agents under Simulated AI Marketplace Dynamics." arxiv.org/abs/2604.14256 @acmsigir.bsky.social
252
Reposted by Fernando Diaz
Bhaskar Mitra | ভাস্কর মিত্র @bmitra.bsky.social · 27/03/2026
Announcing the release of the NTCIR Tip-of-the-Tongue (ToT) Shared Task participation guidelines: ntcir-tot.github.io/guidelines. Please reshare and spread the word. #NTCIR2026 #NTCIRToT #NTCIR2026ToT /1
ntcir-tot.github.io
NTCIR 2026 Tip-of-the-Tongue (ToT) Shared Task
Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.
146
Reposted by Fernando Diaz
Laura Mauldin @lauramauldin.bsky.social · 21/02/2026
Heres the link on Apple Podcasts and yes there is a transcript for access! podcasts.apple.com/us/podcast/i...
podcasts.apple.com
“In sickness and in health”: what no one tells you about caring for a loved one
Podcast Episode · Apple News In Conversation · February 19 · 24m
031
Fernando Diaz @841io.bsky.social · 24/02/2026
"Diagram of the art-making process showing the four main phases, feedback loops, and moderating variables." Mary-Anne Mace & Tony Ward (2002) Modeling the Creative Process: A Grounded Theory Analysis of Creativity in the Domain of Art Making, Creativity Research Journal, 14:2, 179-192.
Diagram of the art-making process showing the four main phases, feedback loops, and moderating variables.
060
Fernando Diaz @841io.bsky.social · 17/02/2026
“Every aspect of filmmaking requires choice. The selection of the subject, the shooting, editing and length are all aspects of choice.” RIP Fred Wiseman
020
Fernando Diaz @841io.bsky.social · 06/02/2026
“back to school” but rodney dangerfield uses wealth to pay for claude max
scene from "back to school" (1986) where rodney dangerfield hires a group of experts to complete his assignments.
010
Reposted by Fernando Diaz
Shaily @shaily99.bsky.social · 02/02/2026
🎭 How do LLMs (mis)represent culture? 🧮 How often? 🧠 Misrepresentations = missing knowledge? spoiler: NO! At #CHI2026 we are bringing ✨TALES✨ a participatory evaluation of cultural (mis)reps & knowledge in multilingual LLM-stories for India 📜 arxiv.org/abs/2511.21322 1/10
14722
Fernando Diaz @841io.bsky.social · 01/02/2026
Allen Newell and Herbert A. Simon. Human problem solving. Prentice-Hall, Inc., 1972.
040
Reposted by Fernando Diaz
Hanna Wallach @hannawallach.bsky.social · 29/01/2026
Microsoft Research NYC is hiring a researcher in the space of AI and society!
26240
Reposted by Fernando Diaz
Carlos Castillo @chato.tech.lgbt.ap.brid.gy · 26/01/2026
Applications for graduate students in computing, sociology, humanities willing to participate in the FAccT 2026 Doctoral Colloquium are open! facctconference.org/2026/callfordc.…
facctconference.org
ACM FAccT 2026 Doctoral Colloquium Call for Applications
015
Fernando Diaz @841io.bsky.social · 21/01/2026
what’s surprising here is less that these papers were written or accepted with fabricated citations, but that it’s a symptom that actually reading, understanding, and analyzing literature has deteriorated for both authors and reviews.
140
Fernando Diaz @841io.bsky.social · 31/12/2025
as AI increasingly supports shopping and ads, it’s worth remembering that retrieval often shapes who gets exposure in final generated output. in a recent paper, @teknology.bsky.social uses methods from fair ranking to assess and address exposure bias in downstream generation. 841.io/doc/fairrag....
083
Reposted by Fernando Diaz
Nancy Baym @nancybaym.bsky.social · 22/12/2025
PhD and Postdoc positions drop! The Research Council of Norway funded MishMash Centre for AI & Creativity has announced 18 doctoral and 6 postdoc positions in arts and/or science. I’m a member of the Scientific Advisory Board and so pleased to see this happening. mishmash.no/news/positio...
mishmash.no
18 PhD and 6 Postdoc positions at MishMash/Norway
The first round of MishMash doctoral and postdoctoral fellowships are now announced.
078
Reposted by Fernando Diaz
Asia Biega @asiabiega.bsky.social · 19/12/2025
I am hiring a PhD student at the Max Planck Institute for Security and Privacy. Topics of interest: (i) AI governance/regulation through computational and socio-technical lens, (ii) computational and socio-technical approaches to digital well-being. More information & how to apply:
asiabiega.github.io
064
Reposted by Fernando Diaz
Nancy Baym @nancybaym.bsky.social · 22/12/2025
We are looking for advanced PhD student interns! Spend 12 weeks scratching a research itch in our Cambridge Massachusetts lab. Closes January 17. apply.careers.microsoft.com/careers/job/...
apply.careers.microsoft.com
Research Intern - Sociotechnical Systems | Microsoft Careers
Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world's best researchers, Research Interns learn, collaborate, and network for life. Researc...
01412
Reposted by Fernando Diaz
Pedro Madruga @pedromadruga.com · 10/12/2025
The influence of domain knowledge is huge when it comes to applied AI. Domain expertise can prevent overengineering and/or unnecessary costs. Working in the legal industry as an AI scientist it became obvious early on how crucial it is to build the bridge towards domain experts. Every day.
031
Reposted by Fernando Diaz
Alexandra Olteanu @aolteanu.bsky.social · 05/12/2025
📣 It's again that time of the year 🤩 - our internship call for the FATE team @ MSR Montreal and our collaborators is now up! 🎉🎉 We are broadly looking for candidates interested in perceptions, evaluation, uses, and impacts of AI! #FAccT #FAccT2025 #CHI2025 #NeurIPS2025 #ACL2025
1259
Reposted by Fernando Diaz
Dan Goldstein @dggoldst.bsky.social · 05/12/2025
Want to be an intern at Microsoft Research in the Computational Social Science group in NYC (Jake Hofman, David Rothschild, Dan Goldstein) Follow this link and do your thing! Deadline approaching soonish! apply.careers.microsoft.com/careers/job/...
apply.careers.microsoft.com
Research Intern - Computational Social Science | Microsoft Careers
Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world's best researchers, Research Interns learn, collaborate, and network for life. Researc...
34941
Reposted by Fernando Diaz
Nick Seaver @nickseaver.website · 03/12/2025
if you work on "AI" and are concerned with social issues, you should apply to be the new director of the Tufts AI Institute: apply.interfolio.com/178311 (Need to be tenureable in one of our engineering departments, but it's explicitly open to people who work on human-oriented stuff.)
02515
Reposted by Fernando Diaz
Alexandra Olteanu @aolteanu.bsky.social · 01/12/2025
On my way to @neuripsconf.bsky.social -- this is my first time at #NeurIPS and looking forward to seeing folks and presenting our paper on Rigor in AI. Do find me if you want to chat about rigor in AI, anthropomorphic AI, or evaluations #NeurIPS2025
Screenshot of the first page of the paper titled "rigor in ai: doing rigorous AI work requires a broader, responsible AI-informed conception of rigor"
0162
Fernando Diaz @841io.bsky.social · 25/11/2025
a light thread on what we mean by "user engagement". 🧵 1/26
262
Fernando Diaz @841io.bsky.social · 24/11/2025
🎉students interested in evaluation!🎉
030
Reposted by Fernando Diaz
lizclayton @lizclayton.bsky.social · 20/11/2025
Did everyone else already know about "fluid bear painting"? Is this trend a hoax?
001
Fernando Diaz @841io.bsky.social · 11/11/2025
Philip K. Dick, "The Penultimate Truth", Belmont Books, 1964.
030
Reposted by Fernando Diaz
arxiv cs.IR @arxiv-cs-ir.bsky.social · 28/10/2025
Rikiya Takehi, Fernando Diaz, Tetsuya Sakai Diversification as Risk Minimization arxiv.org/abs/2510.22681
011
Reposted by Fernando Diaz
Vilém Zouhar @zouhar.bsky.social · 20/10/2025
📢 Announcing the First Workshop on Multilingual and Multicultural Evaluation (MME) at #EACL2026 🇲🇦 MME focuses on resources, metrics & methodologies for evaluating multilingual systems! multilingual-multicultural-evaluation.github.io 📅 Workshop Mar 24–29, 2026 🗓️ Submit by Dec 19, 2025
13415
Reposted by Fernando Diaz
ACM FAccT @facct.bsky.social · 17/10/2025
We’re excited to release the Call for Papers for #FAccT2026 which will be held in Montreal, Canada in June 2026! Abstracts are due on January 8th, papers due on January 13th. Call for Papers: facctconference.org/2026/cfp Important info in thread →
facctconference.org
ACM FAccT - 2026 CFP
12117
Reposted by Fernando Diaz
Yoshua Bengio @yoshuabengio.bsky.social · 15/10/2025
AI is evolving too quickly for an annual report to suffice. To help policymakers keep pace, we're introducing the first Key Update to the International AI Safety Report. 🧵⬇️ (1/10)
33817
Reposted by Fernando Diaz
Divya Shanmugam @dmshanmugam.bsky.social · 14/10/2025
I am on the job market this year! My research advances methods for reliable machine learning from real-world data, with a focus on healthcare. Happy to chat if this is of interest to you or your department/team.
22812
Reposted by Fernando Diaz
arXiv cs.HC Human-Computer Interaction @cshc-bot.bsky.social · 08/10/2025
Renee Shelby, Fernando Diaz, Vinodkumar Prabhakaran: Taxonomy of User Needs and Actions arxiv.org/abs/2510.06124 arxiv.org/pdf/2510.06124 arxiv.org/html/2510.06124
022
Reposted by Fernando Diaz
Dylan Foster 🐢 @djfoster.bsky.social · 02/10/2025
MSR NYC is hiring spring and summer interns in AI/ML/RL! Apply here: jobs.careers.microsoft.com/global/en/jo...
microsoft.com
Microsoft Research Lab - New York City - Microsoft Research
Apply for a research position at Microsoft Research New York & collaborate with academia to advance economics research, prediction markets & ML.
0207
Fernando Diaz @841io.bsky.social · 02/10/2025
In January, Asia Biega (MPI), Georgina Born (UCL), Mary Gray (MSR), Rida Qadri (G), and I ran a Dagstuhl Seminar bringing together folks from CS and the broader social sciences to discuss questions around AI and culture. Dagstuhl has just posted our report, 1/3 drops.dagstuhl.de/storage/04da...
1154
Reposted by Fernando Diaz
Alexandra Olteanu @aolteanu.bsky.social · 30/09/2025
This was accepted to #NeurIPS 🎉🎊 TL;DR Impoverished notions of rigor can have a formative impact on AI work. We argue for a broader conception of what rigorous work should entail & go beyond methodological issues to include epistemic, normative, conceptual, reporting & interpretative considerations
1268
Fernando Diaz @841io.bsky.social · 24/09/2025
I'm noticing that some conversational AI interfaces are pausing text generation (or at least rendering) until the user scrolls. A thread on attention modeling. 👀 🧵 1/10
1101
Reposted by Fernando Diaz
Miro Dudik @mdudik.bsky.social · 18/09/2025
🚨Microsoft Research NYC is hiring🚨 We're hiring postdocs and senior researchers in AI/ML broadly, and in specific areas like test-time scaling and science of DL. Postdoc applications due Oct 22, 2025. Senior researcher applications considered on a rolling basis. Links to apply: aka.ms/msrnyc-jobs
aka.ms
Microsoft Research Lab - New York City - Microsoft Research
Apply for a research position at Microsoft Research New York & collaborate with academia to advance economics research, prediction markets & ML.
0187
Fernando Diaz @841io.bsky.social · 04/09/2025
Giuliano, V.E. and P. E. Jones, "Linear Associative Information Retrieval", Rept. no. CACL-2, Arthur D. Little, Inc., Cambridge, Mass., Nov 1962, 240 p. Also in P. W. Howerton and D. C . Weeks [eds ]. "Vistas in Information Handling", 1963, p. 30-54.
ACORN-i: (Associative Content Retrieval Network) Wired for 40 sentences using 40 index terms. To pose an inquiry, the wires with the clips are attached to the terminals for the index terms and/or sentences deemed to be relevant by the user. As the large knob is turned the
voltages on these wires are raised, and the neon bulbs light up in the order of "relevance" of the various sentences. Rel ative voltages on the individual wires are controlled by the other knobs. Association may be set either "free" or "narrow" by varying the setting on the lower right hand knob.
021
Reposted by Fernando Diaz
Nick Seaver @nickseaver.website · 03/09/2025
junior faculty in STSy positions, check out the CIFAR global scholars call: cifar.ca/next-generat... I'm on the "Future Flourishing Program," and it's a nice community (and a good bit of money as well).
cifar.ca
CIFAR Azrieli Global Scholars Program - CIFAR
Support and training for the research leaders of tomorrow.
162
Reposted by Fernando Diaz
Luke Stark @lukestark.bsky.social · 17/07/2025
My university has announced a fund to essentially poach doctoral students from US institutions. DM me if you do work on the history/social impacts of AI and are interested in being poached 😂
16590277
Reposted by Fernando Diaz
Maik Fröbe @maik-froebe.bsky.social · 15/07/2025
To Eun Kim just presented the work on "Tip of the Tongue Query Elicitation for Simulated Evaluation" at #SIGIR2025. The approach will be used in the #TREC2025 Tip-of-the-Tongue track, and we had some sweets at the poster :) The paper is available online: dl.acm.org/doi/10.1145/...
0123