Sign in

Werner Geyer

@wernergeyer.bsky.social
191 followers 216 following 34 posts

Chief Scientist Human-Center Trustworthy AI @ IBM Research. Interested in Human+AI Interaction & AI-Assisted Productivity. Opinions are my own! wernergeyer.com

PostsRepliesMedia
Reposted by Werner Geyer
Picard Tips @picardtips.bsky.social · 19/10/2025
Picard technology tip: Sometimes your chief engineer can build new systems that are better than your existing enterprise software.
111216
Reposted by Werner Geyer
Hyo Jin (Gina) Do @dohyojin.bsky.social · 16/10/2025
❣️ Shout out to my amazing co-authors: Rachel Ostrand, @wernergeyer.bsky.social , @keerthi166.bsky.social, Dennis Wei, and Justin Weisz! If you'll be at AIES, I would love to connect and chat more about our work! 🙌
011
Reposted by Werner Geyer
Picard Tips @picardtips.bsky.social · 26/09/2025
Picard management tip: Even without game-changing results, experimentation is time well spent.
011222
Werner Geyer @wernergeyer.bsky.social · 25/09/2025
🚀 Excited to share some updates from EvalAssist, the open-source LLM-as-a-Judge framework we released a few months ago! 🧵
110
Werner Geyer @wernergeyer.bsky.social · 21/08/2025
We've just extended the IUI Workshop deadline by one week to August 29. Looking forward to your contributions!
020
Werner Geyer @wernergeyer.bsky.social · 28/07/2025
Getting ready! Come visit us at the IBM booth @acl to learn about our latest Research. We have a number of super interesting demos lined up. research.ibm.com/events/acl-2...
000
Reposted by Werner Geyer
CHIWORK @chiwork.bsky.social · 04/04/2025
We’re growing and going global! 🌍 CHIWORK 2025 is shaping up to be our biggest and most diverse edition yet. Thanks to everyone who submitted, reviewed, and supported us 💙 Can’t wait to see you in Amsterdam! 🔗 chiwork.org #CHIWORK2025 #HCI #FutureOfWork
053
Reposted by Werner Geyer
ACM - Intelligent User Interfaces @acm-iui.bsky.social · 09/06/2025
📢 Call for Workshop & Tutorial Proposals 📢 Bring your ideas and discuss them with fellow researchers in Paphos, Cyprus, from March 22-26, 2026. iui.hosting.acm.org/2026/call-fo... #CallForProposals #IUI2026 #HCI #AI
021
Werner Geyer @wernergeyer.bsky.social · 16/06/2025
📣 Today we open-sourced EvalAssist, a web-based tool that makes it super easy to develop criteria for llm judges. You can run this now locally and then scale up with notebooks using Unitxt. Check out the AI Alliance article to get the scoop: thealliance.ai/blog/llm-as-...
thealliance.ai
LLM-as-a-Judge Without the Headaches: EvalAssist Brings Structure and Simplicity to the Chaos of LLM Output Review | AI Alliance
Evaluating AI model outputs at scale is a major challenge for teams using LLMs, especially when assessing nuanced qualities like politeness, fairness, and tone that traditional benchmarks miss. IBM Re...
153
Reposted by Werner Geyer
Patricia Kahr @pkahr.bsky.social · 05/06/2025
📣 Call for Workshop & Tutorial Proposals 📣 #IUI2026 is looking forward to your contribution! Bring your ideas and discuss them with fellow researchers in Paphos, Cyprus, from March 22-26, 2026. 🚨 Proposal Deadlines: Aug 22 (Workshops) and Oct 17 (Tutorials)🚨 iui.hosting.acm.org/2026/call-fo...
iui.hosting.acm.org
Call for Workshop & Tutorial Proposals | IUI
122
Werner Geyer @wernergeyer.bsky.social · 05/06/2025
📣 IUI 2026 Call for Workshops and Tutorials is live 📣 iui.acm.org/2026/call-fo... Note that this year, submissions will be due August 22 earlier than previous years. Pls. spread the word! We had a fantastic workshop program in 2025 and I'm looking forward to an even better one in 2026 in Cyprus.
iui.acm.org
Call for Workshop & Tutorial Proposals | IUI
020
Werner Geyer @wernergeyer.bsky.social · 06/05/2025
We just published a summary the 6th workshop on Human-AI Co-Creation with Generative Models at IUI 2025 in March. This year's special topic, of course, AI agents and agency. Two of our sessions covered this topic and we had an exciting panel discussion. Check it out! medium.com/human-center...
medium.com
HAI-GEN 2025: 6th Workshop on Human-AI Co-Creation with Generative Models
by Osnat Mokryn (University of Haifa, IL), Orit Shaer (Wellesley College, US), Werner Geyer (IBM Research, US), Mary Lou Maher (Computing…
010
Werner Geyer @wernergeyer.bsky.social · 30/04/2025
Great work from our team @ IBM Research
010
Reposted by Werner Geyer
Kush Varshney कुश वार्ष्णेय @krvarshney.bsky.social · 08/04/2025
A summary of decolonial AI alignment in the Human-Centered AI publication on Medium. Thanks to @jweisz3.bsky.social for asking me to write it, and for editing the piece. medium.com/human-center...
medium.com
Decolonial AI Alignment
by Kush Varshney (IBM Research, US)
052
Reposted by Werner Geyer
Kush Varshney कुश वार्ष्णेय @krvarshney.bsky.social · 28/03/2025
I'm on the IBM Mixture of Experts podcast wearing a safety vest. We talk about all the new things in AI this week. I also connect to older work by IBM Fellows Irene Greif, Bob Dennard, Rolf Landauer, and Charlie Bennett and to Mauro Martino's new AI-generated film. www.youtube.com/watch?v=CgqH...
youtube.com
DeepSeek-V3-0324, Gemini Canvas and GPT-4o image generation
YouTube video by IBM Technology
022
Reposted by Werner Geyer
Kush Varshney कुश वार्ष्णेय @krvarshney.bsky.social · 09/04/2025
Granite Guardian tops a new benchmark! research.ibm.com/blog/granite...
research.ibm.com
Granite Guardian tops third-party AI benchmark
IBM’s collection of LLM guardrail models take six of the top 10 spots on the new GuardBench leaderboard.
032
Werner Geyer @wernergeyer.bsky.social · 01/04/2025
And the final product 😋
010
Werner Geyer @wernergeyer.bsky.social · 31/03/2025
Asparagus time in Germany. This is an automated peeling machine. No AI 😀
000
Werner Geyer @wernergeyer.bsky.social · 26/03/2025
All set up for demo time at IUI. We are showing a tool for GenAU-assisted hypotheses exploration. dl.acm.org/doi/10.1145/...
010
Werner Geyer @wernergeyer.bsky.social · 22/03/2025
IBM Research on their way to IUI
000
Werner Geyer @wernergeyer.bsky.social · 18/03/2025
Ah, and now there is a cool name for it :) www.zdnet.com/article/what... Is there already a CHI paper about it? :)
zdnet.com
What is AI vibe coding? It's all the rage but it's not for everyone - here's why
Caution: Experience required. Vibe coding feels like magic, until your AI assistant starts overwriting your work.
010
Werner Geyer @wernergeyer.bsky.social · 11/02/2025
We have two amazing keynotes this year at HAI-GEN 2025 to challenge our thinking on co-creative systems from an interaction perspective. Hope to cu at IUI this year! hai-gen.github.io/2025/program/
lnkd.in
LinkedIn
This link will take you to a page that’s not on LinkedIn
030
Reposted by Werner Geyer
Estelle Smith @estellesmithphd.bsky.social · 31/01/2025
📣 The #CSCW2026 deadline (@acm-cscw.bsky.social) has been posted. Big change this year. There is **only one deadline** for 2026 and it is May 13, 2025. 📣 Please spread the word! #CSCW #CHI #HCI #socialcomputing cscw.acm.org/2025/index.p...
cscw.acm.org
CALL FOR PAPERS – CSCW 2025
22713
Werner Geyer @wernergeyer.bsky.social · 23/01/2025
Looking forward seeing your papers!!!
050
Reposted by Werner Geyer
Kush Varshney कुश वार्ष्णेय @krvarshney.bsky.social · 20/12/2024
"IBM has equipped the Granite Guardian 3.1 models with the ability to detect hallucinations in AI agent workflows. This feature provides oversight of an AI agent completing a task, monitoring for fabricated information or incorrect function calls." technologymagazine.com/articles/the...
technologymagazine.com
The Key to How IBM's Granite 3.1 is Advancing Enterprise AI
IBM’s new Granite 3.1 addresses key enterprise needs, including expanded context handling, multilingual support, new tools and AI agent development
062
Reposted by Werner Geyer
Kush Varshney कुश वार्ष्णेय @krvarshney.bsky.social · 18/12/2024
We released Granite Guardian 3.1 today! Even better at harm detection than Granite Guardian 3.0. The main new feature is 'function calling hallucination' detection relevant for tool-using AI agents. github.com/ibm-granite/...
071
Reposted by Werner Geyer
Daniel Buschek @dbuschek.bsky.social · 19/12/2024
📣 Join our 6th "HAI-GEN" workshop on Human-AI Co-Creation with Generative Models at #IUI2025! 👉 Submit a paper, demo or poster by Jan 22: hai-gen.github.io/2025/ with: @ossimokryn.bsky.social, @wernergeyer.bsky.social, Orit Shaer, Justin Weisz, Lydia Chilton, Mary Lou Maher #IUI #HCI #CHI #AI
Box with title "HAI-GEN Workshop at IUI 2025" and a badge saying "Deadline Jan 22" on a violet-pink background image of a fantasy landscape. The box also lists two questions: How do we design, implement, and evaluate intent-based co-creative experiences that enhance human creativity? How can we leverage generative AI for positive & effective co-creative user experiences? The bottom line of the box says: Spotlight Topic: "Agents & Agency in Human-AI Co-Creation"
073
Werner Geyer @wernergeyer.bsky.social · 16/12/2024
I showed this cool demo last week @neuripsconf.bsky.social Now we have a public version on Hugging Face that you can play with to see the "judge" model in action. huggingface.co/spaces/ibm-g... Enjoy! Open source repo & benchmarks: github.com/ibm-granite/...
huggingface.co
Granite Guardian Demo - a Hugging Face Space by ibm-granite
demo
074
Reposted by Werner Geyer
Kush Varshney कुश वार्ष्णेय @krvarshney.bsky.social · 14/12/2024
Nice video about Granite Guardian! www.youtube.com/watch?v=n7tt...
youtube.com
Granite Guardian 3.0 8B - Detect Risks in LLM Prompts Responses and RAG Pipelines - Install Locally
YouTube video by Fahd Mirza
031
Werner Geyer @wernergeyer.bsky.social · 12/12/2024
Neurips is a great place to meet friends and former colleagues
020
Werner Geyer @wernergeyer.bsky.social · 10/12/2024
Granite Guardians in Action
040
Reposted by Werner Geyer
Kush Varshney कुश वार्ष्णेय @krvarshney.bsky.social · 10/12/2024
It is @neuripsconf.bsky.social booth setup day! Among Ambrish Rawat, @bhoov.bsky.social, and @wernergeyer.bsky.social, who do you think is *not* an author of the Granite Guardian technical report we released today? (Hint: Granite Guardian helps make any LLM safer.) Link: github.com/ibm-granite/...
IBM Researchers setting up a booth at a convention center. Some are wearing safety gear and some are not.
062
Werner Geyer @wernergeyer.bsky.social · 10/12/2024
Starting to look nice 😊
040
Werner Geyer @wernergeyer.bsky.social · 09/12/2024
Now posted at the under construction booth 😀 our demo lineup for Tuesday. Looking forward connecting with you at the IBM booth @neuripsconf.bsky.social
082
Werner Geyer @wernergeyer.bsky.social · 09/12/2024
Getting ready for the big show this week. @neuripsconf.bsky.social
020
Reposted by Werner Geyer
Krzysztof Gajos @kgajos.bsky.social · 09/12/2024
Do you feel that your profession or organization urgently needs to adopt #AI? Here's some advice that we often share (as academics working in human-AI interaction and #ML) with professional colleagues who consider the role of modern technology in their professions. (w/ Weiwei Pan and Hongjin Lin)
iis.seas.harvard.edu
Keep calm and carry on, with or without AI: What to do if your profession or organization urgently needs to adopt AI – Intelligent Interactive Systems Group at Harvard
086
Reposted by Werner Geyer
Michael Hind @michaelhind.bsky.social · 07/12/2024
I'm happy to announce a significant revision of our paper describing opportunities and challenges of quantitative AI risk assessments, also known as automated red-teaming: arxiv.org/abs/2209.06317
arxiv.org
Quantitative AI Risk Assessments: Opportunities and Challenges
Although AI systems are increasingly being leveraged to provide value to organizations, individuals, and society, significant attendant risks have been identified and have manifested. These risks have...
163
Werner Geyer @wernergeyer.bsky.social · 06/12/2024
The UX surrounding this capability was grounded and informed by research our Human-Centered Trustworthy AI team did on communicating factuality scores and source attribution led by @dohyojin.bsky.social, part of a larger research effort on how to communicate uncertainty. arxiv.org/abs/2405.20434
arxiv.org
Facilitating Human-LLM Collaboration through Factuality Scores and Source Attributions
While humans increasingly rely on large language models (LLMs), they are susceptible to generating inaccurate or false information, also known as "hallucinations". Technical advancements have been mad...
031
Reposted by Werner Geyer
Amy Zhang @axz.bsky.social · 05/12/2024
If you are headed to NeurIPS, please join for our Pluralistic Alignment workshop! We have a great set of speakers from a range of backgrounds. & all the papers that will be presented at the workshop are posted: pluralistic-alignment.github.io lmk if you'd like to catch up at the conference too! :)
pluralistic-alignment.github.io
Pluralistic Alignment @ NeurIPS 2024
Pluralistic Alignment
1429
Reposted by Werner Geyer
Hendrik Strobelt @henstr.bsky.social · 03/12/2024
🎺 Here comes the official 2024 NeurIPS paper browser: - browse all NeurIPS papers in a visual way - select clusters of interest and get cluster summary - ZOOOOM in - filter by human assigned keywords - filter by substring (authors, titles) neurips2024.vizhub.ai #neurips by IBM Research Cambridge
Overview of paper browser. A cluster for reinforcement learning is selected.Paper Browser: only papers assigned to "physical models - physics" are shown.Paper Browser: Filtered by author "Hoover" and detail is shownPaper Brower: ZOOOOM in
56021
Reposted by Werner Geyer
Amy Zhang @axz.bsky.social · 03/12/2024
In collab w/ Semantic Scholar, we conducted a large scale (800+) survey of researcher usage and perceptions of LLMs for science. Major findings: +Most are using LLMs already, mostly for writing +LLMs seem to be a win for research equity +But some groups, like women, have more ethical concerns too
37914
Werner Geyer @wernergeyer.bsky.social · 02/12/2024
I will be at @neuripsconf.bsky.social next week presenting EvalAssist, our research on LLM-as-a-Judge, at the Expo. Stop by if you are around neurips.cc/Expo/Confere...
331
Reposted by Werner Geyer
Daniel Buschek @dbuschek.bsky.social · 29/11/2024
📣 Join our 6th "HAI-GEN" workshop on Human-AI Co-Creation with Generative Models at #IUI2025! 👉 Submit a paper, demo or poster by Jan 22: hai-gen.github.io/2025/ with: Orit Shaer, Justin Weisz, @wernergeyer.bsky.social, Lydia Chilton, @ossimokryn.bsky.social, Mary Lou Maher
Box with title "HAI-GEN Workshop at IUI 2025" and a badge saying "Deadline Jan 22" on a violet-pink background image of a fantasy landscape. The box also lists two questions: How do we design, implement, and evaluate intent-based co-creative experiences that enhance human creativity? How can we leverage generative AI for positive & effective co-creative user experiences? The bottom line of the box says: Spotlight Topic: "Agents & Agency in Human-AI Co-Creation"
082
Werner Geyer @wernergeyer.bsky.social · 22/11/2024
Happy to finally read something useful again in my feed :) ... I found the Sky Follower Bridge really helpful to reconnect with folks on BlueSky.
040
Werner Geyer @wernergeyer.bsky.social · 12/11/2024
📣 We're back! Join our 6th "HAI-GEN" workshop on Human-AI Co-Creation with Generative Models at #IUI2025! 👉 Submit a paper, demo or poster by Jan 22: hai-gen.github.io/2025/ with: Orit Shaer, Justin Weisz, Werner Geyer, Lydia Chilton, Osnat Mokryn, Mary Lou Maher
121