iiinova — where your digital self keeps evolving

Alexandre Lacoste

@alex-lacoste.bsky.social

137 followers 175 following 20 posts

MegaSenior Research Scientist at ServiceNow Research, Former Google. WebAgents, Remote Sensing, Climate Change, Opinions are my own

Posts Replies Media

Alexandre Lacoste @alex-lacoste.bsky.social · 21/08/2025

🚨 Is #WorkArena on the verge of being solved? Or did GPT-5 just get trained on it? 🔥While some benchmarks show modest gains, GPT-5 is crushing WorkArena L2🔥 ➡️ 69.4% avg success vs. ~40% for next best🤯 ➡️ Complex tasks, up to 100 steps, 5–20 min for humans

100

Alexandre Lacoste @alex-lacoste.bsky.social · 02/07/2025

🚨 New benchmark drop! [#ICCV2025] Our paper "GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks" is accepted at ICCV 2025 in Honolulu, Hawaii! 🌺 Let's dive into what makes it exciting: 🧵

110

Alexandre Lacoste @alex-lacoste.bsky.social · 26/03/2025

010

Reposted by Alexandre Lacoste

Nouha Dziri @nouhadziri.bsky.social · 23/01/2025

Interested in knowing more about LLMs agents and in contributing to this topic?🚀 📢We're thrilled to announce REALM: The first Workshop for Research on Agent Language Models 🤖 #ACL2025NLP in Vienna 🎻 We have an exciting lineup of speakers 🗓️ Submit your work by *March 1st* @aclmeeting.bsky.social

1134

Reposted by Alexandre Lacoste

Nouha Dziri @nouhadziri.bsky.social · 23/01/2025

Got ideas to share and want to learn about the latest progress? Consider submitting your work! 🔗https://realm-workshop.github.io Organizers: @shikharmurty.bsky.social @ehsk0.bsky.social @xhluca.bsky.social @alex-lacoste.bsky.social @hanna-nlp.bsky.social @gneubig.bsky.social

111

Alexandre Lacoste @alex-lacoste.bsky.social · 13/12/2024

Just found this cool blogpost discussing #AgentLab, #BrowserGym and #TapeAgent medium.com/@carolynduby...

medium.com

How ServiceNow Delivers Production Grade AI Agents

Large Language Model(LLM) assistants such as ChatGPT have taken the world by storm and revolutionized many everyday tasks but Generative AI…

010

Alexandre Lacoste @alex-lacoste.bsky.social · 12/12/2024

We’re really excited to release this large collaborative work for unifying web agent benchmarks under the same roof. In this TMLR paper, we dive in-depth into #BrowserGym and #AgentLab. We also present some unexpected performances from Claude 3.5-Sonnet

12111

Alexandre Lacoste @alex-lacoste.bsky.social · 12/12/2024

Join us for a co-hosted Happy Hour NeurIPS 2024 with ServiceNow and IMean.ai as we explore the cutting edge of WebAgent development! 📅 Date: Dec 13th 6:00pm PST 📍 Location: 15min walk from Neurips see details after RSVP 🎉 RSVP Here: lu.ma/rw9x9vc6

010

Alexandre Lacoste @alex-lacoste.bsky.social · 10/12/2024

Very excited to see this work coming out from @servicenowresearch.bsky.social. Can't wait to test a trained model in #AgentLab

000

Reposted by Alexandre Lacoste

Juan Rodriguez @joanrod.bsky.social · 10/12/2024

🎉 Excited to introduce BigDocs! An open, transparent multimodal dataset designed for: 📄 Documents 🌐 Web content 🖥️ GUI understanding 👨‍💻 Code generation from images We’re also launching BigDocs-Bench: ➡️ Document, Web, GUI Visual reasoning ➡️ Converting images into JSON, Markdown, LaTeX, SVG, and more!

1168

Alexandre Lacoste @alex-lacoste.bsky.social · 06/12/2024

Awesome Starter Pack. Thanks @xhluca.bsky.social

031

Alexandre Lacoste @alex-lacoste.bsky.social · 03/12/2024

🧵-1 We are thrilled to release #AgentLab, a new open-source package for developing and evaluating web agents. This builds on the new #BrowserGym package which supports 10 different benchmarks, including #WebArena.

AgentLab diagram.

The image describes AgentLab, a framework for efficient parallel experiments with agents. It highlights:

Core Agent Features:

Dynamic Prompting and a Unified LLM API for interacting with large language models.
BrowserGym Platform:

A tool for testing agents on benchmarks like WebArena, WorkArena, MiniWoB, and others.
Key Features:

Reproducibility, a Unified Leaderboard, an analysis tool called Xray, and a Dataset for sharing agent traces.
Blue elements represent AgentLab components.

21815