iiinova — where your digital self keeps evolving

Juan Rodriguez

@joanrod.bsky.social

25 followers 24 following 9 posts

AI Researcher. Working on Multimodal AI at ServiceNow, Mila joanrod.github.io

Posts Replies Media

Reposted by Juan Rodriguez

Alexandre Lacoste @alex-lacoste.bsky.social · 12/12/2024

We’re really excited to release this large collaborative work for unifying web agent benchmarks under the same roof. In this TMLR paper, we dive in-depth into #BrowserGym and #AgentLab. We also present some unexpected performances from Claude 3.5-Sonnet

12111

Reposted by Juan Rodriguez

Chris Pal @chrisjpal.bsky.social · 25/11/2024

LLMs have a lot of potential for science, but scientists can be particularly sensitive to factuality, nuances, and hallucinations. The new ScholarQABench benchmark in this paper looks pretty useful for the community to monitor progress on LLMs for science. arxiv.org/html/2411.14199

011

Juan Rodriguez @joanrod.bsky.social · 10/12/2024

🎉 Excited to introduce BigDocs! An open, transparent multimodal dataset designed for: 📄 Documents 🌐 Web content 🖥️ GUI understanding 👨‍💻 Code generation from images We’re also launching BigDocs-Bench: ➡️ Document, Web, GUI Visual reasoning ➡️ Converting images into JSON, Markdown, LaTeX, SVG, and more!

1168