iiinova — where your digital self keeps evolving

Ahmed S. M. Elhady

@ahmedelhady.bsky.social

PhD Student @UPV/EHU, working on multilingual and multimodal GenAi. ex Microsoft and Agolo.

Ahmed S. M. Elhady @ahmedelhady.bsky.social · 26/02/2025

🧙‍♂️ New paper 🧙‍♀️: Presenting Wicked: a simple automated method to make MCQA benchmarks more challenging. Wicked shook up 18 open-weight LLMs on 6 benchmarks, with up to 19.7% performance drop with direct prompting 🤯 Paper: shorturl.at/1CGq0 Code: shorturl.at/n2nCU

186

Reposted by Ahmed S. M. Elhady

Ai2 @ai2.bsky.social · 25/02/2025

Introducing olmOCR, our open-source tool to extract clean plain text from PDFs! Built for scale, olmOCR handles many document types with high throughput. Run it on your own GPU for free—at over 3000 token/s, equivalent to $190 per million pages, or 1/32 the cost of GPT-4o!

38213