iiinova — where your digital self keeps evolving

William Merrill @lambdaviking.bsky.social · 09/06/2025

I'll be defending my dissertation at NYU next Monday, June 16 at 4pm ET! I've definitely missed inviting some people who might be interested, so please email me if you'd like to attend (NYC or Zoom)

0120

Reposted by William Merrill

Ai2 @ai2.bsky.social · 03/06/2025

As we’ve been working towards training a new version of OLMo, we wanted to improve our methods for measuring the Critical Batch Size (CBS) of a training run, to unlock greater efficiency. but we found gaps between the methods in the literature and our practical needs for training OLMo. 🧵

1163

William Merrill @lambdaviking.bsky.social · 07/03/2025

✨How does the depth of a transformer affect its reasoning capabilities? New preprint by myself and @Ashish_S_AI shows that a little depth goes a long way to increase transformers’ expressive power We take this as encouraging for further research on looped transformers!🧵

Paper: A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers

1122

Reposted by William Merrill

Hagen Blix @hagenblix.bsky.social · 15/02/2025

Wow, authors' copies have just arrived! So cool (and kinda strange lol) to see our work in print! Amazing job from @commonnotions.bsky.social! Love the cover design from Josh MacPhee <3 Get a copy here: www.commonnotions.org/why-we-fear-ai

A book with a six-fingered hand (designed by Josh MacPhee), titled "Why We Fear AI: On the Interpretation of Nightmares"

1102

Reposted by William Merrill

Shane Steinert-Threlkeld @shane.st · 11/02/2025

Excited to announce that the (stellar!) program for NASSLLI is out now: nasslli25.shane.st Further details on registration and whatnot to follow in the coming weeks. Please do circulate to anyone you know who may be interested in attending!

nasslli25.shane.st

North American Summer School on Logic, Language and Information (NASSLLI '25) @ UW

Official website for the North American Summer School for Logic, Language and Information, taking place June 23-27 at the Univeristy of Washington, Seattle.

0174

Reposted by William Merrill

Your Constitution @consti1776.bsky.social · 08/02/2025

This is a call to action. The vast majority of us are furious that our constitution is being blatantly violated at the highest levels of government. Here’s a simple way to use your voice - all you need is tape and access to a printer:

122

William Merrill @lambdaviking.bsky.social · 28/11/2024

eruditio olmonis est omnis divisa in partes tres: praeeruditionem, eruditionem seram, et posteruditionem

030

Reposted by William Merrill

Luca Soldaini 🎀 @soldaini.net · 28/11/2024

hearing reports from r/localLlama that OLMo 2 is decent at latin?… love that it’s the first thing someone thought to try

7303

Reposted by William Merrill

Ai2 @ai2.bsky.social · 26/11/2024

Meet OLMo 2, the best fully open language model to date, including a family of 7B and 13B models trained up to 5T tokens. OLMo 2 outperforms other fully open models and competes with open-weight models like Llama 3.1 8B — As always, we released our data, code, recipes and more 🎁

The OLMo 2 models sit at the Pareto frontier of training FLOPs vs model average performance.

515235

William Merrill @lambdaviking.bsky.social · 26/11/2024

A starter pack for research on Formal Languages and Neural Networks! go.bsky.app/eKG7Ua

3414

William Merrill @lambdaviking.bsky.social · 20/11/2024

This is actually really cool! I used it today to surface results on a topic I’ve been curious about for a while but where conventional search failed (the complexity of the word problem for finitely generated monoids) www.semanticscholar.org/paper/On-the...

semanticscholar.org

[PDF] On the complexity of the word problem of the R. Thompson group V | Semantic Scholar

It is shown that this word problem is the complement of the cyclic closure of a union of reverse deterministic context-free languages and the deterministic time-complexity of the word problem of V is ...

010