iiinova — where your digital self keeps evolving

Thom Lake

@thomlake.bsky.social

714 followers 410 following 6 posts

Principal Scientist at Indeed. PhD Student at UT Austin. AI, Deep Learning, PGMs, and NLP.

Thom Lake @thomlake.bsky.social · 11/12/2024

I'm at #Neurips2024 this week! My work (arxiv.org/abs/2406.17692) w/ @gregdnlp.bsky.social & @eunsol.bsky.social exploring the connection between LLM alignment and response pluralism will be at pluralistic-alignment.github.io Saturday. Drop by to learn more!

0286

Reposted by Thom Lake

Kyle Lo @ ICML2026 🇰🇷 @kylelo.bsky.social · 26/11/2024

Excited to share OLMo 2! 🐟 7B and 13B weights, trained up to 4-5T tokens, fully open data, code, etc 🐠 better architecture and recipe for training stability 🐡 staged training, with new data mix Dolmino🍕 added during annealing 🦈 state-of-the-art OLMo 2 Instruct models #nlp #mlsky links below👇

A scatter plot comparing language models by performance (y-axis, measured in average performance on 10 benchmarks) versus training computational cost (x-axis, in approximate FLOPs). The plot shows OLMo 2 models (marked with stars) achieving Pareto-optimal efficiency among open models, with OLMo-2-13B and OLMo-2-7B sitting at the performance frontier relative to other open models like DCLM, Llama 3.1, StableLM 2, and Qwen 2.5. The x-axis ranges from 4x10^22 to 2x10^24 FLOPs, while the y-axis ranges from 35 to 70 benchmark points.

16812

Reposted by Thom Lake

Juan Diego Rodriguez @juand-r.bsky.social · 22/11/2024

A starter pack for the NLP and Computational Linguistics researchers at UT Austin! go.bsky.app/75g9JLT

go.bsky.app

NLP at UT Austin

Join the conversation

0227