iiinova — where your digital self keeps evolving

Artem Moskalev @artemmoskalev.bsky.social · 14/08/2025

Job alert 🚨 Our team is looking for ML Research Scientist to join Johnson&Johnson research. We work on geometric deep learning and LLMs in drug discovery. 🧬🤓 Drop me a message if you’re interested, or share this if you know someone who’s a great fit! Multiple locations available.

062

Artem Moskalev @artemmoskalev.bsky.social · 12/08/2025

Our code for Hierarchical RNA Language models is out! Multiple training regimes, architectures and evaluations, check it out! Code: github.com/johnsonandjo...

github.com

050

Artem Moskalev @artemmoskalev.bsky.social · 14/07/2025

Interested in efficient equivariance for long-context? Visit our Geoemtric Hyena poster at ICML! ⭐️Spotlight⭐️ When: 11 a.m. — 1:30 p.m Wed July 16 Where: East Exhibition Hall A-B #E-3103

010

Artem Moskalev @artemmoskalev.bsky.social · 23/06/2025

In SF June 23–25 🇺🇸 and Boston June 29–30 🇺🇸 Let me know if you're around! Happy to meet and chat about life and AI for bio!

000

Artem Moskalev @artemmoskalev.bsky.social · 04/06/2025

ICML Spotlight 🚨 Equivariance is too slow and expensive, especially when you need global context. It makes us wonder if it even worths it? We present Geometric Hyena Networks — a simple equivariant model orders of magnitude more memory- and compute-efficient for high-dimensional data. 1/8

180

Artem Moskalev @artemmoskalev.bsky.social · 21/04/2025

Attending ICLR 🇸🇬 Always happy to chat about LLMs and geometric deep learning for drug discovery and bio! We are presenting two conference, and two ORALS workshop papers - HELM:Hierarchical Encoding for mRNA Language Modeling. Thursday 10-12:30. Hall 3+Hall 2B #6. openreview.net/forum?id=MMHqnUOnl0

110

Reposted by Artem Moskalev

Chaitanya K. Joshi @chaitjo.bsky.social · 10/03/2025

Introducing All-atom Diffusion Transformers — towards Foundation Models for generative chemistry, from my internship with the FAIR Chemistry team There are a couple ML ideas which I think are new and exciting in here 👇

1449

Reposted by Artem Moskalev

Max Zhdanov @maxxxzdn.bsky.social · 05/03/2025

🤹 Excited to share Erwin: A Tree-based Hierarchical Transformer for Large-scale Physical Systems joint work with @wellingmax.bsky.social and @jwvdm.bsky.social preprint: arxiv.org/abs/2502.17019 code: github.com/maxxxzdn/erwin

34114

Artem Moskalev @artemmoskalev.bsky.social · 07/02/2025

AI/ML Internships in Drug Discovery🚨 Our team is hiring PhD research interns for summer 2025 in the US. Come work with us on cutting-edge drug discovery projects! We have 3 openings:

172

Artem Moskalev @artemmoskalev.bsky.social · 03/02/2025

Accepted to ICLR 🚨 Does using more geometry always help with molecule property prediction? In practice, we deal with imperfect geometries, which introduce structural noise. In our work arxiv.org/abs/2410.11933, we investigate when and how geometric information is useful (or not) for RNA molecules.

arxiv.org

Beyond Sequence: Impact of Geometric Context for RNA Property Prediction

Accurate prediction of RNA properties, such as stability and interactions, is crucial for advancing our understanding of biological processes and developing RNA-based therapeutics. RNA structures can ...

1131

Artem Moskalev @artemmoskalev.bsky.social · 23/01/2025

Accepted to ICLR 🚨 Don't treat the language of biology as natural language! Biology speaks in hierarchical patterns that natural language models don't fully capture. Meet HELM: a method to align your bio-Language Model with the intrinsic structure of mRNA sequences. arxiv.org/abs/2410.12459 1/5

1150

Reposted by Artem Moskalev

Tanishq Mathew Abraham @iscienceluvr.bsky.social · 10/12/2024

Inventors of flow matching have released a comprehensive guide going over the math & code of flow matching! Also covers variants like non-Euclidean & discrete flow matching. A PyTorch library is also released with this guide! This looks like a very good read! 🔥 arxiv: arxiv.org/abs/2412.06264

110927

Reposted by Artem Moskalev

Kevin K. Yang 楊凱筌 @kevinkaichuang.bsky.social · 03/12/2024

Three BioML starter packs now! Pack 1: go.bsky.app/2VWBcCd Pack 2: go.bsky.app/Bw84Hmc Pack 3: go.bsky.app/NAKYUok DM if you want to be included (or nominate people who should be!)

1615258

Reposted by Artem Moskalev

Mathieu Alain @miniapeur.bsky.social · 26/11/2024

Scientific machine learning starter pack go.bsky.app/9a1GVeq

184413

Reposted by Artem Moskalev

Olga Zaghen @olgatticus.bsky.social · 20/11/2024

A starter pack for researchers interested in Geometric Deep Learning - in the broadest sense possible! Let me know if you would like to be listed. :) Thanks @sharvaree.bsky.social for the idea! go.bsky.app/7h8sek

339821

Reposted by Artem Moskalev

Vaishnavh Nagarajan @vaishnavh.bsky.social · 20/11/2024

My Simons talk on all the next-token & multi-token prediction stuff I've been yapping about is up, if anyone wants to watch! There're better versions of the talk that Gregor co-presented with me elsewhere, but sadly not recorded. He is an amazing presenter! www.youtube.com/watch?v=9V0b...

youtube.com

The Pitfalls of Next-token Prediction

YouTube video by Simons Institute

4527

Reposted by Artem Moskalev

Gabriele Corso @gcorso.bsky.social · 17/11/2024

Thrilled to announce Boltz-1, the first open-source and commercially available model to achieve AlphaFold3-level accuracy on biomolecular structure prediction! An exciting collaboration with Jeremy, Saro, and an amazing team at MIT and Genesis Therapeutics. A thread!

18610204

Artem Moskalev @artemmoskalev.bsky.social · 19/11/2024

Why so many reviewers tend to prefer complexity over simplicity in design?

000

Reposted by Artem Moskalev

AMLab @amlab.bsky.social · 19/11/2024

Yesterday, @erikjbekkers.bsky.social presented his vision on equivariance to IvI (at UvA), showcasing recent work on geometry-grounded representation learning - addressing fundamental limitations in geometric reasoning of current AI systems. 🤖 Exciting times ahead for geometric deep learning! 🌐 🤩

1396

Artem Moskalev @artemmoskalev.bsky.social · 19/11/2024

What would be a good way of getting better in jax as an experienced pytorch user? 🤓

130