iiinova — where your digital self keeps evolving

Sarvesh Patil @nagababa.bsky.social · 28/06/2025

If you are not familiar of the robot-learning/RL papers, and if you have the bandwidth to go through to them, I'm more than happy to share my source papers! Please let me know either ways!

100

Sarvesh Patil @nagababa.bsky.social · 28/06/2025

And that some intervention is still needed for robot learning pipelines to demonstrate respectable ICL? The 8th thread graph makes me very curious, and I'd love to hear your thoughts on this phenomenon!

000

Sarvesh Patil @nagababa.bsky.social · 28/06/2025

i.e. converting robot joints into discrete cosine transforms seems to significantly improve sample efficiency and generalizability. Why do we see this happen? Is that merely a ephemeral local minima that were stuck into?

000

Sarvesh Patil @nagababa.bsky.social · 28/06/2025

However when SOTA papers use transformers for learning policies and Q functions in RL, the observation seems to be that "Distributional RL works better for offline RL tasks", or Frequency action space tokenization.

000

Sarvesh Patil @nagababa.bsky.social · 28/06/2025

Hi Daniel, great post! I'm curious what do you think about continuous control use-cases? From my very quick read over the post (not the paper itself) it seems that ICL emerges as a property of the model being able to handle diversity of continuous variable regression. 1/n

400

Reposted by Sarvesh Patil

Gokul Swamy @gokul.dev · 20/06/2025

It was a dream come true to teach the course I wish existed at the start of my PhD. We built up the algorithmic foundations of modern-day RL, imitation learning, and RLHF, going deeper than the usual "grab bag of tricks". All 25 lectures + 150 pages of notes are now public!

34710

Reposted by Sarvesh Patil

Chris Amato @cjdamato.bsky.social · 07/01/2025

I have a draft of my introduction to cooperative multi-agent reinforcement learning on arxiv. Check it out and let me know any feedback you have. The plan is to polish and extend the material into a more comprehensive text with Frans Oliehoek. arxiv.org/abs/2405.06161

arxiv.org

A First Introduction to Cooperative Multi-Agent Reinforcement Learning

Multi-agent reinforcement learning (MARL) has exploded in popularity in recent years. While numerous approaches have been developed, they can be broadly categorized into three main types: centralized ...

37819

Sarvesh Patil @nagababa.bsky.social · 05/01/2025

Store it on an old school magnetic HDD! You only gotta power it on every decade or so to maintain the hardware.

030

Sarvesh Patil @nagababa.bsky.social · 28/12/2024

RL as a refinement tool has been used in dexterous manipulation for some time! It used to be quite hard to do tabula rasa learning for dexterous manipulation. And still is, for the most part!

040

Reposted by Sarvesh Patil

Pablo Samuel Castro @pcastr.bsky.social · 23/12/2024

The are lots of people who've influenced AI but haven't won Nobel prizes. I discuss a tiny sliver of them in this parody of @billyjoelofficial.bsky.social 's "We didn't start the fire"... Enjoy! youtube.com/shorts/qDSYA...

youtube.com

We Didn't Win A Nobel (Billy Joel Parody)

YouTube video by MUSICODE

0247

Sarvesh Patil @nagababa.bsky.social · 20/12/2024

Hard agree. Although how to reconcile that with when you're writing a paper? Like what do you think is a reasonable process to pick "baselines"? I've seen some students get jaded cos reviewers ask them to incl "baselines" with shitty git implementations :(

020

Reposted by Sarvesh Patil

Csaba Szepesvari @skiandsolve.bsky.social · 19/12/2024

If you are into ML theory (RL or not) with a proven track record, and you are interested in an industry research position, PM me. Feel free to spread the word.

27531

Sarvesh Patil @nagababa.bsky.social · 16/12/2024

Hi! Can you please add me to the list? Thanks for making it!

100

Reposted by Sarvesh Patil

ruiqigao.bsky.social @ruiqigao.bsky.social · 02/12/2024

A common question nowadays: Which is better, diffusion or flow matching? 🤔 Our answer: They’re two sides of the same coin. We wrote a blog post to show how diffusion models and Gaussian flow matching are equivalent. That’s great: It means you can use them interchangeably.

625459

Reposted by Sarvesh Patil

Mathurin Massias @mathurinmassias.bsky.social · 27/11/2024

Anne Gagneux, Ségolène Martin, @quentinbertrand.bsky.social Remi Emonet and I wrote a tutorial blog post on flow matching: dl.heeere.com/conditional-... with lots of illustrations and intuition! We got this idea after their cool work on improving Plug and Play with FM: arxiv.org/abs/2410.02423

1235299

Sarvesh Patil @nagababa.bsky.social · 23/11/2024

Intro Post Hello World! I'm a 2nd year Robotics PhD student at CMU, working on distributed dexterous manipulation, accessible soft robots and sensors, sample efficient robot learning, and causal inference. Here are my cute robots: PS: Videos are old and sped up. They move slower in real-world :3

0153