iiinova — where your digital self keeps evolving

Carlo Sferrazza @carlosferrazza.bsky.social · 29/05/2025

We just released FastTD3: a simple, fast, off-policy RL algorithm to train humanoid policies that transfer seamlessly from simulation to the real world. younggyo.me/fast_td3

130

Carlo Sferrazza @carlosferrazza.bsky.social · 22/04/2025

Heading to @ieeeras.bsky.social RoboSoft today! I'll be giving a short Rising Star talk Thu at 2:30pm: "Towards Multi-sensory, Tactile-Enabled Generalist Robot Learning" Excited for my first in-person RoboSoft after the 2020 edition went virtual mid-pandemic. Reach out if you'd like to chat!

030

Carlo Sferrazza @carlosferrazza.bsky.social · 17/04/2025

What is the place of exploration in today's AI landscape and in which settings can exploration algorithms address current open challenges? Join us to discuss this at our exciting workshop at @icmlconf.bsky.social 2025: EXAIT! exait-workshop.github.io #ICML2025

193

Carlo Sferrazza @carlosferrazza.bsky.social · 16/01/2025

Big news for open-source robot learning! We are very excited to announce MuJoCo Playground. The Playground is a reproducible sim-to-real pipeline that leverages MuJoCo ecosystem and GPU acceleration to learn robot locomotion and manipulation in minutes. playground.mujoco.org

120

Carlo Sferrazza @carlosferrazza.bsky.social · 13/01/2025

Ever wondered what robots 🤖 could achieve if they could not just see – but also feel and hear? Introducing FuSe: a recipe for finetuning large vision-language-action (VLA) models with heterogeneous sensory data, such as vision, touch, sound, and more. Details in the thread 👇

111

Reposted by Carlo Sferrazza

Bhavya Sukhija @sukhijab.bsky.social · 17/12/2024

Excited to share MaxInfoRL, a family of powerful off-policy RL algorithms! The core focus of this work was to develop simple, flexible, and scalable methods for principled exploration. Check out the thread below to see how MaxInfoRL meets these criteria while also achieving SOTA empirical results.

151

Carlo Sferrazza @carlosferrazza.bsky.social · 17/12/2024

🚨 New reinforcement learning algorithms 🚨 Excited to announce MaxInfoRL, a class of model-free RL algorithms that solves complex continuous control tasks (including vision-based!) by steering exploration towards informative transitions. Details in the thread 👇

1182