iiinova — where your digital self keeps evolving

Stone Tao @stonet2000.bsky.social · 19/09/2026

Met some absolute legends of the simulation community, an incredible conference hosted by nvidia and google in london!

Stone Tao @stonet2000.bsky.social · 07/09/2026

will be in London Sept 14-17th. If you want to chat let me know! Looking to learn about the UK robotics space and see how our research @ Pi can help!

061

Stone Tao @stonet2000.bsky.social · 31/07/2026

Just over a month later, I have now joined Physical Intelligence full time! Wrote a bit about why I'm excited to research simulation at Pi stoneztao.substack.com/p/joining-ph...

stoneztao.substack.com

Joining Physical Intelligence to Work on Simulation

What makes researching simulation at Pi exciting!

4271

Stone Tao @stonet2000.bsky.social · 16/06/2026

just arrived in SF and excited to begin my research internship at physical intelligence working on simulation!

0100

Stone Tao @stonet2000.bsky.social · 10/06/2026

I reverted my decision to hand off ManiSkill to someone else. A ManiSkill 4 is now in progress with lots of improvements (focusing on robot manipulation) If you planned to not use ManiSkill because it might not be maintained once I graduate, I hope this convinces you otherwise!

140

Stone Tao @stonet2000.bsky.social · 08/06/2026

The ManiSkill project now has a new home under a new mani-skill github organization, moving out of the old UCSD lab org. Long overdue and done as part of my plans for longer term maintainance as well as more organized community driven development github.com/mani-skill

github.com

ManiSkill

Community for developing the Maniskill robotics simulation framework - ManiSkill

151

Stone Tao @stonet2000.bsky.social · 02/06/2026

in Seattle for 2 weeks finishing up my work at AI2 (at their extremely beautiful office). lmk if you want to meet!

130

Stone Tao @stonet2000.bsky.social · 13/05/2026

First blog post up on Robotics Simulation Infrastructure! I give a high-level overview, followed by an elementary example of better infrastructure for pose management. stoneztao.substack.com/p/robotics-s...

stoneztao.substack.com

Robotics Simulation Infrastructure Part 1

First part of a blog series diving into the world of robotics simulation and machine learning

0375

Stone Tao @stonet2000.bsky.social · 02/04/2026

Wasn't at GTC but a sneak peak of some of my internship work at NVIDIA was! (sim2real cable routing presented by my manager Yashraj) www.youtube.com/watch?v=d5wm...

youtube.com

AI Research Breakthroughs from NVIDIA Research (Hosted by Karoly of Two Minute Papers) | NVIDIA GTC

YouTube video by NVIDIA Developer

010

Stone Tao @stonet2000.bsky.social · 02/04/2026

would people be interested in a blog series on "simulation infrastructure" where I look at popular robotics sim tools (e.g. mjlab, isaac...) and explain the pros and cons of their design decisions. The series would cover what I believe to be key pillars of good, usable, sim code

2191

Stone Tao @stonet2000.bsky.social · 01/11/2025

I will be in SF from November 10-17 🌉 If you work on something interesting and want to meet up let me know! Or if there’s a fun event i’d love some invites 😃 I’m also looking to visit robotics companies (especially startups!), if you have time lmk if I can visit!

010

Stone Tao @stonet2000.bsky.social · 19/09/2025

1/1 neurips submission accepted! Will share more details later, covers an often overlooked aspect of on policy RL training when scaling to large scale parallelized environments

020

Reposted by Stone Tao

Nathan Lambert @natolambert.bsky.social · 19/09/2025

Rumors going around are that NeurIPS PCs had to reject ~400 papers because of venue constraints that were in the accept pile. Hard things like this happen but the PCs and conference should explicitly tell all the authors who had this happen to them. Or create something like accept w/o presentation.

1191

Stone Tao @stonet2000.bsky.social · 09/09/2025

Opensourcing a tool to calibrate camera extrinsics painlessly in a minute, no checkerboards! It's based on EasyHEC, using diff. rendering to optimize extrinsics given object meshes+poses. Crazy that even a piece of paper works too. Code: github.com/StoneT2000/s... (paper example in next post)

2247

Stone Tao @stonet2000.bsky.social · 19/07/2025

might be the first time I made it personally on the trending developers list on github! One of the contributing factors being the lerobot sim2real code

1170

Reposted by Stone Tao

Chris Paxton @cpaxton.bsky.social · 05/07/2025

Combining sim to real with cheap hardware like the so-100 really is making cutting edge robot learning so accessible and its wonderful

5487

Reposted by Stone Tao

Nathan Lambert @natolambert.bsky.social · 04/07/2025

My latest post: The American DeepSeek Project Build fully open models in the US in the next two years to enable a flourishing, global scientific AI ecosystem to balance China's surge in open-source and an alternative to building products ontop of leading closed models. buff.ly/kvJQE3I

1346

Stone Tao @stonet2000.bsky.social · 04/07/2025

Awesome to see people reproducing the accessible LeRobot zero-shot sim2real project! Trained for just 90 min in ManiSkill and deployed directly in real. Sim2real is not easy, but very rewarding when it works Original post by Jianwei Zhang on LinkedIn www.linkedin.com/posts/jianwe...

0296

Stone Tao @stonet2000.bsky.social · 28/06/2025

Excited to announce that I will be interning at @nvidia research this summer on robotics/embodied AI! I’ll be in seattle for the summer, let me know if you want to meet up and chat! 🦾

0100

Stone Tao @stonet2000.bsky.social · 22/06/2025

Rest of my lab has various presentations at RSS2025, please check out their awesome work! June 25 EEB 248 @ 10am - Hardware Optimization for In-Hand Rotation by K. Fay

130

Stone Tao @stonet2000.bsky.social · 22/06/2025

The sim2real demo had some mixed success, hampered primarily by the lighting conditions of the outdoors. At least it worked sometimes! Hindsight says that despite the weather, low-cost nature, only 1 hour of training, anything working is a miracle

192

Stone Tao @stonet2000.bsky.social · 20/06/2025

I’ll be at #RSS2025 from June 21 to June 23! I’ll be giving a presentation on ManiSkill3 on June 21, 5:30 PM We will also have two live demo sessions, on June 21, 12:30-2:00PM and 6:30-8:00PM. Swing by to see live demos of zero shot RGB sim2real, cool sim demos, and VR teleop!

031

Reposted by Stone Tao

Phillip Isola @phillipisola.bsky.social · 15/06/2025

Our computer vision textbook is now available for free online here: visionbook.mit.edu We are working on adding some interactive components like search and (beta) integration with LLMs. Hope this is useful and feel free to submit Github issues to help us improve the text!

visionbook.mit.edu

Foundations of Computer Vision

The print version was published by

311633

Reposted by Stone Tao

Tzu-Mao Li @tzumaoli.bsky.social · 14/06/2025

Rendering nerds! Check out our latest work "Vector-Valued Monte Carlo Integration Using Ratio Control Variates" that has just gotten the best paper award at SIGGRAPH 2025. This paper presents a method that reduces variance of a wide range of rendering and diff. rendering tasks with negligible cost.

79022

Stone Tao @stonet2000.bsky.social · 13/06/2025

Code/tutorial released for🤗LeRobot zero-shot visual sim2real Reinforcement Learning! Train your SO100 robot in ManiSkill's fast simulator+renderer💨 and deploy a cube picking model zero-shot. Just in time for the LeRobot Hackathon, happy hacking! github.com/StoneT2000/l...

github.com

GitHub - StoneT2000/lerobot-sim2real: lerobot sim2real code

lerobot sim2real code. Contribute to StoneT2000/lerobot-sim2real development by creating an account on GitHub.

090

Stone Tao @stonet2000.bsky.social · 12/06/2025

longer uncut video 17/18 successes increased the spawn area size and tuned it to be less occluded. Works well!

051

Stone Tao @stonet2000.bsky.social · 11/06/2025

sneak peek of what Xander and I will show next week at RSS 2025 for the maniskill demo session: Zero shot visual sim2real (basic) manipulation, one camera and <1 hour of RL in sim with SO100 ~3 seconds to pick random color cubes, could be faster but goal is accessibility and low cost!

3243

Stone Tao @stonet2000.bsky.social · 04/06/2025

Is there any research on replay buffer sizes for off policy (sac) RL algorithms? How come we have just assumed that 1M replay buffer size is reasonable for the majority of tasks we test on (in robotics typically). Why not smaller? Can we make it smaller?

130

Stone Tao @stonet2000.bsky.social · 01/06/2025

Very good thread on how we got into this whole stem education / research cutting situation and its impacts by @davidbau.bsky.social Grants that are otherwise perfectly fine if you remove the “dei part” are being cut without being put back into stem education/research?!?! x.com/davidbau/sta...

0120

Stone Tao @stonet2000.bsky.social · 17/05/2025

Nice to see the use of ManiSkill3 in this work! Simulation is not just useful for RL training. It provides some good cheap deterministic test beds, perfect for testing imitation learning scaling laws at scale. Years of data in hours

031

Reposted by Stone Tao

Eugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 16/05/2025

For almost a decade, the environments used for RL research were slow, a huge research bottleneck in cost and throughput. The shift to fast envs will change: - the speed of testing new algorithms and ideas - decrease shoddy results caused by high eval costs Everything is getting so exciting.

3332

Stone Tao @stonet2000.bsky.social · 28/04/2025

first thing I see on wechat channels when I get to China is a 1 hour uncut video of G1 speed walking on a track lmao

010

Stone Tao @stonet2000.bsky.social · 28/04/2025

I’ll be in beijing for about 5 days, let me know if you want to meet up!

110

Stone Tao @stonet2000.bsky.social · 28/04/2025

talk by @ncklashansen.bsky.social at the world models workshop starting now!

041

Stone Tao @stonet2000.bsky.social · 27/04/2025

spotted at the robot learning workshop, 3 papers in a row all using maniskill! (and mujoco) seems like this lab likes to use our parallel rendering features and prebuilt tasks

060

Stone Tao @stonet2000.bsky.social · 27/04/2025

I’ll be at the robot learning workshop today and giving an oral talk at 9:15 AM on ManiSkill3 in rooms Garnet 216/217 at ICLR. Come see the crazy things you can do with fast sim+rendering like fast visual RL and zero-shot RGB sim2real! ManiSkill was also accepted at RSS! Updated paper coming soon

080

Stone Tao @stonet2000.bsky.social · 21/04/2025

no more experiments today apparently

070

Stone Tao @stonet2000.bsky.social · 20/04/2025

strangely, in robotics there’s value to doing BC and RL. RL for generating super human data, BC (or vlas these days) to copy that super human data it’s why i still do research on learning from demos, rl, sim. It’s the most underexplored area at the moment with the promise imo

2100

Stone Tao @stonet2000.bsky.social · 16/04/2025

Will be in singapore for #ICLR2025 next week! I work at the intersection of simulation, embodied ai, and ml/rl, let me know if you want to meet! will share the posters/talks i’m presenting later, will definitely be at the workshop on robot learning

010

Stone Tao @stonet2000.bsky.social · 09/04/2025

as someone who started in rl, I check if manipulation robots are modelled well and run fine in sim by checking if they can learn to pick up objects via RL. Slowly adding these test scripts for robot arms in ManiSkill, including SO100 here!

041

Reposted by Stone Tao

Eugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 09/04/2025

A sensible perspective on humanoids in manufacturing (TLDR: if you can make humanoids, you can probably make better, more manufacturing specific things) blog.spec.tech/p/humanoid-r...

blog.spec.tech

Humanoid Robots in Manufacturing

Or, there's a reason we don't pull cars with mechanical horses

3588

Stone Tao @stonet2000.bsky.social · 05/04/2025

worked on a nice new gallery/docs for robots in maniskill/sapien (inspired by mujoco menagerie). Given all the github issues on robot modelling (it's hard!) it seems like we should just model robots for most people, this is an effort to organize it more maniskill.readthedocs.io/en/latest/ro...

1100

Stone Tao @stonet2000.bsky.social · 20/03/2025

some exciting news, ManiSkill/SAPIEN now has experimental support for MacOS for the CPU simulation and rendering. You can now do your local debugging/development on Mac. Example shown here is a Push-T policy trained on my 4090 running on my mac! try now: maniskill.readthedocs.io/en/latest/us...

0234

Stone Tao @stonet2000.bsky.social · 18/03/2025

been learning warp recently primarily to add soft body sims back to ManiSkill. I’ve also been making some efforts to support mujoco/mjx as a physics backend earlier in the year. If these upgrades work then all of my efforts to learn warp / add mujoco will pay off a ton

180

Stone Tao @stonet2000.bsky.social · 18/03/2025

people are beginning to post writeups for their submissions to the lux ai challenge season 3 and one of them rewrote the entire game engine in rust! and tackled the problem with RL github.com/IsaiahPressm..., the competition wrap-up report will be very interesting

github.com

GitHub - IsaiahPressman/kaggle-lux-2024

Contribute to IsaiahPressman/kaggle-lux-2024 development by creating an account on GitHub.

161

Stone Tao @stonet2000.bsky.social · 14/03/2025

Currently trying to do a kind of api setup where you can really write code like this to get easy sim2real real environment gym interfaces where the action/observation space is the same as the sim env, controllers are aligned etc. hoping to make sim2real more accessible

160