Sign in

Correll Lab

@correlllab.bsky.social
344 followers 272 following 94 posts

Correll Lab at the University of Colorado Boulder.

PostsRepliesMedia
Correll Lab @correlllab.bsky.social · 04/02/2025
Any opinions on "Toward Data Science" moving off of Medium.com? Wonder how many authors have published on TDS because it was on Medium.
medium.com
Medium: Read and write stories.
On Medium, anyone can share insightful perspectives, useful knowledge, and life wisdom with the world.
000
Correll Lab @correlllab.bsky.social · 28/01/2025
Deep Seek just released the multi-modal model Janus-Pro github.com/deepseek-ai/...
github.com
020
Correll Lab @correlllab.bsky.social · 04/01/2025
End-to-end learning datasets should include negative examples, check out James Watson’s block-stacking dataset medium.com/correll-l...
medium.com
Dataset to Improve Performance in Open World Manipulation
The transformer architecture has changed the field of Artificial Intelligence forever in a sweeping fashion by bringing forth a new…
020
Correll Lab @correlllab.bsky.social · 03/01/2025
We tested out-of-the-box VLM reasoning for robotic block stacking with ChatGPT4o (95%) a huge step up, but symbolic planning is still needed medium.com/correll-l...
medium.com
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
000
Correll Lab @correlllab.bsky.social · 02/01/2025
Robot end-to-end learning gets better when including force medium.com/correll-l...
medium.com
Integrating Contact Force for Delicate Robot Grasping
Improving end-to-end learning with salient information
021
Correll Lab @correlllab.bsky.social · 01/01/2025
More and more folks discover the power of tactile/force information in end-to-end learning manipulation medium.com/correll-l...
medium.com
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
011
Correll Lab @correlllab.bsky.social · 31/12/2024
Building CLIP from scratch to identify sport celebrities medium.com/correll-l...
medium.com
Building CLIP from Scratch to Identify Sports Celebrities
Unsupervised Learning Approach for Identifying Sports Legends in Images.
000
Correll Lab @correlllab.bsky.social · 30/12/2024
Check out Aritra and Himanshu’s attempt to solve BeliefMDPs with diffusion models medium.com/correll-l...
medium.com
Draft — Using Diffusion Models for BeliefMDPs
Robotics has come so far, and there are many examples of people achieving incredible tasks with them — whether it’s self-driving cars…
000
Correll Lab @correlllab.bsky.social · 29/12/2024
Two approaches of how to squeeze large (T)VLMs onto a 4090 medium.com/correll-l...
medium.com
Bringing Tactile VLMs to Local GPUs
Scaling the size of the OCTOPI tactile VLM down to a more digestible size
000
Correll Lab @correlllab.bsky.social · 28/12/2024
Spectrogram and Vision Transformers a powerful tool for time-series analysis medium.com/correll-l...
medium.com
Spectrograms & Vision Transformers for Time Series Forecasting (Part 2)
An exploration of using multiple time series instead of one to improve financial time series forecasting.
000
Correll Lab @correlllab.bsky.social · 27/12/2024
A tutorial on training multi-modal end-to-end robot policies with DROID medium.com/correll-l...
medium.com
Training Multimodal Robot Models with DROID
In this article I’ll be going through training a robot policy step-by-step with the DROID policy learning repository with RLDS format data…
000
Correll Lab @correlllab.bsky.social · 27/12/2024
Using ControlNets to condition diffusion to in-paint 3D point clouds for manipulation medium.com/correll-l...
medium.com
Inpainting 3D Point Clouds Using Diffusion Networks
3D UNET Backbone With Adjusted Conditioning for Diffusion Networks on 3D Object Representation Generation
000
Correll Lab @correlllab.bsky.social · 26/12/2024
Diffusion models are emerging as an universal frontend in robotic foundation models. Find out how they work in Yutong Zhang’s summary of the original robotic diffusion paper medium.com/correll-l...
medium.com
Diffusion Policy: Applying Diffusion Model to Policy Learning
Explaining diffusion policy, a powerful imitation learning method and the building block for robotics foundation models
011
Correll Lab @correlllab.bsky.social · 26/12/2024
Add to that to using blogging and youtube to create accessible versions of their work that can be consumed quickly. (And focussing on a low-ceiling summary will also help during the paper creation process - if the paper cannot be summarized in one sentence why should anyone read it?)
000
Correll Lab @correlllab.bsky.social · 25/12/2024
More and more folks discover the power of tactile/force information in end-to-end learning manipulation medium.com/correll-l...
medium.com
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
000
Correll Lab @correlllab.bsky.social · 24/12/2024
End-to-end learning datasets should include negative examples, check out James Watson’s block-stacking dataset medium.com/correll-l...
medium.com
Dataset to Improve Performance in Open World Manipulation
The transformer architecture has changed the field of Artificial Intelligence forever in a sweeping fashion by bringing forth a new…
020
Reposted by Correll Lab
Frank Dellaert @fdellaert.bsky.social · 24/12/2024
Just WOW: youtu.be/X2UxtKLZnNo?...
youtu.be
Unitree B2-W Talent Awakening! 🥳
YouTube video by Unitree Robotics
3216
Correll Lab @correlllab.bsky.social · 23/12/2024
Robot end-to-end learning gets better when including force medium.com/correll-l...
medium.com
Integrating Contact Force for Delicate Robot Grasping
Improving end-to-end learning with salient information
000
Correll Lab @correlllab.bsky.social · 22/12/2024
Still hoping humanoids will solve the greenfield vs brownfield problem that robots suffer also in this industry
010
Reposted by Correll Lab
Codfather #FBPE 🇫🇷🇪🇺 @codfather.bsky.social · 22/12/2024
😂
541169
Correll Lab @correlllab.bsky.social · 22/12/2024
@wxie.bsky.social
010
Reposted by Correll Lab
Remi Cadene @remicadene.bsky.social · 22/12/2024
Open-source implementation of robot policy with Flow Matching 🔥 github.com/HRI-EU/flow... Great work from Fan Zhang and Michael Gienger from Honda Research Institute EU!
1295
Correll Lab @correlllab.bsky.social · 22/12/2024
Great direction!
000
Reposted by Correll Lab
William Xie @wxie.bsky.social · 21/12/2024
i read five papers on tactile robot policies and wrote about them: medium.com/correll-lab/... the first step of me writing my prelim and i hope to have some more interesting synthesis soon. this is in no way a comprehensive review and i welcome recommendations of papers to read!
medium.com
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
242
Correll Lab @correlllab.bsky.social · 22/12/2024
Check out Praneeth Nemani’s work on using VLMs to provide scene understanding to symbolic planning medium.com/correll-l...
medium.com
Contextual Reasoning Meets Structured Planning
Modeling Problem Statements with LLMs
020
Correll Lab @correlllab.bsky.social · 21/12/2024
Neural networks do historically bad on sets, check out Himanshu Gupta’s review on set transformers medium.com/correll-l...
medium.com
Paper Review: Set Transformers
A Framework for Attention-based Permutation-Invariant Neural Networks
020
Correll Lab @correlllab.bsky.social · 20/12/2024
Follow and engage with our research on humanoid robots on medium.com/correll-lab
medium.com
Toward Humanoids
Ongoing pre-publication research on humanoids and related technologies including paper reviews and tutorials.
010
Correll Lab @correlllab.bsky.social · 19/12/2024
We tested out-of-the-box VLM reasoning for robotic block stacking with ChatGPT4o (95%) a huge step up, but symbolic planning is still needed medium.com/correll-l...
medium.com
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
000
Correll Lab @correlllab.bsky.social · 19/12/2024
Cool! We just released a benchmark dataset on medium.com/correll-lab/...
medium.com
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
020
Correll Lab @correlllab.bsky.social · 18/12/2024
Check out how ChatGPT can provide common sense knowledge for better grasping medium.com/towards-d...
medium.com
Grasping With Common Sense using VLMs and LLMs
How to leverage large language models for robotic grasping and code generation
010
Correll Lab @correlllab.bsky.social · 17/12/2024
Learn how DALL-E 2 works by building and training it from scratch medium.com/correll-l...
medium.com
DALL-E 2 from Scratch
Text-Conditioned Image Generation on FashionMNIST using CLIP Latents
031
Correll Lab @correlllab.bsky.social · 17/12/2024
Cool! Looking forward to seeing some cool robotic applications such as imitation learning soon!
000
Correll Lab @correlllab.bsky.social · 17/12/2024
Congratulations on super fast execution, but is the hardware really the limitation that stands in the way of true utility?
000
Correll Lab @correlllab.bsky.social · 17/12/2024
This is really about the dynamical properties. Spiking neuron models are a much better approximation of the real thing, but not too many benefits in standard ANN applications.
100
Correll Lab @correlllab.bsky.social · 17/12/2024
What are the skills you think we should actually teach? Building models from scratch, system engineering for large scale training? Which one is more important?
020
Correll Lab @correlllab.bsky.social · 17/12/2024
Here is how ChatGPT4o does on block stacking (spoiler: symbolic AI will not go away any time soon) medium.com/correll-lab/...
medium.com
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
020
Correll Lab @correlllab.bsky.social · 17/12/2024
"If humanoids are going to be successful in the near future, they need to be "employed" doing very specific tasks that no one wants to do and employers can't find people to do. This is still Robotics Business 101 right now and humanoids are not going to escape that reality. "
010
Correll Lab @correlllab.bsky.social · 17/12/2024
Two highlights: "At this point, the more you are hyping up your humanoid, the more than likely you are farther behind on the tech and a chance of a deployment than those that are not - because they are too busy making their humanoid a reality. "
010
Correll Lab @correlllab.bsky.social · 17/12/2024
Interesting summary of the last three humanoid conferences by Aaron Prather www.linkedin.com/posts/amprat...
linkedin.com
Aaron Prather on LinkedIn: Over the past three months, I have attended A3 - Association for Advancing… | 28 comments
Over the past three months, I have attended A3 - Association for Advancing Automation 𝐇𝐮𝐦𝐚𝐧𝐨𝐢𝐝 𝐑𝐨𝐛𝐨𝐭 𝐅𝐨𝐫𝐮𝐦 in Memphis, IEEE RAS HUMANOIDS… | 28 comments on LinkedIn
200
Correll Lab @correlllab.bsky.social · 16/12/2024
Learn how to use pre-trained models like BERT and GPT2 to train CLIP on large models from scratch medium.com/correll-l...
medium.com
CLIP Model — Ablation Study
In this ablation study, the “Building CLIP from Scratch” by Matt Nguyen was leveraged. The reference source can be found here…
020
Correll Lab @correlllab.bsky.social · 15/12/2024
I created a mini-tutorial on PDDL for those interested in exploring euro-symbolic AI medium.com/towards-d...
medium.com
Thinking, fast and slow with LLMs and PDDL
ChatGPT is never shy at pretending to perform deep thought, but — like our brain — might need better tools to reason accurately
140
Correll Lab @correlllab.bsky.social · 14/12/2024
Diffusion models can not only in-paint images, but also 3D point cloud. Xujia Zhang’s paper review on ScenceSense medium.com/correll-l...
medium.com
Paper review: SceneSense
Diffusion Models for 3D Occupancy Synthesis from Partial Observation
040
Correll Lab @correlllab.bsky.social · 13/12/2024
Lots of robotic applications for hierarchical vision transformers (SWIN) medium.com/correll-l...
medium.com
Paper Review: Swin Transformers and Robotics Applications
Autonomous driving, Geo-localization, Robotic surgery, and Robotic pose estimation
020
Correll Lab @correlllab.bsky.social · 13/12/2024
How does it work, does it require an external depth camera that monitors the workspace?
100
Correll Lab @correlllab.bsky.social · 13/12/2024
Super-psyched to be able to work on a truly dirty-dull-dangerous application for humanoid robots starting next Spring www.colorado.edu/cs/2024/12/0...
colorado.edu
CS robotics research to help strengthen domestic battery supply chain
Nikolaus Correll Computer science professor Nikolaus Correll and his lab at CU Boulder have been awarded $1.8 million by the U.S. Department of Energy Advanced
010
Correll Lab @correlllab.bsky.social · 12/12/2024
How to train locally and merge the resulting weights, not the raw data itself, to learn using a team of robots, paper review by Lekai Chen medium.com/correll-l...
medium.com
Paper Review: Robot Fleet Learning via Policy Merging
How to train locally and merge the resulting weights, not the raw data itself, to learn using a team of robots
010
Correll Lab @correlllab.bsky.social · 11/12/2024
Training VLMs on tactile data allows robots to understand and reason through touch, paper review by Carson Kohlbrenner medium.com/correll-l...
medium.com
Paper Review: Octopi: Object Property Reasoning with Large Tactile-Language Models
Enabling robots to understand and reason through touch!
010
Correll Lab @correlllab.bsky.social · 10/12/2024
Vision language models are now able to resolve multi-step manipulation plans. Check out Stefan Caldararu’s summary of this recent CoRL paper medium.com/correll-l...
medium.com
Paper Review: Towards Open-World Grasping with Large Vision-Language Models
Using vision language models to resolve multi-step manipulation tasks
000
Correll Lab @correlllab.bsky.social · 10/12/2024
Is multi-tier online publication the way to break large publisher’s monopolies? medium.com/correll-l...
medium.com
Multi-tier online communication platforms — a new paradigm for scientific publications?
The scientific publication system is kind of broken. On the one end of the spectrum are “high-impact publications” that charge thousands…
000
Correll Lab @correlllab.bsky.social · 09/12/2024
Check out how ChatGPT can provide common sense knowledge for better grasping medium.com/towards-d...
medium.com
Grasping With Common Sense using VLMs and LLMs
How to leverage large language models for robotic grasping and code generation
000