Sign in

Correll Lab

@correlllab.bsky.social
344 followers 272 following 94 posts

Correll Lab at the University of Colorado Boulder.

PostsRepliesMedia
Correll Lab @correlllab.bsky.social · 04/02/2025
Any opinions on "Toward Data Science" moving off of Medium.com? Wonder how many authors have published on TDS because it was on Medium.
medium.com
Medium: Read and write stories.
On Medium, anyone can share insightful perspectives, useful knowledge, and life wisdom with the world.
000
Correll Lab @correlllab.bsky.social · 28/01/2025
Deep Seek just released the multi-modal model Janus-Pro github.com/deepseek-ai/...
github.com
020
Correll Lab @correlllab.bsky.social · 04/01/2025
End-to-end learning datasets should include negative examples, check out James Watson’s block-stacking dataset medium.com/correll-l...
medium.com
Dataset to Improve Performance in Open World Manipulation
The transformer architecture has changed the field of Artificial Intelligence forever in a sweeping fashion by bringing forth a new…
020
Correll Lab @correlllab.bsky.social · 03/01/2025
We tested out-of-the-box VLM reasoning for robotic block stacking with ChatGPT4o (95%) a huge step up, but symbolic planning is still needed medium.com/correll-l...
medium.com
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
000
Correll Lab @correlllab.bsky.social · 02/01/2025
Robot end-to-end learning gets better when including force medium.com/correll-l...
medium.com
Integrating Contact Force for Delicate Robot Grasping
Improving end-to-end learning with salient information
021
Correll Lab @correlllab.bsky.social · 01/01/2025
More and more folks discover the power of tactile/force information in end-to-end learning manipulation medium.com/correll-l...
medium.com
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
011
Correll Lab @correlllab.bsky.social · 31/12/2024
Building CLIP from scratch to identify sport celebrities medium.com/correll-l...
medium.com
Building CLIP from Scratch to Identify Sports Celebrities
Unsupervised Learning Approach for Identifying Sports Legends in Images.
000
Correll Lab @correlllab.bsky.social · 30/12/2024
Check out Aritra and Himanshu’s attempt to solve BeliefMDPs with diffusion models medium.com/correll-l...
medium.com
Draft — Using Diffusion Models for BeliefMDPs
Robotics has come so far, and there are many examples of people achieving incredible tasks with them — whether it’s self-driving cars…
000
Correll Lab @correlllab.bsky.social · 29/12/2024
Two approaches of how to squeeze large (T)VLMs onto a 4090 medium.com/correll-l...
medium.com
Bringing Tactile VLMs to Local GPUs
Scaling the size of the OCTOPI tactile VLM down to a more digestible size
000
Correll Lab @correlllab.bsky.social · 28/12/2024
Spectrogram and Vision Transformers a powerful tool for time-series analysis medium.com/correll-l...
medium.com
Spectrograms & Vision Transformers for Time Series Forecasting (Part 2)
An exploration of using multiple time series instead of one to improve financial time series forecasting.
000
Correll Lab @correlllab.bsky.social · 27/12/2024
A tutorial on training multi-modal end-to-end robot policies with DROID medium.com/correll-l...
medium.com
Training Multimodal Robot Models with DROID
In this article I’ll be going through training a robot policy step-by-step with the DROID policy learning repository with RLDS format data…
000
Correll Lab @correlllab.bsky.social · 27/12/2024
Using ControlNets to condition diffusion to in-paint 3D point clouds for manipulation medium.com/correll-l...
medium.com
Inpainting 3D Point Clouds Using Diffusion Networks
3D UNET Backbone With Adjusted Conditioning for Diffusion Networks on 3D Object Representation Generation
000
Correll Lab @correlllab.bsky.social · 26/12/2024
Diffusion models are emerging as an universal frontend in robotic foundation models. Find out how they work in Yutong Zhang’s summary of the original robotic diffusion paper medium.com/correll-l...
medium.com
Diffusion Policy: Applying Diffusion Model to Policy Learning
Explaining diffusion policy, a powerful imitation learning method and the building block for robotics foundation models
011
Correll Lab @correlllab.bsky.social · 25/12/2024
More and more folks discover the power of tactile/force information in end-to-end learning manipulation medium.com/correll-l...
medium.com
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
000
Correll Lab @correlllab.bsky.social · 24/12/2024
End-to-end learning datasets should include negative examples, check out James Watson’s block-stacking dataset medium.com/correll-l...
medium.com
Dataset to Improve Performance in Open World Manipulation
The transformer architecture has changed the field of Artificial Intelligence forever in a sweeping fashion by bringing forth a new…
020
Reposted by Correll Lab
Frank Dellaert @fdellaert.bsky.social · 24/12/2024
Just WOW: youtu.be/X2UxtKLZnNo?...
youtu.be
Unitree B2-W Talent Awakening! 🥳
YouTube video by Unitree Robotics
3216
Correll Lab @correlllab.bsky.social · 23/12/2024
Robot end-to-end learning gets better when including force medium.com/correll-l...
medium.com
Integrating Contact Force for Delicate Robot Grasping
Improving end-to-end learning with salient information
000
Reposted by Correll Lab
Codfather #FBPE 🇫🇷🇪🇺 @codfather.bsky.social · 22/12/2024
😂
541169
Reposted by Correll Lab
Remi Cadene @remicadene.bsky.social · 22/12/2024
Open-source implementation of robot policy with Flow Matching 🔥 github.com/HRI-EU/flow... Great work from Fan Zhang and Michael Gienger from Honda Research Institute EU!
1295
Reposted by Correll Lab
William Xie @wxie.bsky.social · 21/12/2024
i read five papers on tactile robot policies and wrote about them: medium.com/correll-lab/... the first step of me writing my prelim and i hope to have some more interesting synthesis soon. this is in no way a comprehensive review and i welcome recommendations of papers to read!
medium.com
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
242
Correll Lab @correlllab.bsky.social · 22/12/2024
Check out Praneeth Nemani’s work on using VLMs to provide scene understanding to symbolic planning medium.com/correll-l...
medium.com
Contextual Reasoning Meets Structured Planning
Modeling Problem Statements with LLMs
020
Correll Lab @correlllab.bsky.social · 21/12/2024
Neural networks do historically bad on sets, check out Himanshu Gupta’s review on set transformers medium.com/correll-l...
medium.com
Paper Review: Set Transformers
A Framework for Attention-based Permutation-Invariant Neural Networks
020
Correll Lab @correlllab.bsky.social · 20/12/2024
Follow and engage with our research on humanoid robots on medium.com/correll-lab
medium.com
Toward Humanoids
Ongoing pre-publication research on humanoids and related technologies including paper reviews and tutorials.
010
Correll Lab @correlllab.bsky.social · 19/12/2024
We tested out-of-the-box VLM reasoning for robotic block stacking with ChatGPT4o (95%) a huge step up, but symbolic planning is still needed medium.com/correll-l...
medium.com
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
000
Correll Lab @correlllab.bsky.social · 18/12/2024
Check out how ChatGPT can provide common sense knowledge for better grasping medium.com/towards-d...
medium.com
Grasping With Common Sense using VLMs and LLMs
How to leverage large language models for robotic grasping and code generation
010
Correll Lab @correlllab.bsky.social · 17/12/2024
Learn how DALL-E 2 works by building and training it from scratch medium.com/correll-l...
medium.com
DALL-E 2 from Scratch
Text-Conditioned Image Generation on FashionMNIST using CLIP Latents
031
Correll Lab @correlllab.bsky.social · 17/12/2024
Here is how ChatGPT4o does on block stacking (spoiler: symbolic AI will not go away any time soon) medium.com/correll-lab/...
medium.com
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
020
Correll Lab @correlllab.bsky.social · 17/12/2024
Interesting summary of the last three humanoid conferences by Aaron Prather www.linkedin.com/posts/amprat...
linkedin.com
Aaron Prather on LinkedIn: Over the past three months, I have attended A3 - Association for Advancing… | 28 comments
Over the past three months, I have attended A3 - Association for Advancing Automation 𝐇𝐮𝐦𝐚𝐧𝐨𝐢𝐝 𝐑𝐨𝐛𝐨𝐭 𝐅𝐨𝐫𝐮𝐦 in Memphis, IEEE RAS HUMANOIDS… | 28 comments on LinkedIn
200
Correll Lab @correlllab.bsky.social · 16/12/2024
Learn how to use pre-trained models like BERT and GPT2 to train CLIP on large models from scratch medium.com/correll-l...
medium.com
CLIP Model — Ablation Study
In this ablation study, the “Building CLIP from Scratch” by Matt Nguyen was leveraged. The reference source can be found here…
020
Correll Lab @correlllab.bsky.social · 15/12/2024
I created a mini-tutorial on PDDL for those interested in exploring euro-symbolic AI medium.com/towards-d...
medium.com
Thinking, fast and slow with LLMs and PDDL
ChatGPT is never shy at pretending to perform deep thought, but — like our brain — might need better tools to reason accurately
140
Correll Lab @correlllab.bsky.social · 14/12/2024
Diffusion models can not only in-paint images, but also 3D point cloud. Xujia Zhang’s paper review on ScenceSense medium.com/correll-l...
medium.com
Paper review: SceneSense
Diffusion Models for 3D Occupancy Synthesis from Partial Observation
040
Correll Lab @correlllab.bsky.social · 13/12/2024
Lots of robotic applications for hierarchical vision transformers (SWIN) medium.com/correll-l...
medium.com
Paper Review: Swin Transformers and Robotics Applications
Autonomous driving, Geo-localization, Robotic surgery, and Robotic pose estimation
020
Correll Lab @correlllab.bsky.social · 13/12/2024
Super-psyched to be able to work on a truly dirty-dull-dangerous application for humanoid robots starting next Spring www.colorado.edu/cs/2024/12/0...
colorado.edu
CS robotics research to help strengthen domestic battery supply chain
Nikolaus Correll Computer science professor Nikolaus Correll and his lab at CU Boulder have been awarded $1.8 million by the U.S. Department of Energy Advanced
010
Correll Lab @correlllab.bsky.social · 12/12/2024
How to train locally and merge the resulting weights, not the raw data itself, to learn using a team of robots, paper review by Lekai Chen medium.com/correll-l...
medium.com
Paper Review: Robot Fleet Learning via Policy Merging
How to train locally and merge the resulting weights, not the raw data itself, to learn using a team of robots
010
Correll Lab @correlllab.bsky.social · 11/12/2024
Training VLMs on tactile data allows robots to understand and reason through touch, paper review by Carson Kohlbrenner medium.com/correll-l...
medium.com
Paper Review: Octopi: Object Property Reasoning with Large Tactile-Language Models
Enabling robots to understand and reason through touch!
010
Correll Lab @correlllab.bsky.social · 10/12/2024
Vision language models are now able to resolve multi-step manipulation plans. Check out Stefan Caldararu’s summary of this recent CoRL paper medium.com/correll-l...
medium.com
Paper Review: Towards Open-World Grasping with Large Vision-Language Models
Using vision language models to resolve multi-step manipulation tasks
000
Correll Lab @correlllab.bsky.social · 10/12/2024
Is multi-tier online publication the way to break large publisher’s monopolies? medium.com/correll-l...
medium.com
Multi-tier online communication platforms — a new paradigm for scientific publications?
The scientific publication system is kind of broken. On the one end of the spectrum are “high-impact publications” that charge thousands…
000
Correll Lab @correlllab.bsky.social · 09/12/2024
Check out how ChatGPT can provide common sense knowledge for better grasping medium.com/towards-d...
medium.com
Grasping With Common Sense using VLMs and LLMs
How to leverage large language models for robotic grasping and code generation
000
Correll Lab @correlllab.bsky.social · 09/12/2024
I'm experimenting with a new (?) approach to science publication and communication that starts by putting an idea out on Bluesky to get initial feedback. So here it is! What do people think about this?
100
Correll Lab @correlllab.bsky.social · 08/12/2024
I created a mini-tutorial on PDDL for those interested in exploring euro-symbolic AI medium.com/towards-d...
medium.com
Thinking, fast and slow with LLMs and PDDL
ChatGPT is never shy at pretending to perform deep thought, but — like our brain — might need better tools to reason accurately
030
Correll Lab @correlllab.bsky.social · 07/12/2024
Learn how DALL-E 2 works by building and training it from scratch medium.com/correll-l...
medium.com
DALL-E 2 from Scratch
Text-Conditioned Image Generation on FashionMNIST using CLIP Latents
042
Correll Lab @correlllab.bsky.social · 06/12/2024
Build CLIP from scratch using ResNet50 and BERT pre-trained embeddings (with code) medium.com/correll-l...
medium.com
CLIP implementation with pre-trained embeddings
Using ResNet50 and BERT to speed up training and increase accuracy
000
Correll Lab @correlllab.bsky.social · 05/12/2024
Learn about Deep Transformer Q-Networks (and background) from Aritra Chakrabarty’s paper review medium.com/correll-l...
medium.com
Deep Transformer Q Networks — A paper analysis
The goal of this article is to analyze the paper “Deep Transformer Q-Networks for Partially Observable Reinforcement Learning” by Kevin…
010
Reposted by Correll Lab
Embedded @embeddedfm.bsky.social · 04/12/2024
This week, @correlllab.bsky.social spoke with Chris( @stoneymonster.bsky.social ) and Elecia( @logicalelegance.bsky.social )about robots, teaching robotics, and writing books about robots. Join them here ( embedded.fm/episodes/490 ). Here's an excerpt from the show: #robotics #robots #embedded
042
Correll Lab @correlllab.bsky.social · 04/12/2024
Lots of robotic applications for hierarchical vision transformers (SWIN) medium.com/correll-l...
000
Correll Lab @correlllab.bsky.social · 04/12/2024
About to order an Unitree H1-2. I expect 10% tariff. Did anyone order a Unitree robot recently and can confirm?
000
Correll Lab @correlllab.bsky.social · 03/12/2024
How to train locally and merge the resulting weights, not the raw data itself, to learn using a team of robots, paper review by Lekai Chen medium.com/correll-l...
medium.com
Paper Review: Robot Fleet Learning via Policy Merging
How to train locally and merge the resulting weights, not the raw data itself, to learn using a team of robots
010
Reposted by Correll Lab
Maria Antoniak @mariaa.bsky.social · 19/11/2024
I'm recruiting 1-2 PhD students to work with me at the University of Colorado Boulder! Looking for creative students with interests in #NLP and #CulturalAnalytics. Boulder is a lovely college town 30 minutes from Denver and 1 hour from Rocky Mountain National Park 😎 Apply by December 15th!
A photo of Boulder, Colorado, shot from above the university campus and looking toward the Flatirons.
9302136
Correll Lab @correlllab.bsky.social · 02/12/2024
Training VLMs on tactile data allows robots to understand and reason through touch, paper review by Carson Kohlbrenner medium.com/correll-l...
medium.com
Paper Review: Octopi: Object Property Reasoning with Large Tactile-Language Models
Enabling robots to understand and reason through touch!
011
Correll Lab @correlllab.bsky.social · 01/12/2024
Vision Transformers can analyze time series via their spectrogram, paper analysis and code by Peter Kinder medium.com/correll-l...
medium.com
Spectrograms & Vision Transformers for Time Series Forecasting
A review and implementation of J.P. Morgan AI Research’s paper submission to the 2023 ACM International Conference on AI in Finance (ICAIF)
000