Sign in

Brilliant Sole

@brilliantsole.bsky.social
68 followers 210 following 78 posts

Making smart insoles for developers. They have pressure sensors (8 per insole), 3DoF motion sensor, and haptics (2 per insole - heel and ball)

PostsRepliesMedia
Brilliant Sole @brilliantsole.bsky.social · 08/06/2026
Experimenting with posture correction on smart glasses, giving led feedback based on head tilt Works with compatible smart glasses (in this case the PMSG, based on the @seeedstudio.com XIAO ESP32-S3, running our firmware)
010
Brilliant Sole @brilliantsole.bsky.social · 02/06/2026
Using Depth Anything 3, we can detect the depth of objects relative to the user (in case behind the user), giving led/haptic feedback when something is too close
000
Brilliant Sole @brilliantsole.bsky.social · 25/05/2026
Using smart glasses to make it easier to draw on your phone With our wearables SDK, we can stream camera data to a webpage on a smartphone, and use MediaPipe to create a cursor that uses your free hand to draw
000
Brilliant Sole @brilliantsole.bsky.social · 18/05/2026
Now you can save camera streams from your smart glasses as videos using our wearables SDK Also testing our firmware on the PMSG (Prototype Modular Smart Glasses), which is not only based on the @seeedstudio.com XIAO ESP32-S3, but comes with a bunch of other features (sensors, leds, haptics, etc)
000
Brilliant Sole @brilliantsole.bsky.social · 04/05/2026
Local AI Assistant with TTS and wake word detection - say “look at this” to take a pic, and “question” to ask a follow up question Whisper for STT, Kokoro for TTS, and @edgeimpulse.com for making the wake model Works with compatible smart glasses, in this case the @seeedstudio.com Xiao esp32-S3
200
Brilliant Sole @brilliantsole.bsky.social · 04/05/2026
Keyword spotting running on smart glasses
000
Reposted by Brilliant Sole
Arduino @officialarduino.bsky.social · 28/04/2026
What if your virtual pet wasn’t just pixels on a screen, but something you could actually reach out and touch? A team at Reality Hack @ MIT 2026 made that idea real with Power Pet – a hybrid VR and physical companion that bridges the digital and tactile worlds.
blog.arduino.cc
Power Pet: a VR companion at your side | Arduino Blog
What if your virtual pet wasn’t just pixels on a screen, but something you could actually reach out and touch? A team at Reality Hack @ MIT 2026 made that idea real with Power Pet – a hybrid VR and ph...
041
Brilliant Sole @brilliantsole.bsky.social · 28/04/2026
Keyword Spotting running on smart glasses Added microphone-based Tflite support to our Wearables SDK, allowing us to run ML models on compatible smart glasses (in this case @seeedstudio.com’s Xiao Esp32-S3 Sense, running our custom firmware) We also used @edgeimpulse.com to make the model
110
Brilliant Sole @brilliantsole.bsky.social · 13/04/2026
Experimenting with locomotion in @vrchat.com using our smart insoles, sending OSC messages to the headset based on various configurations (hoverboard-like movement, stepping in place, etc)
050
Brilliant Sole @brilliantsole.bsky.social · 06/04/2026
Experimenting with different types of locomotion in VR with our smart insoles, from hoverboard-like controls to a “stepping in place” mechanic
000
Brilliant Sole @brilliantsole.bsky.social · 21/03/2026
Snowboarding with smart insoles Attended a PicoXR hackathon in sf last week and our team made a snowboarding demo The Pico browser has Web Bluetooth, allowing us to easily make a WebXR webpage that connects to our wearables - an underrated feature the Apple Vision Pro and Oculus Browser lack
020
Brilliant Sole @brilliantsole.bsky.social · 09/03/2026
Positional tracking on smart glasses and webcams Experimenting with @nianticspatial.bsky.social’s 8thWall engine, allowing us to determine position using camera and motion data
100
Brilliant Sole @brilliantsole.bsky.social · 05/03/2026
Tune your guitar with your smart glasses With our wearables SDK, we’re able to display pitch, allowing musicians to easily tune their instruments Works with compatible smartglasses, in this case the Brilliant Labs Frame running custom firmware
000
Brilliant Sole @brilliantsole.bsky.social · 02/03/2026
Display sheet music on your smart glasses, and tap your foot to turn the page With our wearables SDK, not only can we render musicXML files on compatible smartglasses, but we’re able to use our smart insoles to trigger page turns by running an @edgeimpulse.com model that detects foot taps on device
000
Brilliant Sole @brilliantsole.bsky.social · 26/02/2026
Visualizing pressure and motion data from our smart insoles on smart glasses With our wearables SDK we can receive realtime pressure and motion data from our smart insoles, and then display them on compatible smart glasses (in this case the Brilliant Labs’ Frame running custom firmware)
100
Brilliant Sole @brilliantsole.bsky.social · 23/02/2026
Visualizing jump height on smart glasses With our wearables SDK, we’re able to calculate short-range positional displacement using imu data from our smart insoles & motion modules, visualizing the trajectory on compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)
010
Brilliant Sole @brilliantsole.bsky.social · 09/02/2026
Work out with realtime feedback on your smartglasses With our Wearables SDK, we can visualize imu data from our motion modules (which can be mounted on the wrist or ankle depending on the workout), guiding the user to perform reps at a controlled tempo for maximum effectiveness
010
Brilliant Sole @brilliantsole.bsky.social · 02/02/2026
Running an Image Classifier on smart glasses, using @edgeimpulse.com to create the model
000
Brilliant Sole @brilliantsole.bsky.social · 05/01/2026
Streaming smart glasses camera data to a Quest 3 Using our Wearables SDK, we’re able to stream images from the Omi Glass (based on the @seeedstudio.com XIAO ESP32-S3 running custom Firmware) to a Quest 3
000
Brilliant Sole @brilliantsole.bsky.social · 30/10/2025
Local AI Assistant on Smart Glasses Using our wearables SDK to take a picture, speak a prompt with Whisper’s speech to text, and use chrome’s Prompt API to generate a response to be displayed back on the glasses’ display
010
Brilliant Sole @brilliantsole.bsky.social · 20/10/2025
Spotify Player with Lyrics on Smart Glasses Using our Wearables SDK to experiment with a music player on compatible smartglasses (in this case the Brilliant Labs’ Frame running custom firmware) Also using a Mudra Band and TapXR for hand controls
110
Brilliant Sole @brilliantsole.bsky.social · 15/10/2025
Realtime maps in your smart glasses Using our wearables SDK to display a simple map overlay, using @openstreetmap.bsky.social data to retrieve nearby data
010
Brilliant Sole @brilliantsole.bsky.social · 09/10/2025
Recognize people with smart glasses Using our wearables SDK to look for certain people, and displaying relevant information when someone is recognized Works with compatible smartglasses (in this case the Brilliant Labs’ Frame running custom firmware)
000
Brilliant Sole @brilliantsole.bsky.social · 06/10/2025
Experimenting with hand controls on smart glasses With our Wearables SDK, we can both display a 3d wireframe scene on compatible smartglasses, as well as control a cursor by strapping one of our motion modules to our wrist We’re able to detect pinches by running an @edgeimpulse.com model
000
Brilliant Sole @brilliantsole.bsky.social · 29/09/2025
View yourself in the third person with smart glasses Using our Wearables SDK, we’re able to visualize MediaPipe tracking data (body, hands, and face) on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) Great for yoga, working out, dancing, etc
020
Brilliant Sole @brilliantsole.bsky.social · 22/09/2025
Translation on Smart Glasses Added foreign language support to our Wearables SDK, allowing us to display languages like Chinese, Japanese, and Korean In this case we’re using @hf.co models for both realtime transcription and translation - all done locally (no cloud required)
021
Brilliant Sole @brilliantsole.bsky.social · 15/09/2025
Boxing on smart glasses Added wireframe support to our Wearables SDK, allowing us to display realtime 3d graphics (like A-Frame and @threejs.org) on compatible smart glasses (in this case the Brilliant Labs Frame)
011
Brilliant Sole @brilliantsole.bsky.social · 08/09/2025
Realtime Subtitles on Smart Glasses, using our Wearables SDK We used @hf.co’s Whisper model to transcribe microphone data locally, and then display the transcription on the smart glasses’ display (in this case the Brilliant Labs’ Frame) - no cloud required
010
Brilliant Sole @brilliantsole.bsky.social · 25/08/2025
Added sprite support to our wearables SDK Great for stuff like emulating 3d graphics via billboarding
010
Brilliant Sole @brilliantsole.bsky.social · 18/08/2025
Added Font support to our Brilliant Sole Wearables’ JavaScript SDK
000
Brilliant Sole @brilliantsole.bsky.social · 11/08/2025
Added Bitmap support to our Brilliant Sole Wearables’ JavaScript SDK
020
Brilliant Sole @brilliantsole.bsky.social · 04/08/2025
Our wearables’ JavaScript SDK works great with react-like environments This is a simple example using @nextjs.org, @supabase.com, and @tailwindcss.com to make a basic data collection website that can both record and view sensor data
010
Brilliant Sole @brilliantsole.bsky.social · 28/07/2025
Detect head gestures on your smart glasses Made a simple @edgeimpulse.com model to detect nods and head shakes
010
Brilliant Sole @brilliantsole.bsky.social · 21/07/2025
Smart glasses webcam Created a virtual webcam using OBS and our SwiftUI camera demo
010
Brilliant Sole @brilliantsole.bsky.social · 14/07/2025
Express yourself with smart glasses Using MediaPipe’s face tracking to visualize a user’s eyes and eyebrows on a smart glasses display (in this case the Brilliant Labs’ Frame running our custom firmware)
000
Brilliant Sole @brilliantsole.bsky.social · 07/07/2025
Our smart glasses display simulator also works in WebXR, allowing us to preview ar glasses applications on a Quest 3
010
Brilliant Sole @brilliantsole.bsky.social · 30/06/2025
Added a smart glasses display simulator to our JavaScript SDK Preview what your ar glasses applications will look like using your webcam, a video file, or even an interactive 3D scene
020
Brilliant Sole @brilliantsole.bsky.social · 23/06/2025
Added display support for smart glasses to our JavaScript SDK We created a Canvas-like interface for drawing primitives onscreen for smartglasses with displays, like the Brilliant Labs Frame Easily draw rectangles, circles, rounded rectangles, ellipses, polygons, and segments
000
Brilliant Sole @brilliantsole.bsky.social · 16/06/2025
Running speech recognition on smart glasses 👓 As we port our firmware to the Brilliant Labs’ Frame, we added microphone support to our SDK’s, allowing us to run @hf.co’s Whisper Web to transcribe speech in the browser
010
Brilliant Sole @brilliantsole.bsky.social · 09/06/2025
Hand, face, and object tracking on smart glasses Running MediaPipe and @hf.co models on the Brilliant Labs Frame camera data
000
Brilliant Sole @brilliantsole.bsky.social · 02/06/2025
Streaming camera data from smart glasses to a smart watch via Bluetooth As we port our firmware to the Brilliant Labs’ Frame, we added camera support to our SDK’s
010
Brilliant Sole @brilliantsole.bsky.social · 26/05/2025
Ported our firmware to the Brilliant Labs Frame 👓, making it compatible with our SDK’s
010
Brilliant Sole @brilliantsole.bsky.social · 19/05/2025
Kicking a virtual soccer ball in WebXR using our motion modules
010
Brilliant Sole @brilliantsole.bsky.social · 12/05/2025
Kick, Stomp, and toss green shells in WebXR By wrapping our motion module around our ankle, we can add kick/stomp detection running an @edgeimpulse.com ML model
020
Brilliant Sole @brilliantsole.bsky.social · 05/05/2025
Adding haptic feedback to create an immersive WebXR experience on the Quest 3 Here we vibrate our motion modules differently based on the gesture (pet, punch, grab, and release) We added WiFi support to our JavaScript, allowing us to connect directly to our WiFi-enabled hardware via WebSockets
000
Brilliant Sole @brilliantsole.bsky.social · 28/04/2025
Using our motion modules to detect punches, providing haptic feedback
000
Brilliant Sole @brilliantsole.bsky.social · 21/04/2025
Experimenting with basic wrist controls on our modular Ukaton hardware You can remove the insole+shoe clip, attach a loop clip, and strap it around your wrist Made a simple @edgeimpulse.com model to detect pinches, and using the gyro to move the cursor, similar to @doublepoint.bsky.social
000
Brilliant Sole @brilliantsole.bsky.social · 14/04/2025
Rewrote Ukaton’s firmware so their hardware is 100% compatible with our SDK’s We recently merged with Ukaton and now have 2 implementations for smart insoles
020
Brilliant Sole @brilliantsole.bsky.social · 07/04/2025
Interfacing with our smart insoles on an Apple TV in a SwiftUI app using our Swift Package
020
Brilliant Sole @brilliantsole.bsky.social · 31/03/2025
Visualizing smart insole data on the Apple Vision Pro simulator The AVP simulator doesn’t have bluetooth, but we can use our nodejs server to relay insole data via UDP Even works in Xcode Previews
010