smallfly @smallfly.bsky.social · 01/06/2025Exploring the use of physical interfaces, depth, diffusion, and mixed reality. #MixedReality #MR #AI #StableDiffusion 030
smallfly @smallfly.bsky.social · 31/05/2025Quick one... Using depth to give volume and clip the background. — Mixed Reality + Diffusion prototype #MixedReality #MR #AI #StableDiffusion 140
smallfly @smallfly.bsky.social · 20/05/2025Mixing flat and ‘3D’ snapshots to create a more immersive scene. The recording doesn’t quite capture the sense of depth on the heads—but in the Quest, it feels great. —Mixed Reality + Diffusion to explore concepts, styles, and moods. #MixedReality #MR #AI #StableDiffusion #Quest3 051
smallfly @smallfly.bsky.social · 19/05/2025Live-tweaking the depth displacement—Mixed Reality + Diffusion prototype to explore concepts, styles, and moods. #MixedReality #MR #AI #StableDiffusion #Quest3 010
smallfly @smallfly.bsky.social · 19/05/2025Early test run with freshly added depth estimation — Mixed Reality + Diffusion prototype to explore concepts, styles, and moods. #MixedReality #MR #AI #StableDiffusion #Quest3 030
smallfly @smallfly.bsky.social · 04/05/2025I’ve been using that same alleyway as a sandbox for years—now with the Mixed Reality + Diffusion prototype to explore concepts, styles, and moods. #MixedReality #MR #AI #StableDiffusion #Quest3 010
smallfly @smallfly.bsky.social · 26/04/2025Mixed Reality + Diffusion prototype as a tool for exploring concepts, styles, and moods by transforming real-world surroundings into alternate realities. #MixedReality #MR #AI #StableDiffusion #Quest3 000
smallfly @smallfly.bsky.social · 26/04/2025Exploring how the prototype can be used to research concepts and styles—by transforming snapshots and anchoring them back into the real world. #MixedReality #MR #AI #Passthrough #StableDiffusion #Quest3 010
smallfly @smallfly.bsky.social · 22/04/2025Researching a darker mood with this one. Mixed Reality + Diffusion prototype. #MixedReality #MR #AI #StableDiffusion #Quest3 030
smallfly @smallfly.bsky.social · 20/04/2025Away for the long weekend visiting family… Once again using the Mixed Reality + Diffusion prototype to transform the environment. #MR #AI #Passthrough #StableDiffusion #Quest3 020
smallfly @smallfly.bsky.social · 13/04/2025Wishing the grey weather would go away. Mixed Reality + Diffusion prototype using Quest Passthrough Camera API and SDXL Turbo. #MR #AI #Passthrough #StableDiffusion #Quest3 000
smallfly @smallfly.bsky.social · 13/04/2025This time, my son had a Bob the Builder flashback with the Mixed Reality + Diffusion prototype. Using the Quest Passthrough Camera API and SDXL Turbo. #MR #AI #Passthrough #StableDiffusion #Quest3 010
smallfly @smallfly.bsky.social · 13/04/2025Today my son took over the Mixed Reality + Diffusion prototype… First stop: Mario Kart. #MR #AI #Passthrough #StableDiffusion #Quest3 030
smallfly @smallfly.bsky.social · 22/03/2025In this iteration, I’ve added SAM 2 to our workflow to segment people. Lisa and I had fun testing it in our lab—striking poses in sequence, with our bodies precisely isolated for a refined Stable Diffusion effect. #MR #AI #Passthrough #StableDiffusion #Quest3 052
smallfly @smallfly.bsky.social · 16/03/2025Just updated my MR + Diffusion prototype to use Meta’s Passthrough Camera API. It’s a raw port for now; next, I'll focus on UX exploration. It’s now much easier to do a screen recording. #MR #AI #StableDiffusion 030
smallfly @smallfly.bsky.social · 09/03/2025Daylight saving — Spring is coming — Mixed Reality + Stable Diffusion. #MR #AI #StableDiffusion #spring 130
smallfly @smallfly.bsky.social · 02/03/2025I tried the XGrids Lixel L2 Pro thanks to skytech-drones-inc and XGrids. This LiDAR-based scanner is quite impressive. Here is a capture, rendered as 3D Gaussian splats, of the staircase of our building I captured while going up the levels. #gaussiansplats #3dscan #gaussiansplatting #digitaltwin 060
smallfly @smallfly.bsky.social · 23/02/2025Mixed Reality + Stable Diffusion — Trying to escape the winter. #MR #AI #StableDiffusion #Quest3 #madewithunity #montreal 111
smallfly @smallfly.bsky.social · 22/02/2025Mixed Reality + Stable Diffusion — AI Urbex #MR #AI #StableDiffusion #urbex #Quest3 #madewithunity 040
smallfly @smallfly.bsky.social · 21/02/2025Mixed Reality + Stable Diffusion — How my desk might look after years of being abandoned. #MR #AI #StableDiffusion #Quest3 #madewithunity 010
smallfly @smallfly.bsky.social · 16/02/2025MR + Stable Diffusion Patchwork #MR #AI #StableDiffusion #ComfyUI #Quest3 #Meta #MadeWithUnity 041
smallfly @smallfly.bsky.social · 15/02/2025Quickly capturing a series of spatial snapshots, close to one another, of my surroundings, resulting in an alternate reality patchwork once processed through a Stable Diffusion workflow. The snapshots, not being perfectly aligned, create a sense of depth. #MR #AI #StableDiffusion #ComfyUI #Quest3 050
smallfly @smallfly.bsky.social · 03/02/2025Got a bit trigger-happy capturing Mixed Reality snapshots — Captured images from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest. #MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity 161
smallfly @smallfly.bsky.social · 02/02/2025[02/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on runpod_io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR. #MR #AI #StableDiffusion 030
smallfly @smallfly.bsky.social · 01/02/2025[01/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on RunPod io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR. #MR #AI #StableDiffusion 030
smallfly @smallfly.bsky.social · 27/01/2025Anxiyeti (by ponymtl) and a raccoon... Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest. #MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity 061
smallfly @smallfly.bsky.social · 27/01/2025Robots, Dinosaurs and Ghosts... Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest. #MR #AI #StableDiffusion #ComfyUI #Quest3 010
smallfly @smallfly.bsky.social · 25/01/2025Time to experiment with this type of interface to feed and interact with a real-time img2img diffusion workflow. Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest. 050
smallfly @smallfly.bsky.social · 25/01/2025First pass of optimization completed! Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest. #MR #AI #StableDiffusion #ComfyUI #Quest3 020
smallfly @smallfly.bsky.social · 19/01/2025First prototype using the Quest 3 passthrough feed — Captured snapshots are processed in real-time with a Stable Diffusion ComfyUI workflow on a local machine and sent back to the Quest. Video at 2x speed. Next: optimization, etc ! #MR #AI #StableDiffusion #ComfyUI #Quest3 031
Reposted by smallflysmallfly @smallfly.bsky.social · 08/12/2024Revisiting this memory from the Portland Japanese Garden, a splendid place. #gaussiansplatting #3dgs #3dscan #memories #portland 041
smallfly @smallfly.bsky.social · 08/12/2024Reliving this memory from a visit to the Royal Ontario Museum: the mighty Zeus! This head is from a statue of Zeus, attributed to the circle of Phidias. @romtoronto.bsky.social #gaussiansplatting #3dgs #3dscan #memories #toronto 1171
smallfly @smallfly.bsky.social · 08/12/2024Revisiting this memory from the Portland Japanese Garden, a splendid place. #gaussiansplatting #3dgs #3dscan #memories #portland 041
smallfly @smallfly.bsky.social · 24/11/2024The colored version of the same alleyway I shared yesterday rendered only as depth. Real-time rendering. #gaussiansplatting #3dgs #unity3d #madewithunity #3dscan 131
smallfly @smallfly.bsky.social · 24/11/2024Depth mode – I always find myself coming back to it. #gaussiansplatting #3dgs #unity3d #madewithunity #3dscan 180
smallfly @smallfly.bsky.social · 23/11/2024Continuing my exploration of the captures I’ve made using this 'Immersion Wall' format—this vertical triptych portal offers a different sense of depth and immersion compared to VR, which can feel isolating, or smaller formats like monitors or phones. #gaussiansplatting #3dgs #unity3d #3dscan 090
smallfly @smallfly.bsky.social · 23/11/2024Notre-Dame-de-la-Mer - a Romanesque fortified church from the 9th century, located in Saintes-Maries-de-la-Mer in Camargue. Real-time 3D gaussian splats rendering. #gaussiansplatting #3dgs 020
smallfly @smallfly.bsky.social · 22/11/2024Notre-Dame-de-la-Mer - a Romanesque fortified church from the 9th century, located in Saintes-Maries-de-la-Mer in Camargue. Revisiting an impromptu capture from Summer 2022, done using an iPhone with quite a lot of people around. #gaussiansplatting #3dgs 030
smallfly @smallfly.bsky.social · 21/11/2024Back to training alleyway datasets — 981 perspective images coming from a 360 video capture. #gaussiansplatting #3dgs 020
smallfly @smallfly.bsky.social · 20/11/2024I'm planning to iterate on this soon... Earlier this year, I dove deep into an exploration revolving around the use of physical interfaces to feed and interact with a real-time img2img diffusion pipeline using Stream Diffusion and SDXL Turbo. #stablediffusion #realtime #ai 030
smallfly @smallfly.bsky.social · 17/11/2024(2/2 - Video part B) Here is a CBC Montreal article on Joseph Hovsepian aka 'Radio Doctor'. 020
smallfly @smallfly.bsky.social · 17/11/2024(1/2 - Video part A) Three years ago, I captured Montreal's 'Radio Doctor' shop—one of those special places that make my neighborhood. Since 1960, Joseph Hovsepian has been repairing radios, turntables, and more. Here's the shop reconstructed as a 3D Gaussian splat. #gaussiansplatting #3dgs 141
smallfly @smallfly.bsky.social · 16/11/2024I think this is one of the datasets I've reprocessed most often for testing new features or ideas—219 photos of an alleyway in my neighborhood. #gaussiansplatting #3dgs 051
