Sign in

Arno Solin

@arnosolin.bsky.social
605 followers 84 following 59 posts

Associate Professor in Machine Learning, Aalto University. ELLIS Scholar. arno.solin.fi

PostsRepliesMedia
Reposted by Arno Solin
ELLIS Institute Finland @ellisinstitute.fi · 09/09/2026
In the latest episode of our AI podcast, Kyunghyun Cho talks with @ericmalmi.bsky.social & @arnosolin.bsky.social about how attention is a universal solution to many AI challenges, why he isn’t worried about de-skilling and why coming to Finland was “the best decision ever”. youtu.be/a5oKBtp14MA
012
Reposted by Arno Solin
ELLIS Institute Finland @ellisinstitute.fi · 23/09/2026
Podcastin uudessa jaksossa vieraana kotimaisten kielimallien uranuurtaja Sampo Pyysalo. Miten ja miksi suomalaisia ja eurooppalaisia kielimalleja kehitetään? Näistä kysymyksistä Sampon kanssa keskustelevat @ericmalmi.bsky.social + @arnosolin.bsky.social: youtu.be/HtVcDRyi_ZA @csaalto.bsky.social
youtu.be
Miten kotimaista tekoälyä kasvatetaan – Sampo Pyysalo
YouTube video by Aalto University
023
Reposted by Arno Solin
ELLIS Institute Finland @ellisinstitute.fi · 02/09/2026
Is AI development more dangerous than flying? AI safety researcher Katarina Slama discusses these risks & more on the podcast, including her journey from Finland ➡️ OpenAI. Listen and watch: youtu.be/nx0CeYeL1bM Hosted by @arnosolin.bsky.social + @ericmalmi.bsky.social @csaalto.bsky.social
002
Reposted by Arno Solin
ELLIS Institute Finland @ellisinstitute.fi · 11/08/2026
Uusi podcast: Harri Valpola väittää, että yleinen tekoäly on jo täällä, kertoo robotiikan haasteista ja pohtii, miten tekoälyn hyödyt saadaan jaettua kaikille. Kuuntele Ja ihminen loi älyn -podcastia, jota juontaa @ericmalmi.bsky.social ja @arnosolin.bsky.social: youtu.be/cKns_aHnqUM
012
Arno Solin @arnosolin.bsky.social · 25/06/2026
8/ Project page with more videos and material: aaltoml.github.io/Smol-GS
aaltoml.github.io
Smol-GS: Compact Representations for Abstract 3D Gaussian Splatting
Smol-GS: Compact Representations for Abstract 3D Gaussian Splatting
000
Arno Solin @arnosolin.bsky.social · 25/06/2026
7/ For details, check the paper pre-print (rendering speeds, training details, etc.): arxiv.org/abs/2512.00850
arxiv.org
Smol-GS: Compact Representations for Abstract 3D Gaussian Splatting
We present Smol-GS, a novel method for learning compact representations for 3D Gaussian Splatting (3DGS). Our approach learns highly efficient splat-wise features to model 3D space, which capture abst...
100
Arno Solin @arnosolin.bsky.social · 25/06/2026
6/ Smol-GS is not just smaller. It keeps rendering fast, preserves high visual quality, and avoids the structural overhead of anchors. 🥇On the 3DGS.zip benchmark, it currently gives the best size–quality trade-off: w-m.github.io/3dgs-compres...
100
Arno Solin @arnosolin.bsky.social · 25/06/2026
5/ Tiny MLPs decode each splat into what the renderer needs: color, opacity, shape, rotation, and view-dependent effects. The features and scale controllers are quantized and entropy-coded. The result is a compact neural splat representation without anchor-offset bookkeeping.
110
Arno Solin @arnosolin.bsky.social · 25/06/2026
4/ In Smol-GS, each splat has a compact learned feature vector. Geometry stays explicit, but coordinates are stored with an occupancy-octree. The same octree also gives a locality-aware positional encoding. In short: explicit geometry + learned local appearance.
100
Arno Solin @arnosolin.bsky.social · 25/06/2026
3/ Most strong 3DGS compression methods are anchor-based: Store shared anchors, use local offsets, and decode splats around them. That works well and has dominated recent benchmarks. But Smol-GS takes a different approach.
100
Arno Solin @arnosolin.bsky.social · 25/06/2026
2/ 3DGS gives real-time photorealistic rendering, but the representation is heavy. A scene can easily take hundreds of MBs. That hurts if you care about storage, streaming, editing, mobile, web, VR, or sharing 3D scenes. Can we keep splats explicit, but make them tiny?
100
Arno Solin @arnosolin.bsky.social · 25/06/2026
3D Gaussian splats are amazing--until you realise how much storage space they need. Smol-GS makes #3DGS actually small: explicit splats, tiny learned features w/ positional awareness, octree-coded geometry, and fast rendering. 🥇Now leading the 3DGS.zip benchmark.
160
Reposted by Arno Solin
Marcus Klasson @marcusklasson.bsky.social · 24/04/2026
👋🇧🇷 If you are at #ICLR2026 today, you should talk to @antonbaumann.bsky.social who is presenting our paper about turning pre-trained VLMs into probabilistic models without retraining or fine-tuning. Poster Session 3 ⌚: 10:30am - 1:00pm (local time) 📍: Pavilion 3 P3 - #313 @iclr-conf.bsky.social
143
Arno Solin @arnosolin.bsky.social · 14/04/2026
8/ Paper preprint: Mohammad Hassan Vali, Tom Bäckström, and Arno Solin (2026). DiVeQ: Differentiable vector quantization using the reparameterization trick. ICLR 2026. arxiv.org/abs/2509.26469
arxiv.org
DiVeQ: Differentiable Vector Quantization Using the Reparameterization Trick
Vector quantization is common in deep models, yet its hard assignments block gradients and hinder end-to-end training. We propose DiVeQ, which treats quantization as adding an error vector that mimics...
020
Arno Solin @arnosolin.bsky.social · 14/04/2026
7/ DiVeQ is also included in the popular vector-quantize-pytorch package. To use it there, enable: directional_reparam=True
100
Arno Solin @arnosolin.bsky.social · 14/04/2026
6/ We have also released a PyTorch package on PyPI: pip install diveq It implements the methods and variants from the paper and makes integration into training pipelines straightforward.
100
Arno Solin @arnosolin.bsky.social · 14/04/2026
5/ The result is a direct and general way to do end-to-end trainable quantization, without many of the complications of earlier approaches. We also see improved performance in image compression, image generation, and speech coding.
100
Arno Solin @arnosolin.bsky.social · 14/04/2026
4/ We do this by modelling quantization as adding a carefully constructed error vector. So the forward pass still uses hard assignments, while training gets meaningful gradient flow.
100
Arno Solin @arnosolin.bsky.social · 14/04/2026
3/ In our #ICLR2026 paper, we introduce DiVeQ. The idea is simple: keep the hard quantization behavior we want, but make training behave as if learning can still pass through it.
100
Arno Solin @arnosolin.bsky.social · 14/04/2026
2/ The challenge is that VQ uses a hard nearest-codeword decision. That makes learning awkward, because the quantization step is non-differentiable and gradients stop flowing. Existing fixes often add bias and extra tuning.
100
Arno Solin @arnosolin.bsky.social · 14/04/2026
1/ 🔥 New paper: Differentiable Vector Quantization (DiVeQ) 🔥 Vector quantization (VQ) is a core tool in modern AI. It connects continuous data like images and audio to discrete tokens used by transformers. It underpins compression, generation, and multimodal modelling.
291
Arno Solin @arnosolin.bsky.social · 28/11/2025
OpenReview's announcement: openreview.net/forum/user%7...
openreview.net
Statement Regarding API Security Incident
030
Arno Solin @arnosolin.bsky.social · 28/11/2025
Statement from #AISTATS2026 organizers regarding the @openreview.bsky.social API Security Incident
1136
Arno Solin @arnosolin.bsky.social · 24/11/2025
I'm feeling grateful to colleagues, students, collaborators, and everyone who joined the talk – and excited about the next steps in research on machines that learn, and maybe one day, truly make sense. 🙏✨ 4/n
000
Arno Solin @arnosolin.bsky.social · 24/11/2025
My own research, together with my group, focuses less on building the giant models and more on designing the building blocks behind them: model components, inductive biases, training principles, and inference methods that make AI systems more robust, data-efficient, and uncertainty-aware. 3/n
100
Arno Solin @arnosolin.bsky.social · 24/11/2025
I talked about "Making Sense of Learning Machines": • How modern machine learning has learned to cope with natural, “chaotic” data – images, text, sound • Why the big breakthroughs of the last 10–15 years matter • What we lack and what we would like to understand 2/n
110
Arno Solin @arnosolin.bsky.social · 24/11/2025
I recently gave my installation talk after being tenured. The video of the talk is now available on the university's YouTube channel: youtu.be/R1UQoflPTDg 1/n
youtu.be
Making sense of learning machines – Arno Solin
YouTube video by Aalto University
1153
Arno Solin @arnosolin.bsky.social · 12/08/2025
Yes. The easiest way to find it will be on the website virtual.aistats.org We are in the process of adding material there and will add a link.
virtual.aistats.org
2026 Conference
010
Arno Solin @arnosolin.bsky.social · 12/08/2025
We will go public with it as soon as everything is set up with the venue.
130
Arno Solin @arnosolin.bsky.social · 12/08/2025
I'm thrilled to be Program Chairing AISTATS 2026 together with Aaditya Ramdas. AISTATS has a special feel to it, and it has been described by many colleagues as their "favourite conference". We aim to preserve that spirit while introducing some fresh elements for 2026. [3/3]
140
Arno Solin @arnosolin.bsky.social · 12/08/2025
Accepted papers will be presented in person in Morocco, May 2–5, 2026. The full Call for Papers is available here: virtual.aistats.org/Conferences/... [2/3]
virtual.aistats.org
Call for Papers
110
Arno Solin @arnosolin.bsky.social · 12/08/2025
📣 Please share: We invite submissions to the 29th International Conference on Artificial Intelligence and Statistics (#AISTATS 2026) and welcome paper submissions at the intersection of AI, machine learning, statistics, and related areas. [1/3]
23721
Reposted by Arno Solin
Martin Trapp @trappmartin.eurosky.social · 21/07/2025
Remember that computers use bitstrings to represent numbers? We exploit this in our recent @auai.org paper and introduce #BitVI. #BitVI directly learns an approximation in the space of bitstring representations, thus, capturing complex distributions under varying numerical precision regimes.
BitVI on 1D Gaussian mixture models.
2223
Arno Solin @arnosolin.bsky.social · 09/06/2025
Check our #CVPR paper and project page for more results, videos, and code! 📄 arxiv.org/abs/2411.19756 🎈 aaltoml.github.io/desplat/
aaltoml.github.io
DeSplat: Decomposed Gaussian Splatting for Distractor-Free Rendering
DeSplat: Decomposed Gaussian Splatting for Distractor-Free Rendering
000
Arno Solin @arnosolin.bsky.social · 09/06/2025
Qualitative visualization of static distractor elements achieved by our model, DeSplat. [3/n]
100
Arno Solin @arnosolin.bsky.social · 09/06/2025
Compared to Splatfacto we model and can ignore distractors to improve 3DGS reconstruction quality. [2/n]
100
Arno Solin @arnosolin.bsky.social · 09/06/2025
Real-world #3DGS scenes are messy—occluders, moving objects, and clutter often ruin reconstruction. This #CVPR2025 paper presents DeSplat, which separates static scene content from distractors, all without requiring external semantic models. [1/n]
150
Arno Solin @arnosolin.bsky.social · 04/06/2025
I’m visiting the Isaac Newton Institute for Mathematical Sciences in Cambridge this week. I’m giving an invited talk in the ”Calibrating prediction uncertainty : statistics and machine learning perspectives” workshop on Thursday.
0162
Arno Solin @arnosolin.bsky.social · 29/04/2025
Our method addresses the eminent question of probabilistic modelling in quantized large-scale ML models. See the workshop paper below. [3/3] 📄 Paper: openreview.net/forum?id=Sai...
openreview.net
Are Your Continuous Approximations Really Continuous? Reimagining...
Efficiently performing probabilistic inference in large models is a significant challenge due to the high computational demands and continuous nature of the model parameters. At the same time, the...
010
Arno Solin @arnosolin.bsky.social · 29/04/2025
We introduce BitVI, a novel approach for variational inference with discrete bitstring representations of continuous parameters. We use a deterministic probabilistic circuit structure to model the distribution over bitstrings, allowing for exact and efficient probabilistic inference. [2/3]
110
Arno Solin @arnosolin.bsky.social · 29/04/2025
Have you thought that in computer memory model weights are given in terms of discrete values in any case. Thus, why not do probabilistic inference on the discrete (quantized) parameters. @trappmartin.bsky.social is presenting our work at #AABI2025 today. [1/3]
34411
Arno Solin @arnosolin.bsky.social · 27/04/2025
We show that externalising reasoning as a DAG at test time leads to more accurate, efficient multi-hop retrieval – and integrates seamlessly with RAG systems like Self-RAG. 📄 Paper: openreview.net/pdf?id=gi9aq... 3/3
openreview.net
000
Arno Solin @arnosolin.bsky.social · 27/04/2025
This work was born out of Prakhar's internship with Microsoft Research (\w Sukruta Prakash Midigeshi, Gaurav Sinha, Arno Solin, Nagarajan Natarajan, and Amit Sharma). 2/3
100
Arno Solin @arnosolin.bsky.social · 27/04/2025
Excited to share "Plan*RAG: Efficient Test-Time Planning for Retrieval Augmented Generation", presented at the #ICLR2025 "Workshop on Reasoning and Planning for LLMs" on Monday! 🚀 1/3
170
Arno Solin @arnosolin.bsky.social · 23/04/2025
Our TMLR-to-ICLR poster "Exploiting Hankel-Toeplitz Structures for Fast Computation of Kernel Precision Matrices" (Frida Viset, Anton Kullberg, Frederiek Wesel, Arno Solin) 🗓️ Hall 3 + Hall 2B #416, Fri 25 Apr 10 a.m. +08 — 12:30 p.m. +08 📄 Preprint: arxiv.org/abs/2408.02346
070
Arno Solin @arnosolin.bsky.social · 23/04/2025
Our #ICLR2025 poster "Equivariant Denoisers Cannot Copy Graphs: Align Your Graph Diffusion Models" (Najwa Laabid, Severi Rissanen, Markus Heinonen, Arno Solin, Vikas Garg) 🗓️ Hall 3 + Hall 2B #194, Fri 25 Apr 3 p.m. +08 — 5:30 p.m. +08 📄 Preprint: arxiv.org/abs/2405.17656
151
Arno Solin @arnosolin.bsky.social · 23/04/2025
Our #ICLR2025 poster "Streamlining Prediction in Bayesian Deep Learning" (Rui Li · Marcus Klasson, Arno Solin, Martin Trapp) 🗓️ Hall 3 + Hall 2B #413, Fri 25 Apr 10 a.m. +08 — 12:30 p.m. +08 📄 Preprint: arxiv.org/abs/2411.18425
1110
Arno Solin @arnosolin.bsky.social · 21/04/2025
Our #ICLR2025 poster "Discrete Codebook World Models for Continuous Control" (Aidan Scannell, Mohammadreza Nakhaeinezhadfard, Kalle Kujanpää, Yi Zhao, Kevin Luck, Arno Solin, Joni Pajarinen) 🗓️ Hall 3 + Hall 2B #415, Thu 24 Apr 10 a.m. +08 — 12:30 p.m. +08 📄 Preprint: arxiv.org/abs/2503.00653
2113
Arno Solin @arnosolin.bsky.social · 21/04/2025
Our #ICLR2025 poster "Free Hunch: Denoiser Covariance Estimation for Diffusion Models Without Extra Costs" (Severi Rissanen, Markus Heinonen, Arno Solin) 🗓️ Hall 3 + Hall 2B #140, Thu 24 Apr 3 p.m. +08 — 5:30 p.m. +08 📄 Preprint: arxiv.org/abs/2410.11149
0101
Arno Solin @arnosolin.bsky.social · 21/04/2025
Exploiting Hankel-Toeplitz Structures for Fast Computation of Kernel Precision Matrices Frida Viset · Anton Kullberg · Frederiek Wesel · Arno Solin Hall 3 + Hall 2B #416 🗓️ Fri 25 Apr 10 a.m. +08 — 12:30 p.m. +08 📄 arxiv.org/abs/2408.02346
arxiv.org
Exploiting Hankel-Toeplitz Structures for Fast Computation of Kernel Precision Matrices
The Hilbert-space Gaussian Process (HGP) approach offers a hyperparameter-independent basis function approximation for speeding up Gaussian Process (GP) inference by projecting the GP onto M basis fun...
010