Sign in

Sam Duffield

@samduffield.com
1.1K followers 391 following 61 posts

Stats, ML and open-source

PostsRepliesMedia
Reposted by Sam Duffield
Sam Power @spmontecarlo.bsky.social · 14/09/2026
slide prep continues!
1111
Sam Duffield @samduffield.com · 29/07/2026
Surely the best lineup in Newcastle since Demba Ba + Papiss Cisse
010
Sam Duffield @samduffield.com · 13/07/2026
cuthberto's take on the semi-finals please be wrong on Wednesday........ state-space-models.github.io/cuthberto-ca...
010
Sam Duffield @samduffield.com · 25/06/2026
Wait till he hears about cuthbert github.com/state-space-...
github.com
GitHub - state-space-models/cuthbert: State-space model inference with JAX
State-space model inference with JAX. Contribute to state-space-models/cuthbert development by creating an account on GitHub.
010
Reposted by Sam Duffield
Adrien Corenflos @adriencorenflos.bsky.social · 15/06/2026
I think this didn't get nearly enough traction. Sam did some fantastic work here leveraging the library we've been developing to make predictions for football. This was ported to a UI by Ryan Chan (Warwick MSc student) who's doing his thesis with me (on the methods behind the prediction).
142
Sam Duffield @samduffield.com · 12/06/2026
Now on the state-space-models repo state-space-models.github.io/cuthberto-ca...
state-space-models.github.io
Cuthberto Carlos | World Cup Predictions
Interactive 2026 World Cup match predictions from the Cuthberto Carlos model.
021
Sam Duffield @samduffield.com · 11/06/2026
The World Cup is about to start, I wrote a model using cuthbert to predict the games, check out cuthberto-carlos 🐛⚽ ryantjx.github.io/cuthberto-ca...
130
Sam Duffield @samduffield.com · 28/05/2026
Co-organising a workshop: Non-Equilibrium Sampling: Diffusions · Flows · Particles September, Newcastle Come join the fun!
sites.google.com
Newcastle Non-Equilibrium Sampling Workshop
Group photo from last year's Newcastle Sampling workshop.
0111
Sam Duffield @samduffield.com · 21/04/2026
I'll be at ICLR this week 🇧🇷 presenting my complete SDE decomposition at the DeLTA workshop on Monday. Reach out if you want to meet!
000
Sam Duffield @samduffield.com · 19/04/2026
You think this could be more efficient or have other benefits over Ziggurat?
110
Sam Duffield @samduffield.com · 09/04/2026
There's a load of fun examples in the cuthbert docs and we're always looking to add more! 🐛 state-space-models.github.io/cuthbert/exa...
state-space-models.github.io
Examples - cuthbert
This section contains examples of how to use cuthbert on some fun problems, highlighting the flexibility of the library and the utility of the underlying methods.
030
Sam Duffield @samduffield.com · 09/04/2026
In this highly nonlinear example it's more accurate and faster than both extended and particle filters. state-space-models.github.io/cuthbert/exa...
130
Sam Duffield @samduffield.com · 09/04/2026
The ensemble Kalman filter is now in cuthbert 🔥 The EnKF is one of those algorithms that "just works" - oftentimes in settings it has no right to github.com/state-space-...
github.com
Add the Ensemble Kalman Filter by DanWaxman · Pull Request #229 · state-space-models/cuthbert
This PR introduces the ensemble Kalman filter (EnKF). The implementation is based in part on the implementation of CD-Dynamax. That implementation, in turn, is inspired by Algorithm 10.2 in the not...
160
Sam Duffield @samduffield.com · 18/02/2026
github.com/state-space-...
github.com
GitHub - state-space-models/cuthbert: State-space model inference with JAX
State-space model inference with JAX. Contribute to state-space-models/cuthbert development by creating an account on GitHub.
010
Sam Duffield @samduffield.com · 18/02/2026
It was my birthday this week, it really had to be done
240
Reposted by Sam Duffield
Andrew Gelman et al. @statmodeling.bsky.social · 03/02/2026
“Parallelizing MCMC Across the Sequence Length”: This one is really cool. statmodeling.stat.columbia.edu/2026/02/03/p...
statmodeling.stat.columbia.edu
“Parallelizing MCMC Across the Sequence Length”: This one is really cool. | Statistical Modeling, Causal Inference, and Social Science
0143
Sam Duffield @samduffield.com · 30/01/2026
Repo: github.com/state-space-...
github.com
GitHub - state-space-models/cuthbert: State-space model inference with JAX
State-space model inference with JAX. Contribute to state-space-models/cuthbert development by creating an account on GitHub.
182
Sam Duffield @samduffield.com · 30/01/2026
Come check it out if you're interested in time series, Monte Carlo, sequential problems. We've got a suite of fun examples, lots more to add - contributions welcomed! Super fun work with @adriencorenflos.bsky.social and Sahel Iqbal 🙌
150
Sam Duffield @samduffield.com · 30/01/2026
New open source: cuthbert 🐛 State space models with all the hotness: (temporally) parallelisable, JAX, Kalman, SMC
1359
Sam Duffield @samduffield.com · 13/01/2026
Paper for full details. The proofs draw on ideas from vector calculus and Fourier analysis which was really fun to work through arxiv.org/abs/2601.07834
arxiv.org
A Complete Decomposition of Stochastic Differential Equations
We show that any stochastic differential equation with prescribed time-dependent marginal distributions admits a decomposition into three components: a unique scalar field governing marginal evolution...
000
Sam Duffield @samduffield.com · 13/01/2026
Here is the decomposition: I show that the scalar ϕ is unique(!) but you can choose and Q or D. In diffusion the ϕ terms represent the "probability flow ODE" but there are actually many ODEs which satisfy p(x,t) depending on your choice of Q
100
Sam Duffield @samduffield.com · 13/01/2026
This work combines, unifies and generalises two of my favourite papers - Ma et al - Complete recipe for autonomous SDEs arxiv.org/abs/1506.04696 - Karras et al - Elucidating the Design Space of Diffusion arxiv.org/abs/2206.00364
110
Sam Duffield @samduffield.com · 13/01/2026
New preprint! A Complete Decomposition of Stochastic Differential Equations I characterise *all possible SDEs* that satisfy given time-dependent marginals p(x,t)
140
Sam Duffield @samduffield.com · 09/01/2026
Not like you to not give the sauce, this looks interesting!
110
Reposted by Sam Duffield
Sam Power @spmontecarlo.bsky.social · 27/11/2025
Usual MCMC algorithms are typically guaranteed to work well when used to sample from target distributions for which i) mass is reasonably well-concentrated in the centre of the state space, and ii) the log-density is smooth and of moderate growth. Outside of this setting, things can go poorly.
1336
Sam Duffield @samduffield.com · 29/08/2025
Read more at arxiv.org/abs/2508.20883 Including scaling LRW up to image generation with Stable Diffusion 3.5 🐱
arxiv.org
Lattice Random Walk Discretisations of Stochastic Differential Equations
We introduce a lattice random walk discretisation scheme for stochastic differential equations (SDEs) that samples binary or ternary increments at each step, suppressing complex drift and diffusion co...
050
Sam Duffield @samduffield.com · 29/08/2025
As described in the paper, LRW provides multiple benefits but the key motivation for us @normalcomputing.com was the co-design with novel stochastic computing hardware which we believe can drastically accelerate general-purpose SDE sampling.
120
Sam Duffield @samduffield.com · 29/08/2025
New paper on arXiv! And I think it's a good'un 😄 Meet the new Lattice Random Walk (LRW) discretisation for SDEs. It’s radically different from traditional methods like Euler-Maruyama (EM) in that each iteration can only move in discrete steps {-δₓ, 0, δₓ}.
1165
Reposted by Sam Duffield
Sam Power @spmontecarlo.bsky.social · 13/05/2025
In slides from a recent talk - the { virtuous / vicious } cycle of filtering, smoothing, and parameter estimation in state space models.
2201
Sam Duffield @samduffield.com · 28/04/2025
Oh you king this is great thanks! I was at Lau Pa Sat the other day but went for shrimp noodles (which were great) because the satay queue was too long
010
Sam Duffield @samduffield.com · 27/04/2025
Didn’t listen, good decision
110
Sam Duffield @samduffield.com · 27/04/2025
Me: Hey so where’s good to eat round here? Singapore taxi driver: Malaysia
220
Sam Duffield @samduffield.com · 18/04/2025
However! We’re working on a much broader generalisation of abile which hopefully will be able to share soon 🤞🔜
110
Sam Duffield @samduffield.com · 18/04/2025
Adjacent! posteriors takes the natural gradient descent viewpoint on EKF arxiv.org/abs/1703.00209 Which is nice for online deep learning but not necessarily bespoke state-space model inference
arxiv.org
Online Natural Gradient as a Kalman Filter
We cast Amari's natural gradient in statistical learning as a specific case of Kalman filtering. Namely, applying an extended Kalman filter to estimate a fixed unknown parameter of a probabilistic mod...
140
Sam Duffield @samduffield.com · 18/04/2025
We've also updated the paper and made some cool updates to the library 😎 Paper: arxiv.org/abs/2406.00104 Repo: github.com/normal-compu...
120
Sam Duffield @samduffield.com · 18/04/2025
📃 Poster #419 🗓️ Sat 26th, 10:00–12:30 📍 #ICLR2025, Singapore Swing by if you’re into probml, thermodynamic computing or just wanna say hi
220
Sam Duffield @samduffield.com · 18/04/2025
posteriors 𝞡 published at ICLR! I’ll be in Singapore next week, let’s chat all things scalable Bayesian learning! 🇸🇬👋
1102
Reposted by Sam Duffield
Sam Power @spmontecarlo.bsky.social · 17/04/2025
A new instalment of office decor:
3201
Sam Duffield @samduffield.com · 16/04/2025
F
010
Sam Duffield @samduffield.com · 10/04/2025
Should have said, here h is stepsize 😅
000
Sam Duffield @samduffield.com · 10/04/2025
So simple! Normally we order our minibatches like a, b, c, ...., [shuffle], new_a, new_b, new_c, .... but instead, if we do a, b, c, ...., [reverse], ...., c, b, a, [shuffle], new_a, new_b, .... The RMSE of stochastic gradient descent reduces from O(h) to O(h²) arxiv.org/abs/2504.04274
130
Reposted by Sam Duffield
Alex Thiery @alexxthiery.bsky.social · 29/03/2025
Sequential Monte Carlo (aka. Particle Socialism?): "why send one explorer when you can send a whole army of clueless one"
0122
Sam Duffield @samduffield.com · 25/03/2025
Yep! That would be clearer
000
Sam Duffield @samduffield.com · 24/03/2025
arxiv.org/abs/1806.07366
arxiv.org
Neural Ordinary Differential Equations
We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The outp...
000
Sam Duffield @samduffield.com · 24/03/2025
Was revisiting the Neural ODEs paper the other day and greatly enjoying. But I found this super confusing, it’s not an A=B+A statement
330
Reposted by Sam Duffield
Sam Power @spmontecarlo.bsky.social · 20/03/2025
Thrillingly (/s), I have today (lightly) updated my website (sites.google.com/view/sp-mont...). I highlight that I've added i) links to several slide decks for talks about my research, and ii) materials related to the (few) short courses which I've given in the past couple of years. Enjoy!
sites.google.com
Sam Power's site
Hello! My name is Sam, and I am a researcher in Statistics. I am currently Lecturer in Statistical Science at the University of Bristol. Prior to this role, I was a Senior Research Associate (also at...
3312
Reposted by Sam Duffield
AlgoPerf @algoperf.bsky.social · 14/03/2025
Hi there! This account will post about the AlgoPerf benchmark and leaderboard updates for faster neural network training via better training algorithms. But let's start with what AlgoPerf is, what we have done so far, and how you can train neural nets ~30% faster.
163
Sam Duffield @samduffield.com · 28/02/2025
Thinking about it more, I think the sharp jumps are an artefact of the plotting. The plotting function will linearly interpolate but you can actually probabilistically interpolate using the smoothing equations
010
Sam Duffield @samduffield.com · 28/02/2025
Oh you are right! Very nice!
110
Sam Duffield @samduffield.com · 28/02/2025
I don’t think so - I can’t see any backward iterations in the code. Also the sharp changes after a result in e.g. the boxing plot are a classic filtering feature - there is a reason smoothing is called smoothing after all 😄
110