Sign in

Mat Kelcey

@matpalm.com
413 followers 129 following 135 posts

data nerd wannabe matpalm.com

PostsRepliesMedia
Mat Kelcey @matpalm.com · 08/09/2026
youtu.be/4HUdwmeOj7s
youtu.be
2026 09 07 10 58 04
YouTube video by dithernet
112
Mat Kelcey @matpalm.com · 23/06/2026
trying to work out which company you worked at was "DoofusCo" :D
110
Mat Kelcey @matpalm.com · 22/06/2026
running a cycle accurate fpga emulation of the amiga paula audio chip in eurorack. ( with some extensions for sampling and different modulation ) #eurorack #tiliqua www.youtube.com/watch?v=SPUj... www.matpalm.com/blog/paula_t...
youtube.com
amiga paula running on tiliqua fpga eurorack (subs)
YouTube video by Mat Kelcey
030
Mat Kelcey @matpalm.com · 17/06/2025
cool ideas! i've been slowing teaching myself FPGA programming so i can run neural nets at audio rates ( e.g. matpalm.com/blog/wavenet... ). i am iirationally chasing nano second inference times!
matpalm.com
brain of mat kelcey...
010
Mat Kelcey @matpalm.com · 07/05/2025
code is all there if you want to mess around; pretty old though so definitely won't run as is...
000
Reposted by Mat Kelcey
Edge Impulse @edgeimpulse.com · 06/05/2025
At Imagine Innovators, we just announced our Developer Plan, offering expanded access to Edge Impulse’s powerful tools, completely free! Get GPU training, longer runtimes, more projects, and production-ready licensing, all at zero cost. Details: www.edgeimpulse.com/blog/introdu...
edgeimpulse.com
Introducing the Developer Plan: More Power, More Freedom — for Free
With our new Developer pricing plan you’ll now get the best of our community and professional plans. That means GPU training, longer runtimes, more projects, and production-ready licensing, all at zer...
043
Mat Kelcey @matpalm.com · 04/05/2025
have moved mixing out of the rack to the model1. such a great performance focussed mixer! #improv #techno
040
Reposted by Mat Kelcey
Flux @willflux.bsky.social · 21/03/2025
It's about time I updated my recommended #FPGA links. Send me a suggestion this #FPGAFriday. 😊 projectf.io/recommended-...
projectf.io
Recommended FPGA Sites
This page collects some of my favourite FPGA resources from across the Internet. FPGA Learning Resources Black Mesa Labs FPGA Tutorial Bruno Levy’s Learn FPGA fpga4fun.com fpgacpu.ca Nandland Project ...
0102
Mat Kelcey @matpalm.com · 16/03/2025
i wish this was always an option...
030
Mat Kelcey @matpalm.com · 28/02/2025
still "finding" ( i.e. stepping on ) screws from the great M3 drawer spill of Sept '24
000
Reposted by Mat Kelcey
jake @yetanotheruseless.com · 13/02/2025
I'll take "n^2 - n cursed images" for $1000, Alec
163
Mat Kelcey @matpalm.com · 13/02/2025
_finally_ genAI doing something useful. about time.
010
Reposted by Mat Kelcey
Sander Dieleman @sedielem.bsky.social · 10/02/2025
Great interview with @jascha.sohldickstein.com about diffusion models! This is the first in a series: similar interviews with Yang Song and yours truly will follow soon. (One of these is not like the others -- both of them basically invented the field, and I occasionally write a blog post 🥲)
youtube.com
History of Diffusion - Jascha Sohl-Dickstein
YouTube video by Bain Capital Ventures
04311
Reposted by Mat Kelcey
jacobaustin123.bsky.social @jacobaustin123.bsky.social · 04/02/2025
Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n
39429
Mat Kelcey @matpalm.com · 02/02/2025
"In what part of the world do you currently live?" lol
030
Mat Kelcey @matpalm.com · 02/02/2025
it's a super clever reparameterisation. though the tensors might need to be bigger, i feel it'll be paid for by the simpler streaming implementation on an FPGA. hacking / time will tell!
000
Mat Kelcey @matpalm.com · 02/02/2025
keep coming back to "Scalable MatMul-free Language Modeling" arxiv.org/abs/2406.02528 full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention. slowly getting there!
131
Mat Kelcey @matpalm.com · 28/01/2025
120
Mat Kelcey @matpalm.com · 28/01/2025
same with jerky!! got some the other day that expired a few weeks after opening ???? wasn't that the entire purpose of jerky?!?!
010
Mat Kelcey @matpalm.com · 27/01/2025
ooffff! the "DeepSeek-V3 Technical Report" is info dense! arxiv.org/abs/2412.19437
arxiv.org
DeepSeek-V3 Technical Report
We present DeepSeek-V3, a strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token. To achieve efficient inference and cost-effective training, DeepS...
120
Mat Kelcey @matpalm.com · 26/01/2025
still my fav "at doom's gate" cover! ( i'm probably 1K of those 2M views ) www.youtube.com/watch?v=TZG1...
youtube.com
DOOM: E1M1 (At Doom's Gate) - Metal Cover || RichaadEB & ToxicxEternity
YouTube video by RichaadEB
000
Mat Kelcey @matpalm.com · 24/01/2025
this looks like it's going to be a good read! www.amazon.com/AI-Robotics-...
amazon.com
AI for Robotics: Toward Embodied and General Intelligence in the Physical World
AI for Robotics: Toward Embodied and General Intelligence in the Physical World [Imran, Alishba, Gopalakrishnan, Keerthana] on Amazon.com. *FREE* shipping on qualifying offers. AI for Robotics: Toward Embodied and General Intelligence in the Physical World
020
Mat Kelcey @matpalm.com · 21/01/2025
went camping in an area with lots of eucalyptus and was surrounded by koalas! so cute!
030
Mat Kelcey @matpalm.com · 20/01/2025
that _was_ a weird one...
010
Mat Kelcey @matpalm.com · 15/01/2025
nice one! super excited to see what comes out of this lab!
000
Mat Kelcey @matpalm.com · 14/01/2025
no problem at all! will post blog when i'm done
010
Mat Kelcey @matpalm.com · 14/01/2025
( the next generation of this matpalm.com/blog/wavenet... intending to run on matpalm.com/blog/wavenet... )
matpalm.com
brain of mat kelcey...
010
Mat Kelcey @matpalm.com · 14/01/2025
first logic gate waveshaper results tonight! this is network represented purely by combinational logic ( see arxiv.org/abs/2210.08277 ) i.e. just look up tables; no mults or adds. trained in jax ( 3 nested levels of vmap! ) & inference in amaranth. inference speed should be ~10s nanoseconds.
270
Mat Kelcey @matpalm.com · 08/01/2025
my largest category of splurge spend for last month was "bandcamp" :D #winning
030
Mat Kelcey @matpalm.com · 05/01/2025
and here i am trying to debug why param_set((2,3,16), seed=1) vs param_set((2,3,16), seed=2) isn't working... ::/
110
Mat Kelcey @matpalm.com · 05/01/2025
welcome @jeffdean.bsky.social !
010
Mat Kelcey @matpalm.com · 05/01/2025
i'm porting github.com/matpalm/cach... to use github.com/Felix-Peters... so will post progress along the way!
github.com
GitHub - matpalm/cached_dilated_causal_convolutions: 1D dilated causal convolutions with extreme caching for 5µs inference on an FPGA
1D dilated causal convolutions with extreme caching for 5µs inference on an FPGA - matpalm/cached_dilated_causal_convolutions
120
Mat Kelcey @matpalm.com · 05/01/2025
by a lot of measures this was a completely irrational purchase, but, you know what i like it! it's ok to be irrational some times.
020
Mat Kelcey @matpalm.com · 05/01/2025
100% !!! can you imagine having to "engage" with half your kitchen at 6am before the coffee is brewed. nightmare!!
250
Mat Kelcey @matpalm.com · 05/01/2025
started learning "Amaranth HDL" this morning. my prior FPGA neural net stuff was verilog but switching to amaranth since the match the gateware on a device i'm targetting. as someone with a python background it's 1e6 times nicer than verilog!!
140
Mat Kelcey @matpalm.com · 30/12/2024
this board looks really fun! "a small, low cost board with the Raspberry Pi Pico processor (RP2040) and a Lattice Semiconductor iCE40UP5K FPGA" pico-ice.tinyvision.ai
0123
Mat Kelcey @matpalm.com · 16/12/2024
"Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms". interesting approach using 2nd order info to avoid the exploding/vanishing gradients that come from non differentiable relaxations.. www.youtube.com/watch?v=7aFP...
youtube.com
Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms - NeurIPS2024
YouTube video by Felix Petersen
0164
Mat Kelcey @matpalm.com · 16/12/2024
took my eldest to see die hard for the first time at imax recently. classic!
010
Mat Kelcey @matpalm.com · 13/12/2024
most interesting result of 2024 IMHO. www.youtube.com/watch?v=FKQf...
youtube.com
Convolutional Differentiable Logic Gate Networks - NeurIPS Oral - difflogic
YouTube video by Felix Petersen
000
Mat Kelcey @matpalm.com · 13/12/2024
this is super cool!! i'll definitely be porting my fpga wavenet ( matpalm.com/blog/wavenet... ) in the new year
matpalm.com
brain of mat kelcey...
160
Mat Kelcey @matpalm.com · 12/12/2024
still the best tech speech ever. "whatever path you're on, i advocate for long, hard work." so, so true. knowledge & skills do not just pop into our heads, we have to push and shove and jam it in ourselves. www.youtube.com/watch?v=YOZn...
youtu.be
John Carmack Receives Honorary Degree
YouTube video by UMKC School of Science and Engineering
160
Mat Kelcey @matpalm.com · 12/12/2024
i always have this weird compulsion to move back to seattle. no idea why, given how bad the weather was lol
120
Mat Kelcey @matpalm.com · 11/12/2024
neural nets on FPGAs for waveshaping eurorack ! matpalm.com/blog/wavenet...
matpalm.com
brain of mat kelcey...
110
Mat Kelcey @matpalm.com · 10/12/2024
good one!
000
Mat Kelcey @matpalm.com · 10/12/2024
some awesome selections! keep it up! minor suggestion; a link to bandcamp, where possible, would definitely support the artists :D e.g. in this case ameniiarecords.bandcamp.com/track/sabotage
ameniiarecords.bandcamp.com
Sabotage, by Stef Mendesidis
from the album Chondrite
010
Mat Kelcey @matpalm.com · 10/12/2024
haha! love that USB adapter!
100
Reposted by Mat Kelcey
Edge Impulse @edgeimpulse.com · 10/12/2024
Today STMicroelectronics @ST_World announced the incredible new STM32N6, a powerhouse microcontroller with built-in neural processing that achieves 600x performance over current high-end STM32 MCUs — and offers native Edge Impulse support. Press release: www.businesswire.com/news/home/20...
businesswire.com
Edge Impulse and STMicroelectronics Launching Official Support of Revolutionary STM32N6 for Powerful Edge AI Solutions
Edge Impulse, the leading platform for building, deploying, and scaling edge machine learning models, and STMicroelectronics (NYSE: STM), a global sem
122
Mat Kelcey @matpalm.com · 08/12/2024
absolute classic!
000
Mat Kelcey @matpalm.com · 07/12/2024
the 909 claps at 2:20 were probably too much but i just can't help myself lol. clap, clap, clap, clap
000