Sign in

Mat Kelcey

@matpalm.com
413 followers 129 following 135 posts

data nerd wannabe matpalm.com

PostsRepliesMedia
Mat Kelcey @matpalm.com · 08/09/2026
youtu.be/4HUdwmeOj7s
youtu.be
2026 09 07 10 58 04
YouTube video by dithernet
112
Mat Kelcey @matpalm.com · 22/06/2026
running a cycle accurate fpga emulation of the amiga paula audio chip in eurorack. ( with some extensions for sampling and different modulation ) #eurorack #tiliqua www.youtube.com/watch?v=SPUj... www.matpalm.com/blog/paula_t...
youtube.com
amiga paula running on tiliqua fpga eurorack (subs)
YouTube video by Mat Kelcey
030
Reposted by Mat Kelcey
Edge Impulse @edgeimpulse.com · 06/05/2025
At Imagine Innovators, we just announced our Developer Plan, offering expanded access to Edge Impulse’s powerful tools, completely free! Get GPU training, longer runtimes, more projects, and production-ready licensing, all at zero cost. Details: www.edgeimpulse.com/blog/introdu...
edgeimpulse.com
Introducing the Developer Plan: More Power, More Freedom — for Free
With our new Developer pricing plan you’ll now get the best of our community and professional plans. That means GPU training, longer runtimes, more projects, and production-ready licensing, all at zer...
043
Mat Kelcey @matpalm.com · 04/05/2025
have moved mixing out of the rack to the model1. such a great performance focussed mixer! #improv #techno
040
Reposted by Mat Kelcey
Flux @willflux.bsky.social · 21/03/2025
It's about time I updated my recommended #FPGA links. Send me a suggestion this #FPGAFriday. 😊 projectf.io/recommended-...
projectf.io
Recommended FPGA Sites
This page collects some of my favourite FPGA resources from across the Internet. FPGA Learning Resources Black Mesa Labs FPGA Tutorial Bruno Levy’s Learn FPGA fpga4fun.com fpgacpu.ca Nandland Project ...
0102
Mat Kelcey @matpalm.com · 16/03/2025
i wish this was always an option...
030
Mat Kelcey @matpalm.com · 28/02/2025
still "finding" ( i.e. stepping on ) screws from the great M3 drawer spill of Sept '24
000
Reposted by Mat Kelcey
jake @yetanotheruseless.com · 13/02/2025
I'll take "n^2 - n cursed images" for $1000, Alec
163
Reposted by Mat Kelcey
Sander Dieleman @sedielem.bsky.social · 10/02/2025
Great interview with @jascha.sohldickstein.com about diffusion models! This is the first in a series: similar interviews with Yang Song and yours truly will follow soon. (One of these is not like the others -- both of them basically invented the field, and I occasionally write a blog post 🥲)
youtube.com
History of Diffusion - Jascha Sohl-Dickstein
YouTube video by Bain Capital Ventures
04311
Reposted by Mat Kelcey
jacobaustin123.bsky.social @jacobaustin123.bsky.social · 04/02/2025
Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n
39429
Mat Kelcey @matpalm.com · 02/02/2025
"In what part of the world do you currently live?" lol
030
Mat Kelcey @matpalm.com · 02/02/2025
keep coming back to "Scalable MatMul-free Language Modeling" arxiv.org/abs/2406.02528 full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention. slowly getting there!
131
Mat Kelcey @matpalm.com · 28/01/2025
120
Mat Kelcey @matpalm.com · 27/01/2025
ooffff! the "DeepSeek-V3 Technical Report" is info dense! arxiv.org/abs/2412.19437
arxiv.org
DeepSeek-V3 Technical Report
We present DeepSeek-V3, a strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token. To achieve efficient inference and cost-effective training, DeepS...
120
Mat Kelcey @matpalm.com · 26/01/2025
still my fav "at doom's gate" cover! ( i'm probably 1K of those 2M views ) www.youtube.com/watch?v=TZG1...
youtube.com
DOOM: E1M1 (At Doom's Gate) - Metal Cover || RichaadEB & ToxicxEternity
YouTube video by RichaadEB
000
Mat Kelcey @matpalm.com · 24/01/2025
this looks like it's going to be a good read! www.amazon.com/AI-Robotics-...
amazon.com
AI for Robotics: Toward Embodied and General Intelligence in the Physical World
AI for Robotics: Toward Embodied and General Intelligence in the Physical World [Imran, Alishba, Gopalakrishnan, Keerthana] on Amazon.com. *FREE* shipping on qualifying offers. AI for Robotics: Toward Embodied and General Intelligence in the Physical World
020
Mat Kelcey @matpalm.com · 21/01/2025
went camping in an area with lots of eucalyptus and was surrounded by koalas! so cute!
030
Mat Kelcey @matpalm.com · 14/01/2025
first logic gate waveshaper results tonight! this is network represented purely by combinational logic ( see arxiv.org/abs/2210.08277 ) i.e. just look up tables; no mults or adds. trained in jax ( 3 nested levels of vmap! ) & inference in amaranth. inference speed should be ~10s nanoseconds.
270
Mat Kelcey @matpalm.com · 08/01/2025
my largest category of splurge spend for last month was "bandcamp" :D #winning
030
Mat Kelcey @matpalm.com · 05/01/2025
and here i am trying to debug why param_set((2,3,16), seed=1) vs param_set((2,3,16), seed=2) isn't working... ::/
110
Mat Kelcey @matpalm.com · 05/01/2025
by a lot of measures this was a completely irrational purchase, but, you know what i like it! it's ok to be irrational some times.
020
Mat Kelcey @matpalm.com · 05/01/2025
started learning "Amaranth HDL" this morning. my prior FPGA neural net stuff was verilog but switching to amaranth since the match the gateware on a device i'm targetting. as someone with a python background it's 1e6 times nicer than verilog!!
140
Mat Kelcey @matpalm.com · 30/12/2024
this board looks really fun! "a small, low cost board with the Raspberry Pi Pico processor (RP2040) and a Lattice Semiconductor iCE40UP5K FPGA" pico-ice.tinyvision.ai
0123
Mat Kelcey @matpalm.com · 16/12/2024
"Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms". interesting approach using 2nd order info to avoid the exploding/vanishing gradients that come from non differentiable relaxations.. www.youtube.com/watch?v=7aFP...
youtube.com
Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms - NeurIPS2024
YouTube video by Felix Petersen
0164
Mat Kelcey @matpalm.com · 13/12/2024
this is super cool!! i'll definitely be porting my fpga wavenet ( matpalm.com/blog/wavenet... ) in the new year
matpalm.com
brain of mat kelcey...
160
Mat Kelcey @matpalm.com · 12/12/2024
still the best tech speech ever. "whatever path you're on, i advocate for long, hard work." so, so true. knowledge & skills do not just pop into our heads, we have to push and shove and jam it in ourselves. www.youtube.com/watch?v=YOZn...
youtu.be
John Carmack Receives Honorary Degree
YouTube video by UMKC School of Science and Engineering
160
Mat Kelcey @matpalm.com · 12/12/2024
i always have this weird compulsion to move back to seattle. no idea why, given how bad the weather was lol
120
Reposted by Mat Kelcey
Edge Impulse @edgeimpulse.com · 10/12/2024
Today STMicroelectronics @ST_World announced the incredible new STM32N6, a powerhouse microcontroller with built-in neural processing that achieves 600x performance over current high-end STM32 MCUs — and offers native Edge Impulse support. Press release: www.businesswire.com/news/home/20...
businesswire.com
Edge Impulse and STMicroelectronics Launching Official Support of Revolutionary STM32N6 for Powerful Edge AI Solutions
Edge Impulse, the leading platform for building, deploying, and scaling edge machine learning models, and STMicroelectronics (NYSE: STM), a global sem
122
Mat Kelcey @matpalm.com · 07/12/2024
love the arpeggiator on the oxi one, so playable and fun! #improv #eurorack #techno www.youtube.com/watch?v=mbpF...
youtube.com
2024 12 08 08 58 26 improv eurorack techno
YouTube video by dithernet
170
Mat Kelcey @matpalm.com · 06/12/2024
my 2025 goal is to play a hardware only improv techno set in a full club have played a few times in smaller settings around friends but hearing one of my tracks recently on a proper club PA has really inspired me! dithernet.bandcamp.com/album/chapte...
dithernet.bandcamp.com
chapter twenty two, by Dithernet
12 track album
030
Mat Kelcey @matpalm.com · 06/12/2024
i love seeing people ( myself included ) rediscover old things. the recent flood of interest in AI which, for a lot of people, is 100% LLMs, is the best case i've seen of it! it really helps me solidify my only internal concepts to see someone else explain a decades old idea through new terminology.
130
Mat Kelcey @matpalm.com · 03/12/2024
"the new iris dataset" i'd almost forgotten about this!
020
Mat Kelcey @matpalm.com · 28/11/2024
the dog always waits. the gate in spring is shaded. she will run like hell. #haiku
040
Mat Kelcey @matpalm.com · 26/11/2024
i can't repost this hard enough...
020
Mat Kelcey @matpalm.com · 25/11/2024
keras3 vmapped jax models to tflite via orbax matpalm.com/blog/keras3_...
030
Mat Kelcey @matpalm.com · 24/11/2024
sadly none of it "just works" with a keras3 jax model ( exported as stateless_function ) #sigh no doubt i've just "simply" got my `jax_module.methods[constants.DEFAULT_METHOD_KEY]` wrong or some other magic arg combo, but not sure i can be bothered today...
210
Mat Kelcey @matpalm.com · 24/11/2024
stuck a jax laptop sticker up in a nightclub bathroom friday night. hoping some spaced out dev has a 3am WTF moment...
181
Mat Kelcey @matpalm.com · 23/11/2024
#showYourSetup #eurorack
eurorack synth setup
2281
Mat Kelcey @matpalm.com · 23/11/2024
(this week) jax to tflite is done with orbax ( nightly build only) ai.google.dev/edge/litert/... ( and that's orbax-export, not orbax-checkpoint, since it's been split ) not sure what'll be next week, we'll see! #canYouKeepUp
ai.google.dev
Jax Model Conversion For TFLite  |  Google AI Edge  |  Google AI for Developers
030
Mat Kelcey @matpalm.com · 20/11/2024
whenever i see someone talk about a small 1,000,000,000 param LLM i think about the 20,000 param conv nets we've got deployed on microcontrollers. TBH am glad to not be in the LLM space right now
1140
Reposted by Mat Kelcey
Daniel Situnayake @dansitu.bsky.social · 18/11/2024
Edge AI is maturing, and we’re getting pretty good at sensory perception. What comes next? In this post I explore what we’ll need to bring real intelligence to the field. I’d love to hear what you think 👇🏽 open.substack.com/pub/dansitu/...
open.substack.com
Integration
Edge AI has come a long way, but sensory perception is not enough. What will it take to build systems that can act?
075
Mat Kelcey @matpalm.com · 18/11/2024
have a number of old blog posts that are still useful but have code that no longer works... i know i should update them, just hard to be motivated to do so :/ #lazy
100
Mat Kelcey @matpalm.com · 18/11/2024
oh! just had an idea! in my fpga waveshaper ( matpalm.com/blog/wavenet... ) the limiting factor for speed was the ADAC which ran at 196kHz ( 5 micro second inference ) ...🧵
matpalm.com
120
Mat Kelcey @matpalm.com · 17/11/2024
updated my yolz blog post ( you only look zero shot times ) matpalm.com/blog/yolz/ still scrappy and hard to read i think but my time boxed hacking allocation has run up. onto something else!
matpalm.com
brain of mat kelcey...
020
Mat Kelcey @matpalm.com · 17/11/2024
it's time to celebrate when you reach 6D inputs tensors !
130
Mat Kelcey @matpalm.com · 17/11/2024
sometimes a jax.vmap can cause a MASSIVE blow out in jit time... i wonder what tools are available to understand why? ( it's not really profiling and jaxprs get pretty complex pretty quick... )
100
Reposted by Mat Kelcey
Shawn Hymel @shawnhymel.bsky.social · 17/11/2024
The latest edition of Make Magazine is out and includes an article by yours truly 🤓 I talk about the collaboration project with @Odd_Jayy and give you steps to create your own local #LLM chatbot on a #RaspberryPi. Check it out: www.makershed.com/collections/... #maker #ai #electronics
3383
Mat Kelcey @matpalm.com · 17/11/2024
it's _so_ important to write throwaway sampling debug tools. here's one for my zero shot object detector with top row being best performers and bottom row being worse. you never quite know what little quirk you'll pick up reviewing these...
031
Mat Kelcey @matpalm.com · 16/11/2024
after a couple of months of crappy weather it's about time to get jumping again!
120