Mat Kelcey @matpalm.com · 04/05/2025have moved mixing out of the rack to the model1. such a great performance focussed mixer! #improv #techno 040
Mat Kelcey @matpalm.com · 02/02/2025keep coming back to "Scalable MatMul-free Language Modeling" arxiv.org/abs/2406.02528 full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention. slowly getting there! 131
Mat Kelcey @matpalm.com · 21/01/2025went camping in an area with lots of eucalyptus and was surrounded by koalas! so cute! 030
Mat Kelcey @matpalm.com · 14/01/2025first logic gate waveshaper results tonight! this is network represented purely by combinational logic ( see arxiv.org/abs/2210.08277 ) i.e. just look up tables; no mults or adds. trained in jax ( 3 nested levels of vmap! ) & inference in amaranth. inference speed should be ~10s nanoseconds. 270
Mat Kelcey @matpalm.com · 05/01/2025and here i am trying to debug why param_set((2,3,16), seed=1) vs param_set((2,3,16), seed=2) isn't working... ::/ 110
Mat Kelcey @matpalm.com · 05/01/2025by a lot of measures this was a completely irrational purchase, but, you know what i like it! it's ok to be irrational some times. 020
Mat Kelcey @matpalm.com · 30/12/2024this board looks really fun! "a small, low cost board with the Raspberry Pi Pico processor (RP2040) and a Lattice Semiconductor iCE40UP5K FPGA" pico-ice.tinyvision.ai 0123
Mat Kelcey @matpalm.com · 28/11/2024the dog always waits. the gate in spring is shaded. she will run like hell. #haiku 040
Mat Kelcey @matpalm.com · 25/11/2024keras3 vmapped jax models to tflite via orbax matpalm.com/blog/keras3_... 030
Mat Kelcey @matpalm.com · 17/11/2024it's _so_ important to write throwaway sampling debug tools. here's one for my zero shot object detector with top row being best performers and bottom row being worse. you never quite know what little quirk you'll pick up reviewing these... 031
Mat Kelcey @matpalm.com · 16/11/2024after a couple of months of crappy weather it's about time to get jumping again! 120
Mat Kelcey @matpalm.com · 14/11/2024the AQT lib github.com/google/aqt/ is one of the few libs that does full quantised training ( not just quantised _aware_ training ) but it's implemented via a substitution of the dot_product? isn't jax all about fn transforms? why can't this "just" be a rewrite with tracing? i.e. `quantise(fn)` 010
Mat Kelcey @matpalm.com · 12/11/2024extending my zero shot object detector... ( an example on held out data ) given input image ( top center ) and examples of reference objects ( bottom center ) predictions on left, ground truth on right 010
Mat Kelcey @matpalm.com · 03/11/2024answering my own question; focal loss does pretty well! more tunables :( but seeing an immediate boost in performance around hard negatives :D bsky.app/profile/matk... 480
Mat Kelcey @matpalm.com · 28/10/2024had a couple of days off so messed around keras3 stateless_call and jax to make a zero shot object detector. matpalm.com/blog/yolz/ 010
Mat Kelcey @matpalm.com · 20/07/2024it'd be the same FPGA i used in my prior project too. ECP5 which is a monster! matpalm.com/blog/wavenet... 100
Mat Kelcey @matpalm.com · 20/07/2024with PMODs on the front panel i'll be able to buy 2 ( or more ) and chain them to run parts of a neural net on each 100
Mat Kelcey @matpalm.com · 02/12/2023latest drone setup. lyra 8 -> long life -> cosmos -> rooms. bliss. 010
Mat Kelcey @matpalm.com · 13/09/2023"running a neural net on a microcontroller at (almost) 50,000 inferences / sec" #blog matpalm.com/blog/wavenet... 170
