iiinova — where your digital self keeps evolving

SgtPooki

@sgtpooki.com

268 followers 228 following 172 posts

My Name is Russell. I'm a Software Engineer, single father, gamer, dog trainer, DIYer, tinkerer, and Web3/AI/ML/UX/FOSS enthusiast

Posts Replies Media

SgtPooki @sgtpooki.com · 04/09/2026

> Each Mac reads its own shard locally at 1.2 TB/s, while only relatively small intermediate tensors/activations/collectives cross Thunderbolt. some references you might want to peek at: * github.com/ml-explore/m... * github.com/ml-explore/m...

Table comparing M5 Ultra Mac Studio configurations for local AI/LLM workloads. Columns: configuration, cost, physical RAM, raw local memory-bandwidth sum, estimated effective single-model bandwidth equivalent, and independent compute. 1×96 GiB: $6,799, 96 GiB, 1.2 TB/s raw and effective, 1× compute. 1×256 GiB: $10,799, 256 GiB, 1.2 TB/s raw and effective, 1×. 2×96 GiB: $13,598, 192 GiB, 2.4 TB/s raw, ~2.1–2.3 TB/s effective, 2×. Estimated 1×512 GiB: ~$17,199, 512 GiB, 1.2 TB/s raw and effective, 1×. 3×96 GiB: $20,397, 288 GiB, 3.6 TB/s raw, ~2.8–3.1 TB/s effective, 3×. 2×256 GiB: $21,598, 512 GiB, 2.4 TB/s raw, ~2.1–2.3 TB/s effective, 2×. 4×96 GiB: $27,196, 384 GiB, 4.8 TB/s raw, ~3.4–3.7 TB/s effective, 4×.

Comparison table for one 512 GiB M5 Ultra Mac Studio versus two 256 GiB M5 Ultra Mac Studios. The estimated single 512 GiB system costs about $17.2K, while two 256 GiB systems cost $21,598. Both provide 512 GiB total RAM, though the dual-machine setup uses distributed memory. The single Mac has 1.2 TB/s raw aggregate bandwidth and about 1.2 TB/s effective single-model bandwidth, while the two-Mac setup has 2.4 TB/s raw aggregate bandwidth and an estimated ~2.2 TB/s tensor-parallel effective bandwidth equivalent. The dual system also offers about 2× concurrent independent throughput and 2× compute, but requires RDMA and has higher software complexity.

010

SgtPooki @sgtpooki.com · 17/06/2026

Do i need to do something differently?

100

SgtPooki @sgtpooki.com · 08/09/2025

oh yea, here it is:

screencap of bluesky jobs listing page, with the "Trust & Safety" part of the "Fullstack Typescript Developer - Trust & Safety" relplaced with "Sgt & Pooki"

020

SgtPooki @sgtpooki.com · 25/06/2023

I just replaced the seal in my front-load washer and feel pretty proud. I saved a hefty sum and got an excellent sense of accomplishment.

Maroon colored Samsung frontload clothes washer with the front door off.

Maroon colored Samsung frontload clothes washer with the front door back on and running a load.

010

SgtPooki @sgtpooki.com · 15/06/2023

I was Scrolling through twitter to find an old tweet and saw this gold.

Image of a tweet with the text "The biggest danger of taking your child to a drag show is that a Christian could show up with a gun."

000

SgtPooki @sgtpooki.com · 12/06/2023

Have a great week folks

Fawn-colored Belgian Malinois wearing a brown baseball style cap.

000

SgtPooki @sgtpooki.com · 10/06/2023

My son loves rocks. Can you help us figure out what this is? Found on Oregon coast

220

SgtPooki @sgtpooki.com · 20/04/2023

Russell in Brussels is ending. Flying back home. Thanks for the great event all

000