Sign in

Rami Krispin

@ramikrispin.bsky.social
8.1K followers 2.3K following 1.4K posts

Senior Manager Data Science and Engineering at  | Docker Captain 🐳| Time-series analysis & forecasting My newsletters: Weekly updates: ramikrispin.substack.com AIOps: theaiops.substack.com Forecasting: theforecaster.substack.com

PostsRepliesMedia
Rami Krispin @ramikrispin.bsky.social · 12/10/2026
The second tutorial in the MLX series focuses on setting up an MLX server on a Mac and running an LLM locally👇🏼 theaiops.substack.com/p/getting-st... #llm #ai #mlx
theaiops.substack.com
Getting started with MLX LM
Set up a Python environment on Apple Silicon, download a small model from Hugging Face, and run a first request with the MLX LM server.
050
Rami Krispin @ramikrispin.bsky.social · 10/10/2026
I started a new series of tutorials about running LLMs locally on a Mac with MLX. The first tutorial is out, working on the next 3 ones 👇🏼 If you want to get a sneak peek, please check this repo: github.com/RamiKrispin/...
0211
Rami Krispin @ramikrispin.bsky.social · 10/10/2026
My weekly newsletter is out! 🔹 Open Source - Google Research's new project: Regularized Recursive Self-Improvement 🔹 New learning resources - MLA, Fledge Alpha, Jev decision models 🔹 Book of the week - AI Agents with MCP by @kylestratis.com ramikrispin.substack.com/p/self-impro... #ai #datascience
ramikrispin.substack.com
Self-Improving Agent Harnesses, AI Agents with MCP | Issue 109
Explore RRSI for improving agent harnesses, new resources on attention, decision models, and API design, and AI Agents with MCP by Kyle Stratis.
051
Rami Krispin @ramikrispin.bsky.social · 08/10/2026
I just published a new tutorial in my Docker 101 series for AI/ML developers. Building and running an image confirms that the application works, but inspection reveals the metadata and runtime defaults that Docker stored in the artifact 👇🏼 theaiops.substack.com/p/how-to-ins... #ai #docker #aiops
theaiops.substack.com
How to Inspect a Docker Image
Learn how to inspect a Docker image, read its metadata and runtime configuration, and view its build history and filesystem-layer identifiers.
040
Rami Krispin @ramikrispin.bsky.social · 08/10/2026
Google released EmbeddingGemma 2 - a new multimodel embeddings open weights model. Looks supper cool 👇🏼 www.youtube.com/watch?v=anPs...
youtube.com
Introducing EmbeddingGemma 2: An open model for natively multimodal embeddings
YouTube video by Google for Developers
151
Rami Krispin @ramikrispin.bsky.social · 07/10/2026
Fine tune LLM model on Mac with MLX 👇🏼 www.youtube.com/watch?v=DuCG...
youtube.com
Fine-Tune an LLM on Your Mac with MLX (Real Run, M5 Pro)
YouTube video by RainyTech
040
Rami Krispin @ramikrispin.bsky.social · 03/10/2026
Issue 108 is out! This week’s agenda: 🔹Open Source of the Week - ShinyReact 🔹New learning resources - LangSmith, specialist agents, software factories, and building agents in Python 🔹Book of the week - RAG with Python Cookbook by Dominik Polzer ramikrispin.substack.com/p/react-inte... #rstats #ai
ramikrispin.substack.com
ShinyReact and RAG with Python | Issue 108
Explore ShinyReact for React-based Shiny interfaces, resources on production agents and software factories, and RAG with Python Cookbook by Dominik Polzer.
031
Rami Krispin @ramikrispin.bsky.social · 30/09/2026
AI will find a cure for cancer. We need to invest in infrastructure and build more data centers. Meanwhile, what AI is actually doing 👇🏼 Video credit: unknown
050
Rami Krispin @ramikrispin.bsky.social · 29/09/2026
Here is the supporting repo: github.com/RamiKrispin/...
github.com
GitHub - RamiKrispin/local-llms-with-mlx: Running LLMs locally with MLX LM
Running LLMs locally with MLX LM. Contribute to RamiKrispin/local-llms-with-mlx development by creating an account on GitHub.
000
Rami Krispin @ramikrispin.bsky.social · 29/09/2026
The goal is to take you from “I can run an LLM locally” to “I understand how to optimize the caching, activations, and model weights to optimize the inference process”. Here is the first one in this series: theaiops.substack.com/p/why-mlx-fo...
theaiops.substack.com
Why MLX for local LLMs?
Learn why Apple silicon and unified memory make MLX a natural framework for running large language models locally on a Mac.
140
Rami Krispin @ramikrispin.bsky.social · 29/09/2026
I started a new sequence of tutorials, this time focusing on running LLMs locally on Mac with MLX LM. MLX LM is Apple’s framework for running LLMs locally on Apple Silicon, based on MLX - an array framework designed for machine learning on Apple Silicon 👇🏼 #ai #llm #mlx
170
Rami Krispin @ramikrispin.bsky.social · 29/09/2026
Currently, the competition focuses on optimizing Ternary Bonsai 2 27B, and the winning setting improved the model performance by 6X on a Mac over the frozen baseline. More details are available here: www.yukon.org/mlxfast
yukon.org
The Ternary Bonsai 2 MLX Challenge
Make Ternary Bonsai 2 27B faster on Apple Silicon and follow every improvement on the live MLX Fast leaderboard.
030
Rami Krispin @ramikrispin.bsky.social · 29/09/2026
If you are not familiar with the MLX Fast project, you should check it out. MLX Fast is a competition to make the same #AI model run faster on Apple Silicon by optimizing the inference engine rather than changing the model itself. 🧵👇🏼
1141
Rami Krispin @ramikrispin.bsky.social · 28/09/2026
And rmarkdown
030
Rami Krispin @ramikrispin.bsky.social · 28/09/2026
In a Docker conference, found some familiar hexagons 😎
160
Reposted by Rami Krispin
Kyle @kylestratis.com · 28/09/2026
My physical copy of AI Agents with MCP showed up...it's real! You can order the ebook now, and the print edition should be shipping soon, with pre-orders open. Over 330 pages on the Model Context Protocol, up to date with the July spec rewrite and Python SDK v2. kylestratis.com/books/ai-ag...
A super handsome guy holds AI Agents with MCP in Harvard Bookstore, a bookstore that doesn't actually carry the book.
0266
Rami Krispin @ramikrispin.bsky.social · 27/09/2026
The previous tutorials in this series are available here: ramikrispin.substack.com/t/sql-ai-age...
ramikrispin.substack.com
Rami's Data Newsletter | Substack
A weekly curated update on data science and engineering topics and resources. Click to read Rami's Data Newsletter, by Rami Krispin, a Substack publication with thousands of subscribers.
000
Rami Krispin @ramikrispin.bsky.social · 27/09/2026
A new tutorial in my SQL AI Agents series 👇🏼 I recently started a new series of tutorials that focuses on SQL AI agents in my newsletter 🗞️. This series is beginner-friendly, starting from the foundation all the way to production. ramikrispin.substack.com/p/prepare-da... #ai #sql #python
ramikrispin.substack.com
Prepare data for a SQL AI agent with DuckDB and Ibis
Prepare SFO passenger data for a SQL AI agent, create a persistent DuckDB table through Ibis, and validate it with native SQL.
130
Rami Krispin @ramikrispin.bsky.social · 26/09/2026
My weekly newsletter is out! This week: 🔹Open Source of the Week - Paperclip 🔹New learning resources 🔹Book of the week - Work Automation with R by Tiger Tang ramikrispin.substack.com/p/paperclip-... #ai #datascience #rstats #opensource
ramikrispin.substack.com
Paperclip Agent Orchestration, Work Automation with R | Issue 107
A weekly curated update on data science and engineering topics and resources.
040
Rami Krispin @ramikrispin.bsky.social · 24/09/2026
My LinkedIn Learning course, SQL AI Agents in Production, is available for free for a limited time at the link below: www.linkedin.com/feed/update/... #ai #datascience #sql #python
linkedin.com
My recent LinkedIn Learning course, SQL AI Agents in Production, just reached 4,000 learners 🚀, and it is now open for free for a limited time with the link below 👇🏼 What does production mean… | Rami...
My recent LinkedIn Learning course, SQL AI Agents in Production, just reached 4,000 learners 🚀, and it is now open for free for a limited time with the link below 👇🏼 What does production mean when wo...
040
Rami Krispin @ramikrispin.bsky.social · 23/09/2026
I'm not sure who gets the credit, but it's brilliant! 😂
11210
Rami Krispin @ramikrispin.bsky.social · 22/09/2026
A new tutorial in my Docker 🐳 101 series for AI developers — this time focusing on running a container 👇🏼 theaiops.substack.com/p/how-to-run... #docker #ai #mlops
theaiops.substack.com
How to Run a Docker Container from an Image
Learn how to run a Docker container from an image, publish a FastAPI port to localhost, verify the API, and stop and remove the container.
160
Rami Krispin @ramikrispin.bsky.social · 20/09/2026
Issue 106 is out! This week’s agenda: 🔹 Open Source of the Week - Posit Commons 🔹 New learning resources 🔹 Book of the week - Learning Generative AI Tools for Excel by Angelica Lo Duca ramikrispin.substack.com/p/posit-comm... #ai #rstats #python #datascience
ramikrispin.substack.com
Posit Commons Data Agents, Generative AI Tools for Excel | Issue 106
Explore Posit Commons, videos on Jev, Bonsai 2, coding agent harnesses, and weather forecasting, plus a book on generative AI tools for Excel.
070
Rami Krispin @ramikrispin.bsky.social · 18/09/2026
I couldn't stop laughing 🤣🤣🤣 Credit: Ari K (on X)
011
Rami Krispin @ramikrispin.bsky.social · 14/09/2026
I don't have personal experience with SFT, but there is a big MLX community on Hugging Face that tunes LLMs to work in different settings.
010
Rami Krispin @ramikrispin.bsky.social · 14/09/2026
Started to work on a sequence of tutorials focusing on running LLMs locally on Apple Silicon with MLX LM 👇🏼 github.com/RamiKrispin/... #ai #llm
github.com
GitHub - RamiKrispin/local-llms-with-mlx: Running LLMs locally with MLX LM
Running LLMs locally with MLX LM. Contribute to RamiKrispin/local-llms-with-mlx development by creating an account on GitHub.
1161
Rami Krispin @ramikrispin.bsky.social · 13/09/2026
👇🏼
000
Reposted by Rami Krispin
Mike McQuaid @mikemcquaid.com · 13/09/2026
Today, I’m proud to announce Homebrew 7.0.0. The most significant changes since 6.0.0 are faster installations, stronger sandboxing, native macOS app, vulnerability checks, advisory database, end of macOS 10.15 support and Intel Macs to Tier 3.
brew.sh
7.0.0
Today, I’m proud to announce Homebrew 7.0.0. The most significant changes since 6.0.0 are faster installations and upgrades, stronger sandboxing, a native macOS app, built-in vulnerability checks and an advisory database, the end of macOS 10.15 support and Intel Macs moving to Tier 3.
523226
Rami Krispin @ramikrispin.bsky.social · 13/09/2026
Previous tutorials and supporting code: github.com/RamiKrispin/...
github.com
GitHub - RamiKrispin/docker-for-ai
Contribute to RamiKrispin/docker-for-ai development by creating an account on GitHub.
010
Rami Krispin @ramikrispin.bsky.social · 13/09/2026
A new tutorial in my Docker 🐳 101 series — this time focusing on working with container registries 👇🏼 theaiops.substack.com/p/how-to-pus... #docker #mlops #devops
theaiops.substack.com
How to Push a Docker Image to Docker Hub
Learn how to log in to Docker Hub, push a tagged FastAPI image, read the layer and digest output, and verify the published image.
230
Rami Krispin @ramikrispin.bsky.social · 12/09/2026
Issue 104 is out! This week's agenda: 🔹 Open Source of the Week - the TimesFM project from Google 🔹 New learning resources 🔹 Book of the week - Generative AI on Microsoft Azure ramikrispin.substack.com/p/timesfm-ge... #ai #timeseries #forecasting
ramikrispin.substack.com
TimesFM and Generative AI on Microsoft Azure | Issue 105
Explore TimesFM for zero-shot forecasting, six videos on Python, voice dictation, Git, MCP, AI coding workflows, and looped transformers, plus a guide to generative AI on Azure.
040
Rami Krispin @ramikrispin.bsky.social · 08/09/2026
After a long break, I am returning to my "Getting Started with SQL AI Agent" series. This sequence of tutorials is going to cover two topics: ✅ Foundation of SQL AI agents ✅ SQL AI agents in production This one covers the prerequisites 👇🏼 ramikrispin.substack.com/p/set-up-a-p...
ramikrispin.substack.com
Set up a Python environment for SQL AI agents
Set up Python for SQL AI agent tutorials with uv, venv and pip, or a Docker-based VS Code Dev Container.
010
Rami Krispin @ramikrispin.bsky.social · 05/09/2026
A new tutorial in my Docker 101 series github.com/RamiKrispin/...
github.com
GitHub - RamiKrispin/docker-for-ai
Contribute to RamiKrispin/docker-for-ai development by creating an account on GitHub.
030
Rami Krispin @ramikrispin.bsky.social · 05/09/2026
Unsloth released new GLM settings that enable running the model on a 128 Gb RAM machine 3.3x faster using optimized decoding 👇🏼 unsloth.ai/docs/models/...
unsloth.ai
GLM-5.3-Flash: How to Run Locally | Unsloth Documentation
Run the new GLM-5.3-Flash aka ox-alpha model by Z.ai.
020
Rami Krispin @ramikrispin.bsky.social · 05/09/2026
Issue 104 is out! This week's agenda: 🔹 Open Source of the Week - the agent-top project by Kannan Kalidasan 🔹 New learning resources 🔹 Book of the week - Designing AI Interfaces: Design Principles for Creative and Autonomous AI by Louise Macfadyen ramikrispin.substack.com/p/agent-top-...
ramikrispin.substack.com
Agent Top, Designing AI Interfaces | Issue 104
A weekly curated update on data science and engineering topics and resources.
020
Rami Krispin @ramikrispin.bsky.social · 30/08/2026
A new tutorial in my Docker 🐳 101 series — this time focusing on building Docker images 👇🏼 🔗 theaiops.substack.com/p/how-to-bui... #docker #ai #mlops
theaiops.substack.com
How to Build a Docker Image from a Dockerfile
Learn how to build and tag a Docker image from a Dockerfile, understand the build context, read the build output, and confirm the image locally.
160
Rami Krispin @ramikrispin.bsky.social · 29/08/2026
If you are working with an architecture diagram, Archify is a really cool skill to create interactive diagrams: github.com/tt-a1i/archify
020
Rami Krispin @ramikrispin.bsky.social · 29/08/2026
Issue 103 is out! This week's agenda: 🔹 Open Source of the Week - The Archify project 🔹 New learning resources 🔹 Book of the week - Vector Databases: A Practical Introduction by Nitin Borwankar ramikrispin.substack.com/p/the-archif...
ramikrispin.substack.com
The Archify Project, Vector Databases: A Practical Introduction | Issue 103
A weekly curated update on data science and engineering topics and resources.
110
Rami Krispin @ramikrispin.bsky.social · 29/08/2026
GLM 5.3 can run locally if you have an appropriate machine with ample RAM (e.g., a 256GB Mac or a system with sufficient RAM/VRAM). Here is a guide from Unsloth: unsloth.ai/docs/models/...
040
Rami Krispin @ramikrispin.bsky.social · 28/08/2026
The MLX fast is a new cool community project with the goal of finding the best setting for running different LLM locally on Apple silicon 👇🏼 www.yukon.org/mlxfast
3341
Rami Krispin @ramikrispin.bsky.social · 27/08/2026
Interesting… techcrunch.com/2026/08/26/n...
techcrunch.com
Nvidia closes in on Hugging Face acquisition | TechCrunch
Nvidia has reportedly agreed to buy Hugging Face, the popular open-source AI hub, for $12.9 billion in a move that would let Nvidia both protect its chip empire and jump back into the cloud business.
000
Rami Krispin @ramikrispin.bsky.social · 27/08/2026
Having a weekly quote makes sense. Adding a 5-hour limit is a real motivation to transition my Mac Studio to a local LLM server and say goodbye to OpenAI
010
Rami Krispin @ramikrispin.bsky.social · 26/08/2026
The new VScode version comes with new markdown editor functionality. One of the nice features is editing the markdown directly in preview mode 👇🏼 youtu.be/7uyRMACA_pM?...
youtu.be
New Markdown Editor in VS Code!
YouTube video by Visual Studio Code
0151
Rami Krispin @ramikrispin.bsky.social · 25/08/2026
Memory is the new gold...
000
Rami Krispin @ramikrispin.bsky.social · 25/08/2026
Also, new Mac Studio 👇🏼 www.youtube.com/watch?v=3uAI...
youtube.com
The New Mac Studio with M5 Max and M5 Ultra
YouTube video by Apple
000
Rami Krispin @ramikrispin.bsky.social · 25/08/2026
Hello to the M6! www.youtube.com/watch?v=3Wpz...
youtube.com
The new Mac mini with M6
YouTube video by Apple
230
Rami Krispin @ramikrispin.bsky.social · 25/08/2026
This looks like a great collection of engineering skills and plugins for coding agents (Claude Code, Codex, etc.): github.com/mattpocock/s... #ai #engineering
github.com
GitHub - mattpocock/skills: Skills for Real Engineers. Straight from my .agents directory.
Skills for Real Engineers. Straight from my .agents directory. - mattpocock/skills
0110
Rami Krispin @ramikrispin.bsky.social · 24/08/2026
My Docker 101 series now has a GitHub repo: github.com/RamiKrispin/...
github.com
GitHub - RamiKrispin/docker-for-ai
Contribute to RamiKrispin/docker-for-ai development by creating an account on GitHub.
040
Rami Krispin @ramikrispin.bsky.social · 23/08/2026
QA…
000
Rami Krispin @ramikrispin.bsky.social · 23/08/2026
Claude Code is such a capable tool that it can build an amazing thing. Yet, it cannot give you Python code to copy and paste with the right indentation 🤦🏻‍♂️
1100