Sign in

Luke Marsden

@lmarsden.bsky.social
2.6K followers 4.5K following 84 posts

Hacker & entrepreneur. Founder helix.ml, private GenAI stack, getting business value out of local open source LLMs

PostsRepliesMedia
Luke Marsden @lmarsden.bsky.social · 01/08/2025
Bootstrapped a Private GenAI Startup to $1M revenue, AMA blog.helix.ml/p/bootstrapp...
blog.helix.ml
Bootstrapped Private GenAI Startup Hits $1M Annual Revenue, Launches Helix 2.0
The people behind the story, how agentic AI is changing and why we don't want a sales call with you
041
Luke Marsden @lmarsden.bsky.social · 03/04/2025
Thanks Hannah! 💖
050
Luke Marsden @lmarsden.bsky.social · 03/04/2025
Good morning #KubeCon! Come find me if you want to talk running LLM systems like vision RAG in production on Kubernetes today. Email luke@helix.ml or reply here!
050
Luke Marsden @lmarsden.bsky.social · 02/04/2025
Phil setting up a vLLM vision model provider on helix on his nerd phone on the Elizabeth line #kubecon
050
Luke Marsden @lmarsden.bsky.social · 02/04/2025
Catch my talk with Priya Samuel on running LLMs in production on k8s today at #KubeCon at S10A at 3:15pm ✨
082
Luke Marsden @lmarsden.bsky.social · 02/04/2025
Trying (but failing) to be as colourful as @hannahfoxwell.net today!
110
Reposted by Luke Marsden
HelixML @helixml.bsky.social · 01/04/2025
Oh hello there BlueSky! We've arrived here just in time to share all the highlights of #KubeCon #CloudNativeCon in sunny London! Don't miss @hannahfoxwell.net and @lmarsden.bsky.social at 15:20 today talking about Platform Engineering and Developer Experience For Your On Prem LLM
052
Reposted by Luke Marsden
Jennifer Riggins @jkriggins.bsky.social · 20/02/2025
I looked to define a term that’s being thrown around — #AI-native developer — with the help of @guypo.com @lmarsden.bsky.social and Thoughtworks’ Mike Mason so you can prepare your software teams for the near future. thenewstack.io/what-is-an-a... What’s your definition? Only on @thenewstack.io
thenewstack.io
What Is an AI Native Developer?
We explain what an AI native developer is, how the role will evolve, and why spec-driven AI development is driving this trend.
142
Luke Marsden @lmarsden.bsky.social · 30/01/2025
Deepseek are clever fuckers. I wrote this about how Deepseek is pushing decision makers in large financial institutions to seriously consider running their own models instead of calling out to Microsoft, Amazon & Google Link below 👇
330
Reposted by Luke Marsden
OpenUK @openuk.bsky.social · 15/01/2025
Speaker @lmarsden.bsky.social of MLOps Consulting will be in our SOOCon25 AI Openness track! 🎤 Join to hear about Production-Ready LLMs on Kubernetes: Patterns, Pitfalls, and Performance.💡https://buff.ly/3HjeQxq #opensource #opensourceai #ai #stateofopencon #soocon25 #opensourcelondon #openuk
062
Reposted by Luke Marsden
Martin Paul Eve @eve.gd · 12/01/2025
I enjoyed Stories of Your Life and Others so much that I'm moving straight to Chiang's other collection: Exhalation.
The cover of Ted Chiang's Exhalation. It shows a pair of lungs made up by plants and gears/cogs.
2102
Luke Marsden @lmarsden.bsky.social · 08/01/2025
MS Teams in the UK this morning is the most grim experience imaginable, tons of jitter and bandwidth seems fucked - like trying to do a video call over a highly contended LTE connection - my network connection is fine (per mtr) - is there an outage in some MS data center somewhere?
020
Luke Marsden @lmarsden.bsky.social · 06/01/2025
We shipped a lot over Christmas and I came here to release it: github.com/helixml/heli... - You can now drag'n'drop files directly into knowledge for Helix apps (rather than having to go via the filestore). - Initial support for MCP (more on this coming soon!)
github.com
Release 1.4.12 - apps drag'n'drop filestore, initial MCP support · helixml/helix
What's Changed make frontend work better with filestore knowledge by @nessie993 in #668 Model Context Protocol (MCP) support by @nessie993 in #680 security/refactoring/quality changes: Revive vo...
030
Luke Marsden @lmarsden.bsky.social · 03/01/2025
Cancelled my X subscription over all the stupid political interference
160
Luke Marsden @lmarsden.bsky.social · 20/12/2024
Thank you to @dciangot.com for doing the heavy lifting getting HelixML GPU runners running on Slurm HPC infra to take advantage of hundreds of thousands of GPUs running on Slurm infrastructure and transform them into multi-tenant GenAI systems! Read all about it here: blog.helix.ml/p/running-ge...
blog.helix.ml
Running GenAI on Supercomputers: Bridging HPC and Modern AI Infrastructure
Transform Your Supercomputer into a Private OpenAI: A Look at How Modern HPC Infrastructure Can Power Enterprise AI
081
Luke Marsden @lmarsden.bsky.social · 20/12/2024
This is so awesome! Imagine being able to combine the worlds of cloud-native scalable web services for LLMOps with the raw power of Slurm-powered supercomputers with some of the biggest compute power, networking and GPUs! Check out the writeup here: blog.helix.ml/p/running-ge...
blog.helix.ml
Running GenAI on Supercomputers: Bridging HPC and Modern AI Infrastructure
Transform Your Supercomputer into a Private OpenAI: A Look at How Modern HPC Infrastructure Can Power Enterprise AI
040
Luke Marsden @lmarsden.bsky.social · 19/12/2024
So @cybernetist.com got gptscript working with llama3.3:70b! Check out the detailed writeup here: blog.helix.ml/p/gptscript-...
blog.helix.ml
GPTScript Helix Apps: For Fun and Profit
Making GPTScript Shine with Open Source LLMs: How Llama 3's 70B Model Finally Makes Natural Language Programming Reliable
053
Luke Marsden @lmarsden.bsky.social · 13/12/2024
Got helix.ml running GenAI on a supercomputer..
helix.ml
Private GenAI Platform – HelixML
Build, test and deploy GenAI apps. Connect knowledge and business applications via APIs. Deploy in your cloud or use ours
030
Luke Marsden @lmarsden.bsky.social · 11/12/2024
Fucking dope helix.ml release from @cybernetist.com if you like function calling in open source LLMs and @GPTScript_ai github.com/helixml/heli... (Excuse my French)
github.com
Release 1.4.9 - support function calling in helix runners, add gptscript runner · helixml/helix
What's Changed Add gptscript_runner service to helix stack by @milosgajdos in #635 Bump ollama and update LLM inference with Tool calling by @milosgajdos in #637 Full Changelog: 1.4.8...1.4.9
010
Luke Marsden @lmarsden.bsky.social · 04/12/2024
Test Driven Development (TDD) for your LLMs? Yes please, more of that please! Back to basics - write a test, see the test fail, improve the prompt, see it pass, check it in - just like you would with any other code 😄
231
Reposted by Luke Marsden
Derrick Cogburn @derrickcogburn.bsky.social · 28/11/2024
Luke, this post, including the video, was very helpful. I loved the conference talk. I took my graduate students through a somewhat similar exercise last week for their last lab of the semester. Well done. Thank you.
021
Reposted by Luke Marsden
Derrick Cogburn @derrickcogburn.bsky.social · 28/11/2024
This is a wonderful post by @lmarsden.bsky.social Great presentation and video as well.
021
Luke Marsden @lmarsden.bsky.social · 28/11/2024
ICYMI, here's my 2-part blog series on how we can all be AI engineers with open source models – and how to apply testing best practices to LLM apps 1. blog.helix.ml/p/we-can-all... 2. blog.helix.ml/p/from-click...
blog.helix.ml
We can all be AI engineers – and we can do it with open source models
The barriers to AI engineering are crumbling fast
140
Luke Marsden @lmarsden.bsky.social · 23/11/2024
@llm360.bsky.social please consider adding me to the open source LLMs starter pack ☺️
110
Luke Marsden @lmarsden.bsky.social · 23/11/2024
So how can we _actually_ do AI on Kubernetes? Here's my humble proposal: LLM apps and tests as data (CRDs). Deeply integrated into the existing CI/CD pipeline e.g GitLab and Flux. Self hosted LLMs on GPUs if you want to. Runnable code: github.com/helixml/gena...
github.com
GitHub - helixml/genai-cicd-ref: Cloud-Native GenAI Reference Architecture
Cloud-Native GenAI Reference Architecture. Contribute to helixml/genai-cicd-ref development by creating an account on GitHub.
170
Luke Marsden @lmarsden.bsky.social · 22/11/2024
Just followed all 1400 people who followed me. If you see this, like this post to say hi! 🦋💚🦋
3280
Luke Marsden @lmarsden.bsky.social · 21/11/2024
I wrote a quick summary of the latest MLOps Community podcast: blog.helix.ml/p/from-click...
blog.helix.ml
From ClickOps to GitOps: The Evolution of AI App Development
How we bridge the gap between no-code AI prototypes and production-ready applications
032
Luke Marsden @lmarsden.bsky.social · 20/11/2024
One year ago, I promised to build helix.ml in the open, so here's an update on our commercial progress: blog.helix.ml/p/revenue-an...
blog.helix.ml
Building in the open: Revenue and Pipeline for Private GenAI
National data regulation, repatriation of data, and return to the private cloud is combining with the demand to stay competitive to drive interesting pipeline for our Private GenAI business
120
Reposted by Luke Marsden
Simon Willison @simonwillison.net · 17/11/2024
Anyone got a good system in place for running automated evals against your LLM-driven applications, to help test if tweaks to prompts get better results? I'd love to hear about approaches that are working for people on this
15876
Luke Marsden @lmarsden.bsky.social · 17/11/2024
Now that loads more people are here I guess I should run rerun this thing, right?
021
Luke Marsden @lmarsden.bsky.social · 17/11/2024
Hey cool this thing is here now 🤣
021
Luke Marsden @lmarsden.bsky.social · 17/11/2024
@jodok.bsky.social hey nice to see you here!
100
Luke Marsden @lmarsden.bsky.social · 14/11/2024
Oh shit we're on hacker news front page with blog.helix.ml/p/we-can-all...
blog.helix.ml
We can all be AI engineers – and we can do it with open source models
The barriers to AI engineering are crumbling fast
061
Reposted by Luke Marsden
Hannah Foxwell @hannahfoxwell.net · 13/11/2024
Next up it’s @lmarsden.bsky.social who has renamed his talk!! I didn’t even realise! 😂 “We can all be AI engineers. And we can do it with Open Source models” youtu.be/XR2DicY1zEM?... Note to self: update YouTube title
youtu.be
AI Spec Manifesto: Making GenAI easy for normal developers & DevOps | Luke Marsden
YouTube video by AI for the rest of us
232
Luke Marsden @lmarsden.bsky.social · 12/11/2024
In which I do the wrong thing from a product perspective.. or do I? blog.helix.ml/p/announcing...
blog.helix.ml
Announcing Helix 1.4 – CI/CD for Cloud-Native GenAI Apps
Helix test (evals) and a K8s Operator with a Helix + Flux reference architecture = GitOps for GenAI. Hardened scheduler, new long-context models. JIRA and multi-lingual RAG apps.
012
Luke Marsden @lmarsden.bsky.social · 12/11/2024
Hey #KubeCon roast my CI/CD for GenAI reference architecture! github.com/helixml/gena...
github.com
GitHub - helixml/genai-cicd-ref: Cloud-Native GenAI Reference Architecture
Cloud-Native GenAI Reference Architecture. Contribute to helixml/genai-cicd-ref development by creating an account on GitHub.
011
Luke Marsden @lmarsden.bsky.social · 12/11/2024
AI apps and tests should be data, not code
201
Reposted by Luke Marsden
Diego Ciangottini @dciangot.com · 11/11/2024
Hello @lmarsden.bsky.social , you're live on scigeeks YT :) I was talking of you CI/CD for GenAI ref, pretty cool!
121
Luke Marsden @lmarsden.bsky.social · 11/11/2024
@dciangot.com hello!! 😄
100
Luke Marsden @lmarsden.bsky.social · 11/11/2024
wdyt #KubeCon github.com/helixml/gena...
github.com
GitHub - helixml/genai-cicd-ref: Cloud-Native GenAI Reference Architecture
Cloud-Native GenAI Reference Architecture. Contribute to helixml/genai-cicd-ref development by creating an account on GitHub.
111
Luke Marsden @lmarsden.bsky.social · 31/10/2024
Oh cool, we got evals basics (pass/fail, with critique) right in helix.ml test. Great article from @hamel.bsky.social hamel.dev/blog/posts/l...
helix.ml
Private GenAI Platform – Helix AI
Build and optimize text and image AI for your needs. Train, fine-tune, and generate from your data. Deploy in your cloud — or use ours
010
Reposted by Luke Marsden
𝘴𝘢𝘷˚ ༘♡ ⋆。˚ @isavedya.bsky.social · 29/10/2024
if this goes viral ill delete twitter fr
1946969
Luke Marsden @lmarsden.bsky.social · 28/10/2024
I went to this great conference last week aifortherestofus.live It was run by an incredible woman @hannahfoxwell.net - speaking were incredible women www.linkedin.com/in/liannep @amandabrock.bsky.social I came home and saw sofiakourtesis.com best DJ set of the night Grateful to incredible women!
aifortherestofus.live
AI for the rest of us - 24-25 October 2024, London UK.
AI is ready for you, but who is helping you get ready for AI? Come to our conference in London UK on 24-25 October 2024 and find out!
130
Luke Marsden @lmarsden.bsky.social · 28/10/2024
This is so cool
030
Reposted by Luke Marsden
Noam Ross @noamross.net · 28/10/2024
Was thinking today of Hunter S. Thompson's "Wave" passage and the hope that in a few years those most afflicted with the reactionary fever will look back and see now as when their wave finally broke and receded.
Screenshot from Goodreads of text:

There was madness in any direction, at any hour. If not across the Bay, then up the Golden Gate or down 101 to Los Altos or La Honda. . . . You could strike sparks anywhere. There was a fantastic universal sense that whatever we were doing was right, that we were winning. . . .

And that, I think, was the handle—that sense of inevitable victory over the forces of Old and Evil. Not in any mean or military sense; we didn’t need that. Our energy would simply prevail. There was no point in fighting—on our side or theirs. We had all the momentum; we were riding the crest of a high and beautiful wave. . . .

So now, less than five years later, you can go up on a steep hill in Las Vegas and look West, and with the right kind of eyes you can almost see the high-water mark—that place where the wave finally broke and rolled back.
Hunter S. Thompson, Fear and Loathing in Las Vegas
032
Reposted by Luke Marsden
Kawaii Babe @kawaiibabe.com · 26/10/2024
RT if you like Bluesky more than X 😤
4321741406
Luke Marsden @lmarsden.bsky.social · 27/10/2024
This is not a very interesting take but I'm really happy to be here. Scrolling this app feels so... wholesome
230
Reposted by Luke Marsden
Cody Blakeney ✈️ NeurIPS 2024 @codestar.bsky.social · 27/10/2024
That sucks
131
Reposted by Luke Marsden
🐥pdrm🐣 @pedramnavid.com · 27/10/2024
I don’t think Bluesky would be as good had old twitter not existed, what made that site great was how easy it was to find like-minded people you never knew and build connections with, whereas here it’s entirely dependent on existing connections being resurfaced. Old algo was goated
6291
Luke Marsden @lmarsden.bsky.social · 27/10/2024
I'm excited to see communities forming here, feels fresh. By way of introduction, I'm a three time startup founder, first DevOps, then MLOps and now LLMOps. I'm particularly interested in making it easier for everyone to be an AI engineer using open source models: docs.google.com/presentation...
docs.google.com
We can all be AI engineers with open source models - workshop edition
Workshop: Install your own private ChatGPT with HelixML We Can All Be AI Engineers And We Can Do It With “Open Source” Models Luke Marsden CEO | luke@helix.ml 2024-10-25 helix.ml @lmarsden WORKSHOP ED...
030