Sign in

colton

@colton.boo
2.4K followers 1.9K following 95 posts

Data Engineering / Music / Photography / Tinkering cmpadden.github.io

PostsRepliesMedia
colton @colton.boo · 09/07/2026
It was great to join @christianminich.com in this webinar. He shared a lot of great insights in how he's using AI for data engineering.
021
Reposted by colton
Simon Späti 🏔️ @ssp.sh · 19/05/2026
I wrote an Almanack like Charlie Munger and Naval Ravikant did, but about life wisdom and my time of using Dagster for data orchestration over the years. Since using it in 2018, the story has gone from complexity to composability and from orchestrating to a full data platform.
The Dagster Almanack highlights data orchestration, composability, and governance with icons and structured layout.
172
colton @colton.boo · 09/04/2026
github.com/dagster-io/d...
github.com
Release 1.13.0 (core) / 0.29.0 (libraries) · dagster-io/dagster
Major Changes Since 1.12.0 AI-assisted development: Released dagster-io/skills, a collection of Dagster-focused AI skills for coding agents like Claude Code, OpenAI Codex, and others. Expanded dg ...
030
colton @colton.boo · 09/04/2026
dagster.io/blog/dagster...
130
colton @colton.boo · 09/04/2026
We just released version 1.13.0 of @dagster.io with lots of great features like official Dagster skills for, virtualized assets for modeling entities like views, partitioned asset checks, and more. Check out the blog post for more details.
181
colton @colton.boo · 10/02/2026
Learn how we built a light weight evaluation framework for the official Dagster skills. With short feedback loops and quantitative measurements, we were able to make quick improvements that improving decision routing and context management. dagster.io/blog/evaluat...
dagster.io
Measuring the effectiveness of the Dagster Skills
Learned how we built a light weight evaluation framework for quantiatively measuring the effectiveness of the Dagster Skills
020
colton @colton.boo · 09/01/2026
If you're a Python developer using Claude Code, or something similar, we just published a blog that covers 10 rules we add to our prompt for drastically improved code gen. And we include the full prompt at the end of the post! dagster.io/blog/dignifi...
042
Reposted by colton
All Things Open @allthingsopen.bsky.social · 16/12/2025
🚀 NEW on We ❤️ Open Source 🚀 How can a small team answer 16,000+ community Qs/month? Colton Padden (@colton.boo) reveals Dagster’s smart AI-powered doc strategy—built for humans and LLMs. allthingsopen.org/articles/sca... #WeLoveOpenSource #OpenSource #AI #TechDocs #Dagster #CommunitySupport
031
colton @colton.boo · 16/12/2025
allthingsopen.org/articles/sca...
allthingsopen.org
Scaling documentation without scaling your team: Dagster's AI-powered strategy | We Love Open Source • All Things Open
Learn how Dagster's small team scaled community education by restructuring docs around the software development lifecycle, using AI tools, and building a custom assistant that answers over 16,000 ques...
020
colton @colton.boo · 16/12/2025
We've been improving how we create educational content at @dagster.io: optimizing feedback loops, generating content for different learning styles, and leveraging LLM-powered workflows. You can find our lessons learned on the @allthingsopen.bsky.social "We Love Open Source" blog!
161
colton @colton.boo · 07/11/2025
So excited for this to be available! 🚀
030
Reposted by colton
Christian Minich @christianminich.com · 07/11/2025
“Flexibility without fragmentation” In addition to some solid alteration, it’s also a great explanation of how to build a data team and how your system can and should scale. @colton.boo and Dennis Hume have an awesome new ebook on this topic, check it out! #dataBS dagster.io/how-to-scale...
dagster.io
How to Scale Data Teams | Free eBook from Dagster
Download Dagster's free eBook to learn how to build systems that scale with clarity, reliability, and confidence.
141
colton @colton.boo · 12/10/2025
2025.allthingsopen.org/sessions/ena... #AllThingsOpen
2025.allthingsopen.org
Enabling Community Education With a Little Help From AI • All Things Open 2025
Dagster is a sophisticated tool and platform for building data pipelines, and community members heavily rely on our documentation and educational content to make use of all of its features. In this se...
000
colton @colton.boo · 12/10/2025
Excited to be at All Things Open tomorrow! Come hang out at the @dagster.io booth, or see my talk “Enabling education with a little help from AI” at 1:45 EST on Tuesday!
151
colton @colton.boo · 08/08/2025
@ssp.sh this might be relevant to your interests!
120
Reposted by colton
Christian Minich @christianminich.com · 28/07/2025
Read this post you work in data analytics. A similar mindset problem pervades sales engineering as well, especially in the demo / early stages of discovery. Understand your prospect’s context. Who are they? What do they care about? What value can you provide them? That’s what you show.
1112
colton @colton.boo · 17/06/2025
MotherDuck is live now! DuckLake & The Future of Open Table Formats ft. Jordan Tigani & Hannes Mühleisen www.youtube.com/live/yn07s-_...
youtube.com
DuckLake & The Future of Open Table Formats ft. Jordan Tigani & Hannes Mühleisen
YouTube video by MotherDuck
050
colton @colton.boo · 04/06/2025
Agreed, what a great watch / listen!
030
colton @colton.boo · 25/05/2025
Thanks @christiannolan.bsky.social!
020
colton @colton.boo · 23/05/2025
New Oxidise Your Command Line just dropped. Some that stand out to me are: xh, fselect, and presenterm! www.youtube.com/watch?v=rWMQ...
youtube.com
Oxidise Your Command Line (2025 Edition)
YouTube video by No Boilerplate
050
colton @colton.boo · 22/05/2025
mpv might just be the best way to watch twitch.tv. mpv.io
010
colton @colton.boo · 17/05/2025
@pycon.us might just be my favorite conference ever. everyone is so nice!
040
colton @colton.boo · 05/05/2025
Whoa, that's neat! 📷
120
Reposted by colton
Simon Späti 🏔️ @ssp.sh · 02/05/2025
I'm writing about #opentableformats. With the newest entries of AWS S3 tables and Cloudflare R2, it's interesting to reassess the market and see where the future with managed Iceberg Tables leads us. What's your take? And anything missing on the evolution below?
Open Table Format Evolution
152
colton @colton.boo · 21/04/2025
It’s surprisingly easy using FastMCP: github.com/jlowin/fastmcp We’ll likely refactor this code not to use subprocess, but you can see our initial implementation here! github.com/dagster-io/d...
120
colton @colton.boo · 09/04/2025
github.com/cmpadden/llm...
github.com
GitHub - cmpadden/llm.nvim: Chatblade integration for Neovim
Chatblade integration for Neovim. Contribute to cmpadden/llm.nvim development by creating an account on GitHub.
010
colton @colton.boo · 09/04/2025
Refactored `chatblade.nvim` to use `llm`, and renamed the project to `llm.nvim`. It's archaic compared these agentic MCP workflows, but it's completely replaced Googling programming related questions.
Screenshot of the https://github.com/cmpadden/llm.nvim repository README.
110
colton @colton.boo · 03/04/2025
The dream! Best of luck.
110
colton @colton.boo · 03/04/2025
I sat down to chat with Chris about "Project Airlift", a way to easily observe Airflow environments directly from Dagster. With a couple of lines of code, you can get a holistic picture into all of your environments, and then optionally migrate them!
020
Reposted by colton
dagster.io @dagster.io · 01/04/2025
🚨 New Course Alert 🚨 We are pleased to announce that the new "Testing with Dagster" course is now live on Dagster University. dagster.io/blog/dagster...
051
colton @colton.boo · 21/03/2025
dlthub.com/docs/dlt-eco...
dlthub.com
REST API source | dlt Docs
Learn how to set up and configure
020
colton @colton.boo · 21/03/2025
Tinkering with dltHub's REST API source to ingest data without having to write any bespoke code, and DuckDB's new local web UI, and I feel so spoiled with how good data tooling is getting!
Screenshot of the DuckDB's local UI and a code example using dltHub's REST source config.
170
Reposted by colton
dagster.io @dagster.io · 13/03/2025
🚀 Want to preview the brand new `dg` cli, and a framework for building and working with YAML DSLs built on top of Dagster called "Components"? You can find a link to demo videos and a GitHub discussion in the thread!
1133
colton @colton.boo · 26/02/2025
Ha, I don't know if I'd recommend my extension to people, it's not very polished. But it's cool that you tried it! My usage of it is often writing a comment with a prompt, selecting it and typing `:Chatblade` or making a selection with additional prompting like `:Chatblade convert these to...`.
120
colton @colton.boo · 26/02/2025
Very nice! Glad to see you had a good experience with it too.
120
colton @colton.boo · 25/02/2025
Joe Naso and I just published an e-book covering the essential topics needed to build a data platform! Check it out if you're looking to learn more about data modeling, ingestion patterns, and common data architectures. dagster.io/how-to-build...
071
colton @colton.boo · 24/02/2025
In this video I'm using tmux with a split of nvim on the left, and claude code on the right. For my day-to-day, I've been using a wrapper for the chatblade cli that I created: github.com/cmpadden/cha... I've been meaning to tinker with avante, but haven't done so yet!
github.com
120
colton @colton.boo · 24/02/2025
Ok, Claude Code, consider me impressed!
120
colton @colton.boo · 13/02/2025
There's definitely a learning curve, but once it clicks it's very nice. Using one of the pre-configured frameworks can get you up and running quite fast: www.lazyvim.org Whereas I've spent 10 years tinkering with dotfiles aimlessly, heh.
lazyvim.org
🚀 Getting Started | LazyVim
LazyVim is a Neovim setup powered by 💤 lazy.nvim
060
Reposted by colton
Matthew Mullins @mmullins.coginiti.co · 13/02/2025
I think this is one of the most important books data people could be reading right now, especially if you need to work language models which need all the semantics they can get.
linkedin.com
Matthew Mullins on LinkedIn: Data modeling is very important for any number of reasons, but much of the…
Data modeling is very important for any number of reasons, but much of the discourse on data modeling focuses on the shape of the date. How easy is it to…
0162
Reposted by colton
Melody Joy Kramer @mkramer.bsky.social · 08/02/2025
Announcing the Data.gov Archive lil.law.harvard.edu/blog/2025/02...
19631225
colton @colton.boo · 08/02/2025
I’m hoping for the same thing!
010
colton @colton.boo · 03/02/2025
Come join us if you’d like to learn more about LLM routing from experts in the field!
000
Reposted by colton
Charlie Marsh @crmarsh.com · 29/01/2025
We’re building a new static type checker for Python, from scratch, in Rust. From a technical perspective, it’s probably our most ambitious project yet. We’re about 800 PRs deep!
35722104
colton @colton.boo · 27/01/2025
The exact same thing happened to me!
110
Reposted by colton
Christian Minich @christianminich.com · 25/01/2025
As someone who works at an open core company similar to Preset / Superset, this post really resonates with my experience. Buying a “hosted version of an open source library” made by that libraries creators has more benefits than “just” the hosting. preset.io/blog/running...
preset.io
Running Apache Superset on the Open Internet: A Report from the Fireline
Running Apache Superset on the open internet requires sophisticated solutions to security and performance challenges. Here we explore how to navigate these challenges while keeping data safe (or opt o...
062
Reposted by colton
🐥pdrm🐣 @pedramnavid.com · 23/01/2025
docs.dagster.io
1224
colton @colton.boo · 23/01/2025
I'm really proud to share that the new Dagster docs are live; what an effort!
0101
colton @colton.boo · 23/01/2025
This is a great resource covering the tools you need as a data engineer!
011
colton @colton.boo · 16/01/2025
Loved this discussion between @barrald.bsky.social from Hex and @pedramnavid.com from Dagster on the data ecosystem, and the impact of AI on the work of data engineers and analysts! www.youtube.com/watch?v=8JxD...
youtube.com
Friends of Data: Pedram Navid, Chief Dashboard Officer at Dagster
YouTube video by Hex
072