colton @colton.boo · 09/07/2026It was great to join @christianminich.com in this webinar. He shared a lot of great insights in how he's using AI for data engineering. 021
Reposted by coltonSimon Späti 🏔️ @ssp.sh · 19/05/2026I wrote an Almanack like Charlie Munger and Naval Ravikant did, but about life wisdom and my time of using Dagster for data orchestration over the years. Since using it in 2018, the story has gone from complexity to composability and from orchestrating to a full data platform. 172
colton @colton.boo · 09/04/2026github.com/dagster-io/d...github.comRelease 1.13.0 (core) / 0.29.0 (libraries) · dagster-io/dagsterMajor Changes Since 1.12.0 AI-assisted development: Released dagster-io/skills, a collection of Dagster-focused AI skills for coding agents like Claude Code, OpenAI Codex, and others. Expanded dg ... 030
colton @colton.boo · 09/04/2026We just released version 1.13.0 of @dagster.io with lots of great features like official Dagster skills for, virtualized assets for modeling entities like views, partitioned asset checks, and more. Check out the blog post for more details. 181
colton @colton.boo · 10/02/2026Learn how we built a light weight evaluation framework for the official Dagster skills. With short feedback loops and quantitative measurements, we were able to make quick improvements that improving decision routing and context management. dagster.io/blog/evaluat...dagster.ioMeasuring the effectiveness of the Dagster SkillsLearned how we built a light weight evaluation framework for quantiatively measuring the effectiveness of the Dagster Skills 020
colton @colton.boo · 09/01/2026If you're a Python developer using Claude Code, or something similar, we just published a blog that covers 10 rules we add to our prompt for drastically improved code gen. And we include the full prompt at the end of the post! dagster.io/blog/dignifi... 042
Reposted by coltonAll Things Open @allthingsopen.bsky.social · 16/12/2025🚀 NEW on We ❤️ Open Source 🚀 How can a small team answer 16,000+ community Qs/month? Colton Padden (@colton.boo) reveals Dagster’s smart AI-powered doc strategy—built for humans and LLMs. allthingsopen.org/articles/sca... #WeLoveOpenSource #OpenSource #AI #TechDocs #Dagster #CommunitySupport 031
colton @colton.boo · 16/12/2025allthingsopen.org/articles/sca...allthingsopen.orgScaling documentation without scaling your team: Dagster's AI-powered strategy | We Love Open Source • All Things OpenLearn how Dagster's small team scaled community education by restructuring docs around the software development lifecycle, using AI tools, and building a custom assistant that answers over 16,000 ques... 020
colton @colton.boo · 16/12/2025We've been improving how we create educational content at @dagster.io: optimizing feedback loops, generating content for different learning styles, and leveraging LLM-powered workflows. You can find our lessons learned on the @allthingsopen.bsky.social "We Love Open Source" blog! 161
Reposted by coltonChristian Minich @christianminich.com · 07/11/2025“Flexibility without fragmentation” In addition to some solid alteration, it’s also a great explanation of how to build a data team and how your system can and should scale. @colton.boo and Dennis Hume have an awesome new ebook on this topic, check it out! #dataBS dagster.io/how-to-scale...dagster.ioHow to Scale Data Teams | Free eBook from DagsterDownload Dagster's free eBook to learn how to build systems that scale with clarity, reliability, and confidence. 141
colton @colton.boo · 12/10/20252025.allthingsopen.org/sessions/ena... #AllThingsOpen2025.allthingsopen.orgEnabling Community Education With a Little Help From AI • All Things Open 2025Dagster is a sophisticated tool and platform for building data pipelines, and community members heavily rely on our documentation and educational content to make use of all of its features. In this se... 000
colton @colton.boo · 12/10/2025Excited to be at All Things Open tomorrow! Come hang out at the @dagster.io booth, or see my talk “Enabling education with a little help from AI” at 1:45 EST on Tuesday! 151
Reposted by coltonChristian Minich @christianminich.com · 28/07/2025Read this post you work in data analytics. A similar mindset problem pervades sales engineering as well, especially in the demo / early stages of discovery. Understand your prospect’s context. Who are they? What do they care about? What value can you provide them? That’s what you show. 1112
colton @colton.boo · 17/06/2025MotherDuck is live now! DuckLake & The Future of Open Table Formats ft. Jordan Tigani & Hannes Mühleisen www.youtube.com/live/yn07s-_...youtube.comDuckLake & The Future of Open Table Formats ft. Jordan Tigani & Hannes MühleisenYouTube video by MotherDuck 050
colton @colton.boo · 23/05/2025New Oxidise Your Command Line just dropped. Some that stand out to me are: xh, fselect, and presenterm! www.youtube.com/watch?v=rWMQ...youtube.comOxidise Your Command Line (2025 Edition)YouTube video by No Boilerplate 050
colton @colton.boo · 17/05/2025@pycon.us might just be my favorite conference ever. everyone is so nice! 040
Reposted by coltonSimon Späti 🏔️ @ssp.sh · 02/05/2025I'm writing about #opentableformats. With the newest entries of AWS S3 tables and Cloudflare R2, it's interesting to reassess the market and see where the future with managed Iceberg Tables leads us. What's your take? And anything missing on the evolution below? 152
colton @colton.boo · 21/04/2025It’s surprisingly easy using FastMCP: github.com/jlowin/fastmcp We’ll likely refactor this code not to use subprocess, but you can see our initial implementation here! github.com/dagster-io/d... 120
colton @colton.boo · 09/04/2025github.com/cmpadden/llm...github.comGitHub - cmpadden/llm.nvim: Chatblade integration for NeovimChatblade integration for Neovim. Contribute to cmpadden/llm.nvim development by creating an account on GitHub. 010
colton @colton.boo · 09/04/2025Refactored `chatblade.nvim` to use `llm`, and renamed the project to `llm.nvim`. It's archaic compared these agentic MCP workflows, but it's completely replaced Googling programming related questions. 110
colton @colton.boo · 03/04/2025I sat down to chat with Chris about "Project Airlift", a way to easily observe Airflow environments directly from Dagster. With a couple of lines of code, you can get a holistic picture into all of your environments, and then optionally migrate them! 020
Reposted by coltondagster.io @dagster.io · 01/04/2025🚨 New Course Alert 🚨 We are pleased to announce that the new "Testing with Dagster" course is now live on Dagster University. dagster.io/blog/dagster... 051
colton @colton.boo · 21/03/2025dlthub.com/docs/dlt-eco...dlthub.comREST API source | dlt DocsLearn how to set up and configure 020
colton @colton.boo · 21/03/2025Tinkering with dltHub's REST API source to ingest data without having to write any bespoke code, and DuckDB's new local web UI, and I feel so spoiled with how good data tooling is getting! 170
Reposted by coltondagster.io @dagster.io · 13/03/2025🚀 Want to preview the brand new `dg` cli, and a framework for building and working with YAML DSLs built on top of Dagster called "Components"? You can find a link to demo videos and a GitHub discussion in the thread! 1133
colton @colton.boo · 26/02/2025Ha, I don't know if I'd recommend my extension to people, it's not very polished. But it's cool that you tried it! My usage of it is often writing a comment with a prompt, selecting it and typing `:Chatblade` or making a selection with additional prompting like `:Chatblade convert these to...`. 120
colton @colton.boo · 25/02/2025Joe Naso and I just published an e-book covering the essential topics needed to build a data platform! Check it out if you're looking to learn more about data modeling, ingestion patterns, and common data architectures. dagster.io/how-to-build... 071
colton @colton.boo · 24/02/2025In this video I'm using tmux with a split of nvim on the left, and claude code on the right. For my day-to-day, I've been using a wrapper for the chatblade cli that I created: github.com/cmpadden/cha... I've been meaning to tinker with avante, but haven't done so yet!github.com 120
colton @colton.boo · 13/02/2025There's definitely a learning curve, but once it clicks it's very nice. Using one of the pre-configured frameworks can get you up and running quite fast: www.lazyvim.org Whereas I've spent 10 years tinkering with dotfiles aimlessly, heh.lazyvim.org🚀 Getting Started | LazyVimLazyVim is a Neovim setup powered by 💤 lazy.nvim 060
Reposted by coltonMatthew Mullins @mmullins.coginiti.co · 13/02/2025I think this is one of the most important books data people could be reading right now, especially if you need to work language models which need all the semantics they can get.linkedin.comMatthew Mullins on LinkedIn: Data modeling is very important for any number of reasons, but much of the…Data modeling is very important for any number of reasons, but much of the discourse on data modeling focuses on the shape of the date. How easy is it to… 0162
Reposted by coltonMelody Joy Kramer @mkramer.bsky.social · 08/02/2025Announcing the Data.gov Archive lil.law.harvard.edu/blog/2025/02... 19631225
colton @colton.boo · 03/02/2025Come join us if you’d like to learn more about LLM routing from experts in the field! 000
Reposted by coltonCharlie Marsh @crmarsh.com · 29/01/2025We’re building a new static type checker for Python, from scratch, in Rust. From a technical perspective, it’s probably our most ambitious project yet. We’re about 800 PRs deep! 35722104
Reposted by coltonChristian Minich @christianminich.com · 25/01/2025As someone who works at an open core company similar to Preset / Superset, this post really resonates with my experience. Buying a “hosted version of an open source library” made by that libraries creators has more benefits than “just” the hosting. preset.io/blog/running...preset.ioRunning Apache Superset on the Open Internet: A Report from the FirelineRunning Apache Superset on the open internet requires sophisticated solutions to security and performance challenges. Here we explore how to navigate these challenges while keeping data safe (or opt o... 062
colton @colton.boo · 23/01/2025I'm really proud to share that the new Dagster docs are live; what an effort! 0101
colton @colton.boo · 23/01/2025This is a great resource covering the tools you need as a data engineer! 011
colton @colton.boo · 16/01/2025Loved this discussion between @barrald.bsky.social from Hex and @pedramnavid.com from Dagster on the data ecosystem, and the impact of AI on the work of data engineers and analysts! www.youtube.com/watch?v=8JxD...youtube.comFriends of Data: Pedram Navid, Chief Dashboard Officer at DagsterYouTube video by Hex 072