iiinova — where your digital self keeps evolving

dagster.io @dagster.io · 09/07/2026

If you missed today's webinar where Christian Minich dives deep on how he leverages AI when building projects for prospective Dagster users, then you can find the recording here! www.youtube.com/watch?v=_o7d...

020

Reposted by @dagster.io

Simon Späti 🏔️ @ssp.sh · 19/05/2026

I wrote an Almanack like Charlie Munger and Naval Ravikant did, but about life wisdom and my time of using Dagster for data orchestration over the years. Since using it in 2018, the story has gone from complexity to composability and from orchestrating to a full data platform.

The Dagster Almanack highlights data orchestration, composability, and governance with icons and structured layout.

172

Reposted by @dagster.io

colton @colton.boo · 09/01/2026

If you're a Python developer using Claude Code, or something similar, we just published a blog that covers 10 rules we add to our prompt for drastically improved code gen. And we include the full prompt at the end of the post! dagster.io/blog/dignifi...

042

Reposted by @dagster.io

colton @colton.boo · 16/12/2025

We've been improving how we create educational content at @dagster.io: optimizing feedback loops, generating content for different learning styles, and leveraging LLM-powered workflows. You can find our lessons learned on the @allthingsopen.bsky.social "We Love Open Source" blog!

161

dagster.io @dagster.io · 28/07/2025

Otto's data teams were stuck. Some drowning in endless Argo YAML configurations, others testing directly in production. When your data platform fights against good practices, your teams waste time on operational overhead instead of building value. dagster.io/blog/otto-ca...

051

dagster.io @dagster.io · 01/07/2025

Stop rebuilding data pipelines from scratch every time. We're doing a technical deep dive with our friends at dlthub team to show you exactly how this works in practice. Perfect for data engineers tired of reinventing the wheel on every project. dagster.io/events/devel...

010

dagster.io @dagster.io · 26/06/2025

The best data tools are built by practitioners, for practitioners. That's why we're excited to team up with our friends over at dlthub for a deep dive on July 8th (11 AM ET). We'll focus on patterns you can actually use, not just admire. Register today! dagster.io/events/devel...

010

dagster.io @dagster.io · 17/06/2025

🚨 Deep Dive Alert 🚨 Orchestrating bioinformatics workflows is where traditional pipeline tools go to die. Keith Kam from Basecamp Research learned this while building BaseData™ – managing complex genomic pipelines that power bio AI models. Register today! lp.dagster.io/basecamp-res...

010

dagster.io @dagster.io · 16/06/2025

Connect 211 faced a classic data engineering challenge: building a platform to standardize health and human services data from hundreds of legacy systems. Their team was struggling with Airflow's fragmented visibility across their pipelines. Check out their case study! dagster.io/blog/connect...

020

dagster.io @dagster.io · 23/05/2025

Hear from our Community! Bolin recently worked with us to complete a case study about Stashaway's success since implementing Dagster. Read the full story today! Link in the thread. dagster.io/blog/stashaw...

020

dagster.io @dagster.io · 11/04/2025

Hear from our Community! As Martin explains to his C-suite, this flexibility enables his team to meet their organizational needs without being constrained by the platform. Additionally, Dagster's data observability features have helped his team catch and resolve issues. Thanks Martin!

020

dagster.io @dagster.io · 08/04/2025

On April 15th, Our Founder and CTO Nick Schrock will be hosting a live webinar where he will explain the vision behind components and How Dagster is building the future of data platform engineering. Register today! lp.dagster.io/components

020

dagster.io @dagster.io · 07/04/2025

Dagster University Update 🎓 In an effort to make Dagster University more accessible, we have added support for GitHub Codespaces! Now, you can learn Dagster without having to worry about some of the frustrations that come with local Python development. courses.dagster.io

010

dagster.io @dagster.io · 04/04/2025

Hear from our Community! Steven Ayers is a Principal Engineer at Ayersio Services Limited and has been a Dagster fan for quite some time. With Dagster's asset-centric approach, how you think and talk about your data is aligned to how you build with it.

010

dagster.io @dagster.io · 03/04/2025

Dagster's project Airlift makes it easy to observe and migrate Apache Airflow pipelines to Dagster, bringing a ton of value! youtube.com/shorts/9UF64...

121

dagster.io @dagster.io · 02/04/2025

In case you missed our Deep Dive with Lee Littlejohn from US Foods Yesterday the full recording is now live on Youtube. youtu.be/hoVvlgUYkM8

000

dagster.io @dagster.io · 01/04/2025

🚨 New Course Alert 🚨 We are pleased to announce that the new "Testing with Dagster" course is now live on Dagster University. dagster.io/blog/dagster...

051

dagster.io @dagster.io · 31/03/2025

Hear from our Community! Ismael Rodrigues is a Lead Data Engineer at C&A Modas and has been a Dagster fan for quite some time. Dagster was built with modern data work in mind; that's why we make it easy to bring whatever data process you need into the framework. Thanks Ismeal!

000

dagster.io @dagster.io · 27/03/2025

We understand that your data platform is highly contextual, and you need a tool to accommodate this. Components provide a low-code YAML interface for your users, backed by tools that support software engineering best practices and give platform teams complete control. lp.dagster.io/components

021

dagster.io @dagster.io · 27/03/2025

Hear from our Community! Emil Sundman is a Data Engineer at Bizware and an experienced data professional across the entire data stack. Thanks Emil!

011

dagster.io @dagster.io · 26/03/2025

We're pleased to announce that Dagster has officially earned Snowflake Technology Industry Competency status. This milestone validates our position as a critical component in modern data ecosystems!

031

dagster.io @dagster.io · 24/03/2025

Shivanshu Gupta is a Data Engineer at Chainalysis, where they run Dagster to orchestrate and maintain complex data pipelines. 🔍 In today's data landscape, engineers like Shivanshu need tools that reduce cognitive load while handling increasingly complex pipelines.

051

dagster.io @dagster.io · 19/03/2025

The Dagster community is full of powerful data professionals who are building data platforms that fuel the modern world. Lee will join us for a Deep Dive on April 1st. Register to learn how to replicate his success in your organization. lp.dagster.io/deep-dive-us...

020

dagster.io @dagster.io · 14/03/2025

Join us on April 1st for a deep dive into how Lee Littlejohn built a data platform at US Foods with Dagster! Lee applies kitchen principles to data: minimizing action, reusing components, and creating a single source of truth. lp.dagster.io/deep-dive-us...

031

dagster.io @dagster.io · 13/03/2025

🚀 Want to preview the brand new `dg` cli, and a framework for building and working with YAML DSLs built on top of Dagster called "Components"? You can find a link to demo videos and a GitHub discussion in the thread!

1133

Reposted by @dagster.io

colton @colton.boo · 25/02/2025

Joe Naso and I just published an e-book covering the essential topics needed to build a data platform! Check it out if you're looking to learn more about data modeling, ingestion patterns, and common data architectures. dagster.io/how-to-build...

071

dagster.io @dagster.io · 25/02/2025

📚 NEW EBOOK: Data Platform Fundamentals While every organization's technical stack may differ, the underlying patterns and principles for success remain consistent. Download the ebook today! dagster.io/how-to-build...

063

dagster.io @dagster.io · 25/02/2025

🔍 NEW BLOG: From Prototype to Production - Building AI Products That Scale with Dagster The AI revolution isn't just about models—it's about engineering practices that make AI reliable in production. Read the full post on building AI applications that scale today! buff.ly/3QwvtcL

050

dagster.io @dagster.io · 14/02/2025

Our Chief Dashboard Dashboard officer goes into the unkept promise of the modern data stack and how we are addressing these issues and making it easier than ever to build and manage a data platform where you aren't drowning in reactive work. buff.ly/3Ezuo1m

040

dagster.io @dagster.io · 11/02/2025

Community Spotlight! 🌟 Jurgita Motus shares a practical guide on combining these tools, complete with code examples and real implementation insights from their experience. See how they orchestrate quality checks at scale. buff.ly/4aS5Kow

030

dagster.io @dagster.io · 10/02/2025

Tomorrow's the day! Don't miss our in-depth AI Development Deep Dive happening February 11 at 9 a.m. PT with the Not Diamond Team. If you're looking to optimize your AI costs while boosting accuracy, this is your chance to learn directly from the experts. buff.ly/3EjhlAK

020

dagster.io @dagster.io · 04/02/2025

We're proud to announce that Dagster has achieved Snowflake Ready Technology Partner status, validating our integration through comprehensive third-party testing. This certification demonstrates our commitment to delivering enterprise-grade performance, reliability, and security.

140

dagster.io @dagster.io · 03/02/2025

Are you ready to get into the weeds on AI development best practices to reduce costs and improve accuracy? Join us on a Deep Dive on February 11 at 9 a.m. PT with the Not Diamond Team. buff.ly/3EjhlAK

010

dagster.io @dagster.io · 23/01/2025

The new Dagster docs experience is here, complete with dark mode! This makes it easier than ever to get started with Dagster. Our focus was on creating a more user-friendly docs structure to ensure that all of the information you need is available within just a few clicks buff.ly/4awa90j

071

dagster.io @dagster.io · 21/01/2025

Watch our Developer Advocate, Alex Noonan, build a RAG system from scratch using Dagster. Our abstractions handle the complex parts of working with LLMs, so you can focus on building production-grade applications that deliver real value. buff.ly/3DZNu0i

060

dagster.io @dagster.io · 16/01/2025

In case you missed our deep dive into "Shifting Left and Moving Forward with MotherDuck," the recording is now live on YouTube! buff.ly/4hfq5Gd

010

dagster.io @dagster.io · 13/01/2025

Join us tomorrow where @alexnoonan.bsky.social, @matsonj.com, and @colton.boo will discuss: 🦆 Building an end-to-end data platform ingesting Bluesky data into MotherDuck, and PowerBI 👈 Shifting Left in Data Engineering 🧠 And AI-powered Data Engineering best practices lp.dagster.io/deep-dive-sh...

lp.dagster.io

Dagster Deep Dive - January 14

Join this deep dive on Tuesday, January 14th, for a discussion on modern data engineering workflows and best practices.

193

dagster.io @dagster.io · 08/01/2025

Community Spotlight! Georg Heiler shared a powerful template that brings together some of the best open-source tools in data engineering: DuckDB, Dagster, dbt, and Rust-based tooling for ensuring code quality and Pixi for dependency management. buff.ly/4feldk6

151

Reposted by @dagster.io

colton @colton.boo · 07/01/2025

Did you know Dagster asset checks can directly access data from an asset using the built-in I/O manager. Here's a quick snippet showing how it's done!

Snippet of Dagster code showing how to create an asset_check that validates a Pandas dataframe using the built-in I/O manager.

072

dagster.io @dagster.io · 19/12/2024

Houston Data Practitioners Meetup on December 20th! Join us from 8:30 to 9:30 AM at The Ion, where we'll be diving into all things data engineering. buff.ly/3P1WsMD

020

dagster.io @dagster.io · 12/12/2024

Check out this guide from Gianfranco Demarco on setting up interactive debugging with Dagster in Docker! - Debug your assets directly in containerized environments - Bridge the gap between development and deployment - Step through both your code AND Dagster's internals buff.ly/4g3rjnU

021

dagster.io @dagster.io · 11/12/2024

🚀 Ready to transform your data team from firefighters to innovators? Join us on December 19th with Edson Nogueria, who will reveal how Artefact built a modern, proactive data platform using Dagster, dbt, and dlt. buff.ly/4guDdao.

030

dagster.io @dagster.io · 11/12/2024

Integrations with Looker, Power BI, Tableau, and Sigma are now live! With Dagster, you can have full end-to-end lineage and control of your data platform. Broken dashboards and stale data are a major pain point for data teams and a source of reactive work. buff.ly/4fwEEo3

031

dagster.io @dagster.io · 11/12/2024

Community Spotlight! Edson Noreiga shares a practical solution for managing concurrency limits at the asset level in Dagster, addressing a common challenge data engineers face. Read the full post here! buff.ly/3CTE3Pe

011

dagster.io @dagster.io · 21/11/2024

Data Engineering doesn't have to be a drag Join us at AWS re:Invent to discover how Dagster is revolutionizing data engineering. Stop wrestling with complex pipelines and start building robust, scalable data platforms.

020

dagster.io @dagster.io · 19/11/2024

Enchanted to share how Servco revolutionized its data infrastructure. The team, led by Tausif Islam and Sam Ikemoto, tackled a common enterprise challenge: moving from siloed, on-premise systems to a modern cloud-native platform. buff.ly/3OecYst

020

dagster.io @dagster.io · 18/11/2024

Data Platform Week starts today! Tune in to learn more about what we believe is important in building data platforms, and how new Dagster features support it!

171

dagster.io @dagster.io · 14/11/2024

To foster growth and collaboration within the Dagster ecosystem, we created a specialized repository for users to share their custom integrations without managing their packages' build or release process. We currently have packages for Hex, Hightouch, Modal, and Not-Diamond in this repository.

181