iiinova — where your digital self keeps evolving

Reposted by Aleksandar Milicevic

Georg Heiler @geoheil.com · 15/02/2025

I have to say I am proud of my team. All too often Enterprises just consume open software. yesterday, we made our first open contribution as an enterprise. www.linkedin.com/posts/venkat...

031

Aleksandar Milicevic @milicevica23.bsky.social · 06/02/2025

The recording of our talk is there! You can use it for a drinking game „but, um“ and also to learn a bit about how we scale our data platform with the use of dagster and pixi We are happy to hear your feedback and questions. Thanks, @geoheil.com, @prefix.dev youtu.be/Z0M8h0xeHRM

youtu.be

Pixi powering Telekom data cloud – Show & Tell – January 31th, 2025

YouTube video by prefix

092

Aleksandar Milicevic @milicevica23.bsky.social · 22/01/2025

Doing what you enjoy is the best way to do things. We are happy to show what me, @geoheil.com, @mirko-t.bsky.social, and our team have been doing for the last 8 months

010

Aleksandar Milicevic @milicevica23.bsky.social · 17/01/2025

If you use your encryption key for big query the temp result tables are not encrypted if you don't set the default key per project. We found this out after setting the policy

000

Aleksandar Milicevic @milicevica23.bsky.social · 16/01/2025

Trying to grasp what our data governance team did last 6 months 🤯 very hard topics

000

Aleksandar Milicevic @milicevica23.bsky.social · 16/01/2025

If your dbt models run in dbt cloud where are other important jobs running? #databs

110

Reposted by Aleksandar Milicevic

Andy Pavlo @andypavlo.bsky.social · 16/01/2025

Spring 2025 @cmudb.bsky.social Course: OPTIMIZE! A Journey Through Database Query Optimization This is a survey course on how to build a SQL optimizer from scratch covering foundational and state-of-the-art implementations. All lectures available on YouTube: 15799.courses.cs.cmu.edu/spring2025/

15799.courses.cs.cmu.edu

CMU 15-799 :: Special Topics in Databases: Query Optimization (Spring 2025)

This course is a hands-on exploration of the most challenging problem in computer science: database query optimization. It will cover the classical and state-of-the-art methods and algorithms for conv...

17114

Aleksandar Milicevic @milicevica23.bsky.social · 14/01/2025

Huh interesting move, hope more rust inside dbt

020

Reposted by Aleksandar Milicevic

__Alex Monahan__ @a13x.bsky.social · 10/01/2025

Vertically stacking data should be easy and fast! DuckDB's UNION ALL BY NAME capability matches on column names instead of position - as it always should have been!

1132

Aleksandar Milicevic @milicevica23.bsky.social · 09/01/2025

Good thing about my bad english is you know it is not a chatgpt paste

020

Aleksandar Milicevic @milicevica23.bsky.social · 09/01/2025

I dont know about you but i am a bit pissed from people who use chatgpt for interaction with others and think that is not visible. It is just bla bla sentences

010

Aleksandar Milicevic @milicevica23.bsky.social · 09/01/2025

Enterprise needs somebody to blame for failures 🤭

010

Aleksandar Milicevic @milicevica23.bsky.social · 09/01/2025

In enterprise it is very hard to discuss some implementation that is marked experimental.

000

Aleksandar Milicevic @milicevica23.bsky.social · 03/01/2025

What are must have videos papers and blogs around big querie? How to learn about internals and best practice? #dataBS #bigquery

210

Reposted by Aleksandar Milicevic

Andy Pavlo @andypavlo.bsky.social · 01/01/2025

Buckle up because we're banging into the new year with my annual retrospective of the last year in databases! Highlights include license change blowback, Databricks vs. Snowflake gangwar, @duckdb.org's shotgun weddings, and buying a quarterback to impress your lover: www.cs.cmu.edu/~pavlo/blog/...

cs.cmu.edu

Databases in 2024: A Year in Review

Andy rises from the ashes of his dead startup and discusses what happened in 2024 in the database game.

1019963

Aleksandar Milicevic @milicevica23.bsky.social · 31/12/2024

My path: cs degree with reinforcement learning bachelor -> junior data scientist -> data engineering -> data platform engineering

010

Aleksandar Milicevic @milicevica23.bsky.social · 31/12/2024

My work is not about implementing a data use case but enabling others to make it easier

010

Aleksandar Milicevic @milicevica23.bsky.social · 31/12/2024

Is there some duckdb-kafka extension?

110

Reposted by Aleksandar Milicevic

Charlie Marsh @crmarsh.com · 29/12/2024

I love the Fish shell writeup on their Rewrite-it-in-Rust journey. It's really nuanced: there's some good, some bad, some introspection on their own mistakes. But most importantly: they did it! 2604 commits over ~two years of work across > 200 authors. Ship ship ship! fishshell.com/blog/rustport/

fishshell.com

Fish 4.0: The Fish Of Theseus

A smart and user-friendly command line shell

19717

Reposted by Aleksandar Milicevic

David Gasquez @davidgasquez.com · 28/12/2024

Wrote a post about debugging @dagster.io in VSCode / Cursor! If you're like me and use a lot of notebooks to write code, this might be a great alternative that relies on VSCode / Cursor debugger for a smooth development experience with Dagster or similar libraries. davidgasquez.com/debug-dagste...

2214

Aleksandar Milicevic @milicevica23.bsky.social · 26/12/2024

It is not about real time but just running the next step when the input is ready for it

021

Aleksandar Milicevic @milicevica23.bsky.social · 20/12/2024

Yesterday we had one code location today we have five. It is so nice to see our implementation and hard work used and the dagster graph growing

020

Aleksandar Milicevic @milicevica23.bsky.social · 14/12/2024

A self-serving data platform is not just giving access to the last data product but giving a tool and guidance in the hand to do something with this

000

Aleksandar Milicevic @milicevica23.bsky.social · 12/12/2024

There are two different parts to understand when mastering #dagster. 1. Technical implementation: dagster ui, deamons, state db and code location -> helps to develop 2. Difference between task and asset-based orchestrator -> helps to think about how to solve problems with dagster

130

Reposted by Aleksandar Milicevic

Tyler Hillery @tylerhillery.com · 12/12/2024

TIL when you use "from module import function" python still loads the entire module. Saw this in my memory flame graph. I moved some functions with heavy deps to a separate file and it deleted a whole "flame" of memory allocations

3338

Reposted by Aleksandar Milicevic

Ismail @apitrove.bsky.social · 12/12/2024

resume/cv tip: always write in single column. never use double column or something.

011

Aleksandar Milicevic @milicevica23.bsky.social · 10/12/2024

To get to the business value you need to go through technical steps first. Having hard time to explain this

110

Aleksandar Milicevic @milicevica23.bsky.social · 08/12/2024

What are skills of a good data platform enginner?

120

Aleksandar Milicevic @milicevica23.bsky.social · 06/12/2024

Comparing dbt exposures docs.getdbt.com/docs/build/e... and dagster bi tools integration docs.dagster.io/integrations.... It is just a concept and one more reason to build your platform around the orchestrator

docs.getdbt.com

Add Exposures to your DAG | dbt Developer Hub

Exposures make it possible to define and describe a downstream use of your dbt project, such as in a dashboard, application, or data science pipeline. By defining exposures, you can then:

020

Reposted by Aleksandar Milicevic

Andy Pavlo @andypavlo.bsky.social · 03/12/2024

Alexey's @clickhouse.com talk here is hilariously off-the-chain. I highly recommend watching it: www.youtube.com/watch?v=jmVx... You can hear me yelling at him from the audience at 1:09, 2:40, and 7:33.

youtube.com

My Database Can Do This by Alexey Milovidov (DBDBD 2024)

YouTube video by DSDSD - Dutch Seminar on Data Systems Design

1426

Reposted by Aleksandar Milicevic

DuckDB @duckdb.org · 02/12/2024

Fun fact: DuckDB is faster at counting the lines of a CSV file than the UNIX word count command – and it also parses the file to identify its dialect (separator, quote character, etc.). Here are the timings for a 3 GB CSV file: 2.966 seconds for `wc -l` and 1.261 seconds for DuckDB.

613225

Aleksandar Milicevic @milicevica23.bsky.social · 02/12/2024

I would be happy to chat about dagster in prod? Is there somebody who is using Dagster and would like to share their experience?

100

Aleksandar Milicevic @milicevica23.bsky.social · 02/12/2024

Looking into dagster tableau integration. It is very nice when you have a good base concept for tool integration. Everything is going around the translator and asset definition.

030

Aleksandar Milicevic @milicevica23.bsky.social · 27/11/2024

Just one tool doesn't make business value and not everyone can be an expert in everything

000

Aleksandar Milicevic @milicevica23.bsky.social · 27/11/2024

When you speak with dbt vendor or gcp cloud they speak just about their products, when you speak with dagster people they speak about integration with other tools

010

Aleksandar Milicevic @milicevica23.bsky.social · 26/11/2024

Can i have a feed on bsky to show me content from people just from one starter pack?

200

Aleksandar Milicevic @milicevica23.bsky.social · 26/11/2024

I like when a starter pack is more specific around a tool or concept because if you are interested too then you get fast access to the right people providing content for it

010

Aleksandar Milicevic @milicevica23.bsky.social · 26/11/2024

The problem in the enterprise is not big data but data engineering assessment and strategic data importance over the operational systems

010

Reposted by Aleksandar Milicevic

Simon Späti 🏔️ @ssp.sh · 21/11/2024

Dagster's new layout with clear layers of abstractions, integrating stateful assets while running on any compute (processing layer) looks really cool. Great talks by @schrockn.bsky.social, as always. Recommend to re-listen on youtu.be/rB2nNEEIRBE?....

Control player, and it's layers for integration.

2172

Aleksandar Milicevic @milicevica23.bsky.social · 20/11/2024

I am so grateful to have an opportunity to work with dugster full-time and build our platform around Dagster. I am happy about the future youtu.be/rB2nNEEIRBE?...

youtu.be

Data Platform Week - Day 1 Keynote

YouTube video by Dagster

110

Aleksandar Milicevic @milicevica23.bsky.social · 20/11/2024

What enterprise company do you know that has a good data platform?

600