iiinova — where your digital self keeps evolving

Reposted by Mike Driscoll

Simon Späti 🏔️ @ssp.sh · 17/10/2025

In data analytics, we're facing a paradox. AI agents can theoretically analyze anything, but without the right foundations, they're as likely to hallucinate a metric as to calculate it correctly. They can write SQL in seconds, but will it answer the right business question?

ssp.sh

Data Modeling for the Agentic Era: Semantics, Speed, and Stewardship

Master the three pillars of agentic data modeling: Metrics SQL for semantics, sub-second analytics for speed, and AI guardrails for trusted insights.

144

Mike Driscoll @medriscoll.com · 27/05/2025

DuckLake is a simpler, SQL-friendlier alternative to Iceberg. “There are no Avro or JSON files. There is no additional catalog server or additional API to integrate with. It’s all just SQL.“ That said, choose your catalog database — a single-point of failure — *very carefully*.

0111

Reposted by Mike Driscoll

MotherDuck @motherduck.com · 13/05/2025

Quack... Quack... and code! @mehdio.com and @medriscoll.com from @rilldata.com are diving into how GenAI is reshaping BI-as-code — from idea to implementation. This one’s for data folks who want to see beyond the hype. Register : lu.ma/w4ncmttn

lu.ma

BI-as-Code with GenAI+DuckDB Real Use, Not Just Hype · Luma

Mehdi and Michael dive into how GenAI is reshaping BI-as-code. And as always — it’s not just talk, it’s real code. Get ready for pragmatic insights and…

044

Mike Driscoll @medriscoll.com · 16/04/2025

Yo SF Bay Area #databs crew, want to talk lakehouses at a real Lake House? :) Next week after Data Council, join the founders of @clickhouse.com, @motherduck.com, @startreedata.bsky.social, and @tobikodata.com to talk real-time databases and next-generation ETL. www.rilldata.com/events/data-...

193

Mike Driscoll @medriscoll.com · 11/04/2025

"Shifting left" is the new trend among in data stacks -- but what does it mean and what does it matter?

251

Mike Driscoll @medriscoll.com · 04/04/2025

Apache Pinot is one of the world’s fastest and most scalable real-time analytical databases, relied on by LinkedIn, Uber, and Stripe. It was awesome diving into the secrets behind its unique architecture with creator and @startreedata.bsky.social founder Kishore Gopalakrishna.

0101

Mike Driscoll @medriscoll.com · 14/03/2025

Like others, I jumped on the bandwagon to ridicule the DOGE analyst who "overheated her hard drive" by analyzing just 60k rows of data. I was wrong. The truth is even dumber. 🧵

382

Reposted by Mike Driscoll

Simon Späti 🏔️ @ssp.sh · 11/03/2025

Just published: Ever had to «Scale beyond Postgres»? You may have started with a simple ETL pipeline and crunched critical business logic into useful dashboards, but speed and scale didn't grow with data at some point, and it's the concurrent user. ✨ Below are some highlights from the article.

rilldata.com

Rill | Scaling Beyond Postgres: How to Choose a Real-Time Analytical Database

This blog explores how real-time databases address critical analytical requirements. We highlight the differences between cloud data warehouses like Snowflake and BigQuery, legacy OLAP databases like ...

143

Reposted by Mike Driscoll

Julian Hyde @julianhyde.bsky.social · 03/03/2025

The father of relational databases understood semantic data models.

This activity is sometimes called semantic data modeling. Actually, the task of capturing the meaning of data is a never-ending one. So the label “semantic” must not be interpreted in any absolute sense. – E.F. Codd, 1979

1151

Reposted by Mike Driscoll

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 28/02/2025

Blogged: Exploring UK Environment Agency data with @duckdb.org and @rilldata.com rmoff.net/2025/02/28/e... #dataBS

0207

Mike Driscoll @medriscoll.com · 31/01/2025

DuckCon #6 is now live from Amsterdam (link below!) In about 20 minutes I'll be sharing some work we've been doing at @rilldata.com on metrics-layer-powered dashboards. And speculating in my last slide, because why not, about what you would name an AI agent that runs on DuckDB... 🦆

172

Mike Driscoll @medriscoll.com · 29/01/2025

“Pivot tables are just a shorter, fatter GROUP BY”. ❤️ this by @gregat.es

161

Reposted by Mike Driscoll

DuckDB @duckdb.org · 24/01/2025

DuckCon #6 will start in 168 hours (January 31, 15:00)! If you plan to attend in-person, please register at duckdb.org/2025/01/31/d... The stream will be available without registration.

0227

Mike Driscoll @medriscoll.com · 23/01/2025

#databs welcomes the creator of Pandas, founder of Datapad & Voltron, and all around nice guy Wes McKinney @wesmckinney.com to BlueSky.

0263

Mike Driscoll @medriscoll.com · 16/01/2025

I'm collaborating with @ssp.sh on a brief history of pivot tables. We'll be tracing their lineage and evolution across Visicalc, Lotus, Excel, PowerPivot, Qlik, and PowerBI. Any sites, videos, products (dead or alive) that you would recommend we should mention or dig into?

6221

Mike Driscoll @medriscoll.com · 16/01/2025

Real-time user experiences make applications magical. Google, WhatsApp, and ChatGPT would all fail if you added just 10 seconds to every search, message, or prompt interaction. We are surrounded by fast user experiences and yet most of us tolerate business dashboards that take minutes to load.

081

Reposted by Mike Driscoll

Burak @buremba.bsky.social · 15/12/2024

It took 5 minutes to create this dashboard with @rilldata.com's AI auto-generate features. Impressive @medriscoll.com!

0133

Reposted by Mike Driscoll

Chris @chris.blue · 12/12/2024

👋 @davistreybig.bsky.social Welcome! All, Davis is a VC at innovationendeavors.com and someone that shares my vision around object storage. We also co-invested in responsive.dev together! 😁 Here's one of his posts. You should follow him.

medium.com

S3 as the universal infrastructure backend

Why BLOB stores are becoming the default storage layer for cloud services

0181

Mike Driscoll @medriscoll.com · 09/12/2024

I’ve often said working in data engineering is like working in the post office. Queues get backed up, deliveries are lost, yet the stream never stops. It’s a thankless, mostly invisible job until something goes wrong, & then it’s complaints. I hoped the analogies stopped there, but sadly maybe not.

0151

Reposted by Mike Driscoll

Simon Späti 🏔️ @ssp.sh · 06/12/2024

I had the pleasure of talking with @medriscoll.com on his podcast. I love this long-form discussion, especially on a snowy day like this :) Talked about: > My journey (DE ↠ Author) > Bluesky🦋, DuckDB, S3, data modeling & declarative stacks > What do you call data people? 🎙️ youtu.be/xW_HGb46xMk

1263

Mike Driscoll @medriscoll.com · 06/12/2024

Snowflake’s pricing is a riddle wrapped in a mystery inside an enigma.

140

Mike Driscoll @medriscoll.com · 05/12/2024

Nice review of the latest CSV parsing & querying capabilities of @duckdb.org. Parquet is obviously better than CSV because of its stronger types, efficient compression, and support for predicate pushdown. But given CSV is *everywhere*, these improvements are welcome. duckdb.org/2024/12/05/c...

duckdb.org

CSV Files: Dethroning Parquet as the Ultimate Storage File Format — or Not?

Data analytics primarily uses two types of storage format files: human-readable text files like CSV and performance-driven binary files like Parquet. This blog post compares these two formats in an ul...

0162

Mike Driscoll @medriscoll.com · 05/12/2024

@sfchronicle.com maybe you could find it in your heart to remove the paywall on the TSUNAMI EVACUATION MAP? www.sfchronicle.com/bayarea/arti...

3203

Mike Driscoll @medriscoll.com · 05/12/2024

OK if this stochastic parrot's answer is to be trusted, I'll be bracing for the tsunami's impact around 12:15-12:30pm.

111

Mike Driscoll @medriscoll.com · 04/12/2024

Amazon S3 continues to unleash waves of disruption for data infrastructure. S3 Tables, their managed Iceberg offering, is the latest. What began as commoditization of storage now moves up the stack to swallow cloud warehouses whole. With S3 Tables, what sane person would do ELT in Snowflake?

2121

Mike Driscoll @medriscoll.com · 04/12/2024

In 2003, Jeff Bezos banned Powerpoint from Amazon meetings, insisting managers craft memos, not fancy bullet points. Today, too many dashboards are Powerpoint decks but for data: overly styled visuals better conveyed by a table of metrics. (Ironically, QuickSight dashboards are among the worst).

8242

Reposted by Mike Driscoll

Andy Pavlo @andypavlo.bsky.social · 02/12/2024

The video for my "What Goes Around Comes Around... And Around" talk at CWI is now available: www.youtube.com/watch?v=8Woy... 📊Slides: www.cs.cmu.edu/~pavlo/slide... 📄Paper: db.cs.cmu.edu/papers/2024/...

youtube.com

What Goes Around Comes Around... And Around... - Andy Pavlo (Dijkstra Award 2024)

YouTube video by DSDSD - Dutch Seminar on Data Systems Design

04510

Reposted by Mike Driscoll

Julian Hyde @julianhyde.bsky.social · 20/11/2024

As an engineer, if I've built something once, the chance to do it again is a gift. That's my theory for 🦋 (and the AT protocol) is succeeding technically. In an existing company, rewrites rarely happen - long-term benefit cannot outweigh short-term cost.

2142

Reposted by Mike Driscoll

archie.md @archie.sarrewood.com · 20/11/2024

reposting for the 1M people who joined in the last 24 hrs @duckdb.org ecosystem people go.bsky.app/8jPCfvb

95610

Mike Driscoll @medriscoll.com · 20/11/2024

ICYMI I recently interviewed the creator of @clickhouse.com, Alexey Milovidov. We dove deep into what ClickHouse is so fast, why AI companies love it (hint: its had a vector data type since 2012), rewriting Zookeeper (yikes), and how math informs database design. www.rilldata.com/blog/rill-cl...

rilldata.com

Rill | Data Talks on the Rocks 4 - Alexey Milovidov, ClickHouse

A video interview with Alexey Milovidov, co-founder and CTO of ClickHouse, that dives deep into AI, ClickHouse’s architecture, different database categories, and pain points in the market that ClickHo...

0208

Mike Driscoll @medriscoll.com · 20/11/2024

Evolution of the data stack, 2012-present.

3310

Mike Driscoll @medriscoll.com · 19/11/2024

👋 Welcome real-time database @clickhouse.com to the BlueSky atmosphere.👋 I'm hopeful ClickHouse creator & co-founder Alexey might show up here too. (And selfishly, having the BlueSky Jetstream hosted on a ClickHouse cluster would save me hours of Parquet parsing & JSON spelunking). #databs

2381

Mike Driscoll @medriscoll.com · 18/11/2024

OK @jakthom.bsky.social I'll push this first version of the dashboard up the cloud in a few minutes... it's running locally against just one hour of data (about 8 million records), but would be interesting to run against the full enchilada of data to see some real trends.

180

Mike Driscoll @medriscoll.com · 15/11/2024

cut -d',' -f2,4 data.csv | tail -n +2 | sort | uniq

4220

Mike Driscoll @medriscoll.com · 14/11/2024

Reddit advice Q: how have you engaged in the subreddit data communities? I've started posting a bit over there, but it feels like: * mods are skeptical of newcomers * comment trolls are more common Though I may just suck at Reddit 🤷‍♂️. #databs (er #datareddit)

1171

Mike Driscoll @medriscoll.com · 14/11/2024

Welcome to #dataBS the creator of Apache Calcite & Mondrian, architect @ Looker, mentor to many @ ASF, and wizard of SQL: @julianhyde.bsky.social One of Julian’s most popular recent initiatives is bringing the metrics layer to SQL: hydromatic.net/hyde2024meas...

hydromatic.net

1276

Mike Driscoll @medriscoll.com · 12/11/2024

"I actually don't have a computer at home anymore, which I can recommend to all the computer people out there." - DuckDB co-creator @hannes.muehleisen.org. * * Source: www.rilldata.com/blog/data-ta...

0112

Reposted by Mike Driscoll

Simon Späti 🏔️ @ssp.sh · 12/11/2024

I often saw the question of whether @duckdb.org runs in production and what the use case would be. With the help of many of you, I explored this over the last few weeks and prepared an extensive guide highlighting real-world DuckDB use cases, categorized into the five categories identified in Part 1

motherduck.com

15+ Companies Using DuckDB in Production: A Comprehensive Guide - MotherDuck Blog

Discover how companies are running DuckDB in production | Reading time: 24 min read

2469

Mike Driscoll @medriscoll.com · 12/11/2024

Imagine having no job and yet having: • two chauffeurs • a private chef • a daily housekeeper Yes, it's a good life for my 8-year daughter.

1160

Mike Driscoll @medriscoll.com · 11/11/2024

Strolling by my favorite cafe + urban garden in San Francisco, Stable Cafe. It’s a physical reminder that spaces matter, whether physical or digital. Here’s to making this place matter too.

2493

Reposted by Mike Driscoll

Alexandria Ocasio-Cortez @aoc.bsky.social · 11/11/2024

I don’t even know why I stopped using this in the first place? Good GOD it’s nice to be in a digital space with other real human beings. Can someone give a Cliff Notes of what went down here over the last year? Tea, dev notes, big memes, whatever is best please

2648572252940

Reposted by Mike Driscoll

DuckDB @duckdb.org · 11/11/2024

We finalized the schedule for the sixth edition of DuckCon! DuckCon is a 𝐟𝐫𝐞𝐞 event that will be streamed publicly. Registration is required if you are attending in person. Check out all the details about #DuckCon on our website: lnkd.in/dCE2_k5m

2115

Reposted by Mike Driscoll

Tristan Handy @jthandy.bsky.social · 11/11/2024

Dipping my toe in here. Deeply skeptical of social at this point in my life but at the same time in search of that Twitter golden age. Trying to be open. Hello world.

11532

Reposted by Mike Driscoll

Renee DiResta @noupside.bsky.social · 09/11/2024

They invented FOIA.

Bill Ackman @@BillAckman • Nov 6
Brilliant.
•••
David Sack& Au
@DavidSack • Nov 6
We need a "Twitter Files" for the entire Federal Government. Open up the books, see what's really going on. It will be worse than we think. H/t @balajis

753594499

Mike Driscoll @medriscoll.com · 08/11/2024

Apple Health now telling me to eat a Twinkie to erase this calorie deficit.

170

Reposted by Mike Driscoll

Adam Marcus @marcua.net · 07/11/2024

Looking for a distraction? Try this great interview between @hannes.muehleisen.org and @medriscoll.bsky.social covering all things @duckdb.org. I especially enjoyed the philosophy around improving SQL usability. www.youtube.com/watch?v=a-Rm... #databs

youtube.com

Data Talks on the Rocks 5 - Hannes Mühleisen, DuckDB

YouTube video by Rill Data

0144