I have been using AI in VS Code and Onelake, initially trying to make sense of Chat with your data (without much success, that thing is very hard and we need some breakthrough), and more recently f…

YouTube video by DataMonkey

Four years ago I wrote a blog about using DuckDB with Power BI in DirectQuery. It got a fair number of likes on LinkedIn :) along with the one comment I didn’t want to hear: how does this wor…

YouTube video by DataMonkey

TL;DR: Iceberg’s value is sociological, not technical. And if you care about lightweight, single-process engines like datafusion and duckdb, it’s probably your best shot at first-class …

Microsoft Fabric lets you dynamically configure the number of vCores for a Python notebook session at runtime — but only when the notebook is triggered from a pipeline. If you run it interactively,…

The high-end version of this problem is mostly solved. GPT-4 or Claude Opus paired with a mature proprietary semantic layer like Microsoft Power BI’s will handle natural language queries reli…

A complete data pipeline running on Microsoft Fabric that downloads public data, transforms it into a star schema, exports it as Delta Lake tables, and serves it through a Power BI semantic model w…

DuckDB extension to attach a directory of Delta tables as a database - djouallah/delta_classic

Microsoft Fabric Lakehouse supports Row-Level Security (RLS) and Column-Level Security (CLS) . it works with trusted engines like PowerBI, Spark running inside Fabric etc, but if you use Python not…

YouTube video by DataMonkey

YouTube video by DataMonkey

YouTube video by DataMonkey

TL;DR: Incremental framing is like CDC to RAM :) It significantly improves cold-run performance of Direct Lake mode in some scenarios, there is an excellent documentation that explain everything in…

Getting different parties in the software industry to agree on a common standard is rare. Most of the time, a dominant player sets the rules. Occasionally, however, collaboration happens organicall…

YouTube video by DataMonkey

☕ Coffee benchmark at 3B scale factor : $0.22 total cost 💰 7 Months later, using the latest dev release of #DuckDB with #DuckLake, we cut the cost of running the unfamous :) coffee benchmark to just ...

Learn how the python driver for SQL Server, mssql-python, outperforms pyodbc in terms of latency and throughput for developers.

TL;DR :  As a quick first impression, I tested  for Generating SQL Queries based on a sql like semantic model, all the files are stored here , considering i have only 4 GB of VRAM, it is …

YouTube video by DataMonkey

There are moments in life when you know things will never be the same. I remember distinctly when Gary showed me PowerPivot 10 years ago, and I knew that working with data would become as easy as p…

I was giving a presentation about Microsoft Fabric Python notebooks and someone asked if they scale. The short answer is yes. You can download the notebook and try it for yourself. For the long ans…

YouTube video by DataMonkey

Fabric Python Notebooks examples. Contribute to djouallah/Fabric_Notebooks_Demo development by creating an account on GitHub.