Continuous Integration and Continuous Deployment (CI/CD) pipelines have become essential in the world of modern data engineering, enabling teams to deliver high-quality solutions faster and with fewer errors. If you’re working in Microsoft Fabric, the good news is: CI/CD is absolutely possible. The bad news is: It is not (yet) as straight forward as CI/CD for other software such as Azure Data Factory for example.

As businesses and data professionals seek more efficient ways to extract insights from their data, Microsoft Fabric introduces a new feature: Fabric Data Agents. Now in public preview, these agents simplify data interaction by allowing users to query structured datasets using natural language—eliminating the need for complex query languages like SQL. In this blog post, we’ll explore the potential of Fabric Data Agents, their use cases, limitations, and how they differ from Microsoft Copilot.

Apache Spark has become a go-to framework for big data analytics, machine learning, and real-time processing. With Microsoft Fabric, Spark is now deeply integrated into a powerful, unified platform that brings together data engineering, data science, and business intelligence workflows. This blog post walks you through everything you need to know about Spark in Microsoft Fabric—from foundational concepts to configuring pools, environments, and jobs—so you can build and scale data workloads effectively.

IntroductionUnderstanding ETL and ELTETL vs. ELT in Microsoft FabricHow to choose between ETL and ELTBest Practices for Data Transformation in Microsoft FabricConclusion Introduction In the evolvin…

Automating deployments for Azure Data Factory (ADF) can help streamline updates, reduce manual errors, and ensure consistency across environments. A well-configured CI/CD pipeline allows you to automatically validate, test, and deploy ADF changes with minimal effort. GitHub Actions provides a straightforward way to implement CI/CD for Azure Data Factory, enabling automated integration and deployment directly from your GitHub repository. In this guide, we’ll walk through setting up a CI/CD pipeline using GitHub Actions, covering key steps such as exporting ADF resources, managing configurations, and deploying changes to different environments.

Introduction What Are Shortcuts in Microsoft Fabric? Authorization Why Use Shortcuts? Step-by-Step Guide: How to Create a Shortcut in Microsoft Fabric Prerequisites Conclusion Introduction Microsoft Fabric introduces a powerful feature called Shortcuts, enabling seamless access to data across different sources without duplication. Shortcuts make data more accessible, reduce storage costs, and streamline data engineering workflows. In this post, we will cover:

Access management is a cornerstone of any data-driven organization. In Microsoft Fabric, access levels are designed to provide flexibility and precision, ensuring that the right people have access to the right data while maintaining security and compliance. This post will explore the various access levels in Microsoft Fabric, including Workspace-level access, Item-level access, Object-level access, and Row/Column-level access. We’ll also discuss when to use each and provide a step-by-step guide to setting them up.

As data needs grow more complex, professionals require tools that can handle large-scale data while maintaining flexibility and reliability. The Delta Lake format has emerged as a robust solution for modern data workflows. Coupled with Microsoft Fabric’s approach to integrating Delta Lake, this combination addresses the challenges of managing and analyzing diverse datasets. In this post, we’ll explore the fundamentals of Delta Lake, its practical use cases, and how Microsoft Fabric incorporates its capabilities.