iiinova — where your digital self keeps evolving

Reposted by Hasan Geren

Pipeline To Insights @pipeline2insights.bsky.social · 08/12/2024

We are starting a 32-week Data Engineering Interview Guide program, covering everything from fundamentals to advanced topics, with sessions every Saturday. Do you think we're missing any critical topics? We're curious about your opinions😊 #dataBS #datasky

open.substack.com

Week 0/32 - A Comprehensive Data Engineering Interview Preparation Guide

Join us every Saturday on This New Journey

063

Reposted by Hasan Geren

Pipeline To Insights @pipeline2insights.bsky.social · 04/12/2024

As a Data Engineer, understanding the data storage lifecycle and data retention policies is critical for designing efficient, cost-effective, and compliant data systems. @joereis.bsky.social #dataBS #datasky substack.com/@pipeline2in...

082

Reposted by Hasan Geren

Pipeline To Insights @pipeline2insights.bsky.social · 03/12/2024

In our new post, we've covered 10 of the most popular data pipeline design patterns. We’d love to hear your thoughts. For more details, please check out the full post created by (@hgeren.bsky.social and @hopefanhe.bsky.social ): open.substack.com/pub/pipeline... #dataBS #datasky

open.substack.com

10 Pipeline Design Patterns for Data Engineers

How to leverage Design Patterns for scalable and efficient data pipelines

042

Reposted by Hasan Geren

Pipeline To Insights @pipeline2insights.bsky.social · 28/11/2024

Hi, wishing everyone a great Thanksgiving! Recently we wrote about how SQL queries are executed behind the scenes. If you are interested, check out our post: open.substack.com/pub/pipeline... #dataBS #datasky

062

Reposted by Hasan Geren

Pipeline To Insights @pipeline2insights.bsky.social · 26/11/2024

Storage is at the heart of Data Engineering. In this post, we explore the hierarchy of data storage from the ground up, drawing inspiration from Fundamentals of Data Engineering by @joereis.bsky.social and Matt Housley, as well as insights from the DE Professionals on Coursera. #dataBS #datasky

open.substack.com

Storage Fundamentals For Data Engineers

Why organised and durable storage is the cornerstone of Data Engineering?

3162

Hasan Geren @hgeren.bsky.social · 19/11/2024

Hey #dataBS and #datasky folks, Our new post about "how understanding Big O Notation & Execution Plans can optimize SQL queries" has just been posted. Check it out if you're interested, and we'd love to hear your thoughts! @hopefanhe.bsky.social open.substack.com/pub/pipeline...

open.substack.com

SQL Behind the Curtain: How Are Queries Executed?

Explore the journey of your SQL query guided by execution plans

182

Hasan Geren @hgeren.bsky.social · 08/11/2024

Hey #dataBS, I've been thinking of an analogy for Data Teams' roles. Imagine a company as a vehicle. How would you map Data Engineering, Analytics, and Science to vehicle parts? Teams could have multiple parts or overlap with other Teams. Curious about your thoughts!

240

Reposted by Hasan Geren

Adam Marcus @marcua.net · 07/11/2024

Looking for a distraction? Try this great interview between @hannes.muehleisen.org and @medriscoll.bsky.social covering all things @duckdb.org. I especially enjoyed the philosophy around improving SQL usability. www.youtube.com/watch?v=a-Rm... #databs

youtube.com

Data Talks on the Rocks 5 - Hannes Mühleisen, DuckDB

YouTube video by Rill Data

0144

Reposted by Hasan Geren

Christian Minich @christianminich.com · 07/11/2024

#dstaBS can you repost? Filled up the first 150 and so am creating a second starter pack! Let’s all keep finding each other and make this place the best for all things data

2135

Reposted by Hasan Geren

Erfan Hesami @hopefanhe.bsky.social · 07/11/2024

Week 1 of "100 Days of SQL Optimisation" covered key techniques like column selection, multicolumn indexes, filtering, window functions, Rank, CTE and composite indexes with IMDb data. Check out the full post for more! @hgeren.bsky.social #dataBS #datasky

open.substack.com

Week #1: 100 Days of SQL Optimisation

How Small Tweaks Transformed Our Queries, Saving Time and Resources

061

Reposted by Hasan Geren

Chris @chris.blue · 25/10/2024

I made an infra engineer starter pack. Folks posting about databases, stream processing, durable execution, orchestrators, service meshes, and more. go.bsky.app/SCZe42X

4428774

Hasan Geren @hgeren.bsky.social · 07/11/2024

Hello everyone! I’m Hasan. I transitioned from Industrial Engineering to Data Science, then found my passion in Data Engineering. Currently, doing a PhD in distributed stream processing while working as a Data Engineer. Looking forward to connecting with fellow data enthusiasts to learn and share.

030

Hasan Geren @hgeren.bsky.social · 06/11/2024

Just joined and heard #dataBS and #datasky are where the cool kids hang. Wanted to introduce our blog where we regularly write about Data Engineering concepts, news, and tools. pipeline2insights.substack.com

2153