Andy Nelson @andynelson817.bsky.social · 20/02/2025Why can't you test against the current schedule vs a delayed schedule? 100
Andy Nelson @andynelson817.bsky.social · 23/12/2024I'm reading there's controversy on putting satellites on links in data vault. Curious if #databs has any opinions on the matter. 310
Andy Nelson @andynelson817.bsky.social · 16/12/2024Looking for data vault 2.0 training recommendations. Gotta be pre-recorded or remote. #databs 100
Andy Nelson @andynelson817.bsky.social · 13/12/2024Bet that baby could possibly handle my 25 left joins I write. 010
Andy Nelson @andynelson817.bsky.social · 12/12/2024Paradime has AI tools for dbt. I haven't used them, sorry. 000
Andy Nelson @andynelson817.bsky.social · 11/12/2024Although one of the best, probably also the most boring exercise machine ever produced by Man 000
Andy Nelson @andynelson817.bsky.social · 11/12/2024I think I'm your target demographic Timo. Our team is trying to put sunset clauses on new adhoc pipelines and dashboards so at least we don't support things indefinitely. 120
Andy Nelson @andynelson817.bsky.social · 11/12/2024Honestly I think accumulating snapshots are underutilized. #databs 010
Andy Nelson @andynelson817.bsky.social · 11/12/2024Thanks for the reply Shane. But that's where I disagree with the author. I feel like I the data warehouse we can apply transformations for analytical purposes only. If there are 200 transaction codes and we put them in 5 buckets that aren't represented in the application layer, what's wrong with it? 000
Andy Nelson @andynelson817.bsky.social · 09/12/2024Not sure I understand this article. I wish the author gave examples of antipaterns of Data Engineers building business Logic in the data warehouse. I assumed unless if your doing reverse ETL the application layer needs to maintain their own business Logic. towardsdatascience.com/data-enginee...towardsdatascience.comData Engineering, RedefinedHow data engineering is practiced today and why we should redefine it 110
Andy Nelson @andynelson817.bsky.social · 07/12/2024Yeah I enjoyed his book. He uses some patterns from data vault without the complexity of full blown data vault. 010
Andy Nelson @andynelson817.bsky.social · 06/12/2024I've been influenced by Roberto Zagni's pragmatic data platform approach. I like the patterns he uses. youtu.be/OYrbg5q-CHo?... 130
Andy Nelson @andynelson817.bsky.social · 06/12/2024sadly I have to agree with you Matt. Not sure why Inmon is framing Kimball's approach as just data marts. 010
Andy Nelson @andynelson817.bsky.social · 06/12/2024Chapter 2 of Adamson's Star Schema covers this well. Both authors are pragmatic and allowed flexibility in their approaches. Lots of misconceptions in this space. 020
Andy Nelson @andynelson817.bsky.social · 02/12/2024I really am falling in love with array_agg(). I'm scared to think that my end game is me flattening and reconstructing json objects. #databs 070
Andy Nelson @andynelson817.bsky.social · 01/12/2024Agreed Joe. More so than reading books (which I highly recommend). I think we need repetitive practice in our industry. I take inspiration from web developers who can build simple websites over a weekend. Many data professionals are not getting their reps in. My $.02. 010
Andy Nelson @andynelson817.bsky.social · 01/12/2024Ultimately, I provide dopamine to executives. They like seeing numbers on a screen. 000
Andy Nelson @andynelson817.bsky.social · 01/12/2024Finished these two. Really enjoyed Star Schema. Data Modeling Storytelling has some good advice too #bsdata 020
Andy Nelson @andynelson817.bsky.social · 30/11/2024I'm interested. I work in finance reporting. We take scd2 and date explode them and build periodic snapshot tables. Curious how others deal with them. 000
Andy Nelson @andynelson817.bsky.social · 30/11/2024Really like it's ability to be a "glue" database. Read directly from postgres, s3, parquet, csv , json, pandas dataframes, http urls. As a data engineer I like to sample data before building automated pipelines. 160
Andy Nelson @andynelson817.bsky.social · 29/11/2024Big fan or buying discarded corporate laptops, install SSD drive, and installing Ubuntu or Fedora. Give old tech new life. 010
Andy Nelson @andynelson817.bsky.social · 29/11/2024In data warehousing, edit, publish, but don't manufacture. #databs 010
Andy Nelson @andynelson817.bsky.social · 27/11/2024Thanks for uploading so much material. Learning a ton. @eczachly.bsky.social 021
