iiinova — where your digital self keeps evolving

Mer @mertheman.bsky.social · 06/06/2025

What did you use for your warehouse? The volume we work with is not much so I was just thinking of azure SQL database.

210

I think that's a great idea to showcase hopefully diverse workflows.

100

Yes, data scientists. However looking back now I should have asked what you meant with workflow workshops? I just assumed it meant "how they do the things they do"

100

Does anyone here have a data stack using resources in the Azure Marketplace? I'm looking to get a data warehouse going for my small team What do you use for: - ingestion - transformation - storage - orchestration #databs

100

Mer @mertheman.bsky.social · 03/06/2025

I'd like to learn about what problems they solve and how they choose the tools to solve them. And how those tools integrate with each other.

100

Resume/LinkedIn wise I'd say someone with a diverse background (industry/domain). I'd figure they would have had to solve different problems in different ways using different tools?

Mer @mertheman.bsky.social · 03/06/2025

Curious why you want to be able to ID a generalist?

110

Mer @mertheman.bsky.social · 30/05/2025

I think part of the reason I posted about my team's stack is because of the lack of representation with the older tech stacks. and People shouldn't be ashamed to talk about it even though it's not what the majority of the posts are talking about.

260

Mer @mertheman.bsky.social · 11/05/2025

Data SMEs need to have a seat at the table when discussing KPIs or OKRs. Especially when those metrics determine compensation actions. If you don't, you run the risk creating a metric that can't be measured or over promising on measuring capabilities.

020

Mer @mertheman.bsky.social · 17/02/2025

Me: “Hey, can I set up some time to go over your code that uploads a file to share point?” Dev: “sure, I’ll need a code to charge my time to” Does anyone else experience this?

000

Mer @mertheman.bsky.social · 14/02/2025

TIL to inspect/clean my data prior to merging in pandas. Output had 0 rows. Def something with the join. Inspected the output of each df prior to the merge and saw the column I was joining on had extra spaces. Trim function worked. db2 to SQLServer data joined. 80 sec vs 2 hours in power BI

Mer @mertheman.bsky.social · 09/02/2025

2025-02-09 TIL that BQuery uses a columnar storage format, meaning columns are stored separately. Important to know since BQ pricing is based on data processed by queries. Make sure to only bring in needed columns and LIMIT for sampling.

130

Mer @mertheman.bsky.social · 02/02/2025

2025-02-02 TIL to orchestrate the same flow as 2025-02-01 except store in GCS and load to BigQuery. Going through the exercises gave me a high-level understanding of Kestra. Practice through projects will help me understand the details by creating flows from scratch. #dezoomcamp

Mer @mertheman.bsky.social · 02/02/2025

2025-02-01 TIL to set up a Kestra to orchestrate extract & load of csvs into a separate pg container. Learned scheduling and backfilling data. Sensing that DE is configuring diff technologies together. Helps to have a higher level of understanding before diving into configuring. #dezoomcamp

Mer @mertheman.bsky.social · 01/02/2025

Yes! This guy is awesome - www.youtube.com/watch?v=ZDV4... Terminal emulator - ghostty.org/docs Ghostty config/zsh plugins - www.bitdoze.com/ghostty-term... Prompt = starship.rs/guide/

ghostty.org

Ghostty Docs

Ghostty is a fast, feature-rich, and cross-platform terminal emulator that uses platform-native UI and GPU acceleration.

120

Mer @mertheman.bsky.social · 01/02/2025

Last week instead of learning about Kestra for orchestration, I used 'productive procrastination' to learn about the terminal, shells, prompts and plugins to achieve a beautfil terminal. Proud to say I achieved both form and function on my little sidequest. Here's what it looks like now.

130

Mer @mertheman.bsky.social · 27/01/2025

lol. No. “Documentation” is step 1, run python script. Step 2, open tableau prep, log in and run the flow. Step 3, refresh power BI workbook. Step 4, publish.

Mer @mertheman.bsky.social · 26/01/2025

On Fri I was handed off a dashboard to update/maintain. The analyst combined excel files using python with a csv output . Then Tableau prep to join the data from the python output to data from SQL Server. The tableau prep flow output a csv which was then used by Power BI to create the dashboard.

6150

Mer @mertheman.bsky.social · 22/01/2025

Great idea with the video! I’d love to be part of the community you want to build. Can I help somehow?

110

Mer @mertheman.bsky.social · 22/01/2025

I think its kinda nuts the things you can do with just a few lines of code, like building a whole infrastructure.

000

Mer @mertheman.bsky.social · 22/01/2025

2025-01-21 Started learning about Kestra. I'm seeing similarities between Kestra's "Flow" files, Docker's "Compose" file and Terraform's files. TIL that while they look the same, they are not as Kestra and Docker are YAML while Terraform is HCL. All are forms of Data Serialization files.

100

Mer @mertheman.bsky.social · 20/01/2025

Failure is an integral part of growth and learning.

Mer @mertheman.bsky.social · 20/01/2025

lol, I thought I’ve seen everything

000

Mer @mertheman.bsky.social · 18/01/2025

A friend of mine fell for one and is down A LOT of money. An acquaintance with the Secret Service told them to file a complaint here www.ic3.gov

ic3.gov

Home Page - Internet Crime Complaint Center (IC3)LockCloseFacebookX (Twitter)YouTubeFlickrLinkedInInstagram

120

Mer @mertheman.bsky.social · 17/01/2025

2025-01-17 TIL to supplement my learning instead of relying solely on zoomcamp materials. Zoomcamp has 10min video to give a primer on Terraform and another 29min video showing basics of init, apply, show and destroy. What I really needed was a video like this. www.youtube.com/watch?v=tomU...

youtube.com

Terraform in 100 Seconds

YouTube video by Fireship

000

Mer @mertheman.bsky.social · 16/01/2025

Nice write up! I’m learning about Docker aling with PostgreSQL. Learning how to properly set it up took a long time but I learned a lot. Can you add a pgadmin image to your compose yaml file and test/query there?

000

Mer @mertheman.bsky.social · 14/01/2025

2025-01-13 TIL that Postgresql does not like column names that begins with a capital letter. To query said column, you must use double quotes around it.

000

Mer @mertheman.bsky.social · 14/01/2025

Is there a command in uv that gets me a list of environments? #dataBS

000

Mer @mertheman.bsky.social · 13/01/2025

Which marathon are you training for?

Mer @mertheman.bsky.social · 13/01/2025

Forgot to tag #dataBS Follow and watch me stumble along.

050

Mer @mertheman.bsky.social · 13/01/2025

2025-01-12 TIL I am comfortable going through the motions of stopping and starting Docker containers. Had a corrupt file for some reason. Deleted a folder, re-built postgres image, ran ingest script. Setup compose file for 2 containers and voila, data is ready for queries in pgadmin.

000

I recently setup this corner of my living receiving room as a study corner soon can be closer to my family in the evenings.

During the WFH days I’m upstairs in the spare bedroom.

110

Amazing. Definitely arranged/organized to promote productivity and tranquility. Makes me want to move my desk against the south facing window.

You and me both. I keep trying to put more weight on being a father, husband and friend, but aspiring to be a certain job title and work for a company that aligns with my values always pushes ahead.

120

Setup a little dedicated study station in my house. Previously I was just on the couch distracted by the TV. Bought a desk lamp from Goodwill for $6. Was surprised when I found out only after I put a bulb in it that it had a USB-C port!!

130

Glad you found it! I thought I was just yelling into the void! Want to form a mini study group of some sort?

Mer @mertheman.bsky.social · 11/01/2025

Or just put their budgeted top number so neither the job hunter nor recruiter waste their time.

Mer @mertheman.bsky.social · 10/01/2025

Re-watched Interstellar last night. I want my own TARS.