Gorkem Yurtseven @grk.bsky.social · 11/05/2023getting ready to release distributed python environments @isidentical.bsky.social has been working on for fal.ai it is incredible, we are for sure writing a blog post on it 150
Reposted by Gorkem Yurtseven🐥pdrm🐣 @pedramnavid.com · 10/05/2023Growing list of data people to follow@spite.vc @jakthom.com @lloydtabb.bsky.social @grk.bsky.social @teej.bsky.social @randyau.bsky.social @launchit.ai @ryxcommar.bsky.social @thebbennett.bsky.social @beeonaposy.bsky.social @skamille.bsky.social @seanjtaylor.com @emilyriederer.bsky.social 104316
Gorkem Yurtseven @grk.bsky.social · 06/05/2023Ok hot take; llm projects are packaged very well, you dont even need docker to productize them 010
Gorkem Yurtseven @grk.bsky.social · 04/05/2023typescript is wildly successful because it not a special js runtime and produces js code that can work with existing libraries 100% of the time 000
Gorkem Yurtseven @grk.bsky.social · 04/05/2023but then there will be differences in behavior that impacts how you thought your program ran.. things still wont work at the end lots of libraries need to be re-written in mojo. and that's ok. 100
Gorkem Yurtseven @grk.bsky.social · 04/05/2023its not going to just work if you try to use your existing python program.. after a lot of new extra work the existing programs will start working and they might even have 100% coverage in terms of python functionality on paper.. 110
Gorkem Yurtseven @grk.bsky.social · 04/05/2023just to be clear mojo is not a python superset yet! it aspires to be one, its a long term goal not something out of the box 110
Gorkem Yurtseven @grk.bsky.social · 03/05/2023have you guys seen creator of LLVM just released a new programming language? why would, world's richest man, bernard arnault create a new programming language? 010
Gorkem Yurtseven @grk.bsky.social · 03/05/2023just point FalServerlessRunner to your local dbt directory and it takes care of the rest. syncs the project to the cloud, prepares an environment if necessary, runs the dbt command and releases cloud resources 000
Gorkem Yurtseven @grk.bsky.social · 03/05/2023new addition to fal, FalServerlessRunner - github.com/fal-ai/fal/pull/842 best way to run a whole dbt project in fal-serverless works especially well if you use dbt-duckdb, and keep a duckdb file in the fal-serverless persistent filesystem 131
Gorkem Yurtseven @grk.bsky.social · 03/05/2023this is coming along nicely, bonus: also running a small `dbt run` with each event and only storing the transformed table 000
Gorkem Yurtseven @grk.bsky.social · 03/05/2023Do I know anyone who uses databricks notebooks at work? How do you manage python environments? 100
Gorkem Yurtseven @grk.bsky.social · 03/05/2023at least one pr to the docsite repo after every customer call 000
Gorkem Yurtseven @grk.bsky.social · 25/04/2023You can follow along here: github.com/fal-ai/fal-events 100
Gorkem Yurtseven @grk.bsky.social · 25/04/2023The beautiful part of this is that the simplest version of this implementation is really simple and good enough for a lot people 100
Gorkem Yurtseven @grk.bsky.social · 25/04/2023Most certainly this will become a problem. I dont expect duckdb to handle a large amount of writes. All the events will be stored in a single duckdb file, that wont scale forever at that point we can swap up storage with open source delta lake (delta-rs) or iceberg 110
Gorkem Yurtseven @grk.bsky.social · 25/04/2023I expect this project to grow as our company grows. First we'll be sending all events directly to a duckdb instance and everything will be stored there 100
Gorkem Yurtseven @grk.bsky.social · 25/04/2023This will be a reference implementation to how do build such a system using fal-serverless 100
Gorkem Yurtseven @grk.bsky.social · 25/04/2023Previously we were using posthog and snowflake. We don't have a lot data but still snowflake was charging us 1k a month 100
Gorkem Yurtseven @grk.bsky.social · 25/04/2023We are going to move all our internal user events and metrics to duckdb hosted by fal-serverless 110
