Felipe O. Carvalho
@felipe.rs
1.5K followers 503 following 1.1K posts
SWE @ dbt Labs. Past: SDF, VoDa, Spotify. Apache Arrow/Databases/Compilers/DistSys. Rust/C++/OCaml/TLA+. 🇧🇷 → 🇸🇪 → 🌎 bento.me/felipe / felipe.rs
SWE @ dbt Labs. Past: SDF, VoDa, Spotify. Apache Arrow/Databases/Compilers/DistSys. Rust/C++/OCaml/TLA+. 🇧🇷 → 🇸🇪 → 🌎 bento.me/felipe / felipe.rs
![#include <cstdio>
int add10(int *num) {
return *num += 10;
}
int external_int();
int main(int argc, char *argv[]) {
int i = external_int();
add10(&i);
printf("%d", i);
return 0;
}](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:g66ayxz5kkouqy7q7uoo5yyc/bafkreie3ty47xxjnk6s2aj4wgsg2agfh2frw6xeingb5zhemmgh6mgx3ti)
![[DISCUSS] Workaround Protobuf deserialization depth limit in Substrait
We have accidentally encountered a deserialization limit of official protobuf library with a deep nesting. The limit is 100 (https://protobuf.dev/programming-guides/proto-limits/#depth), that is, the library will fail to parse a message if it contains more than 100 nestings. So I would like to discuss extending Substrait to reference fragment of scalar expression as it already does for the RelOp tree.](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:g66ayxz5kkouqy7q7uoo5yyc/bafkreias2oqnc5n3vvhubijlvc23cs57kodyayzald5mrhjusxx77lkoi4)
![def generate_holes(dates: list, start_date: datetime.date, end_date: datetime.date):
"""
Generate holes in a sorted list of dates.
Parameters
----------
dates : list
Sorted list of dates.
start_date : datetime.date
Start date (inclusive).
end_date : datetime.date
End date (inclusive).
Yields
------
tuple
A tuple with the start and end dates of a hole.
"""
if len(dates) == 0:
yield (start_date, end_date)
return
expected = start_date
i = 0
while True:
while expected == dates[i]:
expected += timedelta(days=1)
i += 1
if i >= len(dates):
break
if i >= len(dates):
break
hole_last = dates[i] - timedelta(days=1)
yield (expected, hole_last)
i += 1
if i >= len(dates):
break
expected = dates[i]
if dates[-1] < end_date:
yield (dates[-1] + timedelta(days=1), end_date)](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:g66ayxz5kkouqy7q7uoo5yyc/bafkreiacaix4vwmmlfghsqasqvdue77xz7tzggyxsz5mzejlpbmsqzldjm)
![if len(dates) == 0:
yield (start_date, end_date)
return
if start_date < dates[0]:
yield (start_date, dates[0] - timedelta(days=1))
for d0, d1 in zip(dates[:-1], dates[1:]):
d0p1 = d0 + timedelta(days=1)
if d0p1 < d1:
yield (d0p1, d1 - timedelta(days=1))
if end_date > dates[-1]:
yield (dates[-1] + timedelta(days=1), end_date)](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:g66ayxz5kkouqy7q7uoo5yyc/bafkreidoy6cfuavlqrpypf6tcf377xif34da5d7zojp55hp4fdbfvudsyu)
