Reposted by Ebehi Iyoha
🚨
Announcing OpenCensus, a new project with @ezrakarger.bsky.social :
We are transcribing the historical US censuses and releasing them as open data
2.6 million people so far in 1940, browse here:
opencensus.us
Ebehi Iyoha
@ebehi.org
4.9K followers 482 following 283 posts
Asst Prof @ HarvardHBS. IO + Trade Economist studying firm networks & productivity. Here to find out if the eXodus (pun very much intended) sticks!
![Running dbreg::dbreg() on a full year of NYC taxi data... and it takes less than 2 seconds.
dbreg(
tip_amount ~ fare_amount + passenger_count | month + vendor_name,
path = "read_parquet('nyc-taxi/**/*.parquet')", ## path to hive-partitioned dataset
vcov = "hc1"
)
#> [dbreg] Estimating compression ratio...
#> [dbreg] Data has 178,544,324 rows and 24 unique FE groups.
#> [dbreg] Using strategy: compress
#> [dbreg] Executing compress strategy SQL
#>
#> Compressed OLS estimation, Dep. Var.: tip_amount
#> Observations.: 178,544,324 (original) | 70,782 (compressed)
#> Standard Errors: Heteroskedasticity-robust
#> Estimate Std. Error t value Pr(>|t|)
#> fare_amount 0.106744 0.000068 1564.742 < 2.2e-16 ***
#> passenger_count -0.029086 0.000106 -273.866 < 2.2e-16 ***
#> ---
#> Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:qww63z2t5rrhniusz5x7gk23/bafkreiajmnp6jiaycebutwid2lxx57hrz3zc3qp2p5ijnoqiyqag34xpe4)
