iiinova — where your digital self keeps evolving

brendan chambers

@societyoftrees.bsky.social

705 followers 544 following 200 posts

Ithaca | prev Chicago | prev research scientist | interested in interconnected systems and humans+computers | currently: gardening

Posts Replies Media

brendan chambers @societyoftrees.bsky.social · 22/11/2024

On the backward pass, significant additional latency savings come from skipping entries that quantize to zero. Table A1 shows how helpful this pruning is.

000

brendan chambers @societyoftrees.bsky.social · 29/10/2024

I know there are a lot of dataheads on bluesky right now: here is my first draft of an answer to “What is the typical approach for storing large text datasets in the context of LM pretraining (and shouldn’t you use a relational db)”. If anyone has any deep thoughts or hot takes definitely come at me

description of typical data practices from the poster’s perspective

051

brendan chambers @societyoftrees.bsky.social · 29/10/2024

I agree and this often feels really confusing and wrong to data engineers. Why? Too long for a reply so it’s an image. Thank you for your work

120