Sign in

Gavia Gray

@reflected.codes
450 followers 277 following 184 posts

Member of Technical Staff at Cerebras (views expressed my own) (also technically prof at Dalhousie University) github.com/gngdb reflected.codes

PostsRepliesMedia
Gavia Gray @reflected.codes · 11/02/2025
The terms people usually use to describe the spectral differences are "vocal weight" and "resonance". Trans people and voice actors probably have the best resources on voice and how to talk about it, like @zheanna.bsky.social has some great videos on this www.youtube.com/watch?v=gZWQ...
youtube.com
The Big Picture of Voice Feminization | A Comprehensive Overview | Lecture & Demonstration
YouTube video by TransVoiceLessons
010
Reposted by Gavia Gray
Margaret Mitchell @mmitchell.bsky.social · 04/02/2025
With Google removing their Responsible AI Principles, they no longer state that they will *not* engage in "Technologies whose purpose contravenes widely accepted principles of international law and human rights". Concerns about surveillance and injury are also erased. ai.google/responsibili...
ai.google
AI Principles – Google AI - Google AI
A guiding framework for our responsible development and use of AI, alongside transparency and accountability in our AI development process.
8269173
Reposted by Gavia Gray
Dave Willner @dwillner.bsky.social · 09/01/2025
Folks are mostly missing the forest for the trees re: the recent Meta announcement. Specifically, the focus on the move from fact checking to community notes. There two different changes that are a much bigger deal that have received less focus. 🧵 1/11
812678959
Gavia Gray @reflected.codes · 20/12/2024
I got Claude to condense github.com/mattjj/autod... to a single file to make it more readable: gist.github.com/gngdb/a6bdf4... It's the same design as the core Jax autograd engine as far as I know.
gist.github.com
Generated condensed version of https://github.com/mattjj/autodidact
Generated condensed version of https://github.com/mattjj/autodidact - autodidact.py
050
Gavia Gray @reflected.codes · 15/12/2024
Our poster is up in the compression workshop for Esha Singh's paper on bounds for scaling sparsity. We investigated better ways to compare sparsity inducing regularizers by grounding to compute efficient dense models. openreview.net/forum?id=qOn...
openreview.net
Empirical Upper Bounds for Unstructured Sparsity in...
Sparsity in deep neural networks promises two improvements in computational efficiency, fewer FLOPs spent both to train the network and to perform inference. We find that both may be quantified...
020
Gavia Gray @reflected.codes · 12/12/2024
My poster is up!
050
Reposted by Gavia Gray
Nora Belrose @norabelrose.bsky.social · 11/12/2024
How do a neural network's final parameters depend on its initial ones? In this new paper, we answer this question by analyzing the training Jacobian, the matrix of derivatives of the final parameters with respect to the initial parameters. arxiv.org/abs/2412.07003
49219
Gavia Gray @reflected.codes · 11/12/2024
code for this work is here: github.com/CerebrasRese...
neurips.cc
NeurIPS Poster Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in TransformersNeurIPS 2024
010
Gavia Gray @reflected.codes · 11/12/2024
I'll be presenting our poster on efficient estimation of critical batch size today at 4:30pm at NeurIPS 2024 neurips.cc/virtual/2024...
neurips.cc
NeurIPS Poster Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in TransformersNeurIPS 2024
150
Gavia Gray @reflected.codes · 11/12/2024
hi! thanks for adding me
010
Reposted by Gavia Gray
Ted Underwood @tedunderwood.com · 29/11/2024
I would put this even more strongly: open source AI is probably our only realistic chance to avoid a terrifying increase in concentration of power. I do not want to live in a world where the people with all the money also have all the intellectual power.
2240784
Gavia Gray @reflected.codes · 28/11/2024
I'm shocked you would fail to see how this is motivated. The sentiment from people cheering this on Twitter and elsewhere is obvious.
080
Reposted by Gavia Gray
Thomas Steinke @stein.ke · 20/11/2024
A feature/bug of BlueSky is that you can back-date posts. People are using this to repost their tweets. If you search for posts from the 1st century, there are jokes about the resurrection of Jesus. And, perhaps even funnier, some posts dated 24-11-20 instead of 2024-11-20. bsky.app/search?q=unt...
bsky.app
1164
Reposted by Gavia Gray
Vicki @vickiboykis.com · 20/11/2024
when you try to convert your text into smaller pieces but all it gives you is Elvish, that’s a tolkienizer
341005103
Reposted by Gavia Gray
Shoshana K. Goldberg @goldbergsk.bsky.social · 20/11/2024
One of the hardest,and most meaningful, projects I do in my job is monitor the epidemic of fatal violence against the trans and gender-expansive community. Today, on Transgender Day of Remembrance (#TDOR), we honor those we’ve lost over the last year. reports.hrc.org/an-epidemic-...
reports.hrc.org
The Epidemic of Violence Against the Transgender & Gender-Expansive…
The 2024 Report
4206105
Reposted by Gavia Gray
Navneet Alang @navneetalang.com · 14/11/2024
Good reporting here: www.thetrillium.ca/news/municip...
thetrillium.ca
How a handful of Toronto businessmen got their way on bike lanes provincewide
'Non-partisan group' Balance on Bloor includes a former PC candidate, donors, and real estate industry players
03110
Reposted by Gavia Gray
Antonin Raffin @araffin.bsky.social · 14/11/2024
Neurips reviews are now publicly available. Don't forget to check out Open RL benchmark, very useful when implementing algorithms or checking performance/impact of hyperparameters. openreview.net/forum?id=ZDv...
openreview.net
Open RL Benchmark: Comprehensive Tracked Experiments for...
In many Reinforcement Learning (RL) papers, learning curves are useful indicators to measure the effectiveness of RL algorithms. However, the complete raw data of the learning curves are rarely...
0212
Reposted by Gavia Gray
Matt Elliott @graphicmatt.com · 13/11/2024
In summary, Ford's bike lane removals will, according to a new City Hall report: - Cost $75 million in direct costs and sunk costs. - Make traffic much, much worse for at least nine months during construction to remove lanes - Have minimal long-term impact on car travel times.
21360170
Reposted by Gavia Gray
Dr. Tessa Fisher @tessafisher.bsky.social · 06/11/2024
We're cooked. The economy's cooked. The planet is really cooked. But trans people are especially cooked, here in the U.S. Because no one's coming to save us:
1373
Gavia Gray @reflected.codes · 14/06/2024
I have just learned that when my dad said "it's like herding cats" he was probably referring to a 1999 superbowl ad www.youtube.com/watch?v=m_Ma...
youtube.com
EDS, an HP Company 'Cat Herders'
EDS, an HP Company 'Cat Herders'
010
Reposted by Gavia Gray
Dr. Kat Napaaqtuk❄️ @napaaqtuk.bsky.social · 12/06/2024
RIP Lynn Conway, chip design pioneer and transgender-rights advocate news.engin.umich.edu/2024/06/the-... From wiki: IBM fired Conway in 1968 after she revealed her intention to transition. IBM apologized in 2020 (!). en.m.wikipedia.org/wiki/Lynn_Co...
news.engin.umich.edu
The legacy of Lynn Conway, chip design pioneer and transgender-rights advocate
Conway, professor emerita of electrical engineering and computer science, has died.
7725323
Gavia Gray @reflected.codes · 31/05/2024
To do machine learning research it's important to have a degree in maths so you can read the math in most papers, a degree in computer science so you can write replicable code and a degree in physics so you can talk to all the physicists here. Luckily, getting them will leave no time for research.
150
Gavia Gray @reflected.codes · 21/05/2024
Years of plotting research yet no use for anything except calling `fig.tight_layout()` and hope.
020
Gavia Gray @reflected.codes · 21/05/2024
When Karpathy said he can't watch any movie more than 20 years old he was actually using Cunningham's rule to get movie recommendations, obviously.
020
Gavia Gray @reflected.codes · 17/05/2024
The fact about polar bear fur being technically transparent is dumb if you think that means you shouldn't say the fur is white but much more interesting if you know that the same transparent structure makes the bears mostly invisible in IR, so night vision would be useless.
030
Reposted by Gavia Gray
Dr. Tessa Fisher @tessafisher.bsky.social · 13/05/2024
The geomagnetic storm seems to be winding down, so if you still need to communicate across time with your dead father via ham radio to solve your mother's murder, now's the time!
381919389
Gavia Gray @reflected.codes · 13/05/2024
The DVD rental store guy recommended this movie a few weeks ago and this post is within 1 hour of us pressing play on the movie and I didn't know this was what the plot was going to be. Unclear what powers over time the DVD rental store guy has.
010
Gavia Gray @reflected.codes · 10/05/2024
Is "back to the old drawing board" just from looney tunes or were drawing boards a universal experience in the 40s?
000
Gavia Gray @reflected.codes · 01/05/2024
It's wild how much better Fiesta Farms is
000
Gavia Gray @reflected.codes · 01/05/2024
Weird side effect of trying to use copilot: when I know what I want to type, I try to type fast enough that it doesn't have time to suggest anything.
010
Gavia Gray @reflected.codes · 30/04/2024
plotille is the best terminal plotting library github.com/tammoippen/p... it's a shame it doesn't come up in search before bashplotlib
github.com
GitHub - tammoippen/plotille: Plot in the terminal using braille dots.
Plot in the terminal using braille dots. Contribute to tammoippen/plotille development by creating an account on GitHub.
030
Gavia Gray @reflected.codes · 27/04/2024
I want a human navigable index, categorization, walkable graphs.
010
Gavia Gray @reflected.codes · 26/04/2024
I tried this and it creates a commit for every action. I kind of like the provenance but it's really difficult to use because obviously it makes mistakes and to fix those mistakes you either do it yourself or make more commits. Maybe works if you're vigilant with git.
000
Gavia Gray @reflected.codes · 21/04/2024
I love that the mycologist that ID'd the mushroom for the hospital at intake contacted him to write this afterwards.
020
Gavia Gray @reflected.codes · 19/04/2024
ArXiv finally updated the TeX source archives they provide to include the `.tar.gz` suffix, so I had to rewrite the function I have in my `.zshrc` to unpack them into a directory: gist.github.com/gngdb/f0186e...
010
Reposted by Gavia Gray
Marcello Seri @mseri.me · 18/04/2024
It is very easy to think that very important scientists had a very straightforward path, especially in the past. Very interesting to read how it was not the case for David Mermin and also his accounts of the context and the luck moments that shaped his career www.aip.org/history-prog...
aip.org
N. David Mermin
Zierler: This is David Zierler, oral historian for the American Institute of Physics. It is April 17, 2020, and it is my great pleasure to be here with Professor N. David Mermin. Dr. Mermin, thank you...
032
Gavia Gray @reflected.codes · 17/04/2024
I haven't read how huge multimodal datasets are iterated but I assume it's a random walk on a graph relating the tokens because that would be the cool way to do it.
000
Gavia Gray @reflected.codes · 16/04/2024
Reducing repetitive strain injuries is something that code LLMs might be good for and aider.chat/docs/voice.h... looks like the best way to do it I've seen so far. Not tried it yet, probably will.
aider.chat
Voice-to-code with aider
aider is AI pair programming in your terminal
120
Gavia Gray @reflected.codes · 15/04/2024
Fabrice Ballard's textsynth is still operational and has base models available
010
Gavia Gray @reflected.codes · 11/04/2024
Got to thank my profs for showing us the completing the square perspective on the Gaussian integral trick vs all the more dense less useful definitions now on Wikipedia. (image from older version because it doesn't render anymore: blog.shakirm.com/2015/08/mach... )
000
Gavia Gray @reflected.codes · 11/04/2024
Also, it's wild that hash in the youtube link is correct.
000
Gavia Gray @reflected.codes · 11/04/2024
While writing this I got Claude to violate Godwin's law.
100
Gavia Gray @reflected.codes · 11/04/2024
Cass review reminds me of how when I was in high school Section 28 was still in effect so it was illegal to tell us trans people existed. I'm not surprised the reaction to the truth is the establishment trying to make trans people not exist.
110
Gavia Gray @reflected.codes · 10/04/2024
I got Claude to write this pedagogical implementation of einsum using `itertools.product`, worked on the second try: gist.github.com/gngdb/6ff171...
gist.github.com
einsum implemented with `itertools.product`
einsum implemented with `itertools.product`. GitHub Gist: instantly share code, notes, and snippets.
010
Gavia Gray @reflected.codes · 10/04/2024
I think this is what's happening in the eigengender paper in sigbovik this year but my graph laplacian knowledge isn't good enough. Any comments? www.sigbovik.org/2024/proceed...
sigbovik.org
010
Gavia Gray @reflected.codes · 08/04/2024
Took a gamble booking a hotel room in the region of totality in western Ontario looks like it might pay off but the cloud reports say to go further west and I assume everyone eclipse motivated with a car in Toronto is currently driving in my direction.
000
Gavia Gray @reflected.codes · 08/04/2024
Most hotel rooms are in the red zone I guess because it's cheaper to heat if you don't have to bring in more oxygen from outside.
000
Gavia Gray @reflected.codes · 08/04/2024
Searching this morning there's no evidence that 1500ppm is enough to make sleep bad, so I was probably doing nothing useful.
100
Gavia Gray @reflected.codes · 08/04/2024
The problem with owning a CO2 monitor is when I can't sleep in a hotel room I look at this graph at 2am and decide that the reasonable thing to do is hold the door of my room open (see drop at 3am) to see if lower CO2 makes it easier to sleep. There's no window to open.
100