Sign in

Evan Miyazono

@miyazono.bsky.social
183 followers 116 following 40 posts

Presumption of innocence for people, not software

PostsRepliesMedia
Reposted by Evan Miyazono
Metagov @metagov.bsky.social · 22/04/2025
Join us on Wednesday April 23 at 12 PM ET for Metagov Seminar: A rule-based approach to mitigating AI-risk (Evan Miyazono). For more details and link to join, register here - lu.ma/m0lc3280
lu.ma
Seminar: A rule-based approach to mitigating AI-risk · Zoom · Luma
Govern AI with Rules, Not Values A Manifesto for Specification-Driven AI “it is indispensable that they should be bound down by strict rules and precedents,…
031
Reposted by Evan Miyazono
Atlas Computing @atlascomputing.bsky.social · 14/04/2025
Attending #ICSE2025 in Ottawa? Join us at the Rust Symposium (Friday, May 2, 9am-5pm) for a full day of cutting-edge tools and research. Featuring speakers from AWS, ETH Zurich, Formal Land, Inria, Microsoft, and Runtime Verification. #RustLang Registration here lu.ma/umi3g2wc
022
Evan Miyazono @miyazono.bsky.social · 27/02/2025
(may I never stop pointing technologists to the federalist papers)
010
Evan Miyazono @miyazono.bsky.social · 27/02/2025
I was recently asked "has there ever been a technology (other than weapons) where there was as much debate about whether it would be good for society as there is for AI?" I'm unusually pleased with my answer: "the creation of the US government"
130
Evan Miyazono @miyazono.bsky.social · 09/02/2025
totally agree! Other books I consider pleasant surprises in this category are Foundations of Decision Analysis by Howard and Abbas, quantum.country, and arxiv.org/abs/1803.05316 for Category Theory
arxiv.org
Seven Sketches in Compositionality: An Invitation to Applied Category Theory
This book is an invitation to discover advanced topics in category theory through concrete, real-world examples. It aims to give a tour: a gentle, quick introduction to guide later exploration. The to...
040
Evan Miyazono @miyazono.bsky.social · 27/12/2024
So I went longer between finishing the first and starting the second than I did between starting the second and finishing the fourth. I'd definitely recommend starting into the second if you haven't to see if the momentum catches you.
110
Evan Miyazono @miyazono.bsky.social · 27/12/2024
Also reminds me of the Utopian Oath from @adapalmer.bsky.social's Terra Ignota series (what such a monastic sacrifice might look like today). I don't know if you've read the series but @benreinhardt.bsky.social, @divya.bsky.social and I all love it.
150
Evan Miyazono @miyazono.bsky.social · 27/12/2024
reminds me of en.wikipedia.org/wiki/Handica... (non-choice sacrifice of resources) en.wikipedia.org/wiki/Altruis... (sacrificing for the good of the family/tribe) but both kinda advance fitness of shared genes, due to natural selection + selection bias (is "natural selection bias" a term?)
en.wikipedia.org
Handicap principle - Wikipedia
220
Evan Miyazono @miyazono.bsky.social · 27/12/2024
I want to be able to mash on my keyboard to select the next most likely autocomplete/autocorrect option. I think I'd tolerate much more aggressive autocorrect if I had this affordance. The voice command "ugh" would also be sufficient.
000
Evan Miyazono @miyazono.bsky.social · 23/12/2024
These systems are inhuman intelligences, and will continue dramatically outperforming humans in more domains and (for now) underperforming in others. If LLMs were growing more capable like a human child, I'd be a lot less worried.
000
Evan Miyazono @miyazono.bsky.social · 23/12/2024
It's easy to find opinions+evidence that "o3 is a superhuman problem solver." Also easy to find takes+evidence that it's way dumber than a child. The surprising takes are the ones that assume only one of these is true.
100
Evan Miyazono @miyazono.bsky.social · 20/12/2024
participant reviews: "My favorite part was hearing someone else's rec - you learn something about the person giving the gift, the person receiving it, and yourself)" "it's like watching someone open someone else's gift thinking 'yeah, nice, I'm getting myself that'"
000
Evan Miyazono @miyazono.bsky.social · 20/12/2024
Step 3: The person who posed the question reveals themself and offers a recommendation. Our recs included south-asian snacks, a Ted Chiang short story, some voyager eps, a bunch of great books, and a few movies. Plus it felt like a nice hangout and close-out.
120
Evan Miyazono @miyazono.bsky.social · 20/12/2024
Step 2: randomly order participants, who choose which elicitation question they want to answer in as much detail as they want. (e.g. the person who picks "what do you like in a story?" could say "fantasy that turns out to be scifi" or "nonfiction that's stranger than fiction")
100
Evan Miyazono @miyazono.bsky.social · 20/12/2024
example preference elicitation questions: What are your top 3 "little treats" and favorite flavor profiles? What's one of the best holiday gifts you ever received, and why? What do you like in a story?
100
Evan Miyazono @miyazono.bsky.social · 20/12/2024
How to do it? Step 1: everyone submits a "preference elicitation question" directly to a coordinator to anonymize (or you could make an anonymous form). So, think of a category of rec (e.g. book, film, snack food, etc) and ask a question that will inform that rec
100
Evan Miyazono @miyazono.bsky.social · 20/12/2024
Why is this a problem? Feels dumb + carbon-intensive to ship white-elephant gifts to each other. I've tried sending books, but preference between e-book, audiobook, physical book, etc is kind of a hassle.
100
Evan Miyazono @miyazono.bsky.social · 20/12/2024
I have a solution I love for the remote-first company holiday gift exchange. A recommendation exchange! Everyone gives and gets a personalized recommendation, no shipping involved - here's how we did it:
110
Evan Miyazono @miyazono.bsky.social · 12/12/2024
"a comprehensive and incomprehensible deep dive" *chef kiss* (stolen from youtu.be/qwiLnLsuqx8?...)
youtu.be
Powerplant Control Panel Tour - Part 1 Authorized Personnel Only S4E1 #engineering #powerplant
YouTube video by Chris Boden
000
Evan Miyazono @miyazono.bsky.social · 11/12/2024
I'm confused - I thought they all had wheels at this size. www.cryofab.com/wp-content/u... at least the ones I used did...
cryofab.com
010
Evan Miyazono @miyazono.bsky.social · 10/12/2024
The Goodhart-Hanlon lazor: Any sufficiently large group or entity appearing to act maliciously likely includes, somewhere, at least one unaware and/or unwilling person nonetheless making things worse by just following orders and maximizing some metric.
041
Evan Miyazono @miyazono.bsky.social · 07/12/2024
I knew FutureHouse generated a mind-numbing number of Wikipedia pages, but I was very surprised to learn that human peer review found 2x the errors in human-generated articles compared to the AI-generated ones
000
Evan Miyazono @miyazono.bsky.social · 07/12/2024
Makes me wonder if there are intuitive ways to quantify this. Especially if you have models of different people for something like a recommendation engine.
000
Evan Miyazono @miyazono.bsky.social · 07/12/2024
I love that Cosmos Ventures includes "supporting individual preferences and abilities" in its definition of human flourishing. "Would a different person make the same choice" seems to be a really interesting indicator of freedom/agency.
140
Evan Miyazono @miyazono.bsky.social · 06/12/2024
"generative adversarial proving" One agent tries to prove the theorem; one tries to find counterexamples
000
Evan Miyazono @miyazono.bsky.social · 05/12/2024
I was surprised to learn that this isn't apparent, and that it might not be common?
000
Evan Miyazono @miyazono.bsky.social · 05/12/2024
I realized I support people because I believe in them - I want to amplify/empower them as an embodiment of their preferences and values. Not because I like the values themselves.
100
Evan Miyazono @miyazono.bsky.social · 05/12/2024
I think I'll start just posting screenshots to tweets I like that aren't on bsky
000
Evan Miyazono @miyazono.bsky.social · 05/12/2024
100
Evan Miyazono @miyazono.bsky.social · 25/11/2024
Totally agree. Flashy LLM applications are NLP, but the interesting directions seem ~ NP-complete problems. Interesting continuation: in this framing, getting enough information from your NP solution could efficiently validate the AI output, which ends up looking ~ like property-based testing.
000
Evan Miyazono @miyazono.bsky.social · 25/11/2024
I'm combating fomo about not being added to starter packs with the belief that it means I'm just part of some "advanced" tier for connoisseurs
020
Evan Miyazono @miyazono.bsky.social · 20/11/2024
😂 a very unintentional advert. which compelled me to check Perplexity (my other go-to): gave a longer answer + more citations for the same question, but I think the answer is worse given the limited (but valid) interpretation of "rock" (i.e. not sand/boulders) www.perplexity.ai/search/has-a...
perplexity.ai
Has anyone estimated distribution of rock sizes for different planetary bodies...
Yes, researchers have estimated and compared the distribution of rock sizes for different planetary bodies, including Earth, Moon, and Mars. Here are some key...
020
Evan Miyazono @miyazono.bsky.social · 20/11/2024
wow. The search was so fast and effective that I feel indulgent having stopped to think first hasanyone.com?id=b52393b3
hasanyone.com
Has Anyone | FutureHouse
Agentically search literature
110
Evan Miyazono @miyazono.bsky.social · 20/11/2024
But also, I assume you could have found a planetary geology paper with better insights in the time it took you to read this 😅. Still fun to consider, though
100
Evan Miyazono @miyazono.bsky.social · 20/11/2024
Factors I assume would matter (but are also probably similar between earth and moon) are rock composition/density/toughness (particularly relative to local ice), and probably atmospheric pressure/windspeed, which starts to pull in distance to the star
100
Evan Miyazono @miyazono.bsky.social · 20/11/2024
I'd assume a rough power law distribution, and imagine one could derive a rough estimate from rock formation and erosion. Assuming the moon and rocky planets reached equilibrium before techtonic activity stopped, I wouldn't be too surprised if the exponent were similar, esp for earth+moon.
110
Reposted by Evan Miyazono
Cat Hicks @grimalkina.bsky.social · 20/11/2024
I don't.... Feel like.... We're grappling with how beyond nuts this is.... I do not have children nor do I intend to but I care about human society and being part of it and therefore childcare feels like one of THE issues we absolutely must solve as a nation, how does everyone not think this
1368
Evan Miyazono @miyazono.bsky.social · 20/11/2024
TIL: phalanges (aka finger/toe bones) is a plural of phalanx (ancient Greek military formation)
000
Reposted by Evan Miyazono
Dr Heidy Khlaaf (هايدي خلاف) @heidykhlaaf.bsky.social · 11/11/2024
Bringing Military x AI posts from other socials: I cannot emphasize enough how much of a disaster this portion of Meta's announcement is for safety engineering and will guarantee a catastrophic incident. TechCrunch covered our criticism here: techcrunch.com/2024/11/04/m...
2115
Evan Miyazono @miyazono.bsky.social · 13/11/2024
Great line from @stuartbuck.bsky.social goodscience.substack.com/p/how-to-imp...
goodscience.substack.com
How to Improve Both Scientific Innovation and Reproducibility at Once
This is a rerun of a piece I wrote for the journal Works in Progress four years ago (here).
010
Evan Miyazono @miyazono.bsky.social · 13/11/2024
> only 3 ways for a scientist to guarantee positive results: - Be a psychic; - Study only marginal, incremental topics where... you can virtually guarantee a positive result; and/or - Skew your research design, data, and analysis, and hide any results that are still null.
100
Evan Miyazono @miyazono.bsky.social · 12/11/2024
cold take: if your idea about the world doesn't include a testable mechanism, it's risky pseudoscience or philosophy spicy take: that includes your favorite interpretation of quantum mechanics and any genetic factors for intelligence
000
Evan Miyazono @miyazono.bsky.social · 12/11/2024
I really want "spec-based AI" to be a term: specification (aka spec) - a set of objective criteria any solution should be verifiable against. spec-based AI - AI systems where outputs can be guaranteed against those objective criteria
010
Evan Miyazono @miyazono.bsky.social · 20/04/2023
Open protocols are the new antitrust because network effects are the new vertical integration
051