iiinova — where your digital self keeps evolving

Kayo Yin @kayoyin.bsky.social · 29/07/2025

I'm excited for #CogSci2025 in SF this week! I would love to meet more people thinking about language and cognition, especially signed languages! Please feel free to reach out :)

030

Reposted by Kayo Yin

Robert Hawkins @rdhawkins.bsky.social · 28/05/2025

Happy to announce the first workshop on Pragmatic Reasoning in Language Models — PragLM @ COLM 2025! 🎉 How do LLMs engage in pragmatic reasoning, and what core pragmatic capacities remain beyond their reach? 🌐 sites.google.com/berkeley.edu/praglm/ 📅 Submit by June 23rd

Reposted by Kayo Yin

Naomi Saphra @nsaphra.bsky.social · 03/03/2025

More evidence of the importance of training analysis for interp! Induction heads might serve as *preliminary* function vector heads (which directly compute in-context learning tasks). Ultimately, LMs rely on FV heads more than IH heads for ICL. from @kayoyin.bsky.social

arxiv.org

Which Attention Heads Matter for In-Context Learning?

Large language models (LLMs) exhibit impressive in-context learning (ICL) capability, enabling them to perform new tasks using only a few demonstrations in the prompt. Two different mechanisms have be...

2142

Reposted by Kayo Yin

Prof. Nicole Holliday @mixedlinguist.bsky.social · 28/02/2025

On Nov. 7th, I told my sociolinguistics students this was going to happen. They did an activity on language policy and one of the lessons was that repressive regimes always try to criminalize languages that are not ideologically associated with nationalism. I’m sorry I was right.

17468157

Kayo Yin @kayoyin.bsky.social · 28/02/2025

Induction heads are commonly associated with in-context learning, but are they the primary driver of ICL at scale? We find that recently discovered "function vector" heads, which encode the ICL task, are the actual primary mechanisms behind few-shot ICL! arxiv.org/abs/2502.14010 🧵👇

1227

Kayo Yin @kayoyin.bsky.social · 19/02/2025

I’m visiting pittsburgh this Sunday until next Tuesday, I’d love to catch up with friends and meet new people! DM me :) this will be my first time back since I graduated 🫶

010

Kayo Yin @kayoyin.bsky.social · 17/01/2025

I'm presenting this virtually at #TISLR15 very soon at 2:35pm today Ethiopia time (3:35am Pacific 😀) !

071

Reposted by Kayo Yin

Randall Munroe @xkcd.com · 16/12/2024

Phase Transition xkcd.com/3025

179203452470

Kayo Yin @kayoyin.bsky.social · 15/12/2024

took my dog to the beach today. His name is apollo and he’s 14 years old :)

A small white bichon frisé dog running on the water at a beach, the sky behind is late sunset colors

0130

Kayo Yin @kayoyin.bsky.social · 03/12/2024

My latest talk on NLP for signed languages presented at the Japanese NLP colloquium doesn’t have an English version yet, maybe you can fix this by inviting me to give a talk :D

030

Reposted by Kayo Yin

Masato Hagiwara @mhagiwara.bsky.social · 02/12/2024

Just watched @kayoyin.bsky.social's fantastic talk at the Japanese NLP colloquium on sign language processing. It broadened my perspective on what language is and how AI can support Deaf and hard-of-hearing communities. Highly recommended! youtu.be/7dD8wu-Chbo

youtu.be

第67回: 手話の自然言語処理

YouTube video by NLPコロキウム

031

Kayo Yin @kayoyin.bsky.social · 26/11/2024

this is driving me crazy, does anyone recognize this song?? It’s stuck in my head but I can’t remember where I heard it

200

Kayo Yin @kayoyin.bsky.social · 22/11/2024

multiple people told me I seem to be in a visibly better mood the past 2 days which coincides perfectly with Berkeley finally getting rainy weather

Photo from window outside my office in berkeley where the sky is white from clouds and it’s raining

060

Kayo Yin @kayoyin.bsky.social · 21/11/2024

✨TISLR 15 stage presentation✨ Spoken languages exhibit communicative efficiency by minimizing speaker+listener effort. What about signed languages? ASL handshapes reflect efficiency pressures - but only in native signs, not signs borrowed from English! aclanthology.org/2024.acl-lon... 🧵

Two figures on a pink background. Left: qualitative plot with "handshape frequency" on x-axis and "articulatory effort" on y-axis. There are 5 handshapes roughly on a diagonal from top-left to bottom-right: higher the handshape frequency, lower the articulatory effort.

Right: Venn diagram titled "Example handshapes in ASL," showing three categories of handshapes: "Native only," "Foreign only," and "Common to all components." The diagram includes illustrations of various handshapes within these categories.

2296

Kayo Yin @kayoyin.bsky.social · 20/11/2024

whenever I open this app I can’t help but sing “heyy there mister blue” in my head

050

Kayo Yin @kayoyin.bsky.social · 19/11/2024

🚨New dataset + challenge🚨 We release ASL STEM Wiki: the first signing dataset of STEM articles! 📰 254 Wikipedia articles 📹 ~300 hours of ASL interpretations 👋 New task: automatic sign suggestion to make STEM education more accessible microsoft.com/en-us/resear... 🧵 #EMNLP2024

23710

Kayo Yin @kayoyin.bsky.social · 18/11/2024

first post 🦋 food in miami was so good thanks emnlp

080