iiinova — where your digital self keeps evolving

Giwon Hong

@giwonhong.bsky.social

521 followers 603 following 9 posts

PhD student in ILCC (NLP) program at the University of Edinburgh

Posts Replies Media

Reposted by Giwon Hong

Aryo Pradipta Gema @aryopg.bsky.social · 02/05/2025

MMLU-Redux just touched down at #NAACL2025! 🎉 Wish I could be there for our "Are We Done with MMLU?" poster today (9:00-10:30am in Hall 3, Poster Session 7), but visa drama said nope 😅 If anyone's swinging by, give our research some love! Hit me up if you check it out! 👋

01711

Reposted by Giwon Hong

Benjamin Minixhofer @bminixhofer.bsky.social · 02/04/2025

We created Approximate Likelihood Matching, a principled (and very effective) method for *cross-tokenizer distillation*! With ALM, you can create ensembles of models from different families, convert existing subword-level models to byte-level and a bunch more🧵

Image illustrating that ALM can enable Ensembling, Transfer to Bytes, and general Cross-Tokenizer Distillation.

12514

Reposted by Giwon Hong

Pasquale Minervini @neuralnoise.com · 19/11/2024

Joining the Generative AI Lab (GAIL, gail.ed.ac.uk) at the University of Edinburgh as a GAIL Fellow! Excited for what's ahead 🤗

gail.ed.ac.uk

Generative AI Laboratory

0192

Giwon Hong @giwonhong.bsky.social · 18/11/2024

🤔How to achieve efficient ICL without storing a huge dataset in one prompt? 💡Mixtures of In-Context Learners (𝗠𝗼𝗜𝗖𝗟): we treat LLMs prompted with subsets of demonstrations as experts and learn a weighting function to optimise the distribution over the continuation (🧵1/n)

1334

Reposted by Giwon Hong

Aryo Pradipta Gema @aryopg.bsky.social · 18/11/2024

I’ll be travelling to London from Wednesday to Friday for an upcoming event and would be very happy to meet up! 🚀 I'd love to chat about my recent works (DeCoRe, MMLU-Redux, etc.). DM me if you’re around! 👋 DeCoRe: arxiv.org/abs/2410.18860 MMLU-Redux: arxiv.org/abs/2406.04127

0117