iiinova — where your digital self keeps evolving

Ismail Elezi

@ismailelezi.bsky.social

Senior Research Scientist at Huawei Noah Ark, London

Ismail Elezi @ismailelezi.bsky.social · 22/01/2025

And on a fun note, 4 years after completing the computer vision holy trinity (CVPR, ICCV, ECCV), finally completed the machine learning conference trinity (NeurIPS, ICML, ICLR). n apparently = 6

010

Ismail Elezi @ismailelezi.bsky.social · 22/01/2025

We will update the paper with the latest results, but the findings are identical to the current ArXiV version: arxiv.org/abs/2410.17174 On a personal note, always wanted to visit Singapore and this seems the perfect way to do so. n/n, n=5

lnkd.in

This link will take you to a page that’s not on LinkedIn

100

Ismail Elezi @ismailelezi.bsky.social · 22/01/2025

Would like to thank my co-authors: Prannay Kaul who interned with me during the course of the project and was the main force of the project, my previous intern Chengcheng Ma who run so many experiments during the course of the project and the rebuttal, and of course Jiankang Deng who advised us. 4/n

100

Ismail Elezi @ismailelezi.bsky.social · 22/01/2025

While providing some real-world utility, in the terms of Transformer-quantization. For practical reasons, most of our experiments were on GPT-2 models, but our preliminary experiments show that everything holds for modern LLMs such as LLama family. 3/n

100

Ismail Elezi @ismailelezi.bsky.social · 22/01/2025

and provides some simple and practical solutions to the problem of channel outliers and the first-token dominance in autoregressive Transformers (your LLMs). 2/n

100

Ismail Elezi @ismailelezi.bsky.social · 22/01/2025

First accepted paper of the year: "From Attention to Activation: Unraveling the Enigmas of Large Language Models" has been accepted to ICLR 2025. The most educative paper I have co-wrote, it strengthens some claims known in the community, it opposes others, 1/n

120

Ismail Elezi @ismailelezi.bsky.social · 09/12/2024

We offer long internships (6+ months), competitive salaries, an office in the center of London, and a very diverse group (very gender-balanced, researchers from 8 countries working on a wide range of topics).

000

Ismail Elezi @ismailelezi.bsky.social · 09/12/2024

have topic match (VLLMs, LLMs, multimodality learning, or diffusion) and are interested in doing an internship at Huawei Research Center in London, please write to me and let’s have a chat in the conference.

100

Ismail Elezi @ismailelezi.bsky.social · 09/12/2024

As always, even more happy to chat during the conference with other researchers, especially with junior ones. If you are presenting some paper in NeurIPS (or have first author papers in equivalent conferences such as ICML, ICLR, CVPR, ICCV or ECCV),

100

Ismail Elezi @ismailelezi.bsky.social · 09/12/2024

I am very happy to attend NeurIPS in Vancouver when together with Roy Miles we will be presenting our VeLora paper on Thu 12 Dec 4:30 p.m. PST — 7:30 p.m. PST.

100

Ismail Elezi @ismailelezi.bsky.social · 26/11/2024

Hey Kostas, would love to be in this.

110

Ismail Elezi @ismailelezi.bsky.social · 26/11/2024

Hey, I would love to join this.

000

Ismail Elezi @ismailelezi.bsky.social · 26/11/2024

Hey, I would love to be added. :)

110