Sign in

Sebastian Loeschcke

@sloeschcke.bsky.social
378 followers 203 following 25 posts

Working on Efficient Training, Low-Rank Methods, and Quantization. PhD at the University of Copenhagen 🇩🇰 Member of @belongielab.org, Danish Data Science Academy, and Pioneer Centre for AI 🤖 🔗 sebulo.github.io/

PostsRepliesMedia
Reposted by Sebastian Loeschcke
Serge Belongie @serge.belongie.com · 30/01/2026
A factor of 10 billion since 2010 😮 A couple of eye-opening slides form @sloeschcke.bsky.social's presentation at today’s @belongielab.org meeting (1/2)
2118339
Sebastian Loeschcke @sloeschcke.bsky.social · 13/08/2025
🇳🇱 𝗤𝘂𝗮𝗹𝗰𝗼𝗺𝗺 𝗔𝗜 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗜𝗻𝘁𝗲𝗿𝗻𝘀𝗵𝗶𝗽 🇳🇱 Excited to join @qualcomm.bsky.social in Amsterdam as a research intern in the Model Efficiency group, where I’ll be working on quantization and compression of machine learning models. I’ll return to Copenhagen in December to start the final year of my PhD.
070
Reposted by Sebastian Loeschcke
Stella Frank @scfrank.bsky.social · 13/06/2025
📯 Best Paper Award at CVPR workshop on Visual concepts for our (@doneata.bsky.social + @delliott.bsky.social) paper on probing vision/lang/ vision+lang models for semantic norms! TLDR: SSL vision models (swinV2, dinoV2) are surprisingly similar to LLM & VLMs even w/o lang 👀 arxiv.org/abs/2506.03994
1134
Sebastian Loeschcke @sloeschcke.bsky.social · 03/06/2025
Check out our new preprint 𝐓𝐞𝐧𝐬𝐨𝐫𝐆𝐑𝐚𝐃. We use a robust decomposition of the gradient tensors into low-rank + sparse parts to reduce optimizer memory for Neural Operators by up to 𝟕𝟓%, while matching the performance of Adam, even on turbulent Navier–Stokes (Re 10e5).
2317
Reposted by Sebastian Loeschcke
Serge Belongie @serge.belongie.com · 30/03/2025
Would you present your next NeurIPS paper in Europe instead of traveling to San Diego (US) if this was an option? Søren Hauberg (DTU) and I would love to hear the answer through this poll: (1/6)
docs.google.com
NeurIPS participation in Europe
We seek to understand if there is interest in being able to attend NeurIPS in Europe, i.e. without travelling to San Diego, US. In the following, assume that it is possible to present accepted papers ...
6279161
Sebastian Loeschcke @sloeschcke.bsky.social · 08/03/2025
Visited the beautiful UC Santa Barbara yesterday.
020
Reposted by Sebastian Loeschcke
Zhaochong An @zhaochongan.bsky.social · 11/02/2025
Thrilled to announce "Multimodality Helps Few-shot 3D Point Cloud Semantic Segmentation" is accepted as a Spotlight (5%) at #ICLR2025! Our model MM-FSS leverages 3D, 2D, & text modalities for robust few-shot 3D segmentation—all without extra labeling cost. 🤩 arxiv.org/pdf/2410.22489 More details👇
1257
Sebastian Loeschcke @sloeschcke.bsky.social · 28/01/2025
☀️ Moved to Pasadena, California! ☀️ For the next five months, I’ll be a Visiting Student Researcher at Anima Anandkumar's group at Caltech, collaborating with her team and Jean Kossaifi from NVIDIA on Efficient Machine Learning and AI4Science.
View from the office building
280
Reposted by Sebastian Loeschcke
Nico Lang @nicolang.bsky.social · 24/01/2025
Recordings of the SSL4EO-2024 summer school are now released! This blog post summarizes what has been covered: langnico.github.io/posts/SSL4EO... Recordings: www.youtube.com/playlist?lis... Course website: ankitkariryaa.github.io/ssl4eo/ [1/3]
Screenshot of the course website for "SSL4EO: Self-Supervised Learning for Earth Observation"
33615
Reposted by Sebastian Loeschcke
Serge Belongie @serge.belongie.com · 16/12/2024
New Starter Pack: Pioneer Centre for AI researchers
0335
Sebastian Loeschcke @sloeschcke.bsky.social · 12/12/2024
Come by our poster session tomorrow! 🗓️ West Ballroom A-D #6104 🕒 Thu, 12 Dec, 4:30 p.m. – 7:30 p.m. PST @madstoftrup.bsky.social and I are presenting LoQT: Low-Rank Adapters for Quantized Pretraining: arxiv.org/abs/2405.16528 #Neurips2024
073
Sebastian Loeschcke @sloeschcke.bsky.social · 11/12/2024
Copenhagen University and Aarhus University meet-up in Vancouver 🇩🇰🇨🇦 #NeurIPS2024
060
Sebastian Loeschcke @sloeschcke.bsky.social · 08/12/2024
On my way to NeurIPS in Vancouver 🇨🇦 Looking forward to reconnecting with friends and meeting new people. Let me know if you are interested in efficient training, quantization, or grabbing a coffee! #NeurIPS2024
0181
Sebastian Loeschcke @sloeschcke.bsky.social · 03/12/2024
Check out the work our lab in Copenhagen will be presenting at #NeurIPS2024 🌟 @neuripsconf.bsky.social @belongielab.org
020
Reposted by Sebastian Loeschcke
Belongie Lab @belongielab.org · 25/11/2024
Here’s a starter pack with members of our lab that have joined Bluesky
go.bsky.app
Belongie Lab
Join the conversation
0134
Sebastian Loeschcke @sloeschcke.bsky.social · 22/11/2024
Pre-NeurIPS Poster Session in Copenhagen. Thanks to the Pioneer Centre for AI and @ellis.eu for sponsoring. @neuripsconf.bsky.social #neurips2024
0131
Reposted by Sebastian Loeschcke
ELLIS @ellis.eu · 22/11/2024
Check out the ELLIS Pre-NeurIPS Fest event today in...🇩🇰Copenhagen! ELLIS Unit Copenhagen is holding their event at the Pioneer Center for AI showcasing #NeurIPS posters and other Denmark-affiliated papers in #AI and #ML. More info: bit.ly/4fRFrAh
bit.ly
ELLIS Pre-NeurIPS Fest 2024: Celebrate, Connect, Collaborate
The ELLIS mission is to create a diverse European network that promotes research excellence and advances breakthroughs in AI, as well as a pan-European PhD program to educate the next generation of AI...
0245
Reposted by Sebastian Loeschcke
Maria Antoniak @mariaa.bsky.social · 19/11/2024
I'm recruiting 1-2 PhD students to work with me at the University of Colorado Boulder! Looking for creative students with interests in #NLP and #CulturalAnalytics. Boulder is a lovely college town 30 minutes from Denver and 1 hour from Rocky Mountain National Park 😎 Apply by December 15th!
A photo of Boulder, Colorado, shot from above the university campus and looking toward the Flatirons.
9302136
Sebastian Loeschcke @sloeschcke.bsky.social · 19/11/2024
Join us for the 𝗣𝗿𝗲-𝗡𝗲𝘂𝗿𝗜𝗣𝗦 𝗣𝗼𝘀𝘁𝗲𝗿 𝗦𝗲𝘀𝘀𝗶𝗼𝗻 in Copenhagen! 🗓️ 𝗪𝗵𝗲𝗻: 16:00–18:00, Nov. 22, 2024 📍 𝗪𝗵𝗲𝗿𝗲: Entrance Hall, Gefion, Øster Voldgade 10, 1350 København K. Present or explore European contributions to NeurIPS 2024 and connect with colleagues. 👉 𝗜𝗻𝗳𝗼 & 𝘀𝗶𝗴𝗻-𝘂𝗽: www.aicentre.dk/events/pre-n...
1123
Sebastian Loeschcke @sloeschcke.bsky.social · 18/11/2024
Ever wanted to train your own 13B Llama2 model from scratch on a 24GB GPU? Or fine-tune one without compromising performance compared to full training? 🦙 You now can, with LoQT: Low-Rank Adapters for Quantized Pretaining! arxiv.org/abs/2405.16528 1/4
23111
Reposted by Sebastian Loeschcke
Serge Belongie @serge.belongie.com · 17/11/2024
A new approach to training models in memory-constrained settings, LoQT allows for the pre-training of a 13B LLM on a 24GB GPU without model parallelism, checkpointing, or offloading strategies during training Code: github.com/sebulo/LoQT
github.com
GitHub - sebulo/LoQT
Contribute to sebulo/LoQT development by creating an account on GitHub.
2405
Reposted by Sebastian Loeschcke
Belongie Lab @belongielab.org · 17/11/2024
Logging on! 🧑‍💻🦋 We're the Belongie Lab led by @sergebelongie.bsky.social. We study Computer Vision and Machine Learning, located at the University of Copenhagen and Pioneer Centre for AI. Follow along to hear about our research past and present! www.belongielab.org
belongielab.org
Belongie Lab - Home
Belongie Lab -- Home.
0289