Sign in

Sebastian Dziadzio

@dziadzio.bsky.social
626 followers 889 following 56 posts

ELLIS PhD student in machine learning at IMPRS-IS. Continual learning at scale. sebastiandziadzio.com

PostsRepliesMedia
Reposted by Sebastian Dziadzio
Adhiraj Ghosh @adhirajghosh.bsky.social · 17/05/2025
🏆ONEBench accepted to ACL main! ✨ Stay tuned for the official leaderboard and real-time personalised benchmarking release! If you’re attending ACL or are generally interested in the future of foundation model benchmarking, happy to talk! #ACL2025NLP #ACL2025 @aclmeeting.bsky.social
082
Reposted by Sebastian Dziadzio
Alfredo Canziani @alfcnz.bsky.social · 12/12/2024
The Practitioner's Guide to Continual Multimodal Pretraining @dziadzio.bsky.social @confusezius.bsky.social @vishaalurao.bsky.social @bayesiankitten.bsky.social
0244
Sebastian Dziadzio @dziadzio.bsky.social · 11/12/2024
📄 New Paper: "How to Merge Your Multimodal Models Over Time?" arxiv.org/abs/2412.06712 Model merging assumes all finetuned models are available at once. But what if they need to be created over time? We study Temporal Model Merging through the TIME framework to find out! 🧵
arxiv.org
How to Merge Your Multimodal Models Over Time?
Model merging combines multiple expert models - finetuned from a base foundation model on diverse tasks and domains - into a single, more capable model. However, most existing model merging approaches...
1257
Sebastian Dziadzio @dziadzio.bsky.social · 10/12/2024
Come chat to us at NeurIPS about continual multimodal pretraining and some interesting follow-ups 👀
020
Reposted by Sebastian Dziadzio
Adhiraj Ghosh @adhirajghosh.bsky.social · 10/12/2024
🚨Looking to test your foundation model on an arbitrary and open-ended set of capabilities, not explicitly captured by static benchmarks? 🚨 Check out ✨ONEBench✨, where we show how sample-level evaluation is the solution. 🔎 arxiv.org/abs/2412.06745
1185
Sebastian Dziadzio @dziadzio.bsky.social · 10/12/2024
The changing of the guard ceremony in Vancouver is complete
Kickstand advertising a Taylor Swift pop-up store.Kickstand advertising a coffee shop to NeurIPS attendees.
140
Sebastian Dziadzio @dziadzio.bsky.social · 29/11/2024
How I use LLMs when writing papers: 1. Write a sentence. 2. Copy it to an LLM for edits, add a prompt explaining in simple words what I'm trying to say. 3. Realise my simple word explanation is actually what I need. 4. Copy it over to the paper, move on to the next sentence.
1100
Reposted by Sebastian Dziadzio
Karsten Roth @confusezius.bsky.social · 28/11/2024
🤔 Can you turn your vision-language model from a great zero-shot model into a great-at-any-shot generalist? Turns out you can, and here is how: arxiv.org/abs/2411.15099 Really excited to this work on multimodal pretraining for my first bluesky entry! 🧵 A short and hopefully informative thread:
213324
Sebastian Dziadzio @dziadzio.bsky.social · 25/11/2024
I went to a fitness class and the trainer finished it with capitalist affirmations?? He was like "you are a person who gets things done, people like to work with you" lmao
140
Reposted by Sebastian Dziadzio
Adhiraj Ghosh @adhirajghosh.bsky.social · 19/11/2024
I've found starter packs on NLP, vision, graphics, etc. But personally, I would love to know and hear from researchers working on vision-language. So, let me know if you'd like to join this starter pack, would be happy to add! go.bsky.app/TENRRBb
425613
Sebastian Dziadzio @dziadzio.bsky.social · 22/11/2024
Berlin autumn means weather is glitching (pics are 3h apart)
0110
Sebastian Dziadzio @dziadzio.bsky.social · 19/11/2024
enjoying this app so far, my only issue is that I can't prevent my polish brain from pronouncing Bluesky like brewsky or kowalski
140
Sebastian Dziadzio @dziadzio.bsky.social · 19/11/2024
Here's a fledgling starter pack for the AI community in Tübingen. Let me know if you'd like to be added! go.bsky.app/NFbVzrA
go.bsky.app
Tübingen AI
Join the conversation
182513
Reposted by Sebastian Dziadzio
Jeff Stormer @jeffstormer.gobirds.online · 13/11/2024
Hello all: It is with a heavy heart that I remove my Starter Pack of "Trustworthy Mesopotamian Copper Ingot Merchants Within the City-State of Ur." I have been informed about some pretty unfortunate oversights on my part and ultimately platformed some creators who should not have been platformed.
172116073225