Sign in

Polaris

@polarishub.io
758 followers 0 following 126 posts

ML-ready datasets and benchmarks for drug discovery. polarishub.io

PostsRepliesMedia
Polaris @polarishub.io · 28/11/2025
4/ This perspective is basically a friendly nudge to the field: let’s build benchmarks that matter in the real world, not just on leaderboards. Huge thanks to the committee for pulling this together! Read the letter: polarishub.io/guidelines/m...
000
Polaris @polarishub.io · 28/11/2025
3/ Few highlights: — Many benchmarks reward models for finding what we already know — Drug discovery needs models that generalize, identify new biology, and flag problems early — Simple baselines still beat fancy models — We need clearer tasks, cleaner data, and shared frameworks
110
Polaris @polarishub.io · 28/11/2025
2/ Multiomics AI is moving fast, but the benchmarks aren’t keeping up with what drug discovery actually needs. The letter lays out the gap clearly and makes the case for why our community needs better, more realistic ways to measure progress.
100
Polaris @polarishub.io · 28/11/2025
1/ Exciting update from the Multiomics Steering Committee on Polaris! Read the letter: polarishub.io/guidelines/m...
100
Polaris @polarishub.io · 11/09/2025
4/ Make sure to checkout our Open Access paper, associated code and thoughts on implementation 👇 📄 Open Access paper: pubs.acs.org/doi/full/10.... 💻 Code on GitHub: github.com/polaris-hub/... 💭 Thoughts on implementation: polarishub.io/blog/imagini...
000
Polaris @polarishub.io · 11/09/2025
3/ We're especially thrilled that this paper is open access thanks to the JCIM editor's choice program. We hope for the broad adoption of these guidelines to help close the gap between perceived progress and real-world impact in drug discovery.
210
Polaris @polarishub.io · 11/09/2025
2/ The initial preprint was refined with invaluable feedback: ✅ Community: Unique open-feedback period hosted on Github: github.com/polaris-hub/.... ✅ Practical Learnings: Lessons learned from applying these guidelines in the ASAP Antiviral challenge. ✅ Peer Review: Formal review process at JCIM.
100
Polaris @polarishub.io · 11/09/2025
1/ 🚀 Our updated paper on practically significant ML method comparison is now published in JCIM!🚀 How do we ensure a model that tops a leaderboard also delivers a practical, real-world impact in drug-discovery? This paper offers a clear framework to address the field's replicability crisis.
111
Polaris @polarishub.io · 30/04/2025
(3/3) Ready to explore the findings? Now’s your chance. Analyze the data, test your ideas, and drop your insights in the Discord. Join the Polaris community on Discord to dive deeper into the challenge results and share what you discover: discord.com/invite/cS6Nf...
000
Polaris @polarishub.io · 30/04/2025
(2/3) 📢 In addition, ASAP is hosting a virtual showcase tomorrow, April 30 at 11AM ET / 5PM BST featuring top performers from the challenge. Speakers will present their methods, background, and post-hoc analyses now that the test data is live. Register for the link: docs.google.com/forms/d/e/1F...
100
Polaris @polarishub.io · 30/04/2025
(1/3) 🎉 Exciting Updates: Antiviral Unblinded Datasets! 🎉 Following the release of the ASAP Discovery x OpenADMET antiviral challenge leaderboard, the evaluation code is now open-sourced and the unblinded datasets are available on Polaris. Unblinded Datasets: polarishub.io/datasets?acc...
100
Polaris @polarishub.io · 08/04/2025
Stay updated on the Multiomics Steering Committee's work by subscribing to our mailing list: polarishub.io#subscribe-to...
polarishub.io
Polaris
The benchmarking platform for drug discovery
000
Polaris @polarishub.io · 08/04/2025
and Rob Moccia (formerly Pfizer), Cuong Q. Nguyen (formerly GSK), Nate Robichaud (Nomic), William J. Godinez (Novartis), Tommaso Biancalani (Genentech), and Kristina Ulicna (Valence Labs). 🧵
100
Polaris @polarishub.io · 08/04/2025
Led by experts from academia and industry, the committee includes: Oren Kraus (Recursion), Judith Mueller (Merck), Ali Denton (Valence Labs), Fabian J. Theis (Helmholtz Munich), Paula A. Marin Zapata (Bayer), Anne E. Carpenter (Broad Institute), Ian Barrett (AstraZeneca)... 🧵
100
Polaris @polarishub.io · 08/04/2025
Multiomics data holds the potential to unravel biological complexity by providing complementary insights into cellular states of disease and their modulation through novel therapeutics. We aim to propose clear definitions, identify benchmarking tasks, and encourage alignment on best practices. 🧵
100
Polaris @polarishub.io · 08/04/2025
We're thrilled to announce the formation of the new Multiomics Steering Committee! By "multiomics" we refer to the integration of high-dimensional data modalities at the cellular level, encompassing molecular (DNA, RNA, protein) and phenotypic (imaging-based, multi-cell-line viability) readouts. 🧵
242
Polaris @polarishub.io · 21/03/2025
🔔 Stay Updated! For future challenges & collaborative opportunities, subscribe to our mailing list. ✉️ polarishub.io#subscribe-to...
000
Polaris @polarishub.io · 21/03/2025
📢 We value your feedback! Help us improve future challenges, share your thoughts. 📄 Feedback Form: share-eu1.hsforms.com/23XmDlumfQBu...
110
Polaris @polarishub.io · 21/03/2025
📝 Next Steps: ASAP Discovery & OpenADMET are writing a paper summarizing insights from the challenge. All participants are invited to contribute. Join us on Discord: discord.gg/cS6Nfj58Gf
100
Polaris @polarishub.io · 21/03/2025
For detailed metrics, leaderboards, and further information, see the challenge page: antiviral.polarishub.io
100
Polaris @polarishub.io · 21/03/2025
🚀 Antiviral Challenge Results! 🚀 After weeks of competition, and nearly 400 submissions, the antiviral challenge has concluded! Thank you to all of our participants. Each submission came with a report — check out the full leaderboard and find more details 👇
151
Polaris @polarishub.io · 10/03/2025
Thanks for the feedback, @greglandrum.bsky.social! We're always looking for ways to improve the accessibility and value of the platform so we'll take this into consideration as we continue to build. 🙏
020
Polaris @polarishub.io · 09/03/2025
📢 Antiviral Challenge Deadline Extended! 🦠 We’ve extended the deadline for the Antiviral Challenge until March 14th at 12:00 PM ET! 💡 To be eligible for the final leaderboard, you’ll need to share a short (~1 page) report about your method. Submit here: polarishub.io/competitions
000
Polaris @polarishub.io · 03/03/2025
We also want to give a huge shoutout to the community for sharing feedback on the challenge! Let’s keep the conversation going. Join us on Discord: discord.gg/VaCbn82CeD
discord.gg
Join the Polaris Discord Server!
Check out the Polaris community on Discord - hang out with 404 other members and enjoy free voice and text chat.
010
Polaris @polarishub.io · 03/03/2025
🚀 Leaderboard Update: Antiviral Challenge! 🚀 The latest rankings are in—check out where you stand: antiviral.polarishub.io Missed this update? No worries, you still have time to compete! The challenge runs until March 10th at midnight. Get started today: polarishub.io/competitions
120
Polaris @polarishub.io · 25/02/2025
Did you miss the cutoff for the last intermediate leaderboard of the antiviral challenge? We’re doing one last leaderboard update before the challenge ends on March 10th! Submit something by midnight, Feb 26th, to see how you place. Submit your results today: polarishub.io/competitions
020
Polaris @polarishub.io · 24/02/2025
Thanks to everyone who joined us last week! You can now watch the recording of the webinar: youtu.be/_ykP_tEVrOk
youtu.be
Have protein-ligand co-folding methods moved beyond memorisation? | Peter Škrinjar
YouTube video by PolarisHQ
040
Polaris @polarishub.io · 21/02/2025
Reminder - this webinar is happening today at 11 AM ET! Join us live in ~40 minutes: us06web.zoom.us/webinar/regi...
us06web.zoom.us
Welcome! You are invited to join a webinar: Have protein co-folding methods moved beyond memorization?. After registering, you will receive a confirmation email about joining the webinar.
The Polaris team is excited to host first author Peter Škrinjar to discuss how training data similarity impacts protein-ligand binding. In the Runs N' Poses benchmark, the paper shows that current co-...
001
Polaris @polarishub.io · 20/02/2025
Polaris is on a mission to bring innovators and practitioners closer together to develop methods that matter. We’re excited to welcome Nicola, Michael, and Nils, who will work with the existing SC to craft guidelines around benchmarking for the community. Learn more: polarishub.io/guidelines
polarishub.io
Polaris
The benchmarking platform for drug discovery
010
Polaris @polarishub.io · 20/02/2025
Today, we’re excited to welcome Nicola Richmond (@recursionpharma.bsky.social), Michael Reutlinger (Roche), and Nils Weskamp (@boehringerglobal.bsky.social) to the Small Molecule Steering Committee at Polaris! Learn more about what the steering committee is up to: polarishub.io/guidelines
171
Polaris @polarishub.io · 17/02/2025
We want to make sure this challenge allows us to learn collectively as a community. We'd love to hear from you if you have ideas or feedback on how we can structure the challenge better. Join us on Discord and let’s chat! discord.gg/VaCbn82CeD
discord.gg
Join the Polaris Discord Server!
Check out the Polaris community on Discord - hang out with 386 other members and enjoy free voice and text chat.
010
Polaris @polarishub.io · 17/02/2025
⚡ The intermediate leaderboard for the antiviral challenge is now live! 👀 See how you placed: antiviral.polarishub.io The challenge officially ends on March 10th, but there's one last leaderboard update before the final results. Submit before midnight on Feb 26th! polarishub.io/competitions
132
Polaris @polarishub.io · 13/02/2025
We’re hosting @peterskrinjar.bsky.social for a webinar to discuss his latest paper “Have protein co-folding methods moved beyond memorization?”! Join live on Feb 21st at 11 AM ET. Register here: us06web.zoom.us/webinar/regi... Explore Runs N’ Poses on Polaris today: polarishub.io/benchmarks/p...
0168
Polaris @polarishub.io · 10/02/2025
We’re extremely excited to host Runs N’ Poses on Polaris! The authors show how current co-folding methods struggle to generalize beyond ligand poses in their training data. Explore the benchmark: polarishub.io/benchmarks/p... Explore the dataset: polarishub.io/datasets/pli...
073
Polaris @polarishub.io · 06/02/2025
Thanks for the contribution, Jackson! Check your DM's. We wanna send you some Polaris merch 🔥
020
Reposted by Polaris
Cas @caswognum.nl · 04/02/2025
Big milestone for @polarishub.io. We merged our first external contribution, thanks to @fastprop.bsky.social! 🎉 github.com/polaris-hub/... #opensource #benchmarking #ml #drugdiscovery
github.com
`Subset.as_dataframe()` hides targets instead of raising an error by JacksonBurns · Pull Request #258 · polaris-hub/polaris
Changelogs Subset.as_dataframe() would raise an error when called on a test set (which hides its targets), this PR allows method to work, just doesn't return targest Checklist: Was this PR...
151
Polaris @polarishub.io · 31/01/2025
🚨 Extension Alert: The intermediate leaderboard submission deadline for the antiviral challenge has been extended to midnight on February 7th! Don't miss this chance to see how you stack up against other participants! Submit your results today: polarishub.io/competitions
022
Polaris @polarishub.io · 30/01/2025
Explore hundreds of ML-ready datasets and benchmarks on Polaris today! The antiviral challenge with @asapdiscovery.bsky.social and @omsf.io is also live! If you're looking to test your skills on new, consistently generated data, now's your chance: polarishub.io/competitions
021
Polaris @polarishub.io · 30/01/2025
🪑 Consistent benchmarks — we store the exact indices used in each split and each metric is codified in a single, transparent implementation. Explore the benchmarks: polarishub.io/benchmarks?a...
polarishub.io
Polaris
The benchmarking platform for drug discovery
120
Polaris @polarishub.io · 30/01/2025
💻 ML-ready datasets — download what you need from Polaris and start training. No pre-processing and no wrangling with different file formats. It only takes a few lines of code to download what you need from Polaris!
100
Polaris @polarishub.io · 30/01/2025
💽 Immutable datasets — once a dataset is uploaded to Polaris, it's permanently locked. Every time you or anyone else downloads the dataset, you'll get the same version. Explore datasets today: polarishub.io/datasets?acc...
polarishub.io
Polaris
The benchmarking platform for drug discovery
100
Polaris @polarishub.io · 30/01/2025
You’ve heard us talk about our mission to be the source of truth for the ML community in drug discovery. But what does that really mean, and how does it shape the way Polaris is built? In the latest blog, we break down the key design choices that make this possible: polarishub.io/blog/reprodu...
141
Reposted by Polaris
Austin Tripp @austinjtripp.bsky.social · 26/01/2025
Easy to get started on the antiviral challenge! I plan to submit some GP baselines from my PhD work (possibly with a collaborator).
051
Reposted by Polaris
Conscience @conscience-network.bsky.social · 27/01/2025
While we gear up to welcome both Polaris and ASAP to our Symposium in April, they have been cooking up something special. They're releasing an intermediate leaderboard for the antiviral challenge on the 31st. So you (looking at #CACHEChallenge participants!) have a few days to get in a prediction!
133
Polaris @polarishub.io · 27/01/2025
Who to expect: Ed Griffen (Lead Medicinal Chemist), Haim Barr (Lead Biochemistry), Jess Stacey (Sr. Comp Chem), Hugo MacDermott-Opeskin (Tech Lead) @jenkescheen.bsky.social, David Cousins (Sr Med Chem), Daren Fearon (Sr Scientist - Structural Biology). RSVP at the link above!
020
Polaris @polarishub.io · 27/01/2025
🗓️ Office Hours Schedule 🗓️ Jan 30th: 9 AM GMT / 10 AM CET Jan 30th: 8:30 AM PT / 11:30 AM ET Jan 31st: 8 AM PT / 11 AM ET docs.google.com/forms/d/e/1F...
docs.google.com
ASAP:OpenADMET:Polaris Blind Challenge Virtual Office Hours
This is a form to gather participants' email addresses so that we can invite you to the Blind Challenge office hours. These office hours are intended for participants in the ASAP:OpenADMET:Polaris com...
110
Polaris @polarishub.io · 27/01/2025
💡Have questions about the data behind the antiviral challenge?💡 This week, @asapdiscovery.bsky.social and @omsf.io are hosting 3 virtual office hour sessions with the experimentalists behind the data! RSVP here: docs.google.com/forms/d/e/1F...
143
Polaris @polarishub.io · 24/01/2025
With MassSpecGym, the goal is to provide researchers with more data and better benchmarks to accelerate the hunt for new, therapeutically valuable natural products. 📜 Read the paper to learn more: arxiv.org/pdf/2410.23326
arxiv.org
120
Polaris @polarishub.io · 24/01/2025
But decoding molecular structures from mass spectra is incredibly challenging, even for human experts. That’s why researchers are increasingly turning to machine learning to tackle this problem. ML aims to make structure elucidation from mass spec data faster, more accurate, and more scalable
110
Polaris @polarishub.io · 24/01/2025
For example, Rapamycin: a potent immunosuppressant, was first discovered in soil samples from Easter Island. Mass spec was used to reveal its structure, sparking a billion-dollar drug industry. It’s used to prevent organ transplant rejection, in cancer therapies, and has anti-aging potential.
110