Reposted by Mathias NiepertCSML IIT Lab @pontilgroup.bsky.social · 17/12/2025Almost 5 years in the making... "Hyperparameter Optimization in Machine Learning" is finally out! 📘 We designed this monograph to be self-contained, covering: Grid, Random & Quasi-random search, Bayesian & Multi-fidelity optimization, Gradient-based methods, Meta-learning. arxiv.org/abs/2410.22854 0139
Reposted by Mathias NiepertViktor Zaverkin @viktorzaverkin.bsky.social · 15/08/2025🚨 New preprint: How well do universal ML potentials perform in biomolecular simulations under realistic conditions? There's growing excitement around ML potentials trained on large datasets. But do they deliver in simulations of biomolecular systems? It’s not so clear. 🧵 1/ 151
Mathias Niepert @mniepert.bsky.social · 17/05/2025Anji is an amazing mentor and colleague. If I could go for another PhD in CS I would apply! 081
Reposted by Mathias NiepertDavid Holzmüller @dholzmueller.bsky.social · 24/04/2025🚨ICLR poster in 1.5 hours, presented by @danielmusekamp.bsky.social : Can active learning help to generate better datasets for neural PDE solvers? We introduce a new benchmark to find out! Featuring 6 PDEs, 6 AL methods, 3 architectures and many ablations - transferability, speed, etc.! 1102
Reposted by Mathias NiepertMultiscale AI @ ICLR 2025 @multiscaleai.bsky.social · 18/03/2025Authors: Marimuthu Kalimuthu, @dholzmueller.bsky.social, @mniepert.bsky.social Full text: openreview.net/forum?id=OCM...openreview.netLOGLO-FNO: Efficient Learning of Local and Global Features in...Learning local features and high frequencies is an important problem in Scientific Machine Learning. For instance, effectively modeling turbulence (e.g., $Re=3500$ and above) depends on accurately... 031
Reposted by Mathias NiepertAndreas Kirsch @blackhc.bsky.social · 17/12/2024The slides for my lectures on (Bayesian) Active Learning, Information Theory, and Uncertainty are online now 🥳 They cover quite a bit from basic information theory to some recent papers: blackhc.github.io/balitu/ and I'll try to add proper course notes over time 🤗 317628
Reposted by Mathias Niepertvinhtong.bsky.social @vinhtong.bsky.social · 13/02/2025[9/n] Beyond Image Generation LD3 can be applied to diffusion models in other domains, such as molecular docking. 101
Reposted by Mathias NiepertAnji Liu @anjiliu.bsky.social · 13/02/2025Want to turn your state-of-the-art diffusion models into ultra-fast few-step generators? 🚀 Learn how to optimize your time discretization strategy—in just ~10 minutes! ⏳✨ Check out how it's done in our Oral paper at ICLR 2025 👇 0154
Reposted by Mathias NiepertComBayNS Workshop @combayns-workshop.bsky.social · 13/02/2025Welcome to our Bluesky account! 🦋 We're excited to announce ComBayNS workshop: Combining Bayesian & Neural Approaches for Structured Data 🌐 Submit your paper and join us in Rome for #IJCNN2025! 🇮🇹 📅 Papers Due: March 20th, 2025 📜 Webpage: combayns2025.github.iocombayns2025.github.ioHome - ComBayNS 2025 Workshop @ IJCNN 2025 094
Reposted by Mathias Niepertvinhtong.bsky.social @vinhtong.bsky.social · 13/02/2025🚀 Exciting news! Our paper "Learning to Discretize Diffusion ODEs" has been accepted as an Oral at #ICLR2025! 🎉 [1/n] We propose LD3, a lightweight framework that learns the optimal time discretization for sampling from pre-trained Diffusion Probabilistic Models (DPMs). 1121
Reposted by Mathias NiepertKareem Ahmed @kareemyousrii.bsky.social · 20/12/2024Very excited to announce the Neurosymbolic Generative Models special track at NeSy 2025! Looking forward to all your submissions! 0203
Reposted by Mathias NiepertGuillem Simeon @guillemsimeon.bsky.social · 17/12/2024arxiv.org/abs/2412.11569, a very relevant effort!arxiv.orgThe dark side of the forces: assessing non-conservative force models for atomistic machine learningThe use of machine learning to estimate the energy of a group of atoms, and the forces that drive them to more stable configurations, have revolutionized the fields of computational chemistry and mate... 2113
Reposted by Mathias NiepertAndrei Manolache @amanolache.bsky.social · 15/12/2024Catch my poster tomorrow at the NeurIPS MLSB Workshop! We present a simple (yet effective 😁) multimodal Transformer for molecules, supporting multiple 3D conformations & showing promise for transfer learning. Interested in molecular representation learning? Let’s chat 👋! 0112
Mathias Niepert @mniepert.bsky.social · 14/12/2024We will run out of data for pretraining and see diminishing returns. In many application domains such as in the sciences we also have to be very careful on what data we pretrain to be effective. It is important to adaptively generate new data from physical simulators. Excited about the work below 091
Reposted by Mathias NiepertDavid Holzmüller @dholzmueller.bsky.social · 12/12/2024I'll present our paper in the afternoon poster session at 4:30pm - 7:30 pm in East Exhibit Hall A-C, poster 3304! 032
Reposted by Mathias NiepertDaniel Musekamp @danielmusekamp.bsky.social · 11/12/2024Neural surrogates can accelerate PDE solving but need expensive ground-truth training data. Can we reduce the training data size with active learning (AL)? In our NeurIPS D3S3 poster, we introduce AL4PDE, an extensible AL benchmark for autoregressive neural PDE solvers. 🧵 1123
Reposted by Mathias NiepertViktor Zaverkin @viktorzaverkin.bsky.social · 11/12/2024Join us today at #NeurIPS2024 for our poster presentation: Higher-Rank Irreducible Cartesian Tensors for Equivariant Message Passing 🗓️ When: Wed, Dec 11, 11 a.m. – 2 p.m. PST 📍 Where: East Exhibit Hall A-C, Poster #4107 #MachineLearning #InteratomicPotentials #Equivariance #GraphNeuralNetworks 051
Reposted by Mathias NiepertPierpaolo Morgante (He/His) @piermorgante.bsky.social · 10/12/2024"Transferability of atom-based neural networks" authored by @januseriksen.bsky.social (thanks for publishing with us, amazing work!) is now out as part of the #QuantumChemistry and #ArtificialIntelligence focus collection #MachineLearningScienceandTechnology. Link: iopscience.iop.org/article/10.1...iopscience.iop.orgTransferability of atom-based neural networks - IOPscienceSearchTransferability of atom-based neural networks, Frederik Ø Kjeldal, Janus J Eriksen 062
Reposted by Mathias NiepertAndrei Manolache @amanolache.bsky.social · 07/12/20241/6 We're excited to share our #NeurIPS2024 paper: Probabilistic Graph Rewiring via Virtual Nodes! It addresses key challenges in GNNs, such as over-squashing and under-reaching, while reducing reliance on heuristic rewiring. w/ Chendi Qian, @christophermorris.bsky.social @mniepert.bsky.social 🧵 1306
Reposted by Mathias NiepertJanus Juul Eriksen @januseriksen.bsky.social · 07/12/2024New #compchem paper out in MLST. We study the transferability of both invariant and equivariant neural networks when training these either exclusively on total molecular energies or in combination with data from different atomic partitioning schemes: iopscience.iop.org/article/10.1...iopscience.iop.orgTransferability of atom-based neural networks - IOPscienceSearchTransferability of atom-based neural networks, Frederik Ø Kjeldal, Janus J Eriksen 0245
Mathias Niepert @mniepert.bsky.social · 06/12/2024You should take a look at this if you want to know how to use Cartesian (instead of spherical) tensors for building equivariant MLIPs. 0112
Reposted by Mathias NiepertViktor Zaverkin @viktorzaverkin.bsky.social · 06/12/2024📣 Can we go beyond state-of-the-art message-passing models based on spherical tensors such as #MACE and #NequIP? Our #NeurIPS2024 paper explores higher-rank irreducible Cartesian tensors to design equivariant #MLIPs. Paper: arxiv.org/abs/2405.14253 Code: github.com/nec-research... 2132
Reposted by Mathias Niepertantonio vergari ⚔️ short-circuiting @nolovedeeplearning.bsky.social · 29/11/2024@ropeharz.bsky.social forced me to do this starter pack on #tractable #probabilistic modeling and #reasoning in #AI and #ML please write below if you want to be added (and sorry if I did not find you from the beginning). go.bsky.app/DhVNyz5 115115
Reposted by Mathias NiepertRobert Peharz @ropeharz.bsky.social · 28/11/2024Amazing opportunity for #Neurosymbolic folks! 🚨🚨🚨 We are looking for a Tenure Track Prof for the 🇦🇹 #FWF Cluster of Excellence Bilateral AI (think #NeSy ++) www.bilateral-ai.net A nice starting pack for fully funded PhDs is included. jobs.tugraz.at/en/jobs/226f...bilateral-ai.netBilateralAI – Bilateral AI – Cluster of Excellence 31511
Reposted by Mathias NiepertKyle Cranmer @kylecranmer.bsky.social · 26/11/2024I haven’t read it carefully, but +1 to works like the one below. It mentions learning artifacts from discreetness. We saw some things like that in this paper, where bad integration of the true Hamiltonian did worse than a learned model (that absorbed artifacts). arxiv.org/abs/1909.12790arxiv.orgHamiltonian Graph Networks with ODE IntegratorsWe introduce an approach for imposing physically informed inductive biases in learned simulation models. We combine graph networks with a differentiable ordinary differential equation integrator as a ... 0272
Reposted by Mathias NiepertKosta Derpanis @csprofkgd.bsky.social · 24/11/2024We've all been there 🤓 #DeepLearning 3372
Reposted by Mathias NiepertMichael J. Black @michael-j-black.bsky.social · 20/11/2024For those who missed this post on the-network-that-is-not-to-be-named, I made public my "secrets" for writing a good CVPR paper (or any scientific paper). I've compiled these tips of many years. It's long but hopefully it helps people write better papers. perceiving-systems.blog/en/post/writ...perceiving-systems.blogWriting a good scientific paper 426065
Reposted by Mathias NiepertDavid Holzmüller @dholzmueller.bsky.social · 18/11/2024Can deep learning finally compete with boosted trees on tabular data? 🌲 In our NeurIPS 2024 paper, we introduce RealMLP, a NN with improvements in all areas and meta-learned default parameters. Some insights about RealMLP and other models on large benchmarks (>200 datasets): 🧵 1608