Mike Smith @mjjsmith.com · 30/06/2026Today is the day you (🫵!) get access to 80TB plus of data from over 30 astronomical surveys in one place. 4GB amount of RAM is enough even at Gaia Scale 🔭. Check it out here: huggingface.co/blog/hugging... 011
Mike Smith @mjjsmith.com · 14/03/2026language ai in space sciences hackathon day 1: given access to real euclid telescope data day 2: we made the galaxies flirt 👉 hf.co/spaces/astrohayley/gHarmonyhuggingface.cog-Harmony - a Hugging Face Space by astrohayleyWhich galaxy is right for you? 010
Reposted by Mike SmithMichael Reeves @integralpilot.bsky.social · 26/01/2026On Apple M3, a Linux KDE plasma desktop under Fedora Asahi Remix is now WORKING! Super excited to share this update and happy to answer any questions! Co-credits to noopwafel and Shiz. :) 1642069
Mike Smith @mjjsmith.com · 02/06/2025New AstroPT models are out 🔭🎉 This time trained with an improved DESI galaxy image dataset. Link here: huggingface.co/Smith42/astr... Check out these new scaling curves! We are still seeing improvement at 800M parameters where before we stalled at 100M. Maybe high quality data is all you need 🤔 141
Reposted by Mike SmithEmily Hunt @emily.space · 20/03/2025Anyways, here's the paper - it's one of the first big uses of foundation models in astronomy that I'm aware of, and it seems to have worked really well! #extragalactic #astrocode 🧪arxiv.orgEuclid Quick Data Release (Q1) Exploring galaxy properties with a multi-modal foundation modelModern astronomical surveys, such as the Euclid mission, produce high-dimensional, multi-modal data sets that include imaging and spectroscopic information for millions of galaxies. These data serve a... 0143
Reposted by Mike Smithmr. TIM @timkellogg.me · 22/05/2025Strong Platonic Representation Hypothesis All embedding models, given large enough scale, can be translated between them without paired data Security implication: Embeddings aren’t encryption, they’re basically plain text arxiv.org/abs/2505.12540 6498
Reposted by Mike SmithEthan Mollick @emollick.bsky.social · 09/05/2025If you add "also Cthulhu-y" to the prompt, the results are pretty great. 3646
Reposted by Mike SmithUniverseTBD @universetbd.org · 18/04/2025📢 New dataset out! We introduce HypoGen💥, a dataset of ~5.5K structured problem–hypothesis pairs (Bit–Flip–Spark + Chain‑of‑Reasoning) to advance LLM-driven scientific ideation💡. Fine‑tuned LLaMA 3.1 8B & R1‑distilled models show significant gains. Humans are still the best🥇. 154
Mike Smith @mjjsmith.com · 16/04/2025Was great fun cooking this up with Sharaf and team! Check out all the code at github.com/UniverseTBD/... and paper at arxiv.org/abs/2504.08583github.comGitHub - UniverseTBD/AstroLLaVAContribute to UniverseTBD/AstroLLaVA development by creating an account on GitHub. 022
Reposted by Mike SmithUniverseTBD @universetbd.org · 13/04/2025🎉 HAPPY BIRTHDAY, UniverseTBD! 🚀 As we turn 2, we’re going 2^2. Launching a new project per day for the next four days. We hope that you all enjoy these works as much as we have enjoyed working on them. Stay tuned for the big reveals! 131
Mike Smith @mjjsmith.com · 23/01/2025arxiv.org/abs/2501.12499 super cool paper! Extracting useful information from astro time series via RNNsarxiv.orgMultiband Embeddings of Light CurvesIn this work, we propose a novel ensemble of recurrent neural networks (RNNs) that considers the multiband and non-uniform cadence without having to compute complex features. Our proposed model consis... 000
Mike Smith @mjjsmith.com · 23/01/2025The final frontier for AI will be anything that can't be captured via a quantitative benchmark 000
Mike Smith @mjjsmith.com · 12/01/2025broke: reading 500 page AI safety papers woke: learning AI alignment best practices from "wallace & gromit: vengeance most fowl" 030
Mike Smith @mjjsmith.com · 09/01/2025first time spotting AI art in the wild just look at that floating ship! 010
Reposted by Mike SmithJoanna Bryson @j2bryson.bsky.social · 06/01/2025This makes so much sense – more cooperation when more willing to wait for rewards ~= less risk averse. www.sciencedirect.com/science/arti...sciencedirect.comPatience is a virtue: Cooperative people have lower discount ratesReciprocal altruism involves foregoing an immediate benefit for the sake of a greater long-term reward. It follows that individuals who exhibit a stro… 062
Reposted by Mike SmithAnna Hughes 🍁 @annaghughes.bsky.social · 22/12/2024Think twice before gifting someone an M dwarf this holiday season 11676531385
Reposted by Mike SmithPeter Coles 🏳️🌈 🏳️⚧️ 🇮🇪 @telescoper.bsky.social · 22/12/2024I move to refer to `'Gold OA' as 'Pay to Publish' 0135
Mike Smith @mjjsmith.com · 21/12/2024o3 got me thinking about the future of selling our labour as code... how many more iterations until that's transformed? 😅 010
Mike Smith @mjjsmith.com · 08/12/2024lets goo hatfield, great doc about my hometown: www.youtube.com/watch?v=IQYt...youtube.comHatfield: The Fifth Most Boring 'City' in the World | DocumentaryYouTube video by Callum Oakaby Wright 000
Reposted by Mike SmithJia-Bin Huang @jbhuang0604.bsky.social · 06/12/2024POV: me getting on social media 0131
Reposted by Mike SmithMark Riedl @markriedl.bsky.social · 04/12/2024OpenAI in 2024: “No AI for weapons or military” “Do use our AI to make weapons to hurt yourself or others” “Military is fine, but no AI for weapons” “Sure put it on battlefield drones” www.technologyreview.com/2024/12/04/1...technologyreview.comOpenAI’s new defense contract completes its military pivotA new partnership with Anduril, announced today, will deploy AI on the battlefield. It represents an overhaul of the company’s position in just a year. 619971
Reposted by Mike Smithruiqigao.bsky.social @ruiqigao.bsky.social · 02/12/2024A common question nowadays: Which is better, diffusion or flow matching? 🤔 Our answer: They’re two sides of the same coin. We wrote a blog post to show how diffusion models and Gaussian flow matching are equivalent. That’s great: It means you can use them interchangeably. 625459
Mike Smith @mjjsmith.com · 04/12/2024Aaand the Multimodal Universe is on ArXiv 🎉 arxiv.org/abs/2412.02527 Come find the poster at #NeurIPS #NeurIPS2024 #astrocode 🔭arxiv.orgThe Multimodal Universe: Enabling Large-Scale Machine Learning with 100TB of Astronomical Scientific DataWe present the MULTIMODAL UNIVERSE, a large-scale multimodal dataset of scientific astronomical data, compiled specifically to facilitate machine learning research. Overall, the MULTIMODAL UNIVERSE co... 0135
Reposted by Mike SmithUniverseTBD @universetbd.org · 02/12/2024Excited to announce the Multimodal Universe (MMU): a huge 100TB dataset bringing together the largest ML-focused collection of astronomical observations ever assembled to accelerate open AI and astronomy research github.com/MultimodalUn... Think ImageNet, but for space 🔭 #astrocode 🧵 2186
Reposted by Mike SmithMeredith Whittaker @meredithmeredith.bsky.social · 02/12/2024📢NEW: 'Open' AI systems aren't open. The vague term, combined w frothy AI hype is (mis)shaping policy & practice, assuming 'open source' AI democratizes access & addresses power concentration. It doesn't. @smw.bsky.social, @davidthewid.bsky.social & I correct the record👇 nature.com/articles/s41...nature.comWhy ‘open’ AI systems are actually closed, and why this matters - NatureA review of the literature on artificial intelligence systems to examine openness reveals that open AI systems are actually closed, as they are highly dependent on the resources of a few large corpora... 271026346
Mike Smith @mjjsmith.com · 02/12/2024Check out 100TB of machine learning ready multimodal astronomy data 🔥🦾 Excited to see what FOSS machine learning world does with this 🔭 071
Reposted by Mike SmithUniversity of Oxford @ox.ac.uk · 02/12/2024CONFIRMED: Oxford University Press select 'brain rot' as the 2024 Oxford Word of the Year 🧠📱 #OxfordWOTY 412247
Mike Smith @mjjsmith.com · 02/12/2024Getting different attention masks working for AstroPT (a proto-foundation model for astronomy github.com/Smith42/astr...), so much nicer to do it with Flex Attention vs custom CUDA kernels -- thank you for releasing it to the world 🫡github.comGitHub - Smith42/astroPT: Transformer for galaxy images (and general astronomy)Transformer for galaxy images (and general astronomy) - Smith42/astroPT 041
Mike Smith @mjjsmith.com · 29/11/2024Exactly this! Related code and data should be reviewed JOSS style 010
Mike Smith @mjjsmith.com · 28/11/2024This is wild! How didn't this show up in evals? This suggests that position embeddings aren't actually that useful/important? 010
Reposted by Mike SmithJeremy Howard @howard.fm · 28/11/2024Rather than restricting data to only the richest and most powerful (as reddit, facebook, and twitter do), bsky makes it available to everyone. Personally, I think that's a good thing. 118915
Reposted by Mike SmithUniverseTBD @universetbd.org · 28/11/2024Very nice work on chemistry and materials science foundation models from Nawaf Alampara and team (including our own @pktrpl.bsky.social 🥳🥳 ) 🧪🧪 Paper link: arxiv.org/abs/2411.16955 031
Mike Smith @mjjsmith.com · 27/11/2024so are dual 3090s the current go-to for a hobby LLM machine? What are peeps here using? 110