Sign in

dhirschfeld.bsky.social

@dhirschfeld.bsky.social
81 followers 199 following 156 posts
PostsRepliesMedia
Reposted by @dhirschfeld.bsky.social
Blosc Development Team @blosc.org · 30/09/2026
📢 Python-Blosc2 4.14 is out! A common interface to stream, query & slice remote Parquet, #PyTables, #HDF5, #Zarr & #Blosc2 data over HTTP/S3: ⚡️ Zero full downloads ⚡️ Cloud index pushdown ⚡️ DuckDB/Polars streaming! Read the tour: blosc.org/posts/remote... Compress Better, Stream Smarter 🚀
012
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 9h
DuckDB. I run DuckDB. 🦆
000
Reposted by @dhirschfeld.bsky.social
DuckDB @duckdb.org · 25/09/2026
Did you know that, since #DuckDB v0.10.3 (~May 2024), you can point a SELECT at a dataset on the Hugging Face Hub⁠, using the DuckDB `hf://` protocol, and query it, without downloading it first? 🤗 🦆 This blog post covers how that Hugging Face + DuckDB integration works and the use cases it fits:
duckdb.org
DuckDB and Hugging Face: Querying Datasets Directly
Hugging Face hosts hundreds of thousands of datasets, and DuckDB can read them directly, exactly where they are and without downloading anything, over the DuckDB hf:// protocol. This post looks at how...
1203
Reposted by @dhirschfeld.bsky.social
David Brochart @davidbrochart.bsky.social · 25/09/2026
AnyIO might be the single most underrated Python library: only 2.5k stars on GitHub but downloaded over a billion times per month on PyPI!
111
Reposted by @dhirschfeld.bsky.social
Michał (Mike) Krassowski @krassowski.bsky.social · 24/09/2026
Checkout the list of 100+ #jupyter #ai extensions I collated at github.com/openteams-ai...
github.com
GitHub - openteams-ai/awesome-jupyter-ai: AI extensions for JupyterLab and Jupyter Notebook 7
AI extensions for JupyterLab and Jupyter Notebook 7 - openteams-ai/awesome-jupyter-ai
044
Reposted by @dhirschfeld.bsky.social
Quansight @quansight.com · 18/09/2026
Small differences in engine semantics create big shifts in query output. Marco Gorelli breaks down the operational differences between Polars and traditional SQL. Read Marco's technical breakdown & migration tips: labs.quansight.org/blog/polars-... #Polars #SQL #DataScience #OpenSource #Narwhals
labs.quansight.org
041
Reposted by @dhirschfeld.bsky.social
Project Jupyter @jupyter.org · 17/09/2026
🤖 Build, export, assemble, and test a robot model right in your browser. Yahia Heni shares a new JupyterCAD robotics workflow using JupyterCAD-URDF + JupyterLab-URDF, with no local ROS installation required. blog.jupyter.org/a-robotics-w... #JupyterCAD #Robotics #OpenSource
042
Reposted by @dhirschfeld.bsky.social
Prefix.dev - the Pixi company @prefix.dev · 31/08/2026
Pixi now fully supports archspec, so you can create CPU-optimized environments and let Pixi handle the installation logic. Read more about it in the blogpost we updated: prefix.dev/blog/buildi...
042
Reposted by @dhirschfeld.bsky.social
Prefix.dev - the Pixi company @prefix.dev · 27/08/2026
Any Rust, C++ or Python project on GitHub can become a global tool on your machine. No recipe, no manifest in the repo. Just name the backend.
081
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 25/08/2026
Pretty amazing the things you can do with textualize!
110
Reposted by @dhirschfeld.bsky.social
Project Jupyter @jupyter.org · 21/08/2026
JupyterLite 0.8 is out: shareable REPL links, a refreshed loading screen, file system fixes, an in-browser terminal with real WebAssembly tools (git, vim, grep), more kernels via jupyterlite-xeus, and Python 3.14 on Pyodide. Try it with no install: jupyter.org/try-jupyter
072
Reposted by @dhirschfeld.bsky.social
Jaime Rodríguez-Guerra @jaimergp.dev · 21/08/2026
CEP 48, which brings conditionals and extras to your @conda.org dependencies, is now accepted! This means you will soon be able to type things like `typing-extensions[when='python<=3.10']`  and `scipy[extras=test]` 🚀 github.com/conda/ceps/b...
github.com
196
Reposted by @dhirschfeld.bsky.social
Prefix.dev - the Pixi company @prefix.dev · 21/08/2026
Conda packages have extras now. Optional dependency groups you declare and then consume, via v3 repodata. Plus when conditions and variant flags.
0126
Reposted by @dhirschfeld.bsky.social
Quansight @quansight.com · 21/08/2026
Polars and SQL operate on fundamentally different mental models. Marco Gorelli explores the architectural nuances that shape both paradigms. Understanding these mechanics is key to writing clean code that generalizes seamlessly across query engines. Read Marco’s full analysis: buff.ly/J31DcJK
011
Reposted by @dhirschfeld.bsky.social
Prefix.dev - the Pixi company @prefix.dev · 20/08/2026
[system-requirements] is deprecated. Platforms now carry the requirements themselves. CUDA and glibc constraints inline, and you can name a target what you actually call it: jetson-nano.
052
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 20/08/2026
OSS collaboration is great to see. I know Nathan has been a core part of moving the scientific Python ecosystem forward! :heart:
010
Reposted by @dhirschfeld.bsky.social
Hynek Schlawack @hynek.me · 20/08/2026
Happy/nervous to announce argon2-cffi-bindings, the low-level C binding wheels used by argon2-cffi. It's a big release w/ wheels for new platforms, but the biggest item is the liberation from setuptools w/ great help by Nathan Goldbaum & @henryiii.bsky.social! 🥳 #Python github.com/hynek/argon2...
github.com
Release 26.1.0 · hynek/argon2-cffi-bindings
Highlights Big and scary release! We've switched from setuptools to scikit-build-core and added wheels for pyemscripten and (provisionally) RISC-V. Full changelog below! Special Thanks This release...
141
Reposted by @dhirschfeld.bsky.social
Journal of Open Source Software @joss-openjournals.bsky.social · 19/08/2026
Just published in JOSS: 'JupyterGIS: A Collaborative GIS Environment for JupyterLab' doi.org/10.21105/joss.10383
054
Reposted by @dhirschfeld.bsky.social
Sylvain Corlay @sylvaincorlay.bsky.social · 17/08/2026
Ten years ago, I founded QuantStack on a conviction: that we could build a sustainable business by supporting world-class open-source software to advance science. We had no outside funding, no guarantees, just trust in open collaboration. Read the full story: quantstack.net/blogs/Decade...
quantstack.net
QuantStack
A team behind major open-source projects of the scientific computing ecosystem such as Jupyter, Conda-Forge, Mamba, XTensor/SIMD, Apache Arrow/Parquet and more.
1147
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 13/08/2026
I have ~forever been on about the dangers of technical debt due to my lived experience of failed codebases. I think understanding tech-debt and it's tradeoffs has never been more important than it is now. Once in a codebase, the cost of technical debt increases exponentially.
200
Reposted by @dhirschfeld.bsky.social
Hynek Schlawack @hynek.me · 13/08/2026
when I said that “even AGI can't solve exponential complexity curves”, I meant something like this: blog.florianherrengt.com/ai-removing-...
blog.florianherrengt.com
AI is removing the middle class of software engineering
AI makes projects with weak engineering culture fail much faster.
1153
Reposted by @dhirschfeld.bsky.social
QuantStack @quantstack.bsky.social · 12/08/2026
Numba now runs entirely in the browser through #JupyterLite and emscripten-forge 🤘 Read Anutosh's post for more details on how we brought Numba's JIT compiler to #WebAssembly, enabling a broader ecosystem including PyTensor, PyMC, Interpolation․py, and Dolo․py. notebook.link/blog/numba-i...
notebook.link
Numba in the Browser: Unlocking a New Scientific Python Stack in JupyterLite | Notebook.link Documentation
A JIT compiler and its scientific Python ecosystem running entirely in the Web browser
0125
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 11/08/2026
The ability to specify all the non-python dependencies your script needs is a game changer!
010
Reposted by @dhirschfeld.bsky.social
Quansight @quansight.com · 11/08/2026
44 seconds down to 1.5 seconds. That is the difference free-threaded Python made once the real bottlenecks got fixed. Read how each one was found and fixed. buff.ly/9Z6f5ux
031
Reposted by @dhirschfeld.bsky.social
Daniel Rothenberg @danielrothenberg.com · 11/08/2026
How good are the frontier AI weather forecast models from Google DeepMind, Microsoft, and NVIDIA? See for yourself on @brightband.com's Operational WeatherBench dashboard - owb.brightband.com! We're happy to run these models operationally and share our evaluation stats with the community!
owb.brightband.com
Operational WeatherBench | AI Weather Forecast Leaderboard
Live skill rankings for AI and physics-based weather forecast models, scored daily with standard metrics and an open toolkit.
0135
Reposted by @dhirschfeld.bsky.social
Prefix.dev - the Pixi company @prefix.dev · 04/08/2026
New community tool: a live dashboard for the conda-forge staged-recipes queue. See which new packages are waiting for review, what's passing CI, and where things are stuck, all in one place. srdb.thath.net/
043
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 03/08/2026
Will have to check it out as I've had occasion to use freezegun in the past.
000
Reposted by @dhirschfeld.bsky.social
francescalted.bsky.social @francescalted.bsky.social · 31/07/2026
Most compression libraries ask you to move in. We think that's backwards. Blosc2 4.9.1: DuckDB, Polars and pandas 3 read a CTable directly via Arrow's PyCapsule protocol — no conversion step. Cooperation, not completeness. blosc.org/posts/not-an... Compress Better, Compute Bigger 🚀 #DataScience
blosc.org
Not an island: bringing compression to the tabular ecosystem
A compression library can go one of two ways: try to be everything (its own dataframe, its own query engine, its own format that nothing else reads), or be a fast, compact layer that slots underneath
022
Reposted by @dhirschfeld.bsky.social
Prefix.dev - the Pixi company @prefix.dev · 28/07/2026
The rattler-build playground got a bit fancier! Now also generates recipes for PyPI, CRAN, and CPAN upstream sources. Try it out under playground.rattler.build
183
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 26/07/2026
Fascinating to see how AI is used in mathematics by true experts! 🤯
120
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 26/07/2026
`anycorn` is my go-to ASGI server. I have more trust in the correctness of applications built on top of `anyio` due to the guarantees of structured concurrency.
020
Reposted by @dhirschfeld.bsky.social
David Brochart @davidbrochart.bsky.social · 22/07/2026
Lots of improvements happening in anycorn (mainly thanks to @graingert.co.uk) 🚀 If you think hypercorn is not moving fast enough, give anycorn a try! It's a fork of hypercorn based on AnyIO. github.com/davidbrochar...
github.com
GitHub - davidbrochart/anycorn: A fork of Hypercorn that uses AnyIO.
A fork of Hypercorn that uses AnyIO. Contribute to davidbrochart/anycorn development by creating an account on GitHub.
111
Reposted by @dhirschfeld.bsky.social
Prefix.dev - the Pixi company @prefix.dev · 24/07/2026
We've been driving one of the biggest changes to the conda ecosystem since its inception: repodata v3. Extras, conditional dependencies, and variant flags, expressed directly in the repodata. Now in beta 👇 prefix.dev/blog/repoda...
prefix.dev
Rolling out repodata v3
Extras, Conditional dependencies and variant flags!
173
Reposted by @dhirschfeld.bsky.social
Dominik Moritz @domoritz.de · 14/07/2026
Alongside the new Mosaic 0.29, we just released an (experimental) Python API for vgplot. idl.uw.edu/mosaic/vgplo...
idl.uw.edu
Mosaic vgplot | Mosaic
Scalable, interactive data visualization
061
Reposted by @dhirschfeld.bsky.social
Jeremy Tuloup @jtp.io · 10/07/2026
JupyterLite 0.8 is released! 🎉 This release updates to the latest JupyterLab 4.6 and Notebook 7.6, and brings new improvements across related projects. ➡️ Try it online: jupyter.org/try-jupyter ➡️ Blog post: blog.jupyter.org/jupyterlite-...
blog.jupyter.org
JupyterLite 0.8 is released! 🎉
JupyterLite is a Jupyter distribution that runs entirely in the web browser without any server components. Deployment and hosting are easy…
1115
Reposted by @dhirschfeld.bsky.social
Rémi Flamary @rflamary.bsky.social · 07/07/2026
We just released POT 0.9.7 with many new OT solvers including lazy and sparse exact solvers, HD Gaussians, sliced OT plans, Spectral-Grassmann OT, batch exact OT with Proximal point, BSP-OT, unbalanced 1D and semidiscrete. This is a big one! Thanks to all contributors! github.com/PythonOT/POT...
0145
Reposted by @dhirschfeld.bsky.social
DuckDB @duckdb.org · 06/07/2026
Missed out on attending #DuckCon in Amsterdam or via the livestream? 🦆📺 Don’t worry, you can still catch up with all the news and roadmap announcements from “The State of the Duck” keynote right here: Video: www.youtube.com/watch?v=iFPK... Slides: blobs.duckdb.org/events/duckc... #DuckDB
0263
Reposted by @dhirschfeld.bsky.social
Polars @pola.rs · 03/07/2026
We've released Polars Cloud client 0.9.0. • Expressions now run distributed • 17% Faster cloud I/O • Breaking: `ClusterContext` now uses `uri=` The `compute_address=` keyword is superseded by `uri=`. Blog post: pola.rs/posts/polars... Full changelog: github.com/polars-inc/p...
pola.rs
Announcing Polars Cloud 0.9.0
Polars Cloud 0.9.0 runs expressions distributed, ships large cloud I/O performance gains, a reworked ClusterContext API, a distributed Iceberg sink, and more.
011
Reposted by @dhirschfeld.bsky.social
Project Jupyter @jupyter.org · 03/07/2026
JupyterLab 4.6 and Notebook 7.6 are out, with a new Scratchpad console and extension builds up to 5x faster. Try it in your browser via JupyterLite! Building JupyterLab and Notebook extensions is now about 5 times faster! blog.jupyter.org/jupyterlab-4... #Jupyter #OpenSource #DataScience
blog.jupyter.org
JupyterLab 4.6 and Notebook 7.6 are out!
JupyterLab 4.6 features new interface customization options, improved file browser and debugger, an easy way to jump between recently…
082
Reposted by @dhirschfeld.bsky.social
Prefix.dev - the Pixi company @prefix.dev · 02/07/2026
Our not-too-secret project allows Pixi to depend on packages built from source. Build graphs, multi-language support and more are handled transparently. Sounds great, doesn't it? Then let us finally introduce it officially! prefix.dev/blog/pixi-b...
prefix.dev
prefix.dev – solving software package management
The software package management platform for Python, C++, R, Rust and more
144
Reposted by @dhirschfeld.bsky.social
Ela Bambust 🏳️‍⚧️ (alleged transsexual) @ela-bambust.bsky.social · 01/07/2026
same comic, signed version, for posterity
10478149
Reposted by @dhirschfeld.bsky.social
Posit @posit.co · 29/06/2026
Posit has joined the Jupyter Foundation! 🎉 @jupyter.org has powered interactive computing across our tools for years, from Notebooks to the kernels behind Positron. Now we're helping fund the infrastructure and community that keep it thriving. Read the blog: opensource.posit.co/blog/2026-06...
08116
Reposted by @dhirschfeld.bsky.social
David Brochart @davidbrochart.bsky.social · 29/06/2026
Interesting coding agent using @willmcgugan.bsky.social's Textual. twotimespi.dev
twotimespi.dev
Tau
An educational Python project for learning how coding agents are built.
011
Reposted by @dhirschfeld.bsky.social
Project Jupyter @jupyter.org · 25/06/2026
Congratulations to the newest batch of Jupyter Distinguished Contributors, James Colliander, Florence Haudin, Gregory Mooney, and Kirstie Whitaker. The Jupyter community thanks you for your effort to advance Project Jupyter, and for leading by example! blog.jupyter.org/congratulati...
blog.jupyter.org
Congratulations, Distinguished Contributors!
We are proud to announce the recipients of the Jupyter Distinguished Contributor (JDC) award for the 2025 cohort of contributors.
0124
Reposted by @dhirschfeld.bsky.social
Fernando Pérez @fernandoperez.org · 15/06/2026
Congrats to @serenabonaretti.bsky.social or the physical publication of her awesome "Learn Python with Jupyter" 📙 👏 🎉 , and thanks for sending me a physical copy to Berkeley! The weaving of Python+Jupyter and how to use them to think is wonderful. We're fortunate to have Serena in our community!
Photo of Fernando Pérez holding the book "Learn Python with Jupyter" by Serena Bonaretti, with a metal print of the Jupyter logo in a rear blue wall, above a window with shades partially drawn.
283
Reposted by @dhirschfeld.bsky.social
scikit-learn @scikit-learn.org · 12/06/2026
🎉 Scikit-learn 1.9 released: ■Solid improvements to many existing estimators: faster, more stable, handling missing values, adding GPU support… ■Also, enhanced estimator displays in notebooks, ■And callbacks that enable progress bars or monitoring of convergence blog.scikit-learn.org/updates/rele...
blog.scikit-learn.org
scikit-learn release 1.9: better numerics, new core functionality
Author: Gael Varoquaux
03013
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 11/06/2026
Very interesting modelling, but I really don't think it's appropriate to apply a statistical model trained on past observations to the current oil price rise. The key disclaimer for me is: > *The models see only market price and volatility history. They cannot see why prices are elevated*
120
Reposted by @dhirschfeld.bsky.social
Hynek Schlawack @hynek.me · 06/06/2026
I'm very relieved to finally announce structlog 26.1.0! Given how long this release took, it's pretty thicc with nice things all over the board! Apologies for the long release cycle; it's been a victim of the slopocalypse and me trying to navigate my way thru the new normal. 1/2
171
Reposted by @dhirschfeld.bsky.social
Michał (Mike) Krassowski @krassowski.bsky.social · 25/05/2026
JupyterLab 4.6 beta is now available for testing 🎉. It includes: - new layout customization options - navigation between recently edited cells - revamped keyboard shortcuts UI - editable breadcrumbs in file browser - debugger improvements Full changelog: jupyterlab.readthedocs.io/en/latest/ge...
022
dhirschfeld.bsky.social @dhirschfeld.bsky.social · 27/05/2026
interesting, but I'm not too sure why I wouldn't just use quack directly.
000