Sign in

francescalted.bsky.social

@francescalted.bsky.social
58 followers 32 following 85 posts
PostsRepliesMedia
francescalted.bsky.social @francescalted.bsky.social · 30/09/2026
The Blosc team is committed to help you survive the data deluge ☔️️
001
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 22/09/2026
We are making a lot of progress on accessing remote PyTables tables via Blosc2 and fsspec. Stay tuned!
011
francescalted.bsky.social @francescalted.bsky.social · 15/09/2026
This is all about *interoperability*.
000
francescalted.bsky.social @francescalted.bsky.social · 11/09/2026
One API for unite them all!
012
francescalted.bsky.social @francescalted.bsky.social · 01/09/2026
Sweet! Smart caches for remote arrays.
000
francescalted.bsky.social @francescalted.bsky.social · 25/08/2026
Dicts are nice data structures, and super-useful for storing repeated data.
000
Reposted by @francescalted.bsky.social
Our Wonderful Green Future @owgf.mastodon.world.ap.brid.gy · 13/08/2026
Cities aren't LOUD CARS ARE LOUD #Urbanism #BikeTooter #Cycling #TheWarOnCars Great video by u/MiserNYC- on Reddit
2759
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 13/08/2026
📣 Python-Blosc2 4.11.0 continues aligning with Arrow conventions. New CTable nullability on a validity mask instead of a sentinel value ✨️ Also, wheels are now abi3 compliant w/ CPython 3.11+, including 3.15 (tested) 🚅 More info: github.com/Blosc/python... Compress Better, Compute Bigger 🚀
github.com
Releases · Blosc/python-blosc2
A high-performance library for compressed ND arrays and columnar tables, with compute and indexing engines - Blosc/python-blosc2
001
francescalted.bsky.social @francescalted.bsky.social · 11/08/2026
The JIT in Blosc2 is quite capable, but requires some love to squeeze the last drop of performance out of it.
000
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 07/08/2026
💡 Blosc2 tip: for unbounded text, use utf8(). blosc2.field(blosc2.utf8()) string(200) costs 800 B/row on every read; utf8() rows cost what they weigh: ~4× less memory. blosc.org/python-blosc... Compress Better, Compute Bigger 🚀 #Python #DataScience #Blosc2
001
Reposted by @francescalted.bsky.social
Peter W🤓 @wang.social · 07/08/2026
Hey Austin!! I’m very proud to announce the grand opening of the Austin STEM Center, a unique space for hands-on science learning! Come to our grand opening, bring your kids, and see all that we have to offer! Play with robots, check out our fab and maker spaces, and help us Keep Austin Curious!!
04810
francescalted.bsky.social @francescalted.bsky.social · 04/08/2026
On-disk broadcasting can save lots of memory.
000
francescalted.bsky.social @francescalted.bsky.social · 31/07/2026
Most compression libraries ask you to move in. We think that's backwards. Blosc2 4.9.1: DuckDB, Polars and pandas 3 read a CTable directly via Arrow's PyCapsule protocol — no conversion step. Cooperation, not completeness. blosc.org/posts/not-an... Compress Better, Compute Bigger 🚀 #DataScience
blosc.org
Not an island: bringing compression to the tabular ecosystem
A compression library can go one of two ways: try to be everything (its own dataframe, its own query engine, its own format that nothing else reads), or be a fast, compact layer that slots underneath
022
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 29/07/2026
💡 Blosc2 tip: mmap read-only opens — skip the syscalls. >>> arr = blosc2.open(path, mmap_mode="r") Maps once, reads pages directly. ~15% faster for scattered reads, same memory. Free win, and scales with concurrent readers 🚀 blosc.org/python-blosc... #Python #DataScience #Blosc2
001
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 28/07/2026
💡 Blosc2 tip: `where=` for filtered reductions. t["temperature"].sum(where=t.region == 3) ~1.9× faster, ~7× less memory than mask-then-index. blosc.org/python-blosc... Compress Better, Compute Bigger 🚀 #Python #DataScience #Blosc2
001
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 27/07/2026
💡 Python-Blosc2 tip #7: don't slice a column to reduce it. t["val"].sum() reduces the compressed column chunk-wise, never materialising it: 1.7× faster, ~12× less peak memory on 50M rows. blosc.org/python-blosc... Compress Better, Compute Bigger 🚀
001
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 21/07/2026
💡 Python-Blosc2 tip #6: generate arrays with DSL kernels, not NumPy A @blosc2.dsl_kernel handed to lazyudf() compiles to native code, filling an NDArray chunk by chunk, in parallel. ~3.6x faster, ~2x less peak memory on 200M elements. blosc.org/python-blosc... Compress Better, Compute Bigger 🚀
012
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 16/07/2026
💡 Python-Blosc2 tip #4: let SUMMARY indexes answer min()/max() directly CTable auto-builds per-block min/max indexes for its scalar columns, so Column.min()/max() never decompress the column: ~4× faster, essentially no extra memory. blosc.org/python-blosc... Compress Better, Compute Bigger 🚀
012
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 15/07/2026
💡 Python-Blosc2 tip #3: align your reads with the double partition A chunk-aligned read decompresses 1 chunk instead of 2 (~2.2× faster), and chunk-aligned slice() copies chunks as-is with no decompression at all (~4.9× faster). Same principle at block level. blosc.org/python-blosc... Enjoy data!
011
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 14/07/2026
💡 Python-Blosc2 tip #2: many readers, one file? Open with mmap_mode="r" in every reader — all share one set of mapped pages instead of a syscall + copy per read. 8 concurrent readers: ~4.5x faster, half the CPU, still ~one copy of the file in RAM. blosc.org/python-blosc... Enjoy data! 🚀
blosc.org
Optimization tips - Python-Blosc2 documentation
011
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 13/07/2026
💡 Python-Blosc2 tip #1: skip the NumPy detour. blosc2.linspace(0, 1, N) fills a compressed array chunk by chunk — at 200M float64, ~25x less peak memory than asarray(np.linspace(...)), comparable speed. Same for arange() and fromiter(). blosc.org/python-blosc... Compress Better, Compute Bigger 🚀
001
francescalted.bsky.social @francescalted.bsky.social · 10/07/2026
This is what I have been using Fable 5 for during this week. I should say that I am quite impressed on the good taste that the beast is showing for API design. Really excited on the perspective that open models would reach this level soon!
000
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 30/06/2026
Python-Blosc2 now has a 🔥 DSL-to-JavaScript transpiler! Newton-Raphson runs 2.7× faster on the browser! 💨 With #Pyodide, it’s not just Python in the browser: it’s the PyData stack 📊 too, #Blosc2 tacking compression 📦 + computing 🧮 duties. Demo 👇 blosc.org/demos/newton...
blosc.org
Newton fractal — blosc2's JIT, live in your browser
011
Reposted by @francescalted.bsky.social
Merche Fernández Alonso @merferalonso.bsky.social · 24/06/2026
Yo no puedo ser tan optimista 👇🏽 science.nasa.gov/earth/explor...
science.nasa.gov
Carbon Dioxide - Earth Indicator - NASA Science
Carbon dioxide (CO2) is an important greenhouse gas. Greenhouse gases trap the heat from sunlight, warming the planet. Without any greenhouse gases, Earth
222
francescalted.bsky.social @francescalted.bsky.social · 17/06/2026
Both amazed and humbled of how much you can build with modern LLMs, #Textual and #Blosc2 . Seriously, if there is something that a LLM can boost creativity, like a lot, this is TUI making.
000
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 11/06/2026
🚀 New Blosc post: one selective query, 24.3M taxi trips, five tools. ⚡ Cold: CTable/.b2z ~1.9x faster than DuckDB, 9.4x vs pandas 🎯 Block indexes skip ~90% of the data 🤝 Warm: dead heat with DuckDB 💾 Only +2% disk vs Parquet blosc.org/posts/ctable... #Python #DuckDB
032
Reposted by @francescalted.bsky.social
Pyodide @pyodide.org · 09/06/2026
Pyodide 314.0.0 is out! 🎉 This marks a significant milestone for the Python-in-the-browser ecosystem! PEP 783 has been accepted, so Pyodide wheels can now be published directly to PyPI 🐍📦 blog.pyodide.org/posts/314-re... Thanks to @pydantic.dev for their guide: pydantic.dev/articles/ems...
blog.pyodide.org
Pyodide 314.0 Release
We are pleased to announce the Pyodide 314.0 release. This release focuses on standardization and packaging, marking a significant milestone in the Python-in-the-browser ecosystem. PEP 783 is Accepted...
275
francescalted.bsky.social @francescalted.bsky.social · 09/06/2026
This is our most playful release so far. Under the hood we did amazing improvements, making toying with very large tabular data a pleasant, NumPy-centric experience. Have fun!
github.com
GitHub - Blosc/python-blosc2: A high-performance library for compressed ND arrays and columnar tables, with compute and indexing engines
A high-performance library for compressed ND arrays and columnar tables, with compute and indexing engines - Blosc/python-blosc2
010
francescalted.bsky.social @francescalted.bsky.social · 25/05/2026
This opens the door to exciting new developments in the Python-Blosc2 wrapper. Stay tuned!
000
francescalted.bsky.social @francescalted.bsky.social · 15/05/2026
Always honored to see our work being broadly used! 🚀
010
francescalted.bsky.social @francescalted.bsky.social · 12/05/2026
Under the new indexing engine is code that I figured out and implemented about 20 years ago... But it still serves pretty well (with a touch of modernization indeed).
000
francescalted.bsky.social @francescalted.bsky.social · 08/05/2026
Have CTable a try and tell us how it goes! We distilled all our tabular skills there 👇
000
francescalted.bsky.social @francescalted.bsky.social · 28/04/2026
The beast is out of the cage! 🧸
000
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 22/04/2026
📣 C-Blosc2 3.0.0-rc2 is out 🚀 Big highlight: a new shared managed thread pool for parallel execution. ✅ With this and previous work, C-Blosc2 will become specially useful for storing variable length data, using extremely low resources. github.com/Blosc/c-blos... #CBlosc2 #Compression #OpenSource
032
Reposted by @francescalted.bsky.social
Simon Willison @simon.fedi.simonwillison.net.ap.brid.gy · 03/04/2026
Warning to open source maintainers: the Axios supply chain attack started with some very sophisticated social engineering targeted at one of their developers simonwillison.net/2026/Apr/3/supply…
simonwillison.net
The Axios supply chain attack used individually targeted social engineering
The Axios team have published a full postmortem on the supply chain attack which resulted in a malware dependency going out in a release the other day, and it involved …
11234
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 27/03/2026
🚀 C-Blosc2 3.0.0 RC1 is out! What's new? 📦 VL-blocks for irregular data (strings, JSON) 🗜️ LZ4/LZ4HC dictionary compression 🛡️ Important safety fixes Check out the full release notes here: github.com/Blosc/c-blos... Give it a spin and provide feedback! #Blosc2 #OpenSource #C
github.com
032
francescalted.bsky.social @francescalted.bsky.social · 25/03/2026
Look at the bump in performance that we will see with the next Python-Blosc2 release. Matrix multiplication has been speeded up by using blocks and Blosc2 prefilters and its own efficient and multithreaded engine. Expect between 5x and 6x better speed for matrices with no padding.
042
Reposted by @francescalted.bsky.social
Project Jupyter @jupyter.org · 12/02/2026
🎉 JupyterLite is now part of Project Jupyter! Run Jupyter notebooks directly in your browser: no server, no setup. Many thanks to the JupyterLite contributors and supporters like QuantStack, Bloomberg and the Gates Foundation. 🔗 blog.jupyter.org/jupyterlite-...
blog.jupyter.org
JupyterLite Officially Joins Project Jupyter!
We are thrilled to announce that JupyterLite is now an official part of Project Jupyter. This milestone marks a significant step forward…
03520
francescalted.bsky.social @francescalted.bsky.social · 10/03/2026
Achievement unlocked: Compressing *and* computing right in the browser ✅
000
francescalted.bsky.social @francescalted.bsky.social · 06/03/2026
New DSL kernels in Python-Blosc2, being parallelizable and JIT-compiling capable, can accelerate code quite a bit 🚀 For example, linspace() has been rewritten to use DSL kernels, and performance boost is well beyond expectations.
001
francescalted.bsky.social @francescalted.bsky.social · 04/03/2026
JIT-compiled DSL kernels: a major step forward for a minor release number! 🥳🥳
000
francescalted.bsky.social @francescalted.bsky.social · 20/02/2026
DSL kernels are gonna be a pretty wild thing.
010
Reposted by @francescalted.bsky.social
Blosc Development Team @blosc.org · 05/02/2026
The new engine in Python-Blosc2 4.0 delivers quite awesome performance results. Processing a 400 MB array can be up to 9.6x faster than NumPy 🤯 The best part is that it fully supports NumPy's array and ufunc interfaces. High performance with zero friction! 🏎️💨 ironarray.io/blog/miniexp... Enjoy!
064
francescalted.bsky.social @francescalted.bsky.social · 02/02/2026
So glad to see v4.0 in the wild! 🥳🥳. Thanks to all the ironArray team; you did an outstanding job in putting together top-class compression with high performance computing 💯
010
francescalted.bsky.social @francescalted.bsky.social · 30/01/2026
Really exciting news! 🥳🥳
000
Reposted by @francescalted.bsky.social
ironArray SLU @ironarray.io · 21/01/2026
🚀 Our #PyDataGlobal 2025 tutorial on modern #Blosc2 & #Caterva2 features is out! Learn how compression boosts array performance & enables cloud computing without downloads. ☁️ Watch here: 👇 www.youtube.com/watch?v=tUvS... #Python #HPC #DataScience #BigData
youtube.com
Francesc Alted+Luke Shaw - Hands-on with Blosc2: Accelerating Your Python Data Workflows-PyData 2025
YouTube video by PyData
002
francescalted.bsky.social @francescalted.bsky.social · 17/12/2025
Run live data analysis and visualizations on your phone in seconds! 💻👁️
010
francescalted.bsky.social @francescalted.bsky.social · 04/12/2025
Blosc2 + Caterva2 + Numba = ⚡⚡
010
francescalted.bsky.social @francescalted.bsky.social · 27/11/2025
🤔 Can a library that computes on compressed data actually outperform performance heavyweights like NumPy and NumExpr? Find some surprising answers 👉 www.blosc.org/posts/roofli... During the walk, I'm also introducing a funny anecdote back when NumPy was a 👶 Enjoy! #Blosc2 #HPC #NumPy #Numexpr
173
francescalted.bsky.social @francescalted.bsky.social · 25/11/2025
A la comunitat local de Python en Castelló de la Plana: aquest divendres dia 28 a les 7:30 ens reunirem al local de Nayar Systems en Avinguda Casalduch, 9. Parlarem de Cat2Cloud ☁️ : ironarray.io/cat2cloud Com que és Black Friday, tenim un regalet preparat per als asistents! 🎁 Us esperem!
000