Sign in

ironArray SLU

@ironarray.io
15 followers 4 following 30 posts

Compress Better, Compute Larger, Share Faster

PostsRepliesMedia
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 15/09/2026
📢 Python-Blosc2 4.13.1 is out! Continuing our "not an island" mood: stream remote datasets (HDF5, Zarr, B2Z) over HTTP/S3 lazily, and compute across formats in one expression: b2z + zarr * h5! Plus tiered caching & Win ARM64 wheels. github.com/Blosc/python... Compress Better, Compute Bigger 🚀
021
Reposted by ironArray SLU
francescalted.bsky.social @francescalted.bsky.social · 11/09/2026
One API for unite them all!
012
ironArray SLU @ironarray.io · 02/09/2026
📢 Caterva2 2026.9.2 is out! 🚀 Intelligent compute & caching for Blosc2 & HDF5 repositories. Highlights: ✅ C2Cache peer caching ✅ Blosc2 CTable (.b2z) support ✅ Virtual roots (.b2z/.h5) ✅ Concurrent chunk writes ✅ Embedded JupyterLite github.com/ironArray/Ca... Share Faster, Compute Bigger 🚀
000
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 11/06/2026
🚀 New Blosc post: one selective query, 24.3M taxi trips, five tools. ⚡ Cold: CTable/.b2z ~1.9x faster than DuckDB, 9.4x vs pandas 🎯 Block indexes skip ~90% of the data 🤝 Warm: dead heat with DuckDB 💾 Only +2% disk vs Parquet blosc.org/posts/ctable... #Python #DuckDB
032
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 12/05/2026
Did you know that in recent Python-Blosc2 4.2.0 we released extremely efficient indexing engines that can store data in (guess what) ...compressed state? As a result, much larger tables can be indexed. Look at how this fares against other good indexing engines in plots below. Enjoy! #TabularData
021
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 22/04/2026
📣 C-Blosc2 3.0.0-rc2 is out 🚀 Big highlight: a new shared managed thread pool for parallel execution. ✅ With this and previous work, C-Blosc2 will become specially useful for storing variable length data, using extremely low resources. github.com/Blosc/c-blos... #CBlosc2 #Compression #OpenSource
032
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 27/03/2026
🚀 C-Blosc2 3.0.0 RC1 is out! What's new? 📦 VL-blocks for irregular data (strings, JSON) 🗜️ LZ4/LZ4HC dictionary compression 🛡️ Important safety fixes Check out the full release notes here: github.com/Blosc/c-blos... Give it a spin and provide feedback! #Blosc2 #OpenSource #C
github.com
032
Reposted by ironArray SLU
francescalted.bsky.social @francescalted.bsky.social · 25/03/2026
Look at the bump in performance that we will see with the next Python-Blosc2 release. Matrix multiplication has been speeded up by using blocks and Blosc2 prefilters and its own efficient and multithreaded engine. Expect between 5x and 6x better speed for matrices with no padding.
042
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 10/03/2026
We designed DSL kernels in Blosc2 so that they can be used in the main platforms; nowadays this necessarily includes Web Assembly (WASM) in the browser. We also implemented a new JIT compiler for WASM specially meant for Blosc2 DSL kernels. Play with it at: cat2.cloud/demo/roots/@... Have fun!
021
Reposted by ironArray SLU
luke.shaw@ironarray.io @lshaw-ironarray.bsky.social · 04/03/2026
Blosc2 4.1 Release! We've packed this minor release: optimised compression and funcs for unicode arrays; cumulative reductions; memory-map support for store containers like `DictStore` ; and a DSL kernel functionality for faster, compiled, user-defined funcs!👇️ Notebook - github.com/Blosc/python...)
022
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 20/02/2026
Super-efficient DSL kernels are coming with forthcoming Python-Blosc 4.1.0. A DSL kernel is a function that takes ndarray objects as input and returns a ndarray object as output. Performance with classic Mandelbrot is kind of mind-blowing. See github.com/Blosc/python... for full notebook.
001
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 05/02/2026
The new engine in Python-Blosc2 4.0 delivers quite awesome performance results. Processing a 400 MB array can be up to 9.6x faster than NumPy 🤯 The best part is that it fully supports NumPy's array and ufunc interfaces. High performance with zero friction! 🏎️💨 ironarray.io/blog/miniexp... Enjoy!
064
ironArray SLU @ironarray.io · 02/02/2026
Happy to sponsor this work, and very pleased with the results 🤘 This will be immensely helpful for making our Cat2.Cloud offer more efficient and user-friendly ❤️
000
Reposted by ironArray SLU
luke.shaw@ironarray.io @lshaw-ironarray.bsky.social · 30/01/2026
📢 Blosc2 🤝 OpenZL 🔁 Use the OpenZL compression 🗜️ library from Blosc2: github.com/Blosc/blosc2...! 𝚙̲𝚒̲𝚙̲ ̲𝚒̲𝚗̲𝚜̲𝚝̲𝚊̲𝚕̲𝚕̲ ̲𝚋̲𝚕̲𝚘̲𝚜̲𝚌̲𝟸̲–̲𝚘̲𝚙̲𝚎̲𝚗̲𝚣̲𝚕̲ and just like that, OpenZL compression + Blosc2 compute engine! Check out the OpenZL project openzl.org. Inside story on the plugin ⏩️ blosc.org/posts/openzl...
022
ironArray SLU @ironarray.io · 21/01/2026
🚀 Our #PyDataGlobal 2025 tutorial on modern #Blosc2 & #Caterva2 features is out! Learn how compression boosts array performance & enables cloud computing without downloads. ☁️ Watch here: 👇 www.youtube.com/watch?v=tUvS... #Python #HPC #DataScience #BigData
youtube.com
Francesc Alted+Luke Shaw - Hands-on with Blosc2: Accelerating Your Python Data Workflows-PyData 2025
YouTube video by PyData
002
ironArray SLU @ironarray.io · 17/12/2025
Visualize data on your phone with Cat2Cloud! 📱✨ Create interactive plots in your mobile browser. No laptop needed! Launch our demo, create graphs with Matplotlib/Plotly, customize, and render instantly. Register to save & share your work. 📈🎉 Try it: cat2.cloud/demo/static/...
000
ironArray SLU @ironarray.io · 04/12/2025
Numba can make UDFs really shine ✨✨✨
011
ironArray SLU @ironarray.io · 29/11/2025
Specially interesting in these times, where SSDs, but specially RAM prices, are skyrocketing: arstechnica.com/gadgets/2025...
arstechnica.com
GPU prices are coming to earth just as RAM costs shoot into the stratosphere
Some RAM kits are over three times as expensive as they were three months ago.
000
Reposted by ironArray SLU
francescalted.bsky.social @francescalted.bsky.social · 27/11/2025
🤔 Can a library that computes on compressed data actually outperform performance heavyweights like NumPy and NumExpr? Find some surprising answers 👉 www.blosc.org/posts/roofli... During the walk, I'm also introducing a funny anecdote back when NumPy was a 👶 Enjoy! #Blosc2 #HPC #NumPy #Numexpr
173
ironArray SLU @ironarray.io · 24/11/2025
It's Black Friday Week! 🛍️🖤 Don't miss out! Use the coupon code BLACKFRIDAY to get a generous 50% OFF your first order on Cat2Cloud. 💰 This offer is valid until Cyber Monday (Dec 1st), so don't delay! ⏳ Get it today! 👉 ironarray.io/pricing
ironarray.io
Pricing | ironArray SLU
Pricing for products & services
021
ironArray SLU @ironarray.io · 24/11/2025
Unlock the power of your HDF5 data in the cloud! ☁️ Cat2Cloud now offers native, out-of-the-box support for HDF5 files. Upload and process your HDF5 data as seamlessly as any other format. ✨ Ready to see it in action? Try our online demo server today! 👉 cat2cloud.com/demo/ #HDF5 #CloudComputing
020
Reposted by ironArray SLU
luke.shaw@ironarray.io @lshaw-ironarray.bsky.social · 20/11/2025
The crown jewel of Cat2Cloud 💎 ! Cat2Cloud's most exciting feature: 𝗿𝗲𝗺𝗼𝘁𝗲 𝗷𝘂𝗽𝘆𝘁𝗲𝗿 𝗻𝗼𝘁𝗲𝗯𝗼𝗼𝗸𝘀! ☁️ cloud-based computation ☁️ cloud-hosted data ☁️ cloud-hosted jupyter notebooks! ⚡No environment headaches, no waiting for computations - all in a seamless interface from the browser!
041
ironArray SLU @ironarray.io · 18/11/2025
Tired of downloading large datasets? Cat2Cloud is now live! 🚀 Bring computation directly to your data. Host, run, and share workflows with incredible speed. ⚡ Read the announcement: ironarray.io/blog/cat2clo... #Cat2Cloud #BigData #DataScience #Python #HPC
031
ironArray SLU @ironarray.io · 12/11/2025
Stop downloading. Start computing. Everything changes on November 18, 2025. #Cat2Cloud is coming.
032
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 07/11/2025
Our Blosc2 tutorial for @euroscipy.bsky.social 2025 is up! Learn how compression boosts tensor data handling, sharing & computing. www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
youtube.com
18.08.2025 Compress, Compute, and Conquer: Python-Blosc2 for Efficient Data Analysis
YouTube video by EuroSciPy
042
ironArray SLU @ironarray.io · 03/11/2025
Blosc2 is making its way towards becoming a general array library for data that is in memory, on disk or remote. This will be extremely useful to add flexibility to our cat2cloud SaaS service: ironarray.io/cat2cloud 🚀 🎉
010
Reposted by ironArray SLU
luke.shaw@ironarray.io @lshaw-ironarray.bsky.social · 20/10/2025
💊 IronPill 1💊 Blosc2 calculates Fourier approximations: ⚡5x faster than NumPy 👣 fraction of the memory footprint 🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷) Full notebook: github.com/Blosc/python... (inspiration: towardsdatascience.com/numexpr-the-...) #Blosc2 #Data #SignalProcessing
042
Reposted by ironArray SLU
luke.shaw@ironarray.io @lshaw-ironarray.bsky.social · 15/10/2025
📢Blosc2 3.10.2 Released! 📢 Lazy evaluation for ALL Blosc2 functions in version 3.10! Blosc2 powers: - Zarr/HDF5 computations (see image and blosc.org/posts/tensor...) - Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)! #Zarr #HDF5 #Python
042
Reposted by ironArray SLU
luke.shaw@ironarray.io @lshaw-ironarray.bsky.social · 01/10/2025
🚨Blosc2 3.9.1🚨 Blosc2 as a mature computation engine >>> • Array API standard compliance - 70 new functions • Fast linalg: tensordot 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays ! • Fast calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy! Blog: ironarray.io/blog/array-api #Python #linalg #computation
011
Reposted by ironArray SLU
francescalted.bsky.social @francescalted.bsky.social · 22/09/2025
It's surprising how often the powerful SIMD capabilities of modern processors are overlooked. Harnessing them is key to unlocking next-level performance.
011
ironArray SLU @ironarray.io · 08/09/2025
Struggling to get performant code from LLMs? 🤔 We can help! 💪 We've spent countless hours profiling and micro-benchmarking Blosc2 for you. A thing that LLMs cannot do (yet). Ready to dive in? 🚀 🔹 EuroSciPy Talk: www.blosc.org/docs/2025-Eu... 🔹 Tutorial: github.com/Blosc/EuroSc... #HPC #Blosc2
031
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 20/08/2025
🚀 We're thrilled to announce *TreeStore*, a new class in Python-Blosc2! Endow your datasets with a hierarchical structure! ⚡️ 📝 We've blogged about it: www.blosc.org/posts/new-tr... It's in beta, and available in Python-Blosc2 v3.7.2. Enjoy! #Python #Blosc2 #TreeStore #DataScience #OpenSource
022
ironArray SLU @ironarray.io · 07/08/2025
📣 #Caterva2 2025.8.7 is out! 🚀 We did a major refactoring for a simpler, more robust system, with client APIs unaffected. ✅ The highlight is the new cat2agent 🤖, a CLI client to watch a directory and auto-sync it with a Caterva2 server. Release notes: github.com/ironArray/Ca... #OpenSource
011
ironArray SLU @ironarray.io · 16/07/2025
Tired of trial-and-error with #Blosc2 compression? You can do better with #Btune! 🚀 Btune can be trained to automatically find the best parameters for your specific datasets and use case. Learn more about optimizing your compression workflow: ironarray.io/btune #DataCompression #Optimization
000
ironArray SLU @ironarray.io · 09/07/2025
Thanks to the advanced double partitioning techniques in #Blosc2, our #Caterva2 package can serve small slices of big datasets (3.8 GB) through internet in less than the blink of an eye. Try it out by yourself! 👉 cat2.cloud/demo/roots/@... Share Data Faster! #BigData #RemoteAccess #Performance
Accessing remote datasets in less than 100 ms
010
ironArray SLU @ironarray.io · 08/07/2025
For those who could not attend, the recording of our recent webinar, "A Gentle Introduction to Cat2Cloud," is now available! ironarray.io/cat2cloud#we... If interested, remember that the subscription to our beta program is currently open! Compress Better, Compute Bigger, Share Faster!
001
ironArray SLU @ironarray.io · 25/06/2025
📣 Final call! 📣 Join us tomorrow, June 26th at 14:15 UTC, for our live webinar: A Gentle Introduction to Cat2Cloud Discover how you can: 📤 Upload 📊 Visualize 💻 Compute 🤝 Share ...your data right in the cloud, in the most efficient way possible! ☁️✨ www.linkedin.com/feed/update/... See you there!
linkedin.com
🚀 Exciting Webinar Announcement! | Francesc Alted
🚀 Exciting Webinar Announcement! 🚀 We're thrilled to invite you to our upcoming webinar: **"A Gentle Introduction to cat2.cloud"** Hosted by ironArray 📅 **Date:** 2025-06-26 🕑 **Time:*...
121
ironArray SLU @ironarray.io · 18/06/2025
In this chapter, our Luke Shaw explains how filters work in Caterva2, a free software that you can run on your own laptop (or server, if you are more serious about large datasets). It works for either #Blosc2 or #HDF5 datasets. Have it a try! #WebGUI #DataAnalysis #LargeData
020
ironArray SLU @ironarray.io · 06/06/2025
🚀 Excited to share more about Caterva2, your ultimate gateway to #Blosc2 / #HDF5 repositories! 🚀 #Caterva2 is designed to revolutionize how you interact with large datasets. Want to see it in action? 🤔 See our new video showcasing Caterva2's main functionalities! 🎬 ironarray.io/caterva2 Enjoy!
000
ironArray SLU @ironarray.io · 29/05/2025
✨ Ever wondered how to effortlessly apply lazy expressions to tomographic HDF5 datasets and visualize them instantly in Cat2Cloud? 🤯 🎬 Discover how Python 🐍 magic and our user-friendly web interface simplify the process. 👇 Watch the full video to see the magic unfold: ironarray.io/cat2cloud
000
Reposted by ironArray SLU
francescalted.bsky.social @francescalted.bsky.social · 27/05/2025
We're making HDF5, the standard for scientific data 📊, faster ⚡ and more versatile 🛠️. By integrating Blosc2 with HDF5, our Caterva2 platform allows you to natively serve ☁️, share 🤝, visualize 👀, and compute 💻 your HDF5 datasets with greater efficiency and ease. Slides: www.blosc.org/docs/2025-Eu...
Caterva2 displaying the result of a computed tomography of a large HDF5 dataset in real-time.
022
ironArray SLU @ironarray.io · 15/05/2025
🚀 Meet Cat2Cloud: High-Speed Throughput for AI/ML and HPC Workloads ⚡️💾 Managing large datasets shouldn't mean navigating complex architectures or unpredictable fees. Visit ironarray.io/cat2cloud to explore how Cat2Cloud can transform your data management experience. #DataManagement #CloudComputing
000
ironArray SLU @ironarray.io · 14/05/2025
Python-Blosc2 3.3.3 is live! ✨ Bug fixes, smoother string lazy expressions, and Windows mmap improvements thanks to the latest C-Blosc2. Upgrade now: pip install blosc2 --update Learn more: github.com/Blosc/python... #Python #Blosc2 #DataScience
github.com
Releases · Blosc/python-blosc2
A high-performance library for compressed ndarrays, with a flexible computational engine - Blosc/python-blosc2
010
ironArray SLU @ironarray.io · 09/05/2025
🗣️ Exciting news! We're introducing a new way to work with large datasets in the ☁️, inspired by spreadsheets 📊. Imagine an expression that automatically updates its value whenever the underlying data changes – that's what we've brought to cloud-based data analysis. Join our beta program and enjoy! 😀
021
ironArray SLU @ironarray.io · 15/04/2025
Your data does not need to be scattered throughout the world. See how you can use Blosc2/Caterva2 for centralize its storage, computing and sharing needs at easy! Compress Better, Compute Bigger, Share Faster
000
ironArray SLU @ironarray.io · 02/04/2025
🗣️ After 15 years delivering Blosc/Blosc2, we are glad to announce the beta program for Cat2Cloud:🤟 - 🗜️ Access to the best compression algorithms available - 🔄 Share complex data securely and effortlessly - ⚡ Perform advanced computations directly in the cloud ...and more! ironarray.io/cat2cloud
First video explaining the roots concept, and how to upload and download data
022
ironArray SLU @ironarray.io · 12/03/2025
Happy to sponsor such an excellent work!
012
Reposted by ironArray SLU
Blosc Development Team @blosc.org · 12/03/2025
📢 We are happy to announce the release of Python-Blosc2 3.2.0! This release introduces the new blosc2.matmul() function. We have written a nice blog: www.blosc.org/posts/optimi... Lastly, we are excited to introduce WASM32 wheels for the first time. More info at: github.com/Blosc/python... Enjoy!
blosc.org
Optimizing chunks for matrix multiplication in Blosc2
Exploring how to optimize chunk sizes in Blosc2 to improve performance in matrix multiplication.
023
ironArray SLU @ironarray.io · 25/02/2025
Happy to be sponsoring such an extremely useful project! Cheers! 🥂
000
ironArray SLU @ironarray.io · 14/02/2025
Happy to sponsor this fine work.
000