Sign in

Stéphane Thiell

@sthiell.bsky.social
82 followers 44 following 20 posts

HPC storage

PostsRepliesMedia
Stéphane Thiell @sthiell.bsky.social · 20/03/2026
Just expanded Sherlock’s /scratch to 15 PB of all-flash Lustre at Stanford Research Computing. Built in-house on community Lustre with our own backported patches, OSTs added live. No vendor black box. No appliance magic. Just open source and a couple people who know their way around it! 🧱🔧⚡️
news.sherlock.stanford.edu
Scratch that: Sherlock now has 15 PB of flash - Sherlock changelog
We are excited to announce a major expansion of Sherlock's /scratch file system. We are adding 5 PB of full-flash storage, bringing the total capacity from 10 PB to 15 PB. This investment directly add...
041
Stéphane Thiell @sthiell.bsky.social · 25/04/2025
Thrilled to host Lustre Developer Day at @stanford-rc.bsky.social post-LUG 2025! 🌟 With 14+ top organizations like DDN, LANL, LLNL, HPE, CEA, AMD, ORNL, AWS, Google, NVIDIA, Sandia and Jefferson Lab represented, we discussed HSM, Trash Can, and upstreaming Lustre in Linux.
Lustre Developer Day at Stanford University on April 3, 2025
150
Stéphane Thiell @sthiell.bsky.social · 04/04/2025
@stanford-rc.bsky.social was proud to host the Lustre User Group 2025 organized with OpenSFS! Thanks to everyone who participated and our sponsors! Slides are already available at srcc.stanford.edu/lug2025/agenda 🤘Lustre! #HPC #AI
0102
Stéphane Thiell @sthiell.bsky.social · 28/03/2025
Getting things ready for next week's Lustre User Group 2025 at Stanford University!
061
Stéphane Thiell @sthiell.bsky.social · 08/03/2025
Join us for the Lustre User Group 2025 hosted by @stanford-rc.bsky.social in collaboration with OpenSFS. Check out the exciting agenda! 👉 srcc.stanford.edu/lug2025/agenda
srcc.stanford.edu
LUG 2025 Agenda
075
Stéphane Thiell @sthiell.bsky.social · 03/02/2025
ClusterShell 1.9.3 is now available in EPEL and Debian. Not using clustershell groups on your #HPC cluster yet?! Check out the new bash completion feature! Demo recorded on Sherlock at @stanford-rc.bsky.social with ~1,900 compute nodes and many group sources! asciinema.org/a/699526
asciinema.org
clustershell bash completion (v1.9.3)
This short recording demonstrates the bash completion feature available in ClusterShell 1.9.3, showcasing its benefits when using the clush and cluset command-line tools.
096
Stéphane Thiell @sthiell.bsky.social · 29/01/2025
We started it! blocksandfiles.com/2025/01/28/s... Check out my LAD'24 presentation: www.eofs.eu/wp-content/u...
Dual Astek SAS switches on top of TFinity tape library.
175
Stéphane Thiell @sthiell.bsky.social · 11/01/2025
Just another day for Sherlock's home-built scratch Lustre filesystem at Stanford: Crushing it with 136+GB/s aggregate read on real research workload! 🚀 #Lustre #HPC #Stanford
0243
Stéphane Thiell @sthiell.bsky.social · 21/11/2024
A great show of friendly open source competition and collaboration: the lead developers of Environment Modules and Lmod (Xavier of CEA and Robert of @taccutexas.bsky.social) at #SC24. They often exchange ideas and push each other to improve their tools!
052
Stéphane Thiell @sthiell.bsky.social · 20/11/2024
Newly announced at the #SC24 Lustre BoF! Lustre User Group 2025, organized by OpenSFS, will be hosted at Stanford University on April 1-2, 2025. Save the date!
Lustre User Group 2025 save-the-date card: April 1-2, 2025 at Stanford University
0108
Stéphane Thiell @sthiell.bsky.social · 18/11/2024
Fun fact: the Georgia Aquarium (nonprofit), next to the Congress center is the largest in the U.S. and the only one that houses whale sharks. I went on Sunday and it was worth it. Just in case you need a break from SC24 this week… 🦈
010
Stéphane Thiell @sthiell.bsky.social · 18/11/2024
I always enjoy an update from JD Maloney (NCSA), but even more when it is about using S3 for Archival Storage, something we are deploying at scale at Stanford this year (using MinIO server and Lustre/HSM!)
061
Stéphane Thiell @sthiell.bsky.social · 14/03/2024
Our branch of robinhood-lustre-3.1.7 on Rocky Linux 9.3 with our own branch of Lustre 2.15.4 and MariaDB 10.11 can ingest more than 35K Lustre changelogs/sec. Those gauges seem appropriate for Pi Day, no? github.com/stanford-rc/... github.com/stanford-rc/...
041
Reposted by Stéphane Thiell
kilian @kiliantw.bsky.social · 08/02/2024
Sherlock goes full flash! The scratch file system of Sherlock, Stanford's HPC cluster, has been revamped to provide 10 PB of fast flash storage on Lustre news.sherlock.stanford.edu/publications...
news.sherlock.stanford.edu
Sherlock goes full flash - Sherlock
What could be more frustrating than anxiously waiting for your computing job to finish? Slow I/O that makes it take even longer is certainly high on the list. But not anymore! Fir, Sherlock’s scratch file system, has just undergone a major
032
Stéphane Thiell @sthiell.bsky.social · 25/01/2024
Filesystem upgrade complete! Stanford cares about HPC I/O! The Sherlock cluster has now ~10PB of full flash Lustre scratch storage at 400 GB/s, to support a wide range of research jobs on large datasets! Fully built in-house!
Racks of Fir Storage at the Stanford Research Computing Facility (SRCF)df command showing 9.8PB /scratchArtist photo of an OSS pair of Fir with HDR-200
161
Stéphane Thiell @sthiell.bsky.social · 28/10/2023
My header image is an extract from this photo taken at the The Last Bookstore in Los Angeles, a really cool place.
The Internet lied to me
010
Stéphane Thiell @sthiell.bsky.social · 28/10/2023
👋
040