iiinova — where your digital self keeps evolving

Reposted by Quentin Lhoest 🤗

Common Crawl Foundation @commoncrawl.bsky.social · 21/05/2026

As an early experiment in distributing Common Crawl data through another channel, the April 2026 crawl archive is now available in a Hugging Face Storage Bucket, alongside its existing home on AWS S3. commoncrawl.org/blog/april-2...

commoncrawl.org

Common Crawl - Blog - April 2026 Crawl Archive Now Available in a Hugging Face Storage Bucket

1133

Quentin Lhoest 🤗 @lhoestq.hf.co · 12/05/2026

1M public datasets on @hf.co ! Congrats for pushing forward AI with open datasets !

000

Quentin Lhoest 🤗 @lhoestq.hf.co · 25/07/2025

New blog post 🚨 Every data engineer should read it @kszucs.bsky.social (Apache Arrow PMC member) announces how to drastically speed up Parquet files uploads and downloads via deduplication. Best part: the feature enabling this is open source ! huggingface.co/blog/parquet...

huggingface.co

Parquet Content-Defined Chunking

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

100

Quentin Lhoest 🤗 @lhoestq.hf.co · 16/05/2025

CDC Parquet writer is out in PyArrow nightlies 🔥🔥 $ pip install \ -i pypi.anaconda.org/scientific-p... \ "pyarrow>=21.0.0.dev0" it's changing the way I view data versioning👇

110

Reposted by Quentin Lhoest 🤗

OpenDriveLab @opendrivelab.bsky.social · 30/12/2024

🤖 We are thrilled to announce AgiBot World, the first large-scale robotic learning dataset designed to advance multi-purpose humanoid policies! Github: github.com/OpenDriveLab... HuggingFace: huggingface.co/agibot-world

073

Reposted by Quentin Lhoest 🤗

IAMJB @iamjbd.bsky.social · 13/12/2024

SuperCharged Euclid is on 🤗 Hugging Face Also, this is the best paper heading I’ve seen in quite some time. The 'en tête' looks fantastic. (⚡Llama 3.3) Chat with the paper: huggingface.co/spaces/hugg... 🤗 Model: huggingface.co/euclid-mult... 🤗 Dataset: huggingface.co/datasets/eu...

092

Reposted by Quentin Lhoest 🤗

Lewis Tunstall @lewtun.bsky.social · 16/12/2024

We outperform Llama 70B with Llama 3B on hard math by scaling test-time compute 🔥 How? By combining step-wise reward models with tree search algorithms :) We're open sourcing the full recipe and sharing a detailed blog post 👇

410921

Reposted by Quentin Lhoest 🤗

Martin Elstner @martin.elstner.dev · 05/12/2024

In-place Assistants > Chat windows! Hugging Face's integration of an "AI Query" overlay in their SQL console exemplifies this. Users input natural language, AI suggests SQL queries—streamlining data exploration seamlessly. Probably the best showcase of this pattern in a freely accessible product.

SQL Console on Hugging Face with the AI Query overlay

121

Reposted by Quentin Lhoest 🤗

Angelika Romanou @agromanou.bsky.social · 02/12/2024

🚀 Introducing INCLUDE 🌍: A multilingual LLM evaluation benchmark spanning 44 languages! Contains *newly-collected* data, prioritizing *regional knowledge*. Setting the stage for truly global AI evaluation. Ready to see how your model measures up? #AI #Multilingual #LLM #NLProc

1386

Reposted by Quentin Lhoest 🤗

Daniel van Strien @danielvanstrien.bsky.social · 25/11/2024

The AT Protocol unlocks exciting possibilities: - Building custom feeds using ML - Creating dashboards for data exploration - Developing custom models for Bluesky To gather @bsky.app resources on @huggingface.bsky.social. I've established a community org 🤗 huggingface.co/bluesky-comm...

huggingface.co

bluesky-community (Bluesky Community)

Tools for Bluesky 🦋

1015933

Reposted by Quentin Lhoest 🤗

Daniel van Strien @danielvanstrien.bsky.social · 26/11/2024

First dataset for the new @huggingface.bsky.social @bsky.app community organisation: one-million-bluesky-posts 🦋 📊 1M public posts from Bluesky's firehose API 🔍 Includes text, metadata, and language predictions 🔬 Perfect to experiment with using ML for Bluesky 🤗 huggingface.co/datasets/blu...

huggingface.co

bluesky-community/one-million-bluesky-posts · Datasets at Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

69852772

Reposted by Quentin Lhoest 🤗

Philipp Schmid @philschmid.bsky.social · 23/11/2024

Open Source Post Training is going strong! In last 2 weeks, we got data or recipes released for OpenCoder, SmolLM-2, Orca Agent Instruct, and Tülu 3. Read it, learn, and iterate:

1345