Sign in

Guilherme Penedo

@guilherme.hf.co
623 followers 66 following 3 posts

ML Research Engineer at 🤗. Lisboeta 🇵🇹

PostsRepliesMedia
Guilherme Penedo @guilherme.hf.co · 08/12/2024
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
160
Guilherme Penedo @guilherme.hf.co · 08/12/2024
Announcing 🥂 FineWeb2: A sparkling update with 1000s of 🗣️languages. We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages. 🥂 FineWeb2 has 8TB of compressed text data and outperforms other datasets.
17619