iiinova — where your digital self keeps evolving

Reposted by fairseq2

juanpino2000.bsky.social @juanpino2000.bsky.social · 27/06/2025

In line with FAIR mission, we open source Seamless Interaction Dataset to the community in order to accelerate the field. Download on github github.com/facebookrese... and @hf.co huggingface.co/datasets/fac...

github.com

GitHub - facebookresearch/seamless_interaction: Foundation Models and Data for Human-Human and Human-AI interactions.

Foundation Models and Data for Human-Human and Human-AI interactions. - facebookresearch/seamless_interaction

121

fairseq2 @fairseq2.bsky.social · 17/06/2025

[4/4] Collaborate efficiently with reproducible experiment setups using FAIRSeq2. Identify root causes swiftly and share lessons learned with the community. Create your benchmarks and contribute!

000

fairseq2 @fairseq2.bsky.social · 17/06/2025

[3/4] Beyond TensorBoard and WanDB, FAIRSeq2 supports torch profilers (set trainer.profile and common.profilers.torch.enabled=True) to inspect potential infra issues. Dive deep into your training processes with various profilers and metric recorders.

100

fairseq2 @fairseq2.bsky.social · 17/06/2025

[2/4] e.g., the tokens/s metric allows easy computation of Model FLOP Utilization – a great metric to check resource utilization efficiency. We achieve up to 48% MFU on 8 GPUs and maintain 37.6% across 4 nodes (32 GPUs). Experience effective and efficient distributed training!

100

fairseq2 @fairseq2.bsky.social · 17/06/2025

[1/4] 🛠️ FAIRSeq2 – your go-to tool for reliable benchmarking and diagnosing infra issues! With native logging of metrics, monitor training performance in real-time and ensure great visibility. #AI #MachineLearning #fairseq2

210

fairseq2 @fairseq2.bsky.social · 10/03/2025

🚀 Transform your LLM post-training with fairseq2! We make complex post-training into a breeze, so that you can make fairseq2 your paper machine! Feel free to check our tutorials out: - SFT: facebookresearch.github.io/fairseq2/sta... - DPO: facebookresearch.github.io/fairseq2/sta...

facebookresearch.github.io

End-to-End Fine-Tuning - fairseq2 DocumentationContentsMenuExpandLight modeDark modeAuto light/dark, in light modeAuto light/dark, in dark mode

010

Reposted by fairseq2

Matthew Finlayson @mattf.nl · 25/02/2025

This project was made feasible by the excellent open-source LLM training library @fairseq2.bsky.social; I highly recommend giving it a look! It made both SFT and DPO a piece of cake 🍰

0103

fairseq2 @fairseq2.bsky.social · 19/02/2025

Nothing explains better than a vivid example:

000

fairseq2 @fairseq2.bsky.social · 19/02/2025

🚀 Big news for LLM researchers! #fairseq2 now has native support in #vLLM. Deploy your fine-tuned language models with vLLM in just one command for lightning-fast performance. Ready to accelerate your research like in FAIR? Check this out: facebookresearch.github.io/fairseq2/sta...

facebookresearch.github.io

End-to-End Fine-Tuning - fairseq2 DocumentationContentsMenuExpandLight modeDark modeAuto light/dark, in light modeAuto light/dark, in dark mode

101

fairseq2 @fairseq2.bsky.social · 14/02/2025

🖼️ A gallery of open-source projects and papers powered by #fairseq2! 🚀 Seamless Communication and Large Concept Models are 2 vivid examples that showcase the potential of what we are building. More exciting FAIR research built on fairseq2 is on the way!

101

fairseq2 @fairseq2.bsky.social · 12/02/2025

Check out our doc for more details: facebookresearch.github.io/fairseq2/stabl…

facebookresearch.github.io

000

fairseq2 @fairseq2.bsky.social · 12/02/2025

👋 Hello world! We’re thrilled to announce the v0.4 release of fairseq2 — an open-source library from FAIR powering many projects at Meta. pip install fairseq2 and explore our trainer API, instruction & preference finetuning (up to 70B), and native vLLM integration.

142