Sign in

MLflow

@mlflow.org
97 followers 6 following 207 posts

The open source developer platform to build AI applications and models with confidence.

PostsRepliesMedia
MLflow @mlflow.org · 06/01/2026
𝗔𝗜 𝗢𝗯𝘀𝗲𝗿𝘃𝗮𝗯𝗶𝗹𝗶𝘁𝘆 𝗳𝗼𝗿 𝗘𝘃𝗲𝗿𝘆 𝗧𝘆𝗽𝗲𝗦𝗰𝗿𝗶𝗽𝘁 𝗟𝗟𝗠 𝗦𝘁𝗮𝗰𝗸 🚀 MLflow 3.6 brings automatic tracing to JS/TS! Get traces from Vercel AI SDK, LangChain, Mastra, Anthropic, & Gemini in the same UI as your Python services. 🔗 Read more: mlflow.org/blog/typescr... #mlflow #opensource #oss #typescript #llm #ai
130
MLflow @mlflow.org · 22/12/2025
We’re excited to announce the release of 𝗠𝗟𝗳𝗹𝗼𝘄 𝟯.𝟴! 🚀 What’s New? ⚙️ 𝗣𝗿𝗼𝗺𝗽𝘁 𝗠𝗼𝗱𝗲𝗹 𝗖𝗼𝗻𝗳𝗶𝗴𝘂𝗿𝗮𝘁𝗶𝗼𝗻 ⏳ 𝗜𝗻-𝗣𝗿𝗼𝗴𝗿𝗲𝘀𝘀 𝗧𝗿𝗮𝗰𝗲 𝗗𝗶𝘀𝗽𝗹𝗮𝘆 ⚖️ 𝗗𝗲𝗲𝗽𝗘𝘃𝗮𝗹 𝗮𝗻𝗱 𝗥𝗔𝗚𝗔𝗦 𝗝𝘂𝗱𝗴𝗲𝘀 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗶𝗼𝗻 🛡️ 𝗖𝗼𝗻𝘃𝗲𝗿𝘀𝗮𝘁𝗶𝗼𝗻𝗮𝗹 𝗦𝗮𝗳𝗲𝘁𝘆 𝗦𝗰𝗼𝗿𝗲𝗿 ⚡ 𝗖𝗼𝗻𝘃𝗲𝗿𝘀𝗮𝘁𝗶𝗼𝗻𝗮𝗹 𝗧𝗼𝗼𝗹 𝗖𝗮𝗹𝗹 𝗘𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝗰𝘆 𝗦𝗰𝗼𝗿𝗲𝗿 Dive into the release notes: github.com/mlflow/mlflo...
000
MLflow @mlflow.org · 15/12/2025
MLflow Ambassador Joana Ferreira just dropped the next chapter in her GenAI series! 🚀 📖 "𝗘𝘃𝗮𝗹𝘂𝗮𝘁𝗶𝗻𝗴 𝗚𝗲𝗻𝗔𝗜 𝘄𝗶𝘁𝗵 𝗠𝗟𝗳𝗹𝗼𝘄: 𝗠𝗼𝗻𝗶𝘁𝗼𝗿𝗶𝗻𝗴 𝗶𝗻 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻" Learn to use MLflow’s unified evaluation framework for continuous production monitoring. Dive in: medium.com/@joana.c.mes... #MLflow #GenAI #OpenSource
010
MLflow @mlflow.org · 09/12/2025
Stop the AI Agent "vibe checks" & manual labeling! 🛑🛠️ Samraj Moorjani (Databricks) shows how #MLflow accelerates high-quality, production-ready agent development. Learn the techniques leading companies use to skip the iteration loop. 🚀 🎥 Watch the full session: www.youtube.com/watch?v=qOFK...
000
MLflow @mlflow.org · 08/12/2025
MLflow 3.7.0 is here and it brings major features and improvements for GenAI Observability, Evaluation, and Prompt Management! 🙌🥳 🔗 View the release notes: github.com/mlflow/mlflo... Thanks to all the contributions from the community! 🙏 🚀 Try it out: pip install mlflow==3.7.0 #opensource #mlflow
020
MLflow @mlflow.org · 28/11/2025
Only a few days left to apply for the next #MLflow Ambassador cohort! 🚀 Join a global group of leaders advancing open source MLflow and helping teams ship high-quality #GenAI with evaluation, tracing, and prompt management. Submit your application by 𝗗𝗲𝗰 𝟭. 🔗 Apply today: forms.gle/eBEf6fTfKWNm...
140
MLflow @mlflow.org · 15/10/2025
Missed last week’s #MLflow Community Meetup? Check out Ben Wilson on agentic judges: “The judge no longer works as an LLM as a judge—it actually works as an agent as a judge.” 🎥 Full video: www.youtube.com/live/bkMabn8... #opensource #oss #agenticjudges
110
MLflow @mlflow.org · 09/10/2025
⚡ In this lightning talk at MLOps World, Danny Chiao tackled a top agent challenge: ensuring high quality output. Rather than labeling and analyzing traces by hand, MLflow makes it easy to log, evaluate, and iterate faster—using techniques leading companies rely on to deploy agents in production. ✅
010
MLflow @mlflow.org · 07/10/2025
🚨 Reminder: MLflow Community Meetup is tomorrow, Oct 8 at 4:00 PM PT! We'll explore trace‑aware, feedback‑aligned judges and versioned eval datasets in MLflow. You don't wait to miss it! 🎥 LIVE on LinkedIn, YouTube & X 🔗 RSVP: luma.com/mlflow-1001 #opensource #oss #mlflow
000
MLflow @mlflow.org · 06/10/2025
Building better LLM evals? Ben Wilson highlights how frameworks like #DSPy boost judge prompts—and reliability—as models evolve. Tips for judge reproducibility/reliability: use reproducible pipelines, re-tune logic as endpoints change, & standardize. ✅ 🎥 Watch more: www.youtube.com/live/HTxpmnO...
000
MLflow @mlflow.org · 01/10/2025
🚀 Headed to MLOps World | GenAI Summit 2025 next week? Don’t miss an exciting lightning talk from Danny Chiao, Engineering Lead at Databricks! 🎤 𝗧𝗲𝗰𝗵𝗻𝗶𝗾𝘂𝗲𝘀 𝘁𝗼 𝗯𝘂𝗶𝗹𝗱 𝗵𝗶𝗴𝗵 𝗾𝘂𝗮𝗹𝗶𝘁𝘆 𝗮𝗴𝗲𝗻𝘁𝘀 𝗳𝗮𝘀𝘁𝗲𝗿 𝘄𝗶𝘁𝗵 𝗠𝗟𝗳𝗹𝗼𝘄 🗓️ October 9 📍 Austin, TX 🔗 Learn more: mlopsworld.com#agenda #MLflow #GenAI #MLOps #LLM
000
MLflow @mlflow.org · 30/09/2025
🚀 The fifth “Invoice Extraction with OpenAI + MLflow” session is now available! #MLflow Ambassador Shrinath Suresh dives into designing a custom scorer to evaluate invoice extraction models beyond just labels or LLM-as-a-judge. 🎥 youtu.be/SmuhOmOYXSg?... 📖 medium.com/@shrinath.su... #opensource
010
MLflow @mlflow.org · 15/09/2025
This blog highlights how MLflow’s #GenAI capabilities streamline development of an LLM-based Optical Character Recognition (OCR) tool. These capabilities reduce friction, accelerate workflows, and deliver value to both technical and non-technical contributors. 🚀 Dive in: mlflow.org/blog/mlflow-...
000
MLflow @mlflow.org · 11/09/2025
This blog looks at the “Coffee Machine” approach: global teams set up standardized #ML pipelines, & local teams adapt them using their own #data. ☕ #MLflow supports every step, making it possible to track changes, register model variants, & maintain reproducibility. 🔗 medium.com/dscier/brewi...
000
MLflow @mlflow.org · 09/09/2025
📣 Happening Tomorrow — MLflow Office Hours! Join #MLflow maintainers for a live Q&A session! Whether you’re running MLflow in production or experimenting with LLMs & GenAI, this is your chance to bring real challenges and get direct feedback. 🕒 Sept 10 @ 3PM SGT 🎟 RSVP: lu.ma/mlflow-910 #oss
000
MLflow @mlflow.org · 05/09/2025
Evaluating AI agents is tricky—they make multi-step decisions, use tools, and follow reasoning chains. To measure them, you need to assess the workflow, not just the final answer. That’s where MLflow’s new agent evaluation framework steps in. 🔗 Docs: mlflow.org/docs/latest/... #MLflow #AI #MLOps
100
MLflow @mlflow.org · 22/08/2025
📣 MLflow 3.3.0 is now available! This release introduces several major features and improvements: 🔹 𝗠𝗼𝗱𝗲𝗹 𝗥𝗲𝗴𝗶𝘀𝘁𝗿𝘆 𝗪𝗲𝗯𝗵𝗼𝗼𝗸𝘀 🔹 𝗔𝗴𝗻𝗼 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗶𝗼𝗻 🔹 𝗚𝗲𝗻𝗔𝗜 𝗘𝘃𝗮𝗹𝘂𝗮𝘁𝗶𝗼𝗻 𝗶𝗻 𝗢𝗦𝗦 🔹 𝗥𝗲𝘃𝗮𝗺𝗽𝗲𝗱 𝗧𝗿𝗮𝗰𝗲 𝗧𝗮𝗯𝗹𝗲 𝗩𝗶𝗲𝘄 🔹 𝗙𝗮𝘀𝘁𝗔𝗣𝗜 + 𝗨𝘃𝗶𝗰𝗼𝗿𝗻 𝗦𝗲𝗿𝘃𝗲𝗿 🔗 Check out the release notes: github.com/mlflow/mlflo... #oss
021
MLflow @mlflow.org · 07/08/2025
Join us for the next MLflow Community Meetup! 🥳 This month, we’re excited to bring you the latest updates and insights from the MLflow ecosystem, featuring: ​🔔 Webhooks in MLflow 🧪 Managed MLflow Features Now in OSS 📅 August 20 @ 4:00 PM PT 📍 Live on X, YouTube, & LinkedIn 🔗 RSVP: lu.ma/mlflow820
021
MLflow @mlflow.org · 05/08/2025
MLflow 3.2 is here! 🚀 Key updates include: 🔹 𝗧𝘆𝗽𝗲𝗦𝗰𝗿𝗶𝗽𝘁 𝗦𝗗𝗞 𝗳𝗼𝗿 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 🔹 𝗦𝗲𝗺𝗮𝗻𝘁𝗶𝗰 𝗞𝗲𝗿𝗻𝗲𝗹 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 🔹 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗲𝗱 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸 𝗟𝗼𝗴𝗴𝗶𝗻𝗴 🔹 𝗘𝘅𝗽𝗲𝗿𝗶𝗺𝗲𝗻𝘁 𝗨𝗜 𝗥𝗲𝗳𝗿𝗲𝘀𝗵 🔹 𝗧𝗿𝗮𝗰𝗲 𝗨𝗜 𝗘𝗻𝗵𝗮𝗻𝗰𝗲𝗺𝗲𝗻𝘁𝘀 🔹 𝗣𝗜𝗜 𝗠𝗮𝘀𝗸𝗶𝗻𝗴 𝗶𝗻 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 🔹 𝗣𝗼𝗹𝗮𝗿𝘀 𝗗𝗮𝘁𝗮𝗙𝗿𝗮𝗺𝗲 𝗟𝗼𝗴𝗴𝗶𝗻𝗴 🔗 Check out the full release notes → github.com/mlflow/mlflo... #oss
131
MLflow @mlflow.org · 04/08/2025
Have #MLflow questions? Join us this Wed, August 6 for MLflow Office Hours! 🚀 What to Expect: ✅ Live troubleshooting of your MLflow implementation questions ✅ Expert insights on model lifecycle management & GenAI integrations ✅ Sneak peeks at new & upcoming features 🔗 Register: lu.ma/mlflow8625
010
MLflow @mlflow.org · 29/07/2025
📣 Join us next Wed, August 6 for #MLflow Office Hours — your live Q&A with core MLflow maintainers & contributors! This is your opportunity to get expert, hands-on technical feedback directly from the team! 🤝 Open to all levels — bring your questions & join the discussion. 🔗 RSVP: lu.ma/mlflow8625
000
MLflow @mlflow.org · 18/07/2025
"When we update any part of a system, we need to make sure we’re not introducing regressions — and ideally, that we’re improving quality. One way to address this is through evaluation-driven development." - Yuki Watanabe, MLflow Maintainer 💬 🔗 Watch the full webinar: www.youtube.com/watch?v=-jzm...
100
MLflow @mlflow.org · 17/07/2025
Model evaluation is the foundation of reliable machine learning. With #MLflow’s evaluation framework, you get more than just accuracy—you get deep insights into model behavior, automated testing, rich visualizations, and validation pipelines. Get started ➡️ mlflow.org/docs/latest/... #opensource
131
MLflow @mlflow.org · 17/07/2025
Happening TODAY! 🚨 Join Agents in Production 2025 for a can’t-miss session on building evaluation-driven #Agentic systems with #MLflow 3.0. 🔎 Yuki Watanabe will break down: ✅ One-line observability ✅ Automatic evaluation ✅ Human-in-the-loop feedback 🔗 Register: home.mlops.community/home/events/...
000
MLflow @mlflow.org · 16/07/2025
🎥 “People ask for it. It’s open-source. It works for both classical ML and GenAI. And it’s easy to start.” Mikhail Rozhkov from Nebius shares why their team chose #MLflow as their experiment tracking and observability platform. 👀 Watch the full video: www.youtube.com/live/4Ok-03P... #opensource
021
MLflow @mlflow.org · 16/07/2025
🚨 Happening TOMORROW, July 17 — Agents in Production 2025 is almost here! Get an inside look at MLflow 3.0’s powerful new features: ✅ One-line observability ✅ Automatic evaluation ✅ Human-in-the-loop feedback Free + virtual! 🎟️ Register here: home.mlops.community/home/events/... #opensource #oss
021
MLflow @mlflow.org · 15/07/2025
MLflow will soon support TypeScript natively! 🙌 You'll be able to: ✅ Track, monitor, and evaluate projects in Python, TypeScript, or JavaScript—all in one place ✅ Unify workflows across data science & full-stack development 👀 Get an exclusive preview: www.youtube.com/watch?v=-jzm... #oss #mlflow
020
MLflow @mlflow.org · 15/07/2025
At what stage or scale of an ML project would you recommend moving from self-hosted MLflow to SageMaker managed MLflow? Watch the full clip for the answer! ⤵️ #sagemaker #mlflow #opensource #oss #ML
011
MLflow @mlflow.org · 15/07/2025
Are your AI responses off-topic? MLflow answer relevance gives instant 1-5 scores showing which responses miss the user's actual question. No more manual review. 📕 View the full article: buff.ly/mT4mlmZ Credit: Khuyen Tran, Founder of CodeCut
010
MLflow @mlflow.org · 14/07/2025
📣 Agents in Production 2025 is this Thursday, July 17! Join Yuki Watanabe (Databricks) for “Driving Evaluation-Driven Development with MLflow 3.0.” ✅ Explore new #MLflow features & agentic app strategies. Free & virtual! Register 👉 home.mlops.community/home/events/... #agenticai #opensource
011
MLflow @mlflow.org · 09/07/2025
Don’t miss Yuki Watanabe’s talk at Agents in Production 2025! See how #MLflow 3.0 enables evaluation-driven Agentic app development and helps build more reliable AI systems. 🗓️ Thursday, July 17 💻 Free & virtual 🔗 Register: home.mlops.community/home/events/agentsinproduction2025 #opensource #oss
011
MLflow @mlflow.org · 08/07/2025
Tracking image datasets is essential for reproducibility & model lineage in computer vision workflows, but comes with challenges. This blog demonstrates practical approaches to track image datasets using #MLflow's experiment tracking capabilities & UI. 🚀 🔗 Learn more: mlflow.org/blog/trackin...
020
MLflow @mlflow.org · 08/07/2025
📣 Reminder: MLflow Office Hours is Tomorrow @ 8AM PT! Whether you’re managing models in production, experimenting with #LLM workflows, or just curious about the latest in #MLflow, this is your chance to connect with the team behind the project. RSVP here ➡️ lu.ma/officehours0... #opensource #oss
110
MLflow @mlflow.org · 07/07/2025
Join Us for MLflow Office Hours – This Wednesday! 🥳 Are you working with models in production, exploring LLM workflows, or eager to dive into the latest MLflow features? Don’t miss our interactive MLflow Office Hours happening this Wednesday, July 9 at 8AM PT! ✅ 🔗 RSVP here: lu.ma/officehours0...
000
MLflow @mlflow.org · 07/07/2025
Want to integrate #OpenAI models into your ML workflows with ease? The MLflow AI Gateway is your bridge to robust, scalable, and secure model deployment and management. ✅ Get started with this hands-on guide 👉 mlflow.org/docs/latest/... #opensource #oss #mlflow #machinelearning
030
MLflow @mlflow.org · 03/07/2025
What to Expect: ✅ Live troubleshooting for your MLflow implementation questions ✅ Expert insights on model lifecycle management and #GenAI integrations ✅ Sneak peeks at new and upcoming features ✅ Tips & best practices for tracking LLM workflows and ML experiments Let’s talk MLflow—see you there! 👏
000
MLflow @mlflow.org · 02/07/2025
MLflow 3: One platform for all your AI workflows. 📚 Learn more: mlflow.org/blog/mlflow-... 🔗 View the release notes: github.com/mlflow/mlflo... #MLflow #MachineLearning #DeepLearning #MLOps #ModelRegistry #GenAI
010
MLflow @mlflow.org · 02/07/2025
MLflow 3 isn’t just for GenAI—this release brings big upgrades for traditional ML and deep learning teams too: 🔗 𝗘𝗻𝗵𝗮𝗻𝗰𝗲𝗱 𝗠𝗼𝗱𝗲𝗹 𝗥𝗲𝗴𝗶𝘀𝘁𝗿𝘆: Unified versioning, deployment, and improved lineage tracking for all model types—including deep learning, with better checkpoint management. (keep reading...👇)
120
MLflow @mlflow.org · 01/07/2025
🚀 Transform Your GenAI Applications with MLflow's Prompt Optimization 𝗦𝘁𝗼𝗽 𝗴𝘂𝗲𝘀𝘀𝗶𝗻𝗴, 𝘀𝘁𝗮𝗿𝘁 𝗼𝗽𝘁𝗶𝗺𝗶𝘇𝗶𝗻𝗴! Building #GenAI applications shouldn't feel like shooting in the dark. With MLflow's new prompt optimization capabilities, you can now transform prompt engineering from an art into a science.
100
MLflow @mlflow.org · 30/06/2025
Trace tags in MLflow are powerful, flexible key-value labels you can attach to traces, making it easy to organize, search, and analyze your trace data for actionable insights. Here’s how they can help...(keep reading) ⬇️ #mlflow #opensource #oss
110
MLflow @mlflow.org · 27/06/2025
Evaluate language model outputs with LLM judges! 🚀 They offer human-like scoring for complex tasks—faster and cheaper than manual review. Use MLflow to automate and scale GenAI evaluation with built-in or custom judges. Ensure quality, reliability, and fairness easily! 🔗 mlflow.org/docs/latest/...
000
MLflow @mlflow.org · 24/06/2025
REMINDER 🚨 The 𝗠𝗟𝗳𝗹𝗼𝘄 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗠𝗲𝗲𝘁𝘂𝗽 is tomorrow, June 25! 🎉 This month’s meetup will feature: 🔹 𝗠𝗟𝗳𝗹𝗼𝘄 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 & 𝗧𝘆𝗽𝗲𝗦𝗰𝗿𝗶𝗽𝘁 𝗦𝗗𝗞 𝗣𝗿𝗲𝘃𝗶𝗲𝘄 🔹 𝗔𝗺𝗮𝘇𝗼𝗻 𝗦𝗮𝗴𝗲𝗠𝗮𝗸𝗲𝗿 𝗠𝗟𝗳𝗹𝗼𝘄: 𝗗𝗲𝗲𝗽 𝗗𝗶𝘃𝗲 𝗶𝗻𝘁𝗼 𝗠𝗮𝗻𝗮𝗴𝗲𝗱 𝗠𝗟𝗳𝗹𝗼𝘄 𝗦𝗲𝗿𝘃𝗶𝗰𝗲𝘀 🗓️ June 25 🕒 4:00PM PT 📍 LIVE on LinkedIn, YouTube, & X 🔗 REGISTER: lu.ma/6x9kdnd8 #mlflow
020
MLflow @mlflow.org · 18/06/2025
💙 70,000 strong and growing on LinkedIn! Huge thank you to our amazing users, contributors, and #opensource community for following the journey of MLflow and making #MLflow what it is today! From tracking experiments to powering production models, the community makes it all possible.
121
MLflow @mlflow.org · 17/06/2025
MLflow Tracing is a powerful feature designed to enhance #LLM observability in your #GenAI applications by capturing detailed information about the execution of your application's services. 🙌 (1/4) ... ⤵️
121
MLflow @mlflow.org · 11/06/2025
📣 After months of collaboration across the open source community, we’re thrilled to announce the release of 𝗠𝗟𝗳𝗹𝗼𝘄 𝟯.𝟬! 🎉 🔗 Learn more: mlflow.org/blog/mlflow-... 👀 View the release notes: github.com/mlflow/mlflo... #opensource #oss #mlflow #linuxfoundation
120
MLflow @mlflow.org · 30/05/2025
Have you heard the news? #MLflow now supports tracking for DSPy optimization workflows—just like it does for #PyTorch training! Keep reading to see what this means for your #LLM projects… 👇 #opensource #dspy #oss
183
MLflow @mlflow.org · 29/05/2025
🚀 Build trustworthy generative AI agents with LangChain LangGraph, Amazon SageMaker AI, and #MLflow! Trace behavior, log metrics (including RAGAS), and manage versions with built-in governance to move from testing to production with confidence. Learn more 👉 aws.amazon.com/blogs/machin... #oss
263
MLflow @mlflow.org · 20/05/2025
MLflow Prompt Registry streamlines prompt engineering for #GenAI. Effortlessly version, track, and reuse prompts across your organization for better consistency and collaboration. ✅ 🎥 Check out this 1-minute video to see it in action! 🔗 Learn more: mlflow.org/docs/latest/... #opensource #oss
021
MLflow @mlflow.org · 19/05/2025
📣 Reminder: the next #MLflow Community Meetup is THIS Wednesday, May 21 @ 4PM PT! What to Expect: 🔹 𝐌𝐋𝐟𝐥𝐨𝐰 𝟑 𝐌𝐢𝐠𝐫𝐚𝐭𝐢𝐨𝐧 𝐟𝐨𝐫 𝐎𝐒𝐒 𝐔𝐬𝐞𝐫𝐬 🔹 𝐌𝐚𝐬𝐭𝐞𝐫 𝐀𝐠𝐞𝐧𝐭𝐢𝐜 𝐀𝐈 𝐃𝐞𝐯𝐞𝐥𝐨𝐩𝐦𝐞𝐧𝐭 𝐰𝐢𝐭𝐡 𝐌𝐚𝐧𝐚𝐠𝐞𝐝 𝐌𝐋𝐟𝐥𝐨𝐰 📍 Streaming LIVE on LinkedIn, YouTube & X 👉 Register now: lu.ma/mlflow521 #opensource #oss #mlops
021
MLflow @mlflow.org · 15/05/2025
Curious about improving #LLM trustworthiness? 🤔 Check out how Cleanlab's Trustworthy Language Models (TLM) integrates with #MLflow! TLM analyzes both prompts and responses to flag potentially untrustworthy outputs-no ground truth labels required. 🔗 Learn more: mlflow.org/blog/tlm-tra... #oss
032