Abhinav Moudgil @amoudgl.bsky.social · 15/06/2025New side project! assayer: A simple Python-RQ based tool to automatically monitor and evaluate ML model checkpoints offline during training. 141 0
Abhinav Moudgil @amoudgl.bsky.social · 15/06/2025github: github.com/amoudgl/assa...github.comGitHub - amoudgl/assayer: Python RQ watchdog to automatically evaluate ML model checkpoints offline during trainingPython RQ watchdog to automatically evaluate ML model checkpoints offline during training - amoudgl/assayer 120 0
Abhinav Moudgil @amoudgl.bsky.social · 15/06/2025This tool is especially useful in cases when evaluations are expensive (e.g. LM harness eval) and you want to track model performance during training. 010 0