Jérémie Klinger found a simple trick back to Girsanov: you take the perturbation in the diffusion at the level of the Fokker-Planck equation and rewrite it to be included in the drift. The resulting drift then has a term proportional to \nabla \log \rho(x,t), what machine learners call the score!