Rather than risk spraying anything inside this panel/raceway before the disconnect, I figured I’d just seal it off with metal tape.
Wasps are going to be mad tomorrow.
And yes, there should be a slip fitting for the conduit to prevent this kind of separation, but I inherited this.