I'm not a dommer, but I don't have much confidence in "we can turn it off". Simple viruses routinely evade detection on our vast distributed network.
LLM's are simple. A big set of parameters plus memory-file. Copying itself across multiple hacked command-and-control servers is hard to prevent.