Human in the loop - sounds cool. But when an AI sounds super confident, we stop thinking. "Automation misuse" is a well researched term. It is basically about just blindly trusting tech more than you should ("Humans and automation: use, misuse, disuse, abuse", R. Parasuraman, V. Riley, 1997).