This process is modeled with "learning loops."
Single loop learning is merely, is the task Done? If not, keep doing it.
Double-loop learning checks, is the output of the task helpful? If not, choose a different task.
Triple-loop learning asks, are we framing "helpful" right? What do we WANT?
Single-loop processes are not able to ask "is the thing we are doing working" but perhaps more importantly, they cannot ask "is the thing we are working towards worthwhile?"
In all 3 cases, the answer of AI boosters is the same: we are building AI so that we can have AI.