In this part? I'm not sure I follow the argument. Yes, we understand logistic regression much deeper (convex loss, easy interventions & statistics). Stacking layers is what creates nonidentifability, nonconvexity, and all the other nastiness of ANNs. So I'd say the case is very different from ANNs?
