We already use robots.txt (they ignore it). We already block known user agents (they hide them). We already block IP ranges when we see them ramping up (they change them). It's a daily game of whack-a-mole that prevents us from doing more work, and prevents you from being able to access it. Fuck AI.