This is the main reason "design within Agile" (read: within Scrum) doesn't work. It's typically set up as designers working N sprints ahead of devs, and then designs get "handed off" to be implemented.
But when you find out you made a mistake you can't fix it - something else is on the roadmap!
