The mistake is confusing detail vs fidelity. Vibe prototypes let you add a lot of detail quickly, just like how component libraries do.
But all of that detail is essentially distraction and waste. Showing off your tasteful drop shadow on the card view is not stress-testing the merit of the solution