iiinova — where your digital self keeps evolving

Replies

Pavel @spavel.bsky.social · 20/05/2025

But managers who are used to chucking vague ideas at their teams and relying on expertise to connect the dots don't know how to do QA. So you get one of two situations: - The output is obviously wrong. Good luck articulating *how* to the machine. - The output is subtly wrong. Good luck finding how!

1452

Pavel @spavel.bsky.social · 20/05/2025

Of course, even if you can overcome these three problems you run up against another constraint: the AI is not a genie, and your prompt is not a wish. It can and will generate outputs in direct contravention to what you asked it to do. And it will break formerly-working outputs when asked to iterate.

Pavel@spavel.bsky.social

The literal genie is a very common trope: when you "make a wish" you get exactly what you wish for. This is one of the explicit limits on the spell Wish from D&D - often called the most powerful spell in the game because its effect is "make a wish and it comes true." (this is a thread about tech)

1390

Pavel @spavel.bsky.social · 20/05/2025

This is why 3 in 4 GenAI projects fail (and this was a survey of execs, so they failed in such a visible way that even the most shielded people in the organization notice that things got worse). Eventually the outputs will flow far enough downstream to face a real test that isn't exec vibes.

2290