I have found LLMs to be more useful when you’re essentially using them for data entry or doing basic coding/python when you can iterate/ have a large context window.
That’s not something you can sell to a typical user who isn’t tech savvy though. And data privacy is a huge issue with the cloud.