This reminds me of this iconic discussion. Sure, you can do all this with SSH. Just find a way to pass credentials and SSO state there, teach all clients to manage keys and sessions, implement a custom token revocation system, sprinkle some way to proxy machine state to LLM client, sandbox it, etc.
