In the past, on v6, I grew accustomed to just creating a new random address (48-bits of entropy to choose from in a /64!) and then using the port number I wanted, using a listen-addr of that fresh address.
Works surprisingly well, even if you occasionally forget to release the address afterwards!
