Finally, if you really, really want to keep using p-values, this working paper by Sudijono, Ejdemyr, Lal and Tingley shows how to solve Azevedo et al.’s “A/B Testing Problem” b tuning the hypothesis testing confidence level based on the prior to replicate the Bayes optimal solution.