The Stranglers were the only punk(ish) band of that time that could physically intimidate anyone, most of them were pretty scrawny and wouldn't have said "boo" to Daltrey & Co at that time.
JJ Burnel & Jet Black Vs John Entwhistle & Moonie would have been a great pay-per-view.