Woolwich didn't become part of greater London until 1965. It was a shared area with Kent, before then.
So we can keep going back and forth with the boundary changes. Or just accept that, based on the geographical places the clubs now are, Spurs were there first. 👍