Little PS Portal update…seems it was my PS5 that was the problem. Where it was situated, the WiFi has terrible (~15mbps). I got a booster (which I should have done ages ago anyway), hardwired the ps5 in and now around 140-150mbps. Portal works flawlessly now