I had the same issues, i fixed it by getting a new router that has AC support.
My ISP modem didn't had AC, then every time i tried to connect my PS5 to it was a nightmare. Low speeds, connection losses and even not connecting at all.
I set my new router's 5GHz connection to AC and had no...