While that’s true, managed services on eg AWS provide hot replica’s as well, which you can use to upgrade the database and do a failover to the new version.

We actually migrated from vanilla Postgres to Aurora that way with minimal risk / downtime, it was a really smooth process.