PostgREST is open source, and so is the rest of Supabase.

Migrating from it is not that hard so far. I did it on an afternoon for a customer.

Also a couple friends are running the open source version in their own containers.

Maybe there are (or will be) cloud only features, but for the basic service there isn’t as much lock-in as something like AWS.