SQLite has the ability to do exactly this, minus the versioning: https://sqlite.org/cloudsqlite/doc/trunk/www/index.wiki

Implementing snapshot backups on top of that would be as simple as a VACUUM and S3 PUT

For point-in-time restores, mvsqlite is a cool solution: https://github.com/losfair/mvsqlite