Finally! Been looking for this a long time. File-based backups for large Pg databases are not very scalable (even incremental), having this in my toolkit would be amazing.
craftkiller 4 hours ago [-]
I'm not sure I follow. Wouldn't this be file-based (zfs-dataset-based) incremental backups? I don't think this has anything to do with postgresql other than copying the style of pgBackRest.
blacklion 3 hours ago [-]
this uses `zfs send @snapshot` which is block-level, not file-level.
craftkiller 2 hours ago [-]
Oh! So the issue with large postgres backups is the number of files?
levkk 40 minutes ago [-]
No. Postgres data files are 1Gb each. When you change just one byte in a table, a whole 1Gb file gets updated (just 1 byte change, effectively). Your file-based backup tool now has to upload 1Gb of data to save 1 byte of actual changes.
It was a major pain point for my backups for years.