How Shopify manages petabyte-scale MySQL backup and restore

A few learnings from the post:

  • Use incremental snapshots of data for backup after one initial full snapshot to reduce both storage and recovery times.
  • Save on storage costs by deleting all but the last two copies for recovery purposes.
  • To ensure data integrity, verify these last two backup iterations daily.
  • Compress, encrypt and transfer the backup to offsite storage to build further security.
  • Using snapshots this way is a more expensive process than more traditional backup technologies. But it reduces time and processing power for both the user and the service.

Full post here, 6 mins read