IssueRaiser

Discussion: How to support cold storages?

This issue is meant to discuss which is the best way to implement the support of cold storages in restic. The need to use restic with cold storages has been addressed in several places, see #1903, #2504, #2611, #2796, #2817 and several discussions in the forum. There are also some experimental PRs which kind of allow users to use cold storages, see #2516, #2881, #3196 and the already merged prune improvements (#2718 and following PRs) are already made to support cold storages in future. What should restic do differently? Which functionality do you think we should add? ---------------------------------------------------------------------------------- Allow users to use repository on some "cold storages". These are usually cheap (cloud) storages where writing is fast and cheap, storing data is extremely cheap, but accessing the data is usually extremely slow (or may even need some extra "warming up" before being able to access it) and/or expensive. Some cold storages also require minimum file sizes or are expensive for small files, but this is not specific to cold storages, so I would like to skip this in the discussion here. Examples of cold storages are: - AWS S3 Glacier and Glacier Deep Archive - Google Cloud Platform Coldline Storage and Archive Storage - Azure Blob Storage Cold and Archive - OVH Cloud Archive - Maybe self-programmed backends which write to a tape What are you trying to do? What problem would this solve? ---------------------------------------------

Posted by aawsome on Dec 30, 2020, 12:15 PM

Tags

Related issues

Raise real-world problems, find people facing the same issue, and discuss solutions.3,000 issues0 comments

pricing (Other)

Discussion: How to support cold storages?

aawsomeDec 30, 2020, 12:15 PM

This issue is meant to discuss which is the best way to implement the support of cold storages in restic. The need to use restic with cold storages has been addressed in several places, see #1903, #2504, #2611, #2796, #2817 and several discussions in the forum. There are also some experimental PRs which kind of allow users to use cold storages, see #2516, #2881, #3196 and the already merged prune improvements (#2718 and following PRs) are already made to support cold storages in future. What should restic do differently? Which functionality do you think we should add? ---------------------------------------------------------------------------------- Allow users to use repository on some "cold storages". These are usually cheap (cloud) storages where writing is fast and cheap, storing data is extremely cheap, but accessing the data is usually extremely slow (or may even need some extra "warming up" before being able to access it) and/or expensive. Some cold storages also require minimum file sizes or are expensive for small files, but this is not specific to cold storages, so I would like to skip this in the discussion here. Examples of cold storages are: - AWS S3 Glacier and Glacier Deep Archive - Google Cloud Platform Coldline Storage and Archive Storage - Azure Blob Storage Cold and Archive - OVH Cloud Archive - Maybe self-programmed backends which write to a tape What are you trying to do? What problem would this solve? ---------------------------------------------

Comments (0)

No comments yet. Start the discussion.

Comment on this issue