Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Backup solutions
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Backup solutions

I am seeking quotes on storage backup solutions. I have upwards of 100 TB of elastic search indices that I would like to backup. What would be the best pricing?

I see Hetzner has backup solutions for €39.90 for 10TB. Are there any storage solutions that are cheaper and located in another region, outside Europe?

Thanks!

Comments

  • Backblaze B2

    Thanked by 1nebulae
  • what about 1fichier?
    has anyone know how to backup website there (remotely) ?

    Thanked by 1nebulae
  • BlaZeBlaZe Member, Host Rep

    2B ezalbkcalB

  • @BlaZe said:
    2B ezalbkcalB

    ezabkcalb ton ezalbkcab s'tI

  • BlaZeBlaZe Member, Host Rep

    @jetchirag said:

    @BlaZe said:
    2B ezalbkcalB

    ezabkcalb ton ezalbkcab s'tI

    Ah! Damm! :D

  • @folom said:
    what about 1fichier?
    has anyone know how to backup website there (remotely) ?

    It works using https://whmeasybackup.com and backup via (s)ftp

  • @Ympker said:

    @folom said:
    what about 1fichier?
    has anyone know how to backup website there (remotely) ?

    It works using https://whmeasybackup.com and backup via (s)ftp

    I think that is only for whmcs sites.

  • @folom said:

    @Ympker said:

    @folom said:
    what about 1fichier?
    has anyone know how to backup website there (remotely) ?

    It works using https://whmeasybackup.com and backup via (s)ftp

    I think that is only for whmcs sites.

    No. It works for any WHM Reseller Accounts.

  • With that much data you probably want to put your backups very close to your search servers, if you hope to be able to restore in a reasonable amount of time. Since they're search indexes, extreme redundant high-latency backup doesn't sound that useful, if you can rebuild the indexes from the original data.

    Hetzner has 3 locations now (2 in DE and one in FI) and their biggest storage server (SX292) is a somewhat cheaper per GB than the storagebox plan. It's hard to do much better than that, short of colo'ing a tape storage system.

    Thanked by 1Hetzner_OL
  • @willie said:
    With that much data you probably want to put your backups very close to your search servers, if you hope to be able to restore in a reasonable amount of time. Since they're search indexes, extreme redundant high-latency backup doesn't sound that useful, if you can rebuild the indexes from the original data.

    Hetzner has 3 locations now (2 in DE and one in FI) and their biggest storage server (SX292) is a somewhat cheaper per GB than the storagebox plan. It's hard to do much better than that, short of colo'ing a tape storage system.

    Thanks everyone for the inputs. I will research those backup options.

    The indices are our original data, meaning no DB data to recreate the indices from. With that said, we create snapshots by the month and prune old data. We rarely have a need to reload ALL the data. We have a process in place to reload a particular month of snapshot should the need arise.

    The snapshot files will be encrypted. I am mostly interested in a place to store these files, as there is a need to go back in time and analyze old records. The restoration performance is not as critical, we will be restoring onto a different non-production ES cluster, for special analysis by the client.

  • williewillie Member
    edited October 2018

    In that case I'd look at a Hetzner SX292. You get 150TB of raw disk space (15x10TB, plus hardware raid controller) and a powerful E5 server to run your analysis on, at an impressively low price for something of that capacity.

    Thanked by 2nebulae eol
  • https://www.tarsnap.com/ . I have been using it for a few servers now. no problem so far.

    Thanked by 1nebulae
  • @willie said:
    In that case I'd look at a Hetzner SX292. You get 150TB of raw disk space (15x10TB, plus hardware raid controller) and a powerful E5 server to run your analysis on, at an impressively low price for something of that capacity.

    SX292 is a really good solution. I have to think about this. I only wish they have DCs outside Europe, away from our production servers.

    Anyone have any feedback on Amazon Glacier? It is $0.004 / GB, slightly less than Hetzner's storage box pricing.

    I was hoping there would be reputable backup providers offering around $0.002 / GB.

    Thanked by 1Hetzner_OL
  • Glacier has high transfer fees. If you don't mind that, you can get OVH Cloud Archive at 0.002/GB and they have it in Canada. What kind of disaster are you worried might take out every server in Europe? I'd think separate data centers with reasonable geographic separation would be enough for most purposes.

    If you want long term archival retention maybe you should think about colo'ing a tape robot. Then it can be in EU and they can ship the tapes to another location periodically.

    Otherwise you could put up a request for custom dedi or colo with a lot of hard drives like an SX292 (but with less cpu etc).

  • edited October 2018

    Online.net C14 is reliable and is 0.002 Euro/GB + cost of operation.

    https://reddit.com/r/datahoarders may be able to help

  • SpryServers_TabSpryServers_Tab Member, Host Rep

    Try backblaze b2 + Duplicati. Easy to use and super cheap.

    Thanked by 1openos
  • HostiggerHostigger Member, Host Rep

    Alternative to Germany
    You can find cheaper in Turkey.

  • I've seen Wasabi mentioned a couple of times around here, but I've never had a chance to test it. It charges $.0049 per GB/month but doesn't charge any transfer fees.

    https://wasabi.com/pricing/

    They have DCs on the US West and East coast:

    https://wasabi-support.zendesk.com/hc/en-us/articles/115001684651-Where-is-my-data-stored-and-how-are-Wasabi-s-data-centers-secured-

  • @beagle said:
    I've seen Wasabi mentioned a couple of times around here, but I've never had a chance to test it. It charges $.0049 per GB/month but doesn't charge any transfer fees.

    https://wasabi.com/pricing/

    They have DCs on the US West and East coast:

    https://wasabi-support.zendesk.com/hc/en-us/articles/115001684651-Where-is-my-data-stored-and-how-are-Wasabi-s-data-centers-secured-

    Wasabi is pretty good, but you pay for 1 TB per month as a minimum. So Backblaze is a lot cheaper if you store less than 1 TB.

  • For anyone thinking of using C14 (intensive or standard) as a backup or archival solution, you can try my c14sync tool - a Perl script that automates syncing a local directory with C14 storage. I use it in a nightly cron job to sync a local borg repository with C14:

    https://github.com/tmo1/c14sync

    Thanked by 1gol3m
  • @tmo1 said:
    Perl script

    perl
    perl
    PERL

  • @Yura said:

    @tmo1 said:
    Perl script

    perl
    perl
    PERL

    ?

    According to perlfaq1 (version 5.021011):

    What's the difference between "perl" and "Perl"?

    "Perl" is the name of the language. Only the "P" is capitalized. The name of the interpreter (the program which runs the Perl script) is "perl" with a lowercase "p".

  • It seems to gear toward windows and require mono for linux.
    Does it work in linux? Any alternative for linux?
    Thanks.

  • dragon2611dragon2611 Member
    edited November 2018

    @greattomeetyou said:

    It seems to gear toward windows and require mono for linux.
    Does it work in linux? Any alternative for linux?
    Thanks.

    Yes it works in linux, usually pretty well actually.

    borgbackup or restic might also be useful particularly if the data compresses/de-duplicates well.

    Thanked by 1greattomeetyou
  • I was reading earlier about how cloud hosting is slowly but surely becoming the future, its going to make backup solutions irrelevant.

  • ItsolutionS said: make backup solutions irrelevant.

    How does cloud hosting make backup solution irrelevant?

    Thanked by 1eol
  • @ItsolutionS said:
    I was reading earlier about how cloud hosting is slowly but surely becoming the future, its going to make backup solutions irrelevant.

    I think it is unlikely hosting servers storage will outpace the data retention needs from businesses.

    To reduce cost, I always plan backup storage to keep my servers cost down, while retain large amount of data.

    I currently use raided nas on site for backup, controlled via smart plugs to turn on when backup jobs are scheduled to run. The cost of online storage is still too high for me. Although I really appreciate everyone's helpful suggestions.

  • @greattomeetyou said:

    ItsolutionS said: make backup solutions irrelevant.

    How does cloud hosting make backup solution irrelevant?

  • JordJord Moderator, Host Rep

    OVH Cloud Archive is cheap, available in quite a few regions now.

Sign In or Register to comment.