Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Shells Virtual Desktop
BMail.ag - Secure Email Service
Server.net
CPLicense.net
VPS Server
Buy VPN
Vultr
VMs for AI
HostDare
ReliableSite White-Label Dedicated Hosting for Resellers
InterServer VPS
BMail.ag - Secure Email Service
Best VPN
High-Performance Bare Metal Server Solutions
Karvl.com
Server Mania Cloud Hosting
DataWagon Hosting
AlphaVPS Hosting
Evoxt.com
Clouvider
VPS Hosting with NVMe
Residential IPs in the US & 4G Mobile Proxies in EU & US with Unlimited Bandwidth
ReliableSite White-Label Dedicated Hosting for Resellers
Rabisu - Hosting Solutions
Shells Virtual Desktop
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Best software: backup

2»

Comments

  • @SGraf said:
    Building for alma/... isnt hard. There are even some "build scripts" for published on github https://github.com/TomGem/proxmox-backup-client (i have not verfied/tesed the content of this repo, as i rund my own build).

    I know that. I have been using it for currently test I am doing with PBS.
    I was saying the lack of such rpm install from the provider itself (Proxmox) is concerning.

    And the client install is just one thing. (Guaranteed it can be done using different methods). The thing that is really missing from PBS to make it a great backup tool is the ability to restore files/directores directly from the PBS server.

    (Think of running restore from R1soft)

  • @remy said:
    Yes, I've tried it and it's what I'm using now.
    Borgmatic + borgwarehouse. It's great, it works very well.

    But it's not quite what I had in mind at first.
    It's still not that quick to set up, quite a lot of configuration in config files. In the end, it's not that different from restic.

    I am also considering running "Borgmatic + borgwarehouse" as an other backup option. (Along with something else, PBS or JetBackup)

  • SGrafSGraf Member, Patron Provider
    edited December 2023

    @Umair said:

    @SGraf said:
    Building for alma/... isnt hard. There are even some "build scripts" for published on github https://github.com/TomGem/proxmox-backup-client (i have not verfied/tesed the content of this repo, as i rund my own build).

    I know that. I have been using it for currently test I am doing with PBS.
    I was saying the lack of such rpm install from the provider itself (Proxmox) is concerning.

    And the client install is just one thing. (Guaranteed it can be done using different methods). The thing that is really missing from PBS to make it a great backup tool is the ability to restore files/directores directly from the PBS server.

    (Think of running restore from R1soft)

    Personally, i like the split where the server is unable to execute code on the clients.
    I can spin up a clean server, install a pbs client and pull the files from pbs.

    The encryption feature is also very neat.

    Reading an official build: From the wiki its on their todo list. So my guess would be that this is something that will come when they are happy with the regular feature set.

  • Since 2 years I have been using Restic, I have never had any problems, everything works smoothly.

  • rafaelscsrafaelscs Member
    edited December 2023

    restic have a gui and a panel for see backups reports?
    duplicati have both, but, very bugs

  • @rafaelscs

    What do you do with the report after the backup? With a simple bash script you don't need all that.

    Just check the health of the repo once in a while with restic check --read-data.
    If you add this command under the backup command, you will get an email if there is an error.

    restic backup ....
    if [ $? -eq 0 ]; then
    echo "great"
    else
    echo "error" | mail -a From:[email protected] [email protected] -s "error"
    fi

    Thanked by 1rafaelscs
  • if you want to backup your entire machine, preferably use snapshot.
    but if you want backup just serveral, you can use rsync. it's quite simple, yet powerful enough.

  • @blackhiden said:
    if you want to backup your entire machine, preferably use snapshot.
    but if you want backup just serveral, you can use rsync. it's quite simple, yet powerful enough.

    Yes, but not all providers support snapshots.
    At least not on low-end vps, the ones I use for fun.
    For professional use, I don't have this problem.

    I think I'll end up always installing promox and using lxc containers.
    After all, it's far too practical to move servers around and backup / restore

  • Yes, but i not find a panel like the duplicati monitoring. For me, is very useful

  • mrl22mrl22 Member
    edited December 2023

    Borgmatic all the way. Extension of Borg. It's a bit of a learning curve at first, but once you have a Borgmatic config template, each instance is very quick to set up.

    Features I like:

    • Compressed and encrypted transfer over SSH
    • Encrypted backups
    • Deduplication
    • Its instant - knows whats changed straight away
    • Can mount specific remote backups to local mount point
    • Block based.
    • Backup to multiple remotes at the same time
    • Ability to run scripts before and after, including notifications.
    • On the backup server, you can compress, check last backup date etc without knowing the encryption key. https://gist.github.com/mrl22/fc100ac4c1d86f502b4c07c66f0dabc0
    Thanked by 1dev077
  • @mrl22 said:
    Borgmatic all the way. Extension of Borg. It's a bit of a learning curve at first, but once you have a Borgmatic config template, each instance is very quick to set up.

    >

    I am looking into them and they do look nice.
    Does it send you any notification of failed backup ?? Any alert ?

    Have you used it for large server (more than 300GB space). Any load impact during backup run ?

  • mrl22mrl22 Member
    edited December 2023

    @Umair

    You will need to code a notification script, unfortunately, but once you have it, it works well. I wrote a script to make a curl request to TwilioSMS. But I also have a few scripts shared on my Gist that will help you. https://gist.github.com/search?q=user%3Amrl22+borg

    You will probably find this the most helpful, what I refer to losely when setting up a new backup client https://gist.github.com/mrl22/579eb6263411a0a62acb2515278472c4

    I moved to Borg mainly because we have a client with a support system that stores all attachments in a MySQL BLOB field. The database is 200gb. I know its a bad idea, I have said this to them many times, but apparently changing it to save to file will delete historic attachments.

    How I was backing it up was to do a MySQL dump and then Rsync to a remote server. This was making 200gb+ backup every night.

    When I moved to Borg, I still did the nightly MySQL dump, but Borg only backs up the changes within a file. The first backup was ~200gb, each backup after that only a 50-100mb based on data for that day.

    As for load, I have not really looked but most of the servers I run are very low end, 1-4 core 0.5-4gb ram vm's and our monitoring (PRTG) doesn't flag any load issues.

    Thanked by 2dev077 Umair
  • Would anyone be interested in a nice script I wrote as a wrapper to Borg? I knew about Borgmatic but I wanted something more flexible that didn't require changing a configuration file and also make restores easier with the same script.

    I recently switched to Borg (using BorgBase and NetDynamics as destinations) and I like it a lot.

  • @vitobotta I would be interested in having a read through what it does and how it does it.

  • vitobottavitobotta Member
    edited December 2023

    @mrl22 said:
    @vitobotta I would be interested in having a read through what it does and how it does it.

    It's quite simple, it's just a wrapper that simplifies a few things. You can see the script here https://bin.botta.me/M3uT0c.sh

    Run the script with -h to see the available commands and required arguments.

    The script expects a configs directory in the location of the script, and in it a subdirectory for each storage/destination, with in it one or more configs for different machines named after the machines. So basically

    borg-backup
    |-configs
       |-borgbase
          |-server1
          |-server2
          |...
          |-desktop
          |-laptop
       |-netdynamics
          |-server1
          |-server2
          |...
          |-desktop
          |-laptop
    

    Each config file contains the following settings:

    SSH_KEY_PATH=<path to your ssh key>
    BORG_PASSPHRASE=<encryption password>
    BORG_REPO=ssh://user@host/./parent-directory
    BACKUP_DIRECTORIES=/root,/home
    BACKUP_HEALTH_CHECK_URL=...
    PRUNE_HEALTH_CHECK_URL=...
    CHECK_HEALTH_CHECK_URL=...
    

    optional settings are

    SKIP_CREATE_MACHINE_SUBDIRECTORY=1 => does not create a subdirectory in the parent directory for each machine, assuming the parent directory will be used for a single machine. E.g. you need this with BorgBase because you can't create subdirectories.
    DISABLE_ENCRYPTION=1 => self explanatory, I use this with local backups on an already encrypted drive
    DISABLE_COMPRESSION=1 => self explanatory, I use this with local backups on an already encrypted drive
    

    BORG_REPO can also be a local directory.

    You first run the init command to initialise the repository, and then backup or else.

    Thanked by 4loay dev077 mrl22 Umair
  • @GreenRuby said:

    @remy said:
    I much prefer borg backup / restic (who probably use rclone internally).

    But I was looking for solutions even simpler than that. Even with a web GUI.

    You could try borgmatic. Its simpler to set up than Borg and has integrations with databases.

    hadn't heard of that one before, will have to check it out

  • Thank you for suggesting this. Tried it and it perfectly suits my demand. And this tool is really really fast.

    Thanked by 1dev077
  • @hzhoanglee said:

    Thank you for suggesting this. Tried it and it perfectly suits my demand. And this tool is really really fast.

    I strongly recommend against using Kopia for production for now, it's just not mature enough and still quite buggy and unreliable. It has corrupted the backup repository 3 times for me and luckily I was using it alongside Restic so I was able to recover my data when it happened. I don't trust it yet.

    Thanked by 2mrl22 dev077
  • @vitobotta Thank you for the script. I will have a play with it!

  • @mrl22 said:
    @vitobotta Thank you for the script. I will have a play with it!

    👍

  • I've been trying to figure this out myself—been running Duplicacy on my NAS for a couple of years now and, it hasn't failed me.

    One advantage I like about it over restic (especially if you're backing up multiple machines simultaneously) is that it supports "lock-free" deduplication and fossil-collection, so that cleaning up old snapshots doesn't lock out other clients from using the repository.

    Free to use non-commerically as a CLI, license required for commercial (read: for your business) when using the CLI or web interface.

    Source code for the CLI is here: https://github.com/gilbertchen/duplicacy

    p.s. It just happened, so too late to get in this year, but Gilbert Chen (the dev) runs lifetime license deals every Black Friday. Set a reminder this time last year to jump on it and so glad I did.

Sign In or Register to comment.