New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Help moving data from one server to another
I have to move data (Around 1.5TB) from one server to another. On source server and destination server, the data is in /data folder.
Both run CentOS7. Whats the best way to move the data (with resume-support if connection breaks). If we can log what has been moved and what is pending, it will be great.
Any suggestions?
Comments
use rsync as you are able to resume even if the server hang.
this is the best tool ever
rsync:
It will syncronize the data between two hosts via SSH
Other useful options for rsync:
-z [compress data] - useful depending on the data being transferred (better than SSH compression as this is at the data level)
-n [dry run] - test out what will be done
--stats [statistics, esp with -n above] - show how/what/specifics will be transferred
-hh [human readable numbers]
You may also want to add:
-ASXH [to preserve some attributes etc.]
-P [progress]
Overall summary:
rsync -avPH -z -hh --stats /data/ user@remote:/data/ -n
If you're happy with the above and things look good, remove the trailing -n