Automating downloading / syncing. Help?!
So anyway... I'm thinking about making a small script that will periodically download files from this location: http://www.arma2.com/beta-patch.php/
which has files on:
However, when trying to access this area anonymously through an FTP client, I can't seem to view or download anything, but if I connect directly through it via
ftp://downloads.bistudio.com/arma2.com/update/beta/ARMA2_OA_Build_95208.zip then I can.
My question is, is there a way for me to pick up every single file name from arma2.com/beta-patch.php and then do a command to "wget" them all and place them onto my server? But only download 'new' ones.
The reason for this is that when a new patch is released, DayZ (a mod) tends to also update to support new beta patches, which means that popular servers are running latest patches, the beta patch site is incredibly slow due to load, if I could run a script that would check every 6 hours and
wget if there's a new one, that would save me time to just download it from a more "unused" location, also allows me to advertise my "unofficial" mirror online.
Intital thoughts were to just
wget recursively using a lengthly command i found, but doesnt seem to work, due to it can't get a directory listing of
ftp://downloads.bistudio.com/arma2.com/update/beta/; I've contacted the dev's to see if there's a way I can do this for a secondry mirror for myself, but as of yet heard nothing back.