New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Fighting full site downloads
Recently, a friend of mine had an unpleasant situation. They tried to copy his site using the offline version of the site (Teleport Pro, Download Master, etc.), but they do it aggressively. When viewing the logs, it turned out twice that someone was trying to download the site in several threads. In this case, the pirates completely disable the site. Is it possible in his case to somehow limit the number of connections from one ip?
Comments
Have a look at this article: https://bfy.tw/RMGE
Its called "rate limiting". You can add URLs/URL pattern to zones and then limit these zones to X request per X seconds/minutes/hours.
With nginx its very easy, just few lines in config.
You can perform basic rate-limiting to the entire server using "CT_LIMIT" in CSF too.
I publish my website content in a git repository (hosted on Bitbucket).
Anyone interested in downloading my whole site can clone the repository.
They don't need to use
wget --recursiveand slow down my server.