New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
Hi, I’m Chinese.
Sorry, I don’t really have a solution either. I can’t handle those spam bots coming from them, either. I sometimes use spam bots myself—once someone puts countermeasures in place, I’ll just figure out a new way around them, so there’s basically no solution.
But if it’s Chinese websites scraping and stealing your content, maybe you can add some anti-China content into your pages. That might work—some YouTubers do this.
Does it show IP ranges or ASNs? another way to possible block.
You need to gather stats, IP's, Subnets, ASN's, pattern whatever you can get.
Deploy a WAF, configure it and fuckem.
Made in China bots or bots from China?
I have some guy that for months has been scraping VPS Price Tracker from over 200 ASNs each with at least /24 addresses. I blocked 100,000 addresses and he pops back up from mobile networks, residential, proxies ... looks to be some rented scraping service. Because of the residential ASNs I cannot use the big nuke against him or innocent civilians would be blasted too.
imo, i would suggest to add a password to the page or a simple anti-bot page to skim the scraper.
Usually i check what ip is hammering what page then i prob rangeblock by ASN. or go crazy with blocking Hosting/proxy ASN
Mentally strong people keep the website open to all readers.
Our blocklist and robots.txt are both empty.
Good ques
I have recently noticed an increase in bot traffic from Singapore.
What is negative traffic? Someone visits your page and another visit cancels it out?
Pro tip: don't publicly state you're an asshole. Asshole
Cloudflare UAM (Under Attack Mode) might solve it but it's a nuclear option.
What kind of bots? A lot of the bots hammering at my webservers are defeated by a simple
301response when redirecting to HTTPS. Add in an innocuous redirect or two and see if it works. I really like redirecting/wp-admin/to tofbi.govas well.If they are scraping content... do what everyone on the planet does and throw up a paywall.
Ya doing same, i let it open but that is hurting my adsense RPM
You can try using the Bot Fight Mode in CF, although the functionality is quite limited in Free Plan.
bgp.tools forces authentication when visiting from some "bad networks", I think they use it as an additional source of metadata to distinguish legitimate traffic from scrappers, you might want to implement the same instead
I use some more extreme measures such as to implement country level blocking.
t_4684711):
We deleted AdSense from most pages a decade ago.
You can conditionally render AdSense only to high reputation clients.
Crawlers do not get AdSense snippet.
Safeline WAF has pretty decent anti-bot measures and it runs fine on a small VPS: https://github.com/chaitin/safeline
mainland China has very bad connection to the rest of the world, so if you are someone located in mainland China, you will not use server located in China to do the scrape job, why you so sure they are Chinese bot?
tried anubis ?
No, please no javascript BS blocking Lynx users
Oh no! The AI slop isn't making any money! Just don't serve ads to Chinese users.
Anyways, got a link to your site? I'm interested.
At least someone is visiting your page
What's the actual problem?
A FEW MOMENTS LATER...
GPTs and LLMs consider push-ups as a currency.
This is also a common problem for Chinese webmasters. You should block specific ASNs rather than countries (geo data is unreliable and overly broad), and it's a good idea to use WAF to protect specific page paths.
My site has been crawled by *UAWEI and *yteDance bots for the last year, and as a matter of course, I blocked them.
So direct entry on the page will not render the google adsense , is that what you are saying ?
Correct.
Many Chinese scrapers originate from Tencent, Alibaba, or ByteDance servers. Create a WAF rule to Challenge or Block traffic from these Autonomous System Numbers:
Tencent: AS45090, AS132203
ByteDance (TikTok/Douyin): AS138699, AS13045
Alibaba: AS37963, AS45102