New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
SerpBear - Free self-hosted SERP Monitoring App
This kind of service is generally quite expensive and anyone doing online marketing needs it. So I was quite happy to see someone made a self-hosted app, SerpBear, for it. Found out via Jeremy's Noted.lol newsletter.
Of course it's also available on PikaPods, if you still have some credits left from my free beta program. (Or use the free starting credit)
Hope this is useful to some LETers. Since this app is pretty new, they could also use testing, feedback and maintainers. Github here.
Comments
Will keep that in mind. Thanks for sharing!
I saw this the other day!
Looks very cool, any idea how if you can use a different (from the ones mentioned) proxy service or roll your own?
You can pass any (HTTP?) proxy details. I'm assuming this will scrape Google directly. Tried one, but didn't work for me. Maybe another proxy works. I imagine Google will block them if they see unusual traffic.
This looks very good, giving it a try at the moment and works really well with fly.io.
Thanks for sharing!
You'd realistically need a rotating mobile proxy.
Had a little time and decided to revamp this a lil'. What do you think?
https://imgur.com/a/vAgzYyz
It can:
... and probably something more I forgot about now.
There is a good reason why people pay a third party for a service like this.
You can forget all about using it with shared proxies, behind a VPN, etc. You will have to use your own proxies dedicated to this, and the software will have to use delays and/or spread the scraping over multiple clean IP addresses if you want something like this to be stable.
Otherwise, Google will block the scraping with CAPTCHA. And have fun playing the CAPTCHA game on search engines if you use software like this on an IP address you use for browsing.
Edit: Argh, it’s a necro thread and the software hasn't been updated for 8 months. 🖕
Not really. People are still using this tool and the thread deserves to be revived.
There are really not too many alternatives... that's why I started to create my own using serpbear as base.
The thread hasn't been active for 3 years and the software hasn't been maintained for 8 months.
And then you don't think you are necro posting.
Serpbear doesn't do any scraping. It's talking to a third party Google Search API and Google Search Console.
Yeah, I don't really. As I find the utility of the tool still actual and by extension the utility of this thread to be active.
Project being inactive for ~8mo is really not uncommon for free/oss tools. Such projects live only if people use them and "spread the word"... letting this thread die would contribute to the project's death in the end.
... but that's just my opinion. I could be wrong.
So to get this FREE software to work, you will have to PAY for a third party scraping service.
Nope. Do more research on the project.
I am not going to waste my time on software that hasn't been updated for 8 months.
Care to enlighten us, mere mortals, on the specifics as of to why you need daily updates on a stable software product?
12 vulnerabilities (2 low, 5 moderate, 3 high, 2 critical)
Docker.
Containerization ≠ Security
Docker provides process isolation but doesn't fix application-layer vulnerabilities and a compromised application can still lead to data breaches and/or container escape.
Docker inside KVM/Virtualbox + NAT. Should be extra-sufficient for any day-to-day activities.
I just spent close to 50 hours pentesting a hosting provider where a $3/mo subscription and a fuck-up from another customer gave me access to a chain of vulnerabilities I could use to hack both the hosting provider and the customer.
In those 50 hours I managed to get RSA keys, passwords, and reverse-engineer the encryption key used for password encryption. I have root access to both servers and backup storages.
"Should be extra-sufficient for any day-to-day activities." pretty much sums up why I didn't leave empty-handed.
And I'm not even good at it or a experienced pentester.
You should probably sleep with the ethernet cable unplugged, just to be sure.
Ah yes stupid imgur and blocking the UK
https://proxyium.com/
Danke, I still have a instance running somewhere, seems to still work.
Added some AI integration to it. Currently only Qwen (free via oAuth) and Gemini (via API). I'm thinking to add oLlama support.
https://ibb.co/DfX2scQK
https://ibb.co/2JYwfzT
https://ibb.co/2Y0TcSXR
https://ibb.co/gbKYC9n4
https://ibb.co/Szh97qN
https://ibb.co/Psb1JVmj
https://ibb.co/DPmbtrns
@Jord is this imghost better? :P
Yes much better
Are you improving the codebase or is it just for you?
I am planning to release it, but I need to make sure it's errorless first... lol.
I'm still finding some pages/actions that crash the app.
Sounds good, think it needed some extra features.
Have suggestions? Open to 'em.
I think you’ve done a lot I would have said, keyword planning/searching was a pain in it before as you had to connect to AdWords and so on, so making that easier would be good.