New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Need some help - SaaS Provider is dead but my site is still up, how should I grab it?
Hey guys,
DevPort, the SaaS that powers my homepage, has died. I can no longer log in, and their Twitter/Facebook/Blog is long gone.
How can I grab my site (http://0xdragon.com) before it too vanishes into the abyss?
Thanks for all your help!
Comments
wget recursive or HTTrack
Why you no backup?
No backups available
Thanks, it's running now.
Get ArchiveTeam on the case?
Damn son.
@joepie91
Looks like the earlier command doesn't grab all the assets such as images. Now to figure out how to include AWS domains..
@0xdragon, want me to try and get a copy of it into the Internet Archive, so you can rebuild from that?
what does this command exactly mean? If the site was a dynamic site, let say powered by Php and Mysql, how to get the full database backup in such a situation?
@dopuloss if you don't have access to the files or the database directly you simply won't be able to do that.
It's still online So if it comes to that, I'll do that. Thanks though!
In this situation, you aren't going to be able to get the full database backup. He wants a static copy mirror of his site.
Change to this, it should get all of your site, including Amazon assets, look for folders like : devport-prod.s3-us-west-1.amazonaws.com
As for what the commands do:
@0xdragon, with not having all possible files downloaded, perhaps play with some flags, the above should work. I've added recursive and span hosts. Never had that issue.
I've at least added it to ArchiveBot, which will download the entire (public) site and put it in the Wayback Machine, as static pages. You can follow the progress here while it is running.
Of course it can't find anything that isn't publicly linked
EDIT: I'm seeing a 502 error on http://0xdragon.com/projects/ox.developerportfolio.com. This might indicate that infrastructure is already failing?
EDIT2: The site of DevPort seems to be up? At least it redirects to http://developerportfolio.com/.
Yes, their site is up, but try logging into it via GitHub.
@0xdragon so did you try HTTrack? It pulls everything visible to the public and you can specify additional URLs that may be hidden for the public.
I used it to make HTML hard copies of a site build with Joomla CMS.
What makes you think they are dead?
Aha, I see. I've added it to the list of proposed projects here anyway... not sure whether somebody will have the time to follow up on it as a whole. Either way, anything public-facing on your site should be saved by now
Awesome! Is there a place I can view/download it?
Aren't you getting 502 errors?
Anyway. To answer your question. OP said that their sites like Blog, Facebook and Twitter are gone and he cannot login.
WOW, nice page! I loved it!
@Hidden_Refuge - Blog is there last entry Friday, May 8, 2015 3:00 AM, Twitter and Facebook are fine.
If anyone has the contact information for who ran/runs DevPort / DeveloperPortfolio - can you please share it with me? or have them contact me?
If they are indeed dying/shutting down, I want to keep it online and running for free as it is now.
Maybe be trying the whois info: https://gist.githubusercontent.com/anonymous/bfb80e0ac231781c81b0/raw
Hey 0xdragon, I'm the creator of DevPort. ItsChrisG reached out to me regarding this issue.
Sorry you're having trouble with the site, there were some issues with redis (session store). I pushed a fix, you should be able to log into your account now.
I'd also like to assure you that I won't be taking DevPort down anytime soon, and if I did, I would allow you to export all your data.
Best!
Ian
Thanks for the reassurance, you had me worried for a month or so
Trying to add new projects and modify data keeps giving me 502 Bad Gateway issues.
502 Bad Gateway
nginx/1.4.6 (Ubuntu)
Yeah, anything saved by ArchiveBot (or well, our instance of it anyway) goes into the Wayback Machine directly. Generally takes anywhere between an hour and a day, depending on how much is being archived - it's batch-imported in fixed-size chunks.
Sounds like you need better error reporting Good to see that it's still alive, though.