NovaCloud-Hosting seems to have died.

NovaCloudHosting

@JohnFilch123 said:

@NovaCloudHosting said: The last backup of Standard VPS DE services were created exactly 25 minutes before the outage started

Well done, this is really good. Usually, providers do backup on best effort basis, so it is always good to have own backups.

Yes, we also do backups on best-effort basis, but take it seriously. All backups of our VPS services a customer creates, are always distributed on 3 separate Backup servers with redundant disks. This doesn't guarantee anything, but we want to minimize the risk of dataloss as good as reasonably possible.

I'd still recommended everybody (not just our customers) to create their own backups on an external provider, if possible. At least on important systems.

N_Gogol

My VPS is not back up and running yet.

forest

@NovaCloudHosting said: I'd still recommended everybody (not just our customers) to create their own backups on an external provider, if possible. At least on important systems.

No backup == no worth.

The one and only reason that a provider should keep their own backups is to reduce downtime for restoration (same with technologies like RAID). No one should ever trust provider backups for the purpose of keeping data safe.

NovaCloudHosting

@N_Gogol said:
My VPS is not back up and running yet.

Send me your ticket ID or support pin via DM, I'll handle it right away.

rpqu

@forest said:

@NovaCloudHosting said: I'd still recommended everybody (not just our customers) to create their own backups on an external provider, if possible. At least on important systems.

No backup == no worth.

The one and only reason that a provider should keep their own backups is to reduce downtime for restoration (same with technologies like RAID). No one should ever trust provider backups for the purpose of keeping data safe.

Yes. Consecutive hardware failure may happened because of poor electricity quality, datacenter fire, getting locked within legal battle (and wanton damage) or with prior swat, attack missile, and the only real scenario that hasn't happened is getting blasted by nuclear explosion

barbarza

@NovaCloudHosting said:

@rpqu said:

@NovaCloudHosting said:

@rpqu said:
@NovaCloudHosting when are you going to FFM2/NTT-FRA1 datacenter in person? FYI, the problem with the previous @alexhost NL location magically disappear once they sent their own people

We are already in contact with the infrastructure provider and found a solution. There is no need to send a technician from our side, since there is no dispute between us and the party, which can provide access to the rackspace. We have received a confirmation, that our hardware was not moved or changed in any way.

Great

It's a really stressful situation for us, but we are working to do everything which is possible to minimize the customer impact.

Roughly 90% of our customers' services were already restored on monday. At the moment, we're looking at around 95%, of which mostly are Standard VPS DE services.

As a client whose service is still down, I am okay with how @NovaCloudHosting has handled this situation.

apollo15

why was upstream provider terminated from the DC?

NovaCloudHosting

@barbarza said: As a client whose service is still down, I am okay with how @NovaCloudHosting has handled this situation.

Thanks for your understanding and praise!

Also, please feel free to send me your ticket ID or support pin via E-Mail. We are currently working on the leftover tickets and restoring VPS by recreating them or restoring from a backup, given what the customer requests.

Whatever is requested, you will be able to retrieve any data from the original VPS, once we have restored our FFM2 location. We are going to be at the datacenter on 01.08. and maybe have everything running a day later. I can't give a guarantee or promise on this, which is the reason we announced the 7. of August in the information E-Mails to be safe.

NovaCloudHosting

@apollo15 said:
why was upstream provider terminated from the DC?

We have 2 redundant upstreams, the issue was that the provider where we rent the Rack from has a dispute with their infrastructure-provider.

It's also explained in the information E-Mail. @N_Gogol posed it here: https://lowendtalk.com/discussion/comment/4836771/#Comment_4836771

N_Gogol

@NovaCloudHosting said:

@N_Gogol said:
My VPS is not back up and running yet.

Send me your ticket ID or support pin via DM, I'll handle it right away.

I sent it and have been waiting for your response for the second day already.

N_Gogol

The problem is solved. The VPS has been restored and is now operational.