Webhorizon down... again

JabJab

almost 8 hours down for NL/tunnel, not a single sign of life.

Let's hope Abd gonna wake up soon and fix stuff.

stephfd21

@JabJab said:
almost 8 hours down for NL/tunnel, not a single sign of life.

Let's hope Abd gonna wake up soon and fix stuff.

I picked up an ex44 from hetzner, I hope my worries are over moving forward

nvme

@JabJab said:
almost 8 hours down for NL/tunnel, not a single sign of life.

Let's hope Abd gonna wake up soon and fix stuff.

Wake up? It is 10.20 PM in India, so he will probably be off to another good night's sleep

Void

@JabJab said:
almost 8 hours down for NL/tunnel, not a single sign of life.

Let's hope Abd gonna wake up soon and fix stuff.

He’s having some minor mental disorder.

srch07

This page is a joke lol.
NL keeps having network issues and it keeps saying up. https://status.webhorizon.net/

JabJab

Seems like someone switched to IPv6 after few hours, lmao. /this above is LXC host/

KVM host seems to be working fine - no changes in last 12 hours... or there is no clients at all (?)

@srch07 said: NL keeps having network issues and it keeps saying up. https://status.webhorizon.net/

Because it's using direct Hetzner IPv4 for pings, not the stupid tunnel - see 4 ms from Frankfurt.

_MS_

@srch07 said:
This page is a joke lol.
NL keeps having network issues and it keeps saying up. https://status.webhorizon.net/

Still can't beat NexusBytes.
https://heartbeat.nexusbytes.com/

Don_Keedic

MS said:

@srch07 said:
This page is a joke lol.
NL keeps having network issues and it keeps saying up. https://status.webhorizon.net/

Still can't beat NexusBytes.
https://heartbeat.nexusbytes.com/

JabJab

@JabJab said:
almost 8 hours down for NL/tunnel, not a single sign of life.
Let's hope Abd gonna wake up soon and fix stuff.

10 hours in, there is a post on OGF about... NAT services and that someone did not pass fraudcheck.

Still no word about current outage, #priorities

Abd

@JabJab said:

@JabJab said:
almost 8 hours down for NL/tunnel, not a single sign of life.
Let's hope Abd gonna wake up soon and fix stuff.

10 hours in, there is a post on OGF about... NAT services and that someone did not pass fraudcheck.

Still no word about current outage, #priorities

It's already fixed, though temporary.

All this problem is one Netherlands location which uses tunneled connectivity.
LXC services use it.

It was a mistake on my part to introduce such 'tunneled' offering in first place which I realize now. I am sorry about the situation and assure you trying best to make things better.

I have applied a temporary fix for IPv4 should be up now
Permanent fix is also on the way will move the LXC services to normal setup and discontinue the 'tunneled connectivity' altogether .
Will send an email with more details soon.

Otus9051

@ralf said:
Guess what other service has gone down too?

Bingo, it's Cloud-V that @Abd is still denying all knowledge of despite it being registered in his name!

Actually, IPv6 works, but IPv4 has been completely off the radar for nearly 3 hours now.

when i got sponsored by them it was cloud-v/webhorizon

srch07

We are back with a bang, in less than 24 hours.

JabJab

@srch07 said:
We are back with a bang, in less than 24 hours.

This is just extended emergency maintenance, you should have checked e-mail!

We would like to inform you that we will be conducting an emergency maintenance at our Netherlands location. This maintenance is necessary to ensure optimal performance and stability of our servers.

Maintenance Details:
Location: Netherlands
Maintenance Window Start: 8 PM CET
Maintenance Window End: 8:15 PM CET

During the maintenance window, there may be intermittent disruptions in service. We apologize for any inconvenience this may cause and assure you that our team will work diligently to complete the maintenance as quickly as possible.

I mean I assume this was supposed start today, but there is no single date in that e-mail...

srch07

@JabJab said:

@srch07 said:
We are back with a bang, in less than 24 hours.

This is just extended emergency maintenance, you should have checked e-mail!

We would like to inform you that we will be conducting an emergency maintenance at our Netherlands location. This maintenance is necessary to ensure optimal performance and stability of our servers.

Maintenance Details:
Location: Netherlands
Maintenance Window Start: 8 PM CET
Maintenance Window End: 8:15 PM CET

During the maintenance window, there may be intermittent disruptions in service. We apologize for any inconvenience this may cause and assure you that our team will work diligently to complete the maintenance as quickly as possible.

I mean I assume this was supposed start today, but there is no single date in that e-mail...

You got a mail?
Mine is stuck in traffic I guess.

JabJab

Yeah, received 4 hours ago

Also don't worry, the actual [LXC] node (not tunnel) is up and working like a charm via IPv6

srch07

@JabJab said:
Yeah, received 4 hours ago

Anyways, it's all good if it's accounted for.
But we had multiple enhancements done on this and ahem it keeps doing same thing.
So, there is that.

JabJab

@srch07 said: But we had multiple enhancements done on this and ahem it keeps doing same thing.

Yeah, the number of times we heard "This is the last time, we got a fix" is like 6. Bah, few months ago there was scheduled maintenance that was suppose to fix it (again)... but that maintenance and server reboot never happen

stephfd21

@JabJab said:

@srch07 said: But we had multiple enhancements done on this and ahem it keeps doing same thing.

Yeah, the number of times we heard "This is the last time, we got a fix" is like 6. Bah, few months ago there was scheduled maintenance that was suppose to fix it (again)... but that maintenance and server reboot never happen

Thanks for letting me know that ipv6 was up yesterday. Got all my data and bolted. Good luck to the rest of you lol

jugganuts

What about your Poland OpenVZ node has been down for over 4 days and no response in tickets...

JabJab

@stephfd21 said: Thanks for letting me know that ipv6 was up yesterday. Got all my data and bolted. Good luck to the rest of you lol

Where!?

I need something too and I am procrastinating for months... because IPv6 works and I use this as a webhost behind CF... so it just works. Sure, I can't IPv4 SSH to box from time to time, some scripts on server fail from time to time when IPv4 dies... but other than that it works and no one notice :P

JabJab

We back!

Downtime: 1 hr 13 min

srch07

@JabJab said:

@stephfd21 said: Thanks for letting me know that ipv6 was up yesterday. Got all my data and bolted. Good luck to the rest of you lol

Where!?

I need something too and I am procrastinating for months... because IPv6 works and I use this as a webhost behind CF... so it just works. Sure, I can't IPv4 SSH to box from time to time, some scripts on server fail from time to time when IPv4 dies... but other than that it works and no one notice :P

I own VPS from GreenCloud, LiteServer, RackNerd, HostHatch, NaranjaTech, Contabo, LittleCreek, WebHorizon, and now TerraHost due to diversification.

First 3 you can't go wrong with lol. Literally I have raised 3 tickets with GC in 2 years, 1 with LS and RN each with 1 year of use. 1 with HH in 6 months of usage.

I just can't have all VPS at one provider. Too much risk with eggs in one basket. :P

I faced so much issues with our redundancy system and email on IPv6, that we just shut off IPv6 first thing on VPS. :P

stephfd21

@JabJab said:

@stephfd21 said: Thanks for letting me know that ipv6 was up yesterday. Got all my data and bolted. Good luck to the rest of you lol

Where!?

I need something too and I am procrastinating for months... because IPv6 works and I use this as a webhost behind CF... so it just works. Sure, I can't IPv4 SSH to box from time to time, some scripts on server fail from time to time when IPv4 dies... but other than that it works and no one notice :P

Bought an ex44 dedi from hetzner, I usually avoid dedis as they are overkill for my projects but its time I took my hosting business more seriously and provide my clients with better service.

JabJab

@stephfd21 said: Bought an ex44 dedi from hetzner

Yeah, that would eat all my budget, but this seems like a nice bump - good luck!

@srch07 said: I own VPS from GreenCloud, LiteServer, RackNerd, HostHatch, Contabo, LittleCreek, WebHorizon, and now TerraHost due to diversification.

GC [check], LS [I don't have any!], RN [check], HH [check], Contabo [Never again], LC [USA only it seems], TH [check].
Eh, I guess I should jump on that LiteServer bandwagon when they have next promo

fluffernutter

@emgh said:

@stephfd21 said:

@emgh said:
You host your clients with WebHorizon?

That's the worst thing to come out of this thread, worse compared to any downtime.

The service was good prior to this year tbh. Decided to transfer over all my business when I saw he had the hetzner dedis. I'll take this as a sign to get my own hetzner dedi.

The service was still a LET operated one man show with users paying scraps.

It dosen't matter if it worked for awhile, it was never even remotely production ready.

Apart from very very few exceptions, such as @MrRadic and @OVH_APAC (not a complete list) - there's basically no providers on here that I'd trust for any production related to clients.

I trust BuyVM for my personal use and I love it, but production is another thing completely.

The same stuff are not to be valued.

I'd trust most of the providers in my signature with prod, maybe besides pulsedmedia (no offense Aleksi), and Limewave. The real idiots are the people who run things with one host and have 0 failover.

jason123santa

Tried to buy a vps from them and my card kept being declined. Opened a ticket about it and they ended up fixing something with it so it worked. Was installed with debian 10 and I tried to reinstall with debian 11 but no matter what I do it says failed to install and my service is down.
Can't tell if the location is down since the status page does not list the New York location. But I can ping the public ip just fine.
Opened a ticket about it and no response and my vps is down no matter what I do. Have a vps from mrvm and it uses the same panel and reinstall works on there.

emgh

@fluffernutter said:

@emgh said:

@stephfd21 said:

@emgh said:
You host your clients with WebHorizon?

That's the worst thing to come out of this thread, worse compared to any downtime.

The service was good prior to this year tbh. Decided to transfer over all my business when I saw he had the hetzner dedis. I'll take this as a sign to get my own hetzner dedi.

The service was still a LET operated one man show with users paying scraps.

It dosen't matter if it worked for awhile, it was never even remotely production ready.

Apart from very very few exceptions, such as @MrRadic and @OVH_APAC (not a complete list) - there's basically no providers on here that I'd trust for any production related to clients.

I trust BuyVM for my personal use and I love it, but production is another thing completely.

The same stuff are not to be valued.

I'd trust most of the providers in my signature with prod, maybe besides pulsedmedia (no offense Aleksi), and Limewave. The real idiots are the people who run things with one host and have 0 failover.

I’d basically trust none of them lol

Few exceptions

BuyVM is great for personal use for example, but not production

When all my backups were failing, their reply was basically ”yeah maybe it’s bugging let’s see if it fixes itself”

It’s also out of stock constantly and have been since years, imagine needing to scale and have to wait for days

It’s just not production level

Francisco

@emgh said:

@fluffernutter said:

@emgh said:

@stephfd21 said:

@emgh said:
You host your clients with WebHorizon?

That's the worst thing to come out of this thread, worse compared to any downtime.

The service was good prior to this year tbh. Decided to transfer over all my business when I saw he had the hetzner dedis. I'll take this as a sign to get my own hetzner dedi.

The service was still a LET operated one man show with users paying scraps.

It dosen't matter if it worked for awhile, it was never even remotely production ready.

Apart from very very few exceptions, such as @MrRadic and @OVH_APAC (not a complete list) - there's basically no providers on here that I'd trust for any production related to clients.

I trust BuyVM for my personal use and I love it, but production is another thing completely.

The same stuff are not to be valued.

I'd trust most of the providers in my signature with prod, maybe besides pulsedmedia (no offense Aleksi), and Limewave. The real idiots are the people who run things with one host and have 0 failover.

I’d basically trust none of them lol

Few exceptions

BuyVM is great for personal use for example, but not production

When all my backups were failing, their reply was basically ”yeah maybe it’s bugging let’s see if it fixes itself”

It’s also out of stock constantly and have been since years, imagine needing to scale and have to wait for days

It’s just not production level

To be fair the old backup system was pretty janky. The new system is far more reliable so I’m hoping you aren’t seeing anything like that now

Francisco

emgh

@Francisco said:

@emgh said:

@fluffernutter said:

@emgh said:

@stephfd21 said:

@emgh said:
You host your clients with WebHorizon?

That's the worst thing to come out of this thread, worse compared to any downtime.

The service was good prior to this year tbh. Decided to transfer over all my business when I saw he had the hetzner dedis. I'll take this as a sign to get my own hetzner dedi.

The service was still a LET operated one man show with users paying scraps.

It dosen't matter if it worked for awhile, it was never even remotely production ready.

Apart from very very few exceptions, such as @MrRadic and @OVH_APAC (not a complete list) - there's basically no providers on here that I'd trust for any production related to clients.

I trust BuyVM for my personal use and I love it, but production is another thing completely.

The same stuff are not to be valued.

I'd trust most of the providers in my signature with prod, maybe besides pulsedmedia (no offense Aleksi), and Limewave. The real idiots are the people who run things with one host and have 0 failover.

I’d basically trust none of them lol

Few exceptions

BuyVM is great for personal use for example, but not production

When all my backups were failing, their reply was basically ”yeah maybe it’s bugging let’s see if it fixes itself”

It’s also out of stock constantly and have been since years, imagine needing to scale and have to wait for days

It’s just not production level

To be fair the old backup system was pretty janky. The new system is far more reliable so I’m hoping you aren’t seeing anything like that now

Francisco

I’m not

The only reason for now that you’re out of my ”production league” is stock really.

Void

@fluffernutter said:
I’d trust most of the providers in my signature with prod,

Sure. Virmache is excellent for production.