Hosthatch sydney

extrem

Anyone have issues with hosthatch sydney today?

emgh

My server with hosthatch has been down for about 8 days now.

Waiting for a refund but no luck yet.

Amsterdam.

dahartigan

Do they even have a refound button?

nick_

Mine in Tokyo has higher latency than usual recently.

webcraft

Sydney, Tokyo and according to the other thread Stockholm too. What's going wrong with hosthatch lately, again?

Gravely

Yeah mine was offline for 4-5 hours. Apparently host node issue which required a restart.

yoursunny

I have AMD Compute 4 GB - PROMO in Sydney.
Downtime started 9 hours ago and ended 4 hours, with the following notifications that the host node was rebooted.

---

Dear Customer,

We would like to inform you that we detected an issue with a host node and our engineers had to perform an unscheduled reboot to completely resolve the issue.

The following VM(s) were affected:
vps3.yoursunny (194.29.100.0) - Sydney

Your VM(s) are now back online and stable. No data or configuration on your server was affected. If you continue to see any issues, please do not hesitate to contact us. We are sorry for the inconvenience.

Sincerely,
HostHatch Support Team

Gravely

4 hours to reboot a node

hosthatch

@webcraft said:
Sydney, Tokyo and according to the other thread Stockholm too. What's going wrong with hosthatch lately, again?

There's no location wide issues - https://status.hosthatch.com/ - there are always going to be single nodes that have issues from time to time, but it's a bit of a stretch to say that that the whole location is having issues because of it

Sydney - we had a node reboot today, took longer than usual because not all VMs on the node were down and the IP address of the node was not down either, so our internal monitoring never showed it as down to us

Tokyo - zero issues

Stockholm - had a scheduled maintenance last week that caused IPv6 issues, which were resolved last week too, zero issues since then

emgh

@hosthatch said:

@webcraft said:
Sydney, Tokyo and according to the other thread Stockholm too. What's going wrong with hosthatch lately, again?

There's no location wide issues - https://status.hosthatch.com/ - there are always going to be single nodes that have issues from time to time, but it's a bit of a stretch to say that that the whole location is having issues because of it

Sydney - we had a node reboot today, took longer than usual because not all VMs on the node were down and the IP address of the node was not down either, so our internal monitoring never showed it as down to us

Tokyo - zero issues

Stockholm - had a scheduled maintenance last week that caused IPv6 issues, which were resolved last week too, zero issues since then

And Amsterdam.

Although, for everyone to know: Refund granted, all good

bdl

Anyone continuing to have issues with their SYD service? Mine keeps on randomly rebooting since the outage today

yoursunny

IPv6 gateway in Sydney seems dead.
I'm seeing:

[root@sysrescue ~]# ip -6 neigh
fe80::1 dev ens3  FAILED

Panel does not show host node, but my service is on the host node that rebooted yesterday.

febryanvaldo

You have been HostHatched?

Gravely

@bdl said:
Anyone continuing to have issues with their SYD service? Mine keeps on randomly rebooting since the outage today

corbpie

Network speeds not looking good on their Singapore location
https://yabsdb.com/yabs/hxazUP7a

hosthatch

@corbpie said:
Network speeds not looking good on their Singapore location
https://yabsdb.com/yabs/hxazUP7a

The low speed seems limited to Clouvider locations only though, have you tried any more tests?

dosai

@corbpie said:
Network speeds not looking good on their Singapore location
https://yabsdb.com/yabs/hxazUP7a

Seems like a network cap from @Clouvider

Oracle cloud Hyderabad to Clouvider Frankfurt,

iperf3 -c fra.speedtest.clouvider.net -p 5201
Connecting to host fra.speedtest.clouvider.net, port 5201
[  5] local 2603:c024:8002:d02:d1df:8b89:55e4:3936 port 46368 connected to 2a0f:9440:1:b::2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  2.83 MBytes  23.7 Mbits/sec    0    339 KBytes
[  5]   1.00-2.00   sec  12.5 MBytes   105 Mbits/sec    0   8.83 MBytes
[  5]   2.00-3.00   sec  20.0 MBytes   168 Mbits/sec    0   8.83 MBytes
[  5]   3.00-4.00   sec  20.0 MBytes   168 Mbits/sec    0   8.83 MBytes
[  5]   4.00-5.00   sec  20.0 MBytes   168 Mbits/sec    0   8.83 MBytes
[  5]   5.00-6.00   sec  18.8 MBytes   157 Mbits/sec    0   8.83 MBytes
[  5]   6.00-7.00   sec  20.0 MBytes   168 Mbits/sec    0   8.83 MBytes
[  5]   7.00-8.00   sec  20.0 MBytes   168 Mbits/sec    0   8.83 MBytes
[  5]   8.00-9.00   sec  18.8 MBytes   157 Mbits/sec    0   8.83 MBytes
[  5]   9.00-10.00  sec  20.0 MBytes   168 Mbits/sec    0   8.83 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   173 MBytes   145 Mbits/sec    0             sender
[  5]   0.00-10.15  sec   172 MBytes   142 Mbits/sec                  receiver

iperf Done.

Crunchbit Washington to Clouvider Frankfurt,

iperf3 -c fra.speedtest.clouvider.net -p 5202                                                                                                                                                           
Connecting to host fra.speedtest.clouvider.net, port 5202
[  5] local 2606:a8c0:3:1fc::a port 52636 connected to 2a0f:9440:1:b::2 port 5202
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  2.83 MBytes  23.7 Mbits/sec    0    353 KBytes
[  5]   1.00-2.00   sec  13.7 MBytes   115 Mbits/sec    0   8.85 MBytes
[  5]   2.00-3.00   sec  20.0 MBytes   168 Mbits/sec    0   8.85 MBytes
[  5]   3.00-4.00   sec  20.0 MBytes   168 Mbits/sec    0   8.85 MBytes
[  5]   4.00-5.00   sec  18.8 MBytes   157 Mbits/sec    0   8.85 MBytes
[  5]   5.00-6.00   sec  20.0 MBytes   168 Mbits/sec    0   8.85 MBytes
[  5]   6.00-7.00   sec  20.0 MBytes   168 Mbits/sec    0   8.85 MBytes
[  5]   7.00-8.00   sec  20.0 MBytes   168 Mbits/sec    0   8.85 MBytes
[  5]   8.00-9.00   sec  20.0 MBytes   168 Mbits/sec    0   8.85 MBytes
[  5]   9.00-10.00  sec  18.8 MBytes   157 Mbits/sec    0   8.85 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   174 MBytes   146 Mbits/sec    0             sender
[  5]   0.00-10.15  sec   174 MBytes   144 Mbits/sec                  receiver

iperf Done.

Inceptionhosting Frankfurt to Clouvider London,

iperf3 -c lon.speedtest.clouvider.net -p 5203                                                                                                                                                           __
Connecting to host lon.speedtest.clouvider.net, port 5203
[  5] local 2a0f:9441:47:cc::c97b port 56878 connected to 2a0d:5082:0:4::2 port 5203
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  6.45 MBytes  54.1 Mbits/sec    0    162 KBytes
[  5]   1.00-2.00   sec  5.27 MBytes  44.2 Mbits/sec    0    176 KBytes
[  5]   2.00-3.00   sec  5.27 MBytes  44.2 Mbits/sec    0    165 KBytes
[  5]   3.00-4.00   sec  5.27 MBytes  44.2 Mbits/sec    0    162 KBytes
[  5]   4.00-5.00   sec  5.27 MBytes  44.2 Mbits/sec    0    162 KBytes
[  5]   5.00-6.00   sec  5.27 MBytes  44.2 Mbits/sec    0    156 KBytes
[  5]   6.00-7.00   sec  5.27 MBytes  44.2 Mbits/sec    0    162 KBytes
[  5]   7.00-8.00   sec  5.27 MBytes  44.2 Mbits/sec    0    165 KBytes
[  5]   8.00-9.00   sec  5.93 MBytes  49.8 Mbits/sec    0    159 KBytes
[  5]   9.00-10.00  sec  5.27 MBytes  44.2 Mbits/sec    0    162 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  54.6 MBytes  45.8 Mbits/sec    0             sender
[  5]   0.00-10.01  sec  52.8 MBytes  44.2 Mbits/sec                  receiver

iperf Done.

Edit: formatting

bdl

@Gravely said:

@bdl said:
Anyone continuing to have issues with their SYD service? Mine keeps on randomly rebooting since the outage today

Mine was really strange, rebooting every 12-15 minutes since the outage - ended up having to rebuild it

rcy026

@hosthatch said:
Stockholm - had a scheduled maintenance last week that caused IPv6 issues, which were resolved last week too, zero issues since then

Just to confirm, I have two servers in Stockholm and they had ipv6 problems after the maintenance. I opened a ticket and it was solved within an hour.
All my servers are monitored with a 30 seconds timeframe and I have not had a dropped ping since then.

Encify

I am having odd issues since the outage occured for Sydney - I seem to be getting ongoing latency issues for the drive and alerts from netdata regarding average backlog size of the vda disk over the last 10 minutes
https://snipboard.io/zJ5tQA.jpg

This is from amplify, reporting latency issues - assuming reading correctly
https://snipboard.io/ugjGyq.jpg

Also seeing delays when trying to write to files using nano, appears to hang for 10-20 seconds intermittently now.

hosthatch

@hosthatch said:

@corbpie said:
Network speeds not looking good on their Singapore location
https://yabsdb.com/yabs/hxazUP7a

The low speed seems limited to Clouvider locations only though, have you tried any more tests?

Just following up - since the issue you mentioned seems to be a quite serious one affecting a whole POP (one of our largest POPs at the moment), have you performed any more tests or is your conclusion about our network not looking good in Singapore based on another provider's network being rate limited?

Just want to make sure we get this resolved for you and for anyone else affected.

yoursunny

@hosthatch
Please fix Sydney IPv6.
ip -6 neigh is still showing fe80::1 dev uplink FAILED.
Server ID 84911.

hosthatch

@yoursunny said:
@hosthatch
Please fix Sydney IPv6.
ip -6 neigh is still showing fe80::1 dev uplink FAILED.
Server ID 84911.

https://cloud.hosthatch.com/tickets/create - thank you

Gravely

Another node reboot today, safe to say i won't be using it for Production anytime soon.

yoursunny

Sydney IPv6 gateway is dead again.
ip -6 neigh is showing fe80::1 dev uplink FAILED.
Ticket opened.
Let's see how quickly it's fixed.

yoursunny

Sydney IPv6 repaired after 8 hours.

gowrann

Had a couple of Sydney VMs offline today, approx 20 mins

Gravely

@hosthatch what's the go with Sydney? People seem to be having issues (including myself)

hosthatch

@Gravely said:
@hosthatch what's the go with Sydney? People seem to be having issues (including myself)

Sorry just seeing this now.

Sydney is the last APAC location where we still use shared colo (everywhere else we've already moved to our own private racks). We're moving to our own space (and GSL bandwidth) within a month so it should be much more smooth going forward.

gowrann

@hosthatch is there any possibility of down time when this happens, will Sydney users be notified prior to change?

hosthatch

@gowrann said:
@hosthatch is there any possibility of down time when this happens, will Sydney users be notified prior to change?

You will receive a notification much in advance, yes. No changes to the service are involved.