1GServers outage?

Comments

• concept Member

  3:17PM edited 3:17PM

  @OhJohn said:
  I was wondering about GTHost as well as they moved DCs in Phoenix last month....

  Had they been in PhoenixNAP before?

  From what I know, they are connected to PhoenixNAP but no servers there. They are online still.
• OhJohn Member

  3:20PM

  yes, GThost in PHX is online and was online all time today.
• corpdecker Member

  3:20PM

  My server just came back online, uptime of 11 minutes, so it was def power cycled.

  Thanked by 1a2razor
• Maximus Member

  3:42PM

  @corpdecker said:
  My server just came back online, uptime of 11 minutes, so it was def power cycled.

  Mine still down
• parapara Member

  3:46PM edited 3:46PM

  4 of em for me still down. 1 up.
• aru Member

  3:48PM

  1 up 26 minutes ago, but
  Package id 0: +99.0°C (high = +93.0°C, crit = +103.0°C)

  shutdown now
• a2razor Member

  3:54PM

  Machine came back online here:

  Chassis: 47°C
  
  CPU 1 / CPU 2: 62°C / 55°C
  
  Motherboard NIC sensors: 67°C / 67°C
  
  Peripheral area: 51°C
  
  DIMMs: up to 56°C
  
  SSDs: 46°C primary, 43°C secondary -- these aren't M.2's, they got up to 70c earlier according to BMC logs but seem back down now.
  
  Fans: 10,700 – 11,400 RPM
  

  Temps way down from earlier.
• a2razor Member

  3:57PM

  @corpdecker said:
  My server just came back online, uptime of 11 minutes, so it was def power cycled.

  Yep, abrupt shutoff observed here too, not a clean shutdown according to logs.
• paradoxo Member

  3:57PM

  Damn, my server is at 62°C right now, and the network is still unstable. I hope they fix it as soon as possible 😥
• thane Member

  4:05PM

  According to LiquidWeb we may be looking at 10-16 hours of downtime here: https://status.liquidweb.com/
• Mainfrezzer Member

  4:07PM

  Holy moly. Fun
• hekris Member

  4:07PM

  @paradoxo said:
  Damn, my server is at 62°C right now, and the network is still unstable. I hope they fix it as soon as possible 😥

  How to check the temperature when the server is powered off and cannot be accessed?
• Maximus Member

  4:14PM

  still down. 3+ hours down and zero email or call answering. Would you trust this company in the future if anything goes wrong? I wouldn't.
• freelanceonline Member

  4:18PM edited 4:22PM

  @OhJohn said:
  ok, at least i seem to have the servers still in the old colo location and not the new DC.

  And here is the status page by phoenixnap: https://status.phoenixnap.com/

  Incident: https://status.phoenixnap.com/incidents/dnjp5pfv2mmh

  
  It looks like it has a DDoS attack flow.
• concept Member

  4:20PM

  @freelanceonline said:

  @OhJohn said:
  ok, at least i seem to have the servers still in the old colo location and not the new DC.

  And here is the status page by phoenixnap: https://status.phoenixnap.com/

  Incident: https://status.phoenixnap.com/incidents/dnjp5pfv2mmh

  
  It looks like a DDoS attack.

  Site works for me.
• iohn Member

  4:26PM

  what happened? all of sudden my server rebooted and i can't ssh into it anymore
• thane Member

  5:05PM

  They restored more cooling capability, seeing some servers come online again and temps dropping. Another major cooler is expected to be installed in about 2.5 hours, hopefully servers dont take that long to be safe to boot back up...
• 1743528077 Member

  5:19PM

  Since the reboot, my server’s outbound TCP traffic has been limited to about 56 KB/s with high packet loss, while inbound speed and the local NIC remain normal.
• 1743528077 Member

  5:19PM

  @1743528077 said:
  Since the reboot, my server’s outbound TCP traffic has been limited to about 56 KB/s with high packet loss, while inbound speed and the local NIC remain normal.

  I don't know if I'm the only one like this; is there anyone else?
• szarka Member

  5:20PM

  @1743528077 said:

  @1743528077 said:
  Since the reboot, my server’s outbound TCP traffic has been limited to about 56 KB/s with high packet loss, while inbound speed and the local NIC remain normal.

  I don't know if I'm the only one like this; is there anyone else?

  I don't even have signs of life.
• 1743528077 Member

  5:22PM

  @szarka said:

  @1743528077 said:

  @1743528077 said:
  Since the reboot, my server’s outbound TCP traffic has been limited to about 56 KB/s with high packet loss, while inbound speed and the local NIC remain normal.

  I don't know if I'm the only one like this; is there anyone else?

  I don't even have signs of life.

  Don't worry, at least it didn't catch fire.
• 1743528077 Member

  5:24PM edited 5:24PM

  Their official website has yet to come back online—it is already well past 10 a.m. there, which is truly baffling.
• emgh Veteran, Megathread Squad

  5:29PM

  insane to me how companies like namecheap and namesilo seemingly have absolutely 0 redundancy and also 0 disaster recovery measures when a singular DC is down

  Thanked by 7concept OhJohn zGato Mainfrezzer Obelous Xrmaddness AdiOnLET
• OhJohn Member

  5:32PM edited 5:33PM

  Again, this is the current update stream:

  @emgh said: insane to me how companies like namecheap and namesilo seemingly have absolutely 0 redundancy and also 0 disaster recovery measures when a singular DC is down

  yepp, that is embarrassing, esp. if you think about their size. (But CF centralization in Portland is even more embarrassing if we recall their outage a few years ago)

  Thanked by 2zGato emgh
• zGato Member

  5:34PM edited 5:35PM

  @emgh said:
  insane to me how companies like namecheap and namesilo seemingly have absolutely 0 redundancy and also 0 disaster recovery measures when a singular DC is down

  Them actually calling it an "emergency maintenance" is hilarious. Like how hard is it to call it for what it is? An outage?
  

  Thanked by 4emgh MikeA Xrmaddness AdiOnLET
• Mainfrezzer Member

  5:38PM

  @zGato said:

  @emgh said:
  insane to me how companies like namecheap and namesilo seemingly have absolutely 0 redundancy and also 0 disaster recovery measures when a singular DC is down

  Them actually calling it an "emergency maintenance" is hilarious. Like how hard is it to call it for what it is? An outage?
  

  I'm gonna shit bricks if it's because of some weird terms that outages are reimbursed differently

  Thanked by 2zGato emgh
• concept Member

  5:38PM edited 5:44PM

  LOL
  

  Just to think if the dc goes up in flames like OVH Strasbourg, there will be nothing left. They are hosting everything out of PhoenixNAP.

  Thanked by 1zGato
• OhJohn Member

  5:51PM

  @concept said: Just to think if the dc goes up in flames like OVH Strasbourg, there will be nothing left. They are hosting everything out of PhoenixNAP.

  With no backups - YOLO
• OhJohn Member

  5:51PM edited 5:52PM

  Let's just hope that an unpingable mail server IP does not mean the mail server is also down... (this in regards to 1gservers, not namecheap).
• concept Member

  5:52PM edited 5:52PM

  @OhJohn said:

  @concept said: Just to think if the dc goes up in flames like OVH Strasbourg, there will be nothing left. They are hosting everything out of PhoenixNAP.

  With no backups - YOLO

  Surely a company with a 1.5 billion dollars valuation and making nearly $400 million in revenue would have their own DC by now or some kind of backup strategy.
  https://hostdean.com/news/cvc-capital-partners-majority-stake-namecheap/