New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
Our Primary 100G Uplink to Lumen is back online!
Time to add Crown Castle as a upstream :P
Looks like Cogent is down again. And not everyone at TRG signed on with another provider.
Hello, does anyone know any cogent update or any link to know the status in Houston, a couple of hours ago it went down again and I have no ping
Last I heard Cogent was down due to a fiber cut. But they can't get in there to work on it until a utility pole is fixed.
Sounds like Cogent could be down for a bit.
Sadly Cogent has been down since 945AM CDT. Lumen is holding strong.
So can I buy it now because this machine seems like it's okay but I don't know if he's going to be able to work properly
Your order just got approved. Our network is working as it should.
**Our primary 100Gbps to Lumen is holding strong for almost 24hrs now, but they still are on generator power.
**As of 8.37PM last night Cogent is back up online. However we only route traffic to Cogent if Lumen dies so its not really being used much since Lumen bandwidth has better hops/latency and speed.
A diverse route to Lumen would be really nice. Is that even possible?
Our Lumen fiber is all underground and dual pathed to the TRG datacenter already. The problem with both Lumen and Cogent was both of there 2 generators, (a total of 4) failed after the storm.
Lumen has utility power restored and has been rock solid since. They also have 3 portable generators & additional cooling. We are confident Lumen will remain. Cogent on the other hand has left everyone in the dark about their progress.
We have had no routing issues for over 24hrs, even with Cogent randomly bouncing.
Thanks,
Ryan
Good news, thanks, @oplink! Now would you please consider adding an external offsite status/uptime service in addition to whatever you want to do with Twitter/X and here at LET? Would add to the sense of confidence in your service IMO.
I think that's super valid.
A status page or Discord, a channel where we could have quicker access to company information. Discord is great for customer interaction.
All in all.
This was a "perfect storm" per say for test of infrastructure.
For both Lumen & Cogent going down is like winning the lottery (I hope you went out and got a ticket. ) of shit hitting the fan in a colossal way.
TXNet links stayed up with 2 providers and loosing Cogent (3rd link).
We'll stay in touch with you @oplink as TXNet is working on some things.
Cogent is back up hopefully for good now. So lets hope all is good!
Do you have any examples of a status page that your suggesting? Curious to see what your looking for beyond what we post on x.
something simple like this is okay
https://cloudflarestatus.com/
Sounds great! Thank you> @oplink said:
The problem with X is that you need an account to view any updates... So anything is better then X.
Sure!
https://www.atlassian.com/software/statuspage
Many companies use Atlassian's status page software
In my opinion, it's one of the best there is, because of the many interactions and integrations between apps in the marketplace (Teams, Jira, Monitoring Apps, Social Networks and other)
You can see a sample page here:
https://status.digitalocean.com/
https://status.digitalocean.com/history
Please if you can provide me your network uptime/stability in past 6 months or year. I strictly need to have least amount of network downtime/issues.
The only outage we have had in the last 12months happened this week. We were down for about 5hrs total after the storm due issues at our two uplink's and their datacenters with generator failures. Our two uplinks bounced up/down between each other during the even.
Other LET members here I am sure can share their reviews on our uptime.
You could also share router uptime
But here's one of your router's uptime.
My uptime has been great since the beginning, very fast VMs too.
I don't have to complain about Oplink either, apart from this week's incident. The performance of their vps x cost benefit is the best there is. I used another company and migrated to Oplink recently, but so far I've had nothing but praise.
I think this week's events were totally atypical!
The only point I have to leave as an improvement is the status page, which I commented on earlier and some other members as well.
Core.atlas: uptime is 2 years, 35 weeks, 1 day, 10 hours, 39 minutes
It has good uptime. The last time it was rebooted was for updates during scheduled maintenance
Yes, uptime has been excellent, no issues that I have in my records, other than the hurricane-related incident discussed in this thread, which was understandable considering the circumstances, and I think the way it was handled was totally fine, except I would have liked an external status update page other than X (which requires subscription) and LET.
Examples of what I would like to see include:
https://status.hetrixtools.com/
https://status.atlassian.com/
https://status.proton.me/
https://status.dropbox.com/
https://status.apps.rackspace.com/
And so forth.
BTW, Hetrix has a public status page feature and that is very affordable. I think that would be the simplest, quickest, most reputable way (i.e. confidence-boosting IMO!) to solve this and give timely, accurate updates as comprehensively as you want to.
EDIT: The Hetrix public status page feature is part of their monitoring service - https://hetrixtools.com/pricing/uptime-monitor/ - and they have some instructions to create a nice status page for your customers: https://docs.hetrixtools.com/how-to-create-a-beautiful-uptime-status-page/
2 years. That sounds like the move?
If that is right. Jeez. Time flys quickly.
I'm tired of @oplink
If it's just the easiest place to start, I don't mind if you guys just run an Uptime Kuma, or maybe just a little VM from a place outside of Houston like Hetzner's Ashburn for monitoring would be nice.
Just for basic monitoring and situation posting when out of certain situations.
I totally appreciate the transparency of the email you posted to the customer today, but the page looks much more user friendly, and next time maybe just email the customer to a link and explain the situation.
While this might be ideal. There can be "security" flaws in either.
People don't trust links but also some don't trust PDFs.
It is a mixed handbag all in all.
Now granted @oplink could use their already Announcement or Network Status page in WHMCS however it appears their website is hosted on their network. So would be not good "IF" this was to happen again.
One of the core reasons we don't host our website ourselves but that's besides the point.
Maybe getting a cheap cPanel from GoDaddy or even maybe something on the free tier from AWS/GCloud/Azure/DO/Akamai would be sufficient enough for a status page.
Just throwing ideas out there as well
We have always liked to host our own things in house. We will do something soon with a status page offnet. Our priority has been helping local business who need colo/ded/vps servers/ or even internet. Its just been a long week. I see those temp cross connects to your racks, you have been busy too! Take care datacenter neighbor and get some rest yourself too!
-Ryan
"GoDaddy"
Indeed it has.
We have been in the progress of BIG things coming soon that could help everyone both for companies like Oplink and TRG.
Can't wait to share the exciting news