New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
CrowdStrike update caused BSOD on hospitals, banks, servers worldwide
This discussion has been closed.
Comments
So, when something like this occurs who is responsible for the damage done and the financial impact/loss from having systems down? What does accountability look like in this particular scenario?
Wasn't impacted, but for a few hours had quieter skies since many departing flights near me were delayed.
The former Crowdstrike intern and since he has been fired, case closed.
TOS makes it extremely difficult to put any liability on software company, unless they were advised in past and they simply ignored.
-- not a legal advice. Just sharing my opinion
So these big companies can't come here on LET and complain they lost millions?
Sure, figured they outline such things in a TOS but assume that despite that, this disastrous 'woops' can be likely measured in the hundreds of millions or more in dollars worth of damage. Even if they have a TOS, they may have dozens or more large companies with teams of lawyers wanting to challenge it and sue for damages since they all would assume and expect that such updates are tested thoroughly before being pushed live.
Not sure how this all works though.
Is there a change log that shows what this update was supposed to do/fix/improve/correct or anything? I searched but my Google-Fu is weak.
Yep, not coming back to work
TOS is a legal contract.
Unless it is shown willful and known cause , it is difficult to make a case.
But such cases drive a big change how software updates are delivered and its potential impact across different sectors.
-- again, not a legal advice.
This incident shows lack of higher compensations for C suite clerks at crowdstrike. Gov should chim and subsidize few billions. Lack of yachts, good cocaine and hookers was also a factor for oopsie.
Video is also actually funny.
https://x.com/vinceflibustier/status/1814277507396296828?s=42
From:
"The Top 20 CrowdStrike Memes You Can Enjoy While You Fix Servers"
The fact that a simple mistake can have such a big impact demonstrates the power we place in the hands of Ruzzia when we allow them to freely sell and distribute software from ISPSystem, ISPManager, Kaspersky, etc. in our countries.
One update, and they can take down or abuse all the servers/computers with their software installed.
So a single man managed to create so much chaos with just an update. This goes to prove the huge importance and responsibility of a system administrator.
Pretty sure it’s satire
Now wheres the non-Windows VPS deals
Havent they tried switching them off and on again ? Works every time
.
@gwnd1989, you should apply for Vincent's job.
CrowdStrike alternative?
I imagine the keyword will be trending so I'm leaving it here. xD
Kaspersky
It also seems to have happened with linux some time ago
https://news.ycombinator.com/item?id=41005936
I can recall that a few years ago, Kaspersky also caused similar problems for Windows. They were not so big, but they were still problems. Any software can cause problems on any operating system.
Actually, this case is just an illustration of the fact that progress has its own cost and it is great.
Kaspersky US ban goes live tomorrow. Crowdstrike, a competitor with close ties to the US government, pushes a Friday deploy. Can't be an emergency fix for the bad deploy they had in June as that only required a reboot, not Friday worthy.
I'm not forming a conclusion I'm just saying I think there's one to be had that isn't going to be the official story.
Those damn interns…
Source:https://www.crowdstrike.com/blog/statement-on-falcon-content-update-for-windows-hosts/
Windows hosts which are brought online after 0527 UTC will also not be impacted
Hosts running Windows 7/2008 R2 are not impacted
So what we learned?
Stay on old OS as much as possible and always start your windows system after 05:27 UTC.
WTF??
I love this part:
Nice, so detach, attach, glue, bond.... who the heck is gonna pay for those labor hours?
One of the reasons people/companies use payed OS and software is because of the "trust" that if it is payed, somebody "up there" knows what it is doing.
Apparently, QC is going down the toilet these days, especially in software.
But the magnitude of this fuckup is gorgeous.
PS:
My 2 cents on the guy is that he probably got a nice paycheck/deal to take the hit, so the company ( AKA CrowdStrike ) stays clear.
That DEV guy is part of a team, that team has a manager. There are rules and regulations in these type of companies so shit like this does not happen. I doubt that a fresh employed guy can do this havoc.
For example a few years ( well not few, like 10+
) when I got employed at a big multi-national company for Network Admin i did not even touch a device for 3mo until I did not finish training, learn the rules, pass tests and simulations in a lab and other.
Script it with virt-customize, no labor hours.
nahhh, somebody has to pay.... but yeah, whatever works.
Lawsuit galore!
I doubt it was an intern.
Whatever wrt "it wasn't Windows Microsoft" many won't care and simply try to avoid MS Windows, some will at least try to avoid Crowdstrike - not the corporations, though.
The real problem in my eyes is bloat, almost no discipline in development, too many utterly clueless or careless managers, too little real education, plus waaaaay too much bloat everywhere.
IMO this isn't the worst case - it's but one of many more to come plus it's one that couldn't be hushed up.
@jsg -
Exactely, this is not the first, nor the last, and MSFT is not the only one suffering from it.
As you said, this is a global phenomenon, unfortunately in most / all fields ( especially tech related ), from car makers to cell phone makers.
So true....
Civilization is a little degraded for many reasons, but we have what we have. When about 250 million people play the Hamster game in hope of getting some money, I am not surprised. When Taylor Swift's visit to the UK may increase the GDP by a lot. When a Boeing airplane loses a door in flight. Nice, perfect current world