Reminds me of the Crowdstrike incident last year.
You must log in or # to comment.
Seems like it.
Reminds me of the Cloudflare incident this year.
And the Cloudflare incident also this year.
Clownflare is going just great.
🔥 Everything is fine 🔥
Reminds me of the Cloudflare incident this year.
And the Cloudflare incident also this year.
Were those as big as this one? Somehow I missed them.
I’m learning about this one right now, so I guess I basically missed this one, too, while being online for hours…
Use cloud services, they said. To prevent outages, they said.
There are a lot of IT departments though that get to throw up their hands and say “can’t fix it, it’s a cloud issue!” and watch as management, who pushed for cloud in the first place, sucks it up because they don’t want to lose face for their decision.
(Yes I know some still get yelled at regardless and told to fix a 3rd party service)
(Yes I know some still get yelled at regardless and told to fix a 3rd party service)
Man I feel this. Once some drunk asshat hit a telephone pole and it killed the fiber line to a call center for the company I worked for. Hilariously the backup Internet was on the same pole… Additionally… It was a hemispherical call center meaning it served everyone in the western hemisphere.
Anyway… All internet was down for the call center for like 8 hours. So no calls were being answered. No orders being placed etc.
Being on the Helpdesk at the time…I took so many “our Internet is down” calls. Which after a couple hours it turned into “fix the internet or I’m calling your boss” lol
Which then turned into “fix the internet or I’m calling their boss”
From my pov it was hilarious.
Someone in upper management got fired for consolidating all the call centers. Then they moved to wireless Internet via cell towers as a backup.
But as we all know. That’s just fiber based at the tower. Lol
So yeah fun times of “go do someone else’s job”
Still to this day idk why it took so long… you’d think an sla would be in place. ¯\_(ツ)_/¯
It’ll be fun, they said.
Your cat won’t die, they said.
@tux0r@feddit.org when cloudflare catch a cold, it’s half the web that is coughing…
and people called me crazy when i said it was a big fat SPOF…“trust is” says marketing.
The world’s richest man can’t even keep his own website up and accessible. But the guys hosting the fedi in their garage are just fine. Lol
tbf, the scales are slightly different
I mean, isn’t that part of the point? Decentralization to smaller systems
He should be able to afford a lot more redundancy than our garage hosters.
The scale makes it more embarrassing, not less.
Can I rent some space in your garage?
Lemmy.ca was down
Oh man, these global outages are really getting out of hand. A few days after the recent AWS and Azure outages, I suddenly noticed that I couldn’t reach certain webpages anymore. And I genuinely didn’t even bother trying to debug, because I just assumed that it’s another global outage.
In the evening, I did look into it and noticed that my router was at fault (presumably DNS got bugged by a recent update). That was just wild to me, that I genuinely deemed it more likely that several major webpages went offline together than that my home setup is fucky.
To be fair, it’s never DNS ;]
To be fair, it’s never DNS ;]
Sometimes it’s BGP.
Well yeah. Yourrouter is managed by a person. We aren’t as good at fucking up as mega corps.
I mean, sure, I do understand what’s happening on a logical level. I’m just so baffled, because this whole internet thingamabob was architected by the military.
It was intentionally built, so that parts of it could fail without disrupting the rest. When a corporation fucks up, it was supposed to take down the servers of that corporation, not also a good chunk of the rest.But unfortunately, this internet thingamabob is merely the closest approximation we have for the “perfect market” that economics theory calls for, so it still doesn’t actually self-regulate like that whole theory would love to believe.
In fact, it is so much worse, because now monopolization happens across the whole planet. Particularly also because we don’t have a functioning “world government” that could enforce competition at that level via laws.So, the network leads to companies monopolizing on top of it and then monopolies necessitate that the respective companies do as poor of a job as possible, because this reduces costs and increases profits. As a result, major parts of this military-grade internet now falter every few weeks.
Yep. The resilient system got corrupted by capitalism, which is an inherently monopolizing centralizing destabilizing enshittifying exploitation algorithm.
Are they vibe-coding or something?
Either that or DNS :)
Or BGP
Probably
There’s some malicious satisfaction watching centralized internet burning in dumpster fire while your self hosted stuff is still up
Except many of us use cloudflare tunnels to reach our selfhosted kit from the internet because we’re behind CGNATs…
hell yea
Never replace your code monkeys with clankers, boys.
Yes. All my fedi services are still happy tho :)
Most Lemmy images stopped working. And maybe what my server is showing me in terms of posts is just what it still has stored.
Edit: My server is actually much more responsive with most of the big Lemmy instances being down. I really hope 1.0 brings great improvements.
Piefed.ca
iswas down because of it :( Edit: it’s back online!
maybe if big tech stopped firing all their engineers and investing in ai, this could have been prevented.
No, sorry. Shareholder value. Gotta keep the bubble inflating.
Cloudflare is increasingly a SPOF for the web
It’s hilariously probably at the point where it’s beneficial for them from a PR perspective to recommend alternatives to new customers now
They are half the internet.
The age old question: was it DNS or LLM?
Gonna be a run day at work today
Damn, I really shouldn’t have trusted cloudflare tunnel. All my selfhosted servers are inaccessible… It’s running behind traefik so no ports are open.
VPS+VPN (WireGuard for me), with Tailscale as an emergency alternative, has worked very well for me. Knock on wood the only outages have been my own fault.
Do you have VPS recommendations? I searched for a bit on Lemmy and found out Vultr might not be a good option (they sell your data).
Sadly not really. I use the free tier Oracle, which honestly has worked very well, but I’m not going to recommend using Oracle aside to say that it functionally works for me.
If I were to switch I would probably go to racknerd.
Weird. Didn’t notice because Cloudflare blocks my real user traffic because I have the audacity to use a VPN and Firefox with privacy extensions that block like maybe two of their arsenal of fingerprinting tools.
