Pages:
Author

Topic: Huge site outage! - page 2. (Read 782 times)

legendary
Activity: 2954
Merit: 1159
October 12, 2023, 04:24:36 PM
#47
This morning, I got worried when I noticed an unusual delay that took hours and different than previous time where it took only few minutes. I texted some friends and tried using different devices thinking the issue might be only on my device or my home network. But after checking websites like isitdownrightnow, I discovered that the problem is with everyone. In my opinion this is a serious issue, and even the administrators here are not aware of the main reason and why it took longer this time. I'm wondering if the problem is related to Cloudflare or the hosting servers, and I believe the hosting company can provide an answer for this error and suggest ways to prevent it.
 Some of us can't live without Bitcointalk for even few hours LOL!

Luckily or unluckily (don't know what to call it), I did not experience this big outage today and the reason for this was that I wasn't online on bitcointalk at this moment.

However, i know that these days we often experience outages in bitcointalk, the previous recent one was experienced by me when Re: Bitcointalk was down .

It is true that we cannot live without bitcointalk but what worries me is that theymos is also not sure why the forum is facing too many of these downtimes recently.
It was the same weird thing which caused a few hours of downtime 6-12 months ago, and I think it's what causes the few minutes of downtime people observe every few weeks. I've never been able to figure out what causes it.
legendary
Activity: 2030
Merit: 2173
Professional Community manager
October 12, 2023, 03:45:14 PM
#46
In my opinion this is a serious issue, and even the administrators here are not aware of the main reason and why it took longer this time. I'm wondering if the problem is related to Cloudflare or the hosting servers, and I believe the hosting company can provide an answer for this error and suggest ways to prevent it.
The hosting company will not be providing an answer to what caused the downtime or ways to prevent it.
It is impossible to have a website or app with zero downtimes, but when it last as long as 2-3 hours then it is a problem that you will not want to repeat itself.

Hopefully the update on the server end will be able to fix whatever issues that caused the downtime.
hero member
Activity: 756
Merit: 607
October 12, 2023, 03:02:01 PM
#45
This morning, I got worried when I noticed an unusual delay that took hours and different than previous time where it took only few minutes. I texted some friends and tried using different devices thinking the issue might be only on my device or my home network. But after checking websites like isitdownrightnow, I discovered that the problem is with everyone. In my opinion this is a serious issue, and even the administrators here are not aware of the main reason and why it took longer this time. I'm wondering if the problem is related to Cloudflare or the hosting servers, and I believe the hosting company can provide an answer for this error and suggest ways to prevent it.
 Some of us can't live without Bitcointalk for even few hours LOL!
legendary
Activity: 3332
Merit: 6809
Cashback 15%
October 12, 2023, 02:53:02 PM
#44
I was online at that time and I was waiting boringly for almost an hour, pressing the refresh button LOL. It was fully down in everywhere.
Years ago I probably would've been in the same boat, eager to see what kind of drama was playing out or browsing the Speculation section during one of the raging bull markets.  Maybe it's a change in attitude or enthusiasm or the state of the forum, but while I did in fact notice that bitcointalk was down for a lot longer than it normally goes down for, I just got up from my busted-up chair, stretched my legs, and went for a bike ride.

That was hours ago, and *yay!* we're back.  I don't know much about cloudfare, but I thought there might be some kind of DDOS attack (and if that were to happen, some other screen would probably show up, right?).  So let's get back to the fun and games, kids.
legendary
Activity: 1722
Merit: 5937
October 12, 2023, 02:11:30 PM
#43
Maybe they are working on adding new 2FA forum patch, but I am just speculation and hoping for this Wink
Hah that would be great but unfortunately that wasn't the reason for this and it looks like even theymos is not really sure why that keeps happening every once in a while.

It was the same weird thing which caused a few hours of downtime 6-12 months ago, and I think it's what causes the few minutes of downtime people observe every few weeks. I've never been able to figure out what causes it. It looks like the network gets cut between the web server and the database for a while. It seems to always happen at around the same time, so I suppose it's probably some automated maintenance process messing something up, but I don't have anything running at this time, so I wonder if it's something in the web-host's networking infrastructure, or something like that. It's difficult to diagnose, since it happens rarely, and usually when I'm sleeping.
legendary
Activity: 2212
Merit: 7064
Cashback 15%
October 12, 2023, 02:06:18 PM
#42
It's a good thing that admins were at hand and got the servers back online. But may I ask what was the cause of the outage in the first place?
Maybe they are working on adding new 2FA forum patch, but I am just speculation and hoping for this Wink

I think something strange is also happening with cloudflare, today I got a message that I am in some waiting line and that I have to wait for one minute to continue to website... don't know if this is related or not.

I was online at that time and I was waiting boringly for almost an hour, pressing the refresh button LOL. It was fully down in everywhere.
Crazy!

It's difficult to diagnose, since it happens rarely, and usually when I'm sleeping.
Gremlins attack Wink
copper member
Activity: 1526
Merit: 2890
October 12, 2023, 01:59:55 PM
#41
It was the same weird thing which caused a few hours of downtime 6-12 months ago, and I think it's what causes the few minutes of downtime people observe every few weeks. I've never been able to figure out what causes it. It looks like the network gets cut between the web server and the database for a while. It seems to always happen at around the same time, so I suppose it's probably some automated maintenance process messing something up, but I don't have anything running at this time, so I wonder if it's something in the web-host's networking infrastructure, or something like that. It's difficult to diagnose, since it happens rarely, and usually when I'm sleeping.

Ok so theymos made the "I" bold... "I don't have anything running at this time"... does it mean someone else have been running things but theymos don't want to name him Cheesy

This reminds me of working on one project where daily backup of the database used to take ages (3-4 hours) and during this time no one was allowed to run any thing on the server. But as soon as we use to start backup someone will run some other tasks on the server everyone in db team started running around and asking who's running that? who's doing this? and everybody will be like... no I didn't run anything, but we knew who's doing that Cheesy

(The few minutes of downtime just now was due to me doing something, and is unrelated.)

So for those few minutes of downtime you caused, hey, we all have our moments, right? At least we can blame that on you.

Anyway thanks for keeping the ship sailing, even when those rare downtimes. We appreciate your hard work!

I'm planning on upgrading the main servers sometime in the next few months. (Just as part of standard maintenance: there will be no user-visible changes other than perhaps slightly improved speed.) Maybe that'll fix it just by virtue of moving things to different areas.

Also it's great to hear you're planning an upgrade in the moving things around might just be the secret sauce to overcome the mysterious downtime.  And "slightly improved speed" – it's huge, every millisecond counts in the bitcoin world!

"there will be no user-visible changes" yeah thank you, but when? When there will be user-visible changes Smiley

hero member
Activity: 1414
Merit: 915
🇺🇦 Glory to Ukraine!
October 12, 2023, 01:30:39 PM
#40
Theymos just forgot to pay the bills this month. Better make sure to remind him to set some reminders.

What?
Could this be the cause of the shut down and how does he generates money to pay the bill?

Calm down, It was just a joke!

I'm sure that the forum has enough money to keep running for a very long time. Even theymos said so when he disabled forum advertising.
legendary
Activity: 2464
Merit: 2094
October 12, 2023, 12:24:28 PM
#39
So far downtime has happened very often, but today I felt something different. The downtime is too long and it has made me wait more than 1 hour and keep trying to log in in various ways. I checked ninjastic to see if it was just a mistake on my part, but apparently there were no new posts at that time.

I returned after a few hours, thankfully it was back to normal. To be honest I was really hoping the forum would get back to normal quicker as usual, but I was wrong as it seems the recovery happened after 3 hours. Something needs to be done and I'm excited about the improvement plans theymos just announced.
legendary
Activity: 2828
Merit: 6108
Jambler.io
October 12, 2023, 10:46:09 AM
#38
It's difficult to diagnose, since it happens rarely, and usually when I'm sleeping.

Do you see a pizza or Fedex van outside?
If so then we can safely say that one of the three letter agencies is grabbing up the data  Cheesy






hero member
Activity: 616
Merit: 713
Don't joke with my Daughter
October 12, 2023, 10:25:28 AM
#37
Forum outrage happening quite frequently, today might be the longest one. Glad to see it is back and running smoothly.

There was also (a brief) one yesterday and another on October 8.

Though I didn't experienced that of yesterday and on 8 October as well, todays own took longer time and was pissed off since I am more closer to this forum than any other social media today. Most times I don't finds it interesting visiting other site except here and I am really gaining lot of knowledge here, well does this means the forum can shut down anytime without properly being handled and why is it always happening like this please don't be mad at my questions.

Theymos just forgot to pay the bills this month. Better make sure to remind him to set some reminders.

What?
Could this be the cause of the shut down and how does he generates money to pay the bill?

Edit..

It's difficult to diagnose, since it happens rarely, and usually when I'm sleeping.
Could it be a witch somewhere is always monitoring you when sleeping to attack the forum?
Never mind my jokes 😂
hero member
Activity: 1624
Merit: 791
Bitcoin To The Moon 📈📈📈
October 12, 2023, 09:56:55 AM
#36
Just realized now that this afternoon the forum experienced downtime, because I felt that at that time I was not accessing the forum because of other activities. Cheesy

This has happened before, I wouldn't be surprised by this downtime, everything will return to normal after a few hours.

I'm planning on upgrading the main servers sometime in the next few months.
Want to see what happens after upgrading the server, for now we will continue as normal?
hero member
Activity: 798
Merit: 669
October 12, 2023, 09:30:59 AM
#35
Whenever there is a site downtime, I don’t really panic too much about it because this is not the first time and whenever it happens, it always come back after some time. The only problem is that, you can’t tell when the site will go off and when it’ll be back.

I'm planning on upgrading the main servers sometime in the next few months. (Just as part of standard maintenance: there will be no user-visible changes other than perhaps slightly improved speed.) Maybe that'll fix it just by virtue of moving things to different areas.

I hope this solves the problem when done. I believe this have made many users scare out on what could have been the case of the forum that it’s facing downtime for too long and more often unlike before.
legendary
Activity: 2702
Merit: 2645
Farewell LEO: o_e_l_e_o
October 12, 2023, 09:27:00 AM
#34
I'm planning on upgrading the main servers sometime in the next few months. (Just as part of standard maintenance: there will be no user-visible changes other than perhaps slightly improved speed.) Maybe that'll fix it just by virtue of moving things to different areas.
We hope we will expect a better experience than now. Thanks for coming in and writing a few words. I was logged in again when the latest downtime occurred.

I'm feeling disappointed now.  Sad
i think the plan for the upgrade is because of this unknown downtime accoutred a few times in the past.
legendary
Activity: 1568
Merit: 2581
Top Crypto Casino
October 12, 2023, 09:20:28 AM
#33
I'm planning on upgrading the main servers sometime in the next few months. (Just as part of standard maintenance: there will be no user-visible changes other than perhaps slightly improved speed.)

For a brief moment there, you had me wondering where this was going. LOL!

I'm feeling disappointed now.  Sad
hero member
Activity: 700
Merit: 521
October 12, 2023, 09:15:26 AM
#32
Having this kind of experience is not the first time on the forum and this is when it undergoing some maintenance, but as OP have noted, this does not happened today alone, also some other networks were also affected as well that the internet became inaccessible, there are many reasons to have caused such outage which are beyond our own knowledge, though we had some people releasing circulars some fews weeks ago that the whole internet is going to be shut down between 10th and 11th of October 2023 which something like that eventually happened, i hope everything that is all about this maintenance or development should be in our favour, both on this forum and on the general use of the internet.
administrator
Activity: 5166
Merit: 12850
October 12, 2023, 09:10:36 AM
#31
It was the same weird thing which caused a few hours of downtime 6-12 months ago, and I think it's what causes the few minutes of downtime people observe every few weeks. I've never been able to figure out what causes it. It looks like the network gets cut between the web server and the database for a while. It seems to always happen at around the same time, so I suppose it's probably some automated maintenance process messing something up, but I don't have anything running at this time, so I wonder if it's something in the web-host's networking infrastructure, or something like that. It's difficult to diagnose, since it happens rarely, and usually when I'm sleeping.

I'm planning on upgrading the main servers sometime in the next few months. (Just as part of standard maintenance: there will be no user-visible changes other than perhaps slightly improved speed.) Maybe that'll fix it just by virtue of moving things to different areas.

(The few minutes of downtime just now was due to me doing something, and is unrelated.)
hero member
Activity: 784
Merit: 544
October 12, 2023, 08:37:05 AM
#30
My issue is why it constantly occurs and had there has been no way of solving it. It's a Ddos attack and it's quite disturbing. Imagine being unable to access the forum for about three hours! Is this the longest or are we going to see more
You probably weren't here just before the forum started using Cloudflare DDoS protection. The outages were far more frequent, and sometimes the forum would load so slowly for hours. What happened today was one of a kind in a long time.

However, I have noticed that the frequency of the DDoS attacks seems to be on the increase once again. But this happens to other sites too from time to time and not just Bitcointalk
Today's outage actually took a longer time than expected, judging from the previous downtime that I have experienced here, I almost lost hope of posting today, coming back several times to check and noticing that the issue was not yet resolved. The issue with this outage is that it usually took us unaware without prior information on what is going on with the site until the restoration.

Good to have the site back.

legendary
Activity: 2702
Merit: 2645
Farewell LEO: o_e_l_e_o
October 12, 2023, 08:35:32 AM
#29
I was online at that time and I was waiting boringly for almost an hour, pressing the refresh button LOL. It was fully down in everywhere.




Theymos just forgot to pay the bills this month. Better make sure to remind him to set some reminders.
Need automatic bitcoin payment setup.
hero member
Activity: 2072
Merit: 603
October 12, 2023, 08:35:07 AM
#28
Great, I thought it was my end that broke the connection. Anyways this is not the first time this happened but after a long wait I started to break down myself whether it’s my end deal or what. Tried checking from different connections also.

If this is response to DDos attacks then is it a mechanism to save the data from blowing up OR is itself a problem within our servers?

Just curious whether this is a wake up call for the admins to make the site more protected from such attacks? I think we need to bring up the discussion of adding 2FA one more time.  Tongue



Edit:

Ahh wait just checked the tweet sneak peak from @EarnOnVictor, it seems we fried some hardwares. Hmm.
Pages:
Jump to: