For the last several days, I've been getting a "gateway timeout" on this Forum, Bookapy, and SOL. It doesn't last long, but it happens multiple times a day.
Is the problem mine?
For the last several days, I've been getting a "gateway timeout" on this Forum, Bookapy, and SOL. It doesn't last long, but it happens multiple times a day.
Is the problem mine?
I've received few such reports. Especially last night on the log in server.
I've been unable to locate the source of the issue. The database servers are running a usual with no particularly high load.
I've hit it a few times as well. It could be a congestion issue at some intermediate node if you aren't seeing any issues on your end.
I experienced unusually long upload times for the next chapter of a story. Problem lasted for an hour or so.
also been getting them for nearly a week. checked 'is it down' always says up. but if I was to guess I'd say something on the web server having a hiccup because of some other site on the same server. this idea at least gels with the variable response rates that are displayed. so if there's a wait for the server in general it could be causing time outs at that point
i suspect it's downstream from the SoL servers as I had it a lot last week but changed my VPN exit into the Canadian Internet to across the other side of the country and it went away.
For the last several days, I've been getting a "gateway timeout" on this Forum, Bookapy, and SOL. It doesn't last long, but it happens multiple times a day.
Is the problem mine?
Nope.
Last night same issue, but it's been occurring on and off for about a week.
On all WLPC sites. Generally getting the Gateway timeout on SOL, other sites have just been very sluggish to respond (but also giving the very occasional Gateway timeout).
For whatever reason, none my instruments are able to detect this issue.
Did anybody experience it this afternoon?
I've seen an issue in the late morning (US CST), but not multiple times per day. But not today, although it was every OTHER day this week. Only once per day, and I figured it was you doing an update.
Did anybody experience it this afternoon?
I haven't experienced it since late last night (Thursday night) right before I went to bed. I checked my Bookapy sales stats and it timed out. When I brought the Bookapy stats up on Friday morning, it made me log back in.
At 7:50 am edt have long loads for next chapter.
This has been happening over several days.
Keep up the good work otherwise
As of a few minutes ago. 11 seconds to get to home page. 10 seconds to get to forums and 14 seconds to load this post. An hour ago, all was quick and normal.
*edit * a half hour later and all is well. Maybe the lag was due to this mornings timed post's hitting the site?
I didn't experience any outage yesterday afternoon, but I experienced a 504 error about 10 minutes ago.
Edit: I experienced another short outage a few minutes after my previous message was posted.
Just had it about 6 times in a row, making about 10 times total, about 10mins ago.
ISTR that when Easynews was having intermittent gateway timeouts, they eventually traced it to one of the backend servers having an intermittent problem
Gateway Time out again here at SOL & SciFi Stories at 06:45 UTC and 45min later was still down.
Just tried again now 0808 UTC and working well.
I have had sporadic problems over the last few days but have not kept a log as to when, your experiences this morning do correspond. They were all using the "normal" address, I only use the alternate name (the one that costs extra and will remain unnamed) on my phone but can't remember any problems with it.
Oh, and I'm in Europe.
The next time it happens I'll try the alternate address on my PC and see if that makes a difference.
So this means the three hour maintenance window in 20 minutes is unrelated? Not what I was hoping for.
The next time it happens I'll try the alternate address on my PC and see if that makes a difference.
I tried both, made no difference. Everything is up again and seems a little more responsive but that could be my imagination.
Everything is up again and seems a little more responsive but that could be my imagination.
this morning I beefed up the database servers and done full maintenance and updates on them. We'll see if that resolves the issue.
Please keep reporting if you face those timeouts.
At present links on the web sites are very responsive, but the forum is somewhat sluggish- clicking on a Topic or thread usually gives an almost instant response. Presently taking about a half second or so for the clicked on link to come up.
clicking on a Topic or thread usually gives an almost instant response.
The forum uses cached pages. Normally, the response is instant as it pulls it out of the cache and sends it to you. But sometimes you hit on a page and its cache has just expired and need to be re-rendered and cached. For a 100+ posts thread that can take a couple of seconds.
2021-09-20T07:53:20Z 504 on /library/todaysAccesses.php (about 6 items)
2021-09-20T07:55:00Z 504 on this thread
2021-09-20T07:55:40Z Successfully loaded this thread
Times are approximate, after link clicked but before page loaded/failed
There was probably another 504 on /library/todaysAccesses.php (I had three pages of Gateway Error displayed) but I don't have a time
Before getting the 504 I had already successfully accessed the both /home.php and library/about-to-be-archived.php on each of storiesonline.net, finestories.com and scifistories.com, and the forum 'All Threads by Date' page and the five updated threads.
Gateway timeout here on SOL & SciFi Stories at 07:55 UTC
OK again at 08:25UTC
I tracked down the problem to the log in server. For whatever reason, it decided to slow down considerably. I changed some software around this morning and it seems to be doing much better.
Hopefully, that fixes it. 🤞
I tracked down the problem to the log in server.
The last time I had the timeout was when I checked my Bookapy sales stats a few nights ago. The next morning it made me log back in and I haven't had the problem since. I don't know if that's related to the problem you found on the log in server.
Well, that was a lesson for admins if there ever was one.
First, the ID/login server has been running very well since I moved to the unified log in page at login.wlpc.com for all the sites.
Suddenly, without any modifications on our end to the server or its software, the sites (all of them) became problematic.
Restarting the main database server seemed to fix it for all the sites, so the thinking was, well, it's the database server. Let's upgrade it and update it.
Did that Sunday morning. With beefier hardware, it seemed to run well. Until 4am this morning that is.
Checking the database server with various tools, I found too many stuck connections from the id server and it was using up most of the connections available.
Investigated the ID server and found a long list of time outs in the logs. Updated the ID server's software and switched one piece for a supposedly much faster one. Time outs persisted.
Finally, examining the time out reports, it was a small number (about 70) of IP addresses getting those timeouts.
Investigating the requests from those IP addresses on the low level, it turned out a single piece of software being used by various companies to keep track if a site is up or not. Their latest release was last week, and since that release, our trouble started. It seems to be sending some malformed requests and acting like a hacking bot.
Blocked that software and so far, there are no stuck connections to the db server.
Hopefully there isn't yet another layer to investigate!
Significant timeouts and slowness earlier this morning (around 1400 UTC). Pages slow/timing out. Timeout trying to login to Bookapy.
I was unable to log in at all this morning (UK time). I entered my username and password and it just sat there.
Since lunch it's been largely ok, just the occasional glitch.
AJ
I can confirm the logon issues morning (CET).
Somebody was trying to hack the log in server. They managed to slow it down quite a bit.
I wondered whether it might be some sort of denial of service attack in response to your anti-page-scraping measures. Pages not requiring login loaded quickly.
AJ
You really have to wonder about people sometimes. It's like someone that would counterfeit $1 bills and grocery store coupons.
Yes. The rest of the time I don't wonder at all. I'm in IT, and I've dealt with ransomware.
No Gateway timeout, but Scifi stories & Finestories are timing out, and here at Stories on Line everything is taking a month of Sundays to happen.
From around 10:20 UTC, now 10:25 UTC and web site & forums still barely functioning.
There are currently other sites too that are having problems. Probably the russians getting angry ;)
From around 10:20 UTC, now 10:25 UTC and web site & forums still barely functioning.
No issues showed up on the servers dashboard at the time of the report. This must have been a network issue with where you are.
From around 10:20 UTC, now 10:25 UTC and web site & forums still barely functioning.
No issues showed up on the servers dashboard at the time of the report. This must have been a network issue with where you are.
Whatever it was, it was only affecting the WLPCo sites. No problems accessing Eastcoast US, EU & SE Asian sites at that time.