Readit News logoReadit News
Posted by u/neverrroot 2 years ago
Ask HN: Why is HN so often down?
It's daily now, that I'm seeing "We're having some trouble serving your request. Sorry!", maybe even 10-20 times during different times.

From Europe, especially during the lunch break hours, HN is down again and again. For instance as of the past 30 minutes, I see the above message more often than the expected pages. It's been like that also yesterday, the day before that.

I understand that this happens often based on searching, but I don't remember having it that often in the past.

Honest question: what happens, why do we get that message, especially during these times? Is there something that is going on the the early AM hours in the US? Maintenance work maybe?

Edit based on some comments below:

  - could it be this has to do with being logged in or not? I will try to stay less often logged in.
  - dang wrote: "but for those who are comfortable logging in and out: HN gets a lot faster if you log out, and it will reduce the load on the server if you do" (source: https://news.ycombinator.com/item?id=38309611)
  - another reason could be rate limits, especially if not logged in
  - rozenmd is monitoring HN, that looks awesome: https://hackernews.onlineornot.com/
  - "Did you post something negative about Google/DEI? Or maybe just upvote it? Or skim one of those threads. There you go. Time out for you." <---- this is particularly disturbing IF TRUE

shdon · 2 years ago
I've been frequenting this site daily for over 15 years now, and I don't think I've had error messages more than a handful of times in that decade and a half. Today was indeed one such time - which is what triggered me to check out this particular post. But at least in my experience it's not what I'd call "often". Maybe you're just very unlucky, or perhaps I'm extremely lucky... Who can tell?
rozenmd · 2 years ago
I've been keeping track, it goes down often (checking from US East, US West, Japan, Australia, and NL)

https://hackernews.onlineornot.com/

here's what it looks like on the monitoring side:

https://x.com/RozenMD/status/1763152885892727188?s=20

(HN is slightly more stable if you're logged out)

voytec · 2 years ago
I believe it's just a virtual machine and IP addresses are not anycast; no need to check from multiple locations when you can reach the host and the issue is in it returning HTTP 5xx.
eterm · 2 years ago
Do you have a longer term graph please?
eterm · 2 years ago
For the past couple of months I've had these errors multiple times a day, it's definitely often down now.
neom · 2 years ago
Months? I'd say I'm mildly addicted to HN and I noticed this week it was hit or miss, but only this week. Very surprised to hear you say months.
7thaccount · 2 years ago
I get it happening every few weeks for a short amount of time it seems. More so recently (also been a site user for approximately 10 years).
gpderetta · 2 years ago
I had never seen it for more than a decade, but in the last couple of years it has become very frequent.
acheron · 2 years ago
Maybe somebody bumped the desk: https://news.ycombinator.com/item?id=23472870

Dead Comment

sph · 2 years ago
It is not often down, but it's very easy to hit its rate limiter when upvoting or commenting. Waiting a minute usually fixes it.

The rate limiter is even stricter when not logged in — for a period I wanted to take a break with getting into online arguments, so I stayed logged out, which would cause my IP to be banned after a day or two (a bit annoying, though easily unbanned with the self-service system: https://news.ycombinator.com/item?id=4761102) — IIRC dang confirmed that it would be better to stay logged in to avoid this anti-bot measure.

I guess that's the price to pay to have such a popular website that's maintained by a single person.

bakugo · 2 years ago
I really wish the rate limit was relaxed when favoriting posts specifically. Favoriting a post counts as two requests since it redirects you to another page, so you'll often hit the rate limit page while favoriting, but the favorite still goes through because only the redirected request gets rate limited.
lukan · 2 years ago
"I guess that's the price to pay to have such a popular website that's maintained by a single person."

Why do you think, it is only one? There is definitely help with the moderation for example.

EchoChamberMan · 2 years ago
I can't find the source, but there is an article that mentions the entire site is moderated by 2 people. Maybe they've added a third since then.
w-m · 2 years ago
I've had that same message a couple of times over the last few days, while logged in (EU).

It's kind of expected behavior when there's a thread with thousands of comments (like when OpenAI shafts their CEO [0]), but the last few days seemed relatively calm.

So maybe the server is crumbling under the increase in traffic from higher HN rankings in Google [1]?

[0]: https://news.ycombinator.com/item?id=38310213

[1]: https://news.ycombinator.com/item?id=39423949

nottorp · 2 years ago
It was down for me a bit today.

But it's a great free service with no tracking/ads so I'm fine with that.

TrueGeek · 2 years ago
I agree it's a great free service and I've rarely seen downtime, but as a nitpick:

The posts for YC backed companies that are hiring (where the comments are turned off) are ads.

nottorp · 2 years ago
I believe most regulars know who our sponsors are :)

If you put it that way, the whole site is a giant ad for Y Combinator. It just happens to be a public service too.

It's also one of the few sites* i frequent where uBlock Origin says it's not blocking anything.

* Tbh the only other is Ars Technica, and there only because I'm logged in as a paying customer.

prmph · 2 years ago
I'm in Ghana, and can confirm that I'm seeing this a lot recently. Sometimes the problem persists even after multiple refreshes.

I'm almost always logged in, and it happens even when I have not visited HN in some hours.

krisbolton · 2 years ago
I've noticed it too - also in Europe. It could be a result of increased traffic from a recent Google search algorithm update which increased HN's ranking significantly. I understand HN infrastructure isn't enormous, so it would make sense. HN ranking discussion here - https://news.ycombinator.com/item?id=39423949
nubinetwork · 2 years ago
Dang said they're working on it, I presume they are upgrading the hardware soon or something... (edit: in any case they are aware and it hopefully shouldn't be an issue long term)
vsnf · 2 years ago
He’s also been saying that for years, so.
cutemonster · 2 years ago
Maybe they have improved performance but traffic increased even more?

There was this recently:

A steep rise of Hacker News in Google rankingshttps://news.ycombinator.com/item?id=39423949

codingdave · 2 years ago
Traffic has been increasing for years, so a multi-year "working on it" effort is probably a good thing - it shows an ongoing effort to size the resources to the level needed at the time, and adjusting as times change.
OJFord · 2 years ago
Is that a reason to believe it less? You can also see from hiring threads that it's a very small (but growing) team and that inherently it is truly being worked on.
tutfbhuf · 2 years ago
Hence, I would conclude that he is working on it for years.

Deleted Comment

zild3d · 2 years ago
Traffic has probably been going up for years..
silverquiet · 2 years ago
I was under the impression that a lot of the code is single-threaded and so throwing hardware at it won't do a whole lot.
therealdrag0 · 2 years ago
Sheesh. Isn’t this the easiest type of application to just cache the reads and queue the writes, then you can scale horizontally easily.
nojvek · 2 years ago
Same, it seems HN is getting more traffic but hasn't been keeping up with the load.

Which is interesting because YC has funded many infra companies.

I usually browse through hn.algolia.com and that has a much higher uptime than news.ycombinator.com

In 2024, it is surprising how often HN is unavailable.

rezonant · 2 years ago
It's still just one old server. Which itself is impressive, but with the search indexing changes maybe not enough anymore?