Moar Cooties
-
Also:
-
-
@Tsaukpaetra said in Moar Cooties:
Am I being used for connectivity checks now?
I think you count as a good bot. Or at least a better one than @obeselymorbid (in terms of your access pattern…)
-
@Tsaukpaetra Might as well. If those notifications aren't coming in, chances are good WTDWTF is broken. Or you have "read" everything (which amounts to the same thing).
-
-
Is there anything else misbehaving (besides @Tsaukpaetra and @obeselymorbid)? I'm still getting the connection lost toasters.
-
@HardwareGeek The cooties do appear to be continuing.
-
@Erufael Memories of .
-
-
-
-
Dammit, now I got this stuck in my head so you can share in the "fun":
https://www.youtube.com/watch?v=dTAAsCNK7RA
At least the single-take music video is still as impressive and silly as before.
-
@JBert said in Moar Cooties:
Dammit, now I got this stuck in my head so you can share in the "fun":
https://www.youtube.com/watch?v=dTAAsCNK7RA
At least the single-take music video is still as impressive and silly as before.
-
Yes.
-
-
@loopback0 yeah there was a bunch of this going on earlier and I was looking to see if I could figure out why.
NARRATOR: He didn't.
At least it wasn't an obvious bot rampaging around the system.
-
Also, it's not a particular instance that keeps going down. It's a bunch of them. So...I guess there's some post around here that's causing problems as opposed to some misbehavior.
Maybe @ben_lubar can use some of his black magic to figure out which one?
-
@boomzilla said in Moar Cooties:
I guess there's some post around here that's causing problems
-
@boomzilla said in Moar Cooties:
Also, it's not a particular instance that keeps going down. It's a bunch of them. So...I guess there's some post around here that's causing problems as opposed to some misbehavior.
Maybe @ben_lubar can use some of his black magic to figure out which one?
If I knew how to do that, I'd fix the source of the problem.
-
@ben_lubar said in Moar Cooties:
how to do that
Shirley there's logging of 500 errors () or stack traces () or memory dumps ( ) of when the crashes occur?
-
@Tsaukpaetra said in Moar Cooties:
@ben_lubar said in Moar Cooties:
how to do that
Shirley there's logging of 500 errors () or stack traces () or memory dumps ( ) of when the crashes occur?
Unfortunately, NodeBB runs as a single process (or, in our case, 8 processes) so we have no way to know which topic or post or even input to the composer is breaking it.
-
@ben_lubar said in Moar Cooties:
@Tsaukpaetra said in Moar Cooties:
@ben_lubar said in Moar Cooties:
how to do that
Shirley there's logging of 500 errors () or stack traces () or memory dumps ( ) of when the crashes occur?
Unfortunately, NodeBB runs as a single process (or, in our case, 8 processes) so we have no way to know which topic or post or even input to the composer is breaking it.
In theory (if there were such things as the above) a pattern would emerge, such that it wouldn't matter if it was a single process or a million...
-
@Tsaukpaetra said in Moar Cooties:
@ben_lubar said in Moar Cooties:
how to do that
Shirley there's logging of 500 errors () or stack traces () or memory dumps ( ) of when the crashes occur?
We have a watchdog process that kills the node process when it stops responding for a while. Then it's automatically restarted. So there isn't any sort of useful logging for these situations. It takes longer to wait for the process to run out of memory, making the forum that much less responsive.
-
@boomzilla said in Moar Cooties:
kills the node process
Is there no command to take a snapshot of the process (ie simulate a crash) before doing so? I can't be the first person ever to have these sorts of ideas...
-
@boomzilla said in Moar Cooties:
@boomzilla said in Moar Cooties:
Something called
centurybot9
was not playing by the rules and seemed to be causing a lot of automatic restarts. It's now in thebad-bots.conf
file.Also
mj12bot
.
-
@ben_lubar
select * from posts where post_text like '%U+0018%'
-
@Tsaukpaetra said in Moar Cooties:
@boomzilla said in Moar Cooties:
kills the node process
Is there no command to take a snapshot of the process (ie simulate a crash) before doing so? I can't be the first person ever to have these sorts of ideas...
Unfortunately, crash dumps haven't been especially useful in the past.
We've tried this, and even tried giving the NodeBB container enough kernel permissions to run gdb within it.
-
Is WTDWTF slow for everyone else or is it just me?
-
@JBert The site looks like NodeBB, but feels like Discourse.
-
@mott555
We're under a DJOS attack! :ohnoes:
-
-
I don't see a bot attack. However, there is a large amount of activity from an IP coming from...the IRS (!?!). It's repeatedly loading the same two URLs.
They're blocked now, so hopefully that will help.
-
-
@boomzilla said in Moar Cooties:
However, there is a large amount of activity from an IP coming from...the IRS (!?!).
Hmm... I think @Karla mentioned working for a government agency or something...
They're blocked now
Will miss her.
-
Even though @Karla is no longer here it seems like cooties are still running around.
-
@lolwhat said in Moar Cooties:
@boomzilla said in Moar Cooties:
two URLs
Which ones
Nothing that made any sense. One was a group and another was some random thread. It's still requesting them every few seconds but now they're getting
403
s.@Gąska said in Moar Cooties:
Hmm... I think @Karla mentioned working for a government agency or something...
Not a registered user. And she definitely doesn't work for the IRS.
-
Watching
top
I see lots ofpostgres
activity (high CPU). Dunno if that's normal. But maybe we need to vacuum some indexes or whatever you're supposed to do with it?But it's different than our normal cootification where we get RegexDoS'd and node processes eventually run out of memory or get capped by the watchdog (which hasn't happened for a while now as I write this).
-
You can see the effect of booting the revenuer:
-
The site works fine within a single tab once it loads, but loading a new tab or window takes 2 - 3 minutes initially.
-
@mott555 not my experience. The site just stops responding and I get disconnected toasters. But I'm on mobile, so maybe that's why it's different.
-
@mott555 said in Moar Cooties:
The site works fine within a single tab once it loads, but loading a new tab or window takes 2 - 3 minutes initially.
It's often slow for me when I click on unread or recent.
-
@mott555
You have a crazy definition of "works fine", since clicking on to go back to the main page (which is effectively /recent) is slow
-
@izzion That works just fine as long as I don't do it in a new tab. It's like it takes forever to get a WebSocket going, but once that's connected, everything's peachy.
-
@mott555
I thought we banned people from Earth-74
-
@izzion said in Moar Cooties:
@mott555
You have a crazy definition of "works fine", since clicking on to go back to the main page (which is effectively /recent) is slowI'm seeing the same thing, takes minutes. Weirdly I got a notification toaster half-way through waiting for the page to load.
-
@izzion How do I identify which Earth I'm on? That seems like good information to have.
-
@mott555 said in Moar Cooties:
@izzion How do I identify which Earth I'm on? These seems like good information to have.
You didn't cut off the label, did you?
-
@mott555 said in Moar Cooties:
@izzion How do I identify which Earth I'm on? These seems like good information to have.
Make an account here: https://meta.discourse.org
Tell us about your experience.
-
@boomzilla Fun fact, that is the only website I've ever been banned from.
-
@JBert I think the label was covered up by the new Missouri Ocean.