GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!
-
-
DDOS from Blakey
-
@ben_lubar E_TRUMP_NOT_BUG
-
Representative screenshot:
-
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Representative screenshot:
Care to explain the significance? 'Cause I don't get it.
-
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Representative screenshot:
Care to explain the significance? 'Cause I don't get it.
There's about 5 pages of Baidu IPs and maybe 1 or 2 TDWTF users every time an instance restart message is posted.
-
-
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
There's about 5 pages of Baidu IPs
Simple fix, then; IP ban Baidu?
Edit: That also explains the OP, whose significance I also didn't get.
Filed under: Use your words, Ben.
-
@Tsaukpaetra said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@ben_lubar I keep hearing him say
'gina
-
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Representative screenshot:
and that means?
it's apparently a representative screenshot but of what?
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
There's about 5 pages of Baidu IPs and maybe 1 or 2 TDWTF users every time an instance restart message is posted.
And why was that harder than posting the screenshot? this post was 10000% more informative than the "representative screenshot" was.
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Filed under: Use your words, Ben.
PLEASE! FOR THE LOVE OF MIKE! USE YOUR WORDS BEN!
-
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
-
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
There's about 5 pages of Baidu IPs and maybe 1 or 2 TDWTF users every time an instance restart message is posted.
So are you going to build a firewall to keep china out?
-
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
s/MIKE/[diety or non-diety of your choice]/
-
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
s/MIKE/[diety or non-diety of your choice]/
-
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
s/MIKE/[diety or non-diety of your choice]/
But does Ben use words of his own?
Only Mike knows, and he's not telling.
-
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
s/MIKE/[diety or non-diety of your choice]/
But does Ben use words of his own?
Only Mike knows, and he's not telling.
-
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
s/MIKE/[diety or non-diety of your choice]/
But does Ben use words of his own?
Only Mike knows, and he's not telling.
-_-
seriously. that's not funny.
not.
funny.
at.
all.
-
@Salamander said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
There's about 5 pages of Baidu IPs and maybe 1 or 2 TDWTF users every time an instance restart message is posted.
So are you going to build a firewall to keep china out?
It will be a great firewall. The greatest firewall. You won't believe how great the firewall will be.
-
@ben_lubar
Man, it's almost like someone should invent a technology called "geobanning". Or, maybe some way to catalog bad requests and then after a certain IP shows up in the log with those bad requests multiple times, to blacklist them in the firewall. You know, ban them after a bunch of failed requests. Hm, there must be a catchy name for such a technology that would make it really popular...
-
Huh. Baidu is the website my Skype account was blasting out to everyone when my Microsoft account was compromised last week.
-
@izzion said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@ben_lubar
Man, it's almost like someone should invent a technology called "geobanning"Man, it's almost as if someone should be able to code a piece of forum software to be able to handle a webcrawler and not fuck itself so hard that it shits out its nose.
This is one step removed from having a public-facing page with
<a class='admin_only_display_else_hidden' href='deletepost.cgi?id=1' onclick='confirm("are you sure?");'>Click here to delete post #1</a>
-
@Lorne-Kates said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@izzion said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@ben_lubarMan, it's almost like someone should invent a technology called "geobanning"
Man, it's almost as if someone should be able to code a piece of forum software to be able to handle a webcrawler and not fuck itself so hard that it shits out its nose.
This is one step removed from having a public-facing page with
<a class='admin_only_display_else_hidden' href='deletepost.cgi?id=1' onclick='confirm("are you sure?");'>Click here to delete post #1</a>That's, uh, kind of how the front page works.
The entire page is cached for most things, so the edit link is just hidden by CSS and displayed if the user has the IS_ADMIN cookie.
The IS_ADMIN cookie doesn't affect actual permissions, though.
-
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
That's, uh, kind of how the front page works.
The entire page is cached for most things, so the edit link is just hidden by CSS and displayed if the user has the IS_ADMIN cookie.
The IS_ADMIN cookie doesn't affect actual permissions, though.
I wonder if cautionary tales like these were ever documented on a site dedicated to showcasing IT fuckups.
The Spider of Doom
Josh Breckman worked for a company that landed a contract to develop a content management system for a fairly large government website. Much of the project involved developing a content management system so that employees would be able to build and maintain the ever-changing content for their site....
Filed under: Hi, Google
-
@Lorne-Kates said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Filed under: Hi, Google
Some day in the not-so-distant future, Googlebot will actually start replying back to the forums that talk about it.
-
@ben_lubar faulty cause, you found the symptom.
The real cause is NodeBB.
-
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@ben_lubar said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
There's about 5 pages of Baidu IPs
Simple fix, then; IP ban Baidu?
Edit: That also explains the OP, whose significance I also didn't get.
Filed under: Use your words, Ben.
I think someone ask about baidu webspider behaviour here before, and it seems their spiders honors robot.txt.
-
@izzion said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Hm, there must be a catchy name for such a technology that would make it really popular...
ban4spam? bot-h8?
I feel like it should have a number in it anyway, for branding purposes...
-
This post is deleted!
-
This post is deleted!
-
@cheong said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
I think someone ask about baidu webspider behaviour here before, and it seems their spiders honors robot.txt.
Whatever these are I don't think they really are. Also, their user agents don't identify them as such.
-
@boomzilla this behaviour is completely cromulent for Baidu.
-
@boomzilla said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Whatever these are I don't think they really are. Also, their user agents don't identify them as such.
If you're relying on useragent alone, you're
- Look at the User Agent
- If they claim to be a bot, do a DNS lookup on their IP
- The hostname will be able to reverse DNS lookup back to the IP
- If everything is kosher, you whitelist the IP as not to have to look it up again
- If the verification fails, you ban the IP.
-
@Lorne-Kates said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
If you're relying on useragent alone, you're
I'm not. I just find it extremely unlikely that the pattern of views from those IP addresses were actually people using those browsers.
Aha! Found the IP Blacklist interface in the admin control panel. New blacklist:
# Baidu bots: 202.46.56.0/23
-
@boomzilla said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Baidu bots:
202.46.56.0/23
But now how will people in China learn about our forum?
-
@Lorne-Kates
Someone will have to start a new Chinesespinoffknockoff site, The Daily Worse Than Firewalls.
-
@cheong said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
it seems their spiders honors robot.txt.
-
@anotherusername It's not difficult to search at all.
-
-
@anotherusername Yup. In one of the replied you linked:
Yandex obeys robots.txt I had them locked out till we realized a good chunk of our business comes from Russia and had to remove the block. Baidu, you have to check the netblocks. Not all Baidu announced UA are actually Baidu so you need to do a robots.txt block for the legitimate Baidu traffic and then do a UA string block in your .htaccess for what remains and then waste your life doing block by block identification and denial for the rest that gets around the UA string block. It's just as much work as just beefing your server up to take the traffic
Also not all webspiders that claims to be baiduspider are baiduspider because some search engine uses that name as user-agent to allow them to get indexing sites in China (nearly no Chinese site will block it since afterall it's the largest search engine provider in China, much like why my Microsoft Edge claims to be Chrome)
Btw, it turns out that you need to block a number of user-agent string to block all baiduspider variants.
-
@cheong those IPs in the 202.46.32.0/19 block are registered to one "ShenZhen Sunrise Technology Co.,Ltd.", organization "Beijing Baidu Netcom Science and Technology Co.". In other words, Baidu.
So unless you can explain to me why that isn't the "real" Baidu, ... well I'm not sure if it matters. There are tons of complaints about that IP range, so just blackhole all the fuckers in it.
-
@anotherusername said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
There are tons of complaints about that IP range, so just blackhole all the fuckers in it.
Yes, we've blacklisted large swathes of Baidu and Yandex at this point. Some of them were identified as bots others were not.
#MakeTDWTFGreatAgain
-
@boomzilla said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@anotherusername said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
There are tons of complaints about that IP range, so just blackhole all the fuckers in it.
Yes, we've blacklisted large swathes of Baidu and Yandex at this point. Some of them were identified as bots others were not.
#MakeTDWTFGreatAgain
Aw, but now we won't have a chance to get Baidu devs to come here and explain their clusterfuck of a spider.
-
@Maciejasjmj said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
Aw, but now we won't have a chance to get Baidu devs to come here and explain their clusterfuck of a spider.
:man1: we made search engine for Glorious Government that returns no results for "Tienanmen Square". That is good happy priority #1. All else is secondary.
-
@Lorne-Kates said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
:man1: we made search engine for Glorious Government that returns no results for "
All is good happy
-
I am simple man. I see shitpost, I downvote.
EDIT: Oh, it was a non-shitpost that looked like a shitpost.
-
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
s/MIKE/[diety or non-diety of your choice]/
Is a diety someone who looks like they're on a diet?
-
@pydsigner said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
s/MIKE/[diety or non-diety of your choice]/
Is a diety someone who looks like they're on a diet?
no. it's what happens when you let accalia try to spell deity.
-
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@pydsigner said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@HardwareGeek said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
PLEASE! FOR THE LOVE OF MIKE!
But we don't really love him; he's such a liar.
s/MIKE/[diety or non-diety of your choice]/
Is a diety someone who looks like they're on a diet?
no. it's what happens when you let accalia try to spell deity.
To be fair, the ways deity is typically pronounced lend themselves to confusion about the spelling.
: i before e
except after c
and when sounded as long a
and also in wierd words
and the deities may do whatever they please
...
Uh, I think that's all.
raises hand
: yes?
: So you spell it D-I-E-T-E-I-S? : I'm retiring
-
@pydsigner said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
To be fair, the ways deity is typically pronounced lend themselves to confusion about the spelling.
to be fair i really should spiel chuck my work more otter.
-
@accalia said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
@pydsigner said in GUYS! I FIGURED OUT WHAT WAS CAUSING THE COOTIES!:
To be fair, the ways deity is typically pronounced lend themselves to confusion about the spelling.
to be fair i really should spiel chuck my work more otter.
Spell check! It works grate!
