coming soon: spam killing!

Red Squirrel · Post by **Red Squirrel** » Thu Jan 06, 2005 9:50 pm

I'm sick and tired of those stupid "free ipod" crap and other scams so I'm working on a spam detection system that will detect spam posts. Very easy since all spammers seem to follow specific patterns and keywords that I just need to look for. When a positive is found, the user is banned, the post is put in the moderation queue, an alarm is sent to my alarm system, and an email in my inbox telling me of the new alarm. I will let you guys know once the system is implimented. This won't really affect what you can say in posts due to the nature of how it will work and lot of other details.

Oh and here's how it will look like to get Pwn3d by the system:

- user enters post (reply or new topic)
- user hits submit
- user get's blank page with a message saying he is classified as a spammer and to check back later if it's a false positive
- user may attempt to use a different IP, apon doing so, will realize he is banned
- at the admin end, the post will be in the moderation queue and if it really is spam then the IP will be sent to blacklist sites, and I will probably set a subnet rule to track down activity on that subnet for a while.

This system should be very sophisticated, I'm just not sure how accurate it will be, I will have to do tests on my local server. There's a problem that hopefully I can fix with help of IPB support on the database end but other then that it's working well. It's really easy to add/modify rules as it's a seperate files with a bunch of if(stristr()) statements.

So if we get spam in the next few days, it will probably be the last.

Archived topic from Anythingforums, old topic ID:1616, old post ID:21515

Red Squirrel · Post by **Red Squirrel** » Fri Jan 07, 2005 3:31 pm

I should have this fully implimented very shortly! Man this system is slick. I'm trying it on iceteks first then I'll put it here, but I'll make it use the same ruleset.

Archived topic from Anythingforums, old topic ID:1616, old post ID:21565

Red Squirrel · Post by **Red Squirrel** » Fri Jan 07, 2005 9:05 pm

Fully implimented.

IB 2.0 is odd though, could not figure out how to make it so the posts go in the moderation queue, so they are just lost. The message that pops up is like this: "You have been classified as a spammer. We apologize if this is a mistake. Your post was not successfully stored in the moderation queue for checking, due to an unfortunate accident."

Archived topic from Anythingforums, old topic ID:1616, old post ID:21588

Cicero · Post by **Cicero** » Sat Jan 08, 2005 6:56 pm

So what words should we avoid? Or does it have to be certain words in a sequance?

EDIT: And what would happen if you typed up a spam post. Would you sorta ban yourself automatically?

Sorry bout that, I'm just curious now.

Archived topic from Anythingforums, old topic ID:1616, old post ID:21645

Chris Vogel · Post by **Chris Vogel** » Sat Jan 08, 2005 7:06 pm

Cicero wrote: So what words should we avoid? Or does it have to be certain words in a sequance?

EDIT: And what would happen if you typed up a spam post. Would you sorta ban yourself automatically?

Sorry bout that, I'm just curious now.

I think Red said that only new members would be affected.

Thanks for the hard work, Red!

I have never really had a problem with removing spam manually, but it’s neat to have a system that does it automatically.

Archived topic from Anythingforums, old topic ID:1616, old post ID:21647

Red Squirrel · Post by **Red Squirrel** » Sat Jan 08, 2005 7:13 pm

Well the system can be fooled both ways (make it think non spam is spam, and vise versa) because it mostly goes by keywords and some well known spammer patterns/word sequences but in general it should catch most spam, and yes it only applies to new members, since 99.9% of spammers do it on their first post. I could use advanced measures to make sure people don't spam l i kek he hthis but did not bother since it would be really hard on the server. (tried it with my email server, crashed the thing).

Basically if you have been a member for a while you can easly get away with stuff like call now! 1-290-424-4244 for free ipods and viagra! FREE! FREE FREE!!!

But that sentance alone would probably be enough to get banned on the first post.

Problem here is that there's no way to make posts go in the moderation queue but in 1.2 which I use at iceteks posts go in the queue so I check to ensure it's spam, if it's not I let it through and unblock the person.

Archived topic from Anythingforums, old topic ID:1616, old post ID:21648