Spam filters and mailbox usage

It’s no secret that I run very little in the way of spam filters, and what filters I do run don’t throw away mail, they just shove it into various mailboxes.
Looking at my mailboxes currently I have 11216 unread messages in my mail.app junk folder, 10600 unread messages in my work spam assassin folder and 29401 messages in my personal spam assassin folder (mail getting more than +7 on our version of spam assassin gets filtered into these folders). I went through and marked all of my messages read back in mid-January. That’s a little over 50,000 messages in a little over 5 months or slightly more than 2700 spams a week.
But these are messages I don’t have to deal with so while they’re somewhat annoying and a bit of “wow, my addresses are everywhere” they’re not a huge deal. I have strong enough filters for wanted mail that I can special case it.

Spam in a mailbox makes it harder to find wanted mail.

I use tagged addresses whenever I sign up for something. This means I can identify and separate senders I gave addresses to from those senders who are spamming me. I can trivially filter out solicited from unsolicited email. In the same amount of time that I received 50,000+ spam, I received just over 8000 real messages. If I didn’t have an easy way to sort out spam from mail I signed up for, I’d have to manually delete 6 messages to find one message I wanted.
I don’t know how much experience you have with manually deleting spam, but I do it daily (my filters aren’t 100%) and I spam a message I shouldn’t have at least once a month.

What happens when spam and real mail mix together?

I have another mailbox, that belongs to my second non-work/school related email account. I acquired this address back in 1993 and have kept it for those 20 years.  This mailbox is behind a commercial filter, but as this address was on the internet long before commercial mail or spam was a reality, it still gets a lot of spam. This mailbox is also associated with a couple discussion lists, ones I follow but don’t post on very often.
Last year I started a project to look at what happens when you unsubscribe from spam. I unsubscribed from every message coming into this mailbox for a month. Then I recorded every message that came into this mailbox for 2 months. My goal was to then count the number of messages coming into this mailbox for the next 6 months, to see what the long term consequence of unsubscribing from spam.
Because I am counting spam, I’m leaving all the spam in that mailbox as unread mail until it’s recorded. Right now there are 2709 unread messages in that mailbox. The problem is, some of that mail is actually discussion mail. But in order to find it, I have to rely on searches to find the list mail. It means I’m a lot less likely to actually look in the mailbox to find the mail I want, it’s just too painful and annoying to do it, and I don’t care that much about the discussions. If I had to do this with all my discussion lists, I’d probably declare mailbox bankruptcy and find myself a new email address. It’s that annoying.

Spam filters are a net benefit.

My point is that filters make and keep email useable. Unfiltered mailboxes quickly fill up with unsolicited mail that overwhelms any commercial or personal usage.

Related Posts

Light blogging for a while

Sorry for the lack of substantive posts, things seem to have gone completely out of control and I’m not finding a lot of extra cycles to sit down and blog. I’ll try and get some stuff up this week, but I’m also getting ready for MAAWG and the sessions I’m a part of there.
There was an interesting post by Romer over on his personal blog. If you don’t know, Romer helps maintain one of the commercial mail filters. He recently got spammed by one of his vendors and talked about how this is probably not the best idea. Al adds his own take on companies assuming permission. I’ve talked about taking permission in the past but haven’t touched on things like “spamming the guy who runs the filter.”
You’d be surprised, or maybe you wouldn’t, about how many people who run filters for large organizations get spammed regularly. You wouldn’t be surprised to find out that those people do factor in their own personal spam load when adjusting their organizational filters.

Read More

It's about the spam

Tell someone they have hit a spamtrap and they go through a typical reaction cycle.
Denial: I didn’t hit a trap! I only send opt-in mail. There must be some mistake. I’m a legitimate company, not a spammer!
Anger: What do you mean that I can’t send mail until I’ve fixed the problem? There is no problem! You can’t stop me from mailing. I’m following the law. My mail is important. I’ll sue.
Bargaining: What if I just send mail to some recipients? What if I hire an email hygiene company to remove traps from my list?
Acceptance: What can I do to make sure the people I’m mailing actually want to be on my list?
Overall, my problem with the focus on spamtraps (and complaints to a lesser extent) is that these metrics are proxies. Spamtraps are a way to objectively monitor incoming email. Mail sent to spamtraps is, demonstrably, sent without permission of the address owner. This doesn’t mean all mail from the same source is spam, but there is proof at least some of the mail is spam.
If there is enough bad mail on that list, then reworking the subscription process may be necessary to fix delivery.

Read More

Filtering is not just about spam

A lot of filters started out just as filters against spam. But over the years they’ve morphed into more general blocks against dangerous or problematic email. There’s a lot of crime and bad behavior on the internet, much of it using email as a conduit or vector. Filtering is so much more than stopping spam now. It’s as much, or more, about stopping crime.
Email filters are essential to protect us from scammers. Sometimes I forget this, and then I read about a grandmother getting swindled by a Nigerian scammer and ending up dead.
There are real consequences to poor filtering and there is real crime facilitated by email. It’s easy to forget this as we deal with the email that gets caught in filters when they shouldn’t.
Filters are one of the first lines of defense against online crime.
Not only does filtering stop crime, but they also keep email working. An unfiltered mail stream is an ugly, unreadable, unworkable mess.

Read More