Measurements

One of the things I’ve been spending a lot of time thinking about lately is how we measure deliverability. Standard deliverability measurements include: opens, bounces, complaints, and clicks. There are also other tools like probe accounts, panel data, and public blocklists. Taken together these measurements and metrics give us an overall view of how our mail is doing.


A globe with the words innovation, creativity, inspiration and idea written on it.

More and more, though, I see senders meeting all the standard metrics for these measurements, yet still struggling with deliverability. In many ways this isn’t surprising. There are a whole host of tools out there that allow senders to manipulate the underlying metrics without changing their underlying practices. To complicate matters even more, there are tools that manipulate open and click rates by following every link in an email. Finally, we know that some ISPs don’t send 100% of the “this is spam” messages to their FBL. Other metrics, like probe accounts, are inaccurate in an era of personalised delivery based on activity.

All in all, these metrics were built to tell us things about a mail system that no longer exists. Our next challenge is to figure out what metrics to use in the future. How do we monitor the effectiveness of our address collection processes and our deliverability?

One thing I’ve started having customers look at, especially my ESP clients, is how the consumer ISPs are accepting their mail. Are they seeing temp failures and if they are, what specific mailstreams are the temp failures related to? It’s a little early to tell if this is an effective measurement for ESP compliance purposes. It’s definitely helping identify problematic mail streams for my brand clients and allowing us to make adjustments to get to the inbox.

What I do know is that we in the deliverability space need to continue innovating and thinking about how to measure our deliverability. Mail filters are evolving, and we must evolve as well.

Related Posts

Subject lines

There has been a lot of discussion in various places recently about subject line length and how it affects email marketing. There have been multiple studies done on how the subject line affects opens and clicks. (Mailchimp, Alchemy Worx, Mailer Mailer, Adestra). The discussion has even spilled over into Ken Magill’s newsletter today.
I’ve had a couple people ask me my opinion on subject line over the years. My general response is that subject line length is not directly measured by spamfilters and so don’t fret about the length. It is true that consistently crafting poor subject lines can indirectly cause delivery problems. Send mail few people open and that will hurt your reputation over time.
I think Ken really said it best, though.

Read More

How accurate are reports?

One of the big topics of discussion in various deliverability circles is the problems many places are seeing with delivery to Microsoft properties. One of the challenges is that Microsoft seems to be happy with how their filters are working, while senders are seeing vastly different data. I started thinking about reporting, how we generate reports and how do we know the reports are correct.

Read More

Tor cleans up their lists

Recently I got an email from Tor. Apparently they’re watching their opens and clicks and they noticed I hadn’t loaded any images recently.

Read More