Email Filters Catch Dolphins Along With Sharks
What's the point in spending hours preparing a newsletter, message or report if it's automatically filtered into the junk folder before the recipient even sees it?
Spam threatens to choke the communication channels promising global freedom of expression.
Internet Service Providers (ISPs), corporate server administrators and end users are increasingly using new anti-spam technology to try to stem the relentless tide of junk email flooding the Net.
The problem is: how can we prevent the dolphins from being caught along with the sharks?
The origin of 'spam'
SPAM is a pink canned luncheon meat immortalised in Monty Python's spam-loving Vikings sketch.
In an Internet context, lowercase spam refers to unsolicited commercial or bulk email (such as get-rich-quick schemes, miracle cures, weight loss, Viagra, lotteries, loans, pornography and Nigerian sob stories) and allegedly originated in a MUD/MUSH community.
Of more practical use is the origin of the actual spam mail itself.
Where does all the junk come from?
In the mid-90s, Usenet newsgroups (also called "discussion groups" or "bulletin boards") were the number one source of email addresses for spammers.
Today, the most common origin is web pages, especially if they're listed in a search engine or directory.
Some people have tried foiling address-seeking spambots by inserting the word "UNSPAM" in capitals in the middle of all email addresses on their sites. This stops auto spammers working but enables human beings to work out what to do.
Spammers also harvest addresses from headers of messages you send to friends who forward them to their friends (a good reason for using BCC -- blind carbon copy rather than simple CC which displays all recipients ? although some people filter out mail sent using BCC as many spammers also use it).
Other sources include open e-mail discussion lists and web pages that invite you to "insert your address here to be on a 'do not mail' list".
Spammers can simply guess addresses by generating lists of popular names and random words attached to common domains (bob@aol.com, john@hotmail.com).
Once on a spam list, the only way to get off is to change addresses.
If you reply or respond to instructions to "remove", your message will simply confirm your address is valid and you'll get even more junk.
Depending on your email client, you can try tracing junk back to its owner by contacting the server listed in the full message header information (the From address is generally fake - check your Help files to find out how to "reveal full headers").
How to stop spam
Despite legislation against unsolicited commercial email, the volume of junk is increasing alarmingly.
The simplistic oft-cited fix -- "just hit delete" -- is only a bandaid solution and fails to discourage the junk merchants.
Self-regulation and industry codes are difficult to enforce. ISPs face problems if they disconnect service to spammers under some countries' telecommunications laws.
Technical solutions have centred on filtering technology.
Types of filters
Many corporations and ISPs filter incoming mail on or after delivery.
Server-side filtering software typically looks at the headers, subject line and/or contents of the message.
Some filters -- and their users -- are smarter than others.
SpamAssassin is an open-source, collaborative, community anti-spam effort based on filtering rules to analyse email content.
The software gives each message a score based on how many rules it breaks.
Any programmer can suggest rules for new releases of the software which spots, not blocks, spam.
ISPs and server administrators then decide whether to send suspect mail to junk folders, automatically delete mail tagged as spam, or bounce it back to sender.
Unfortunately for email publishers, some of the filter rules are too broad or the threshold is set too low.
Many innocent messages are being lumped in with the guilty.
One of my newsletter readers notified me that his ISP had tagged a recent issue as spam -
SPAM: -------------------- Start SpamAssassin results ----------------------
SPAM: This mail is probably spam. The original message has been altered
SPAM: so you can recognise or block similar unwanted mail in future.
SPAM: See http://spamassassin.org/tag/ for more details.
SPAM:
SPAM: Content analysis details: (13.2 hits, 6 required)
SPAM: Hit! (1.5 points) BODY: Asks you to click below
SPAM: Hit! (0.2 points) BODY: No such thing as a free lunch (1)
SPAM: Hit! (2.6 points) BODY: Instant Access button
SPAM: Hit! (3.5 points) URI: URL of page called "unsubscribe"
SPAM: Hit! (4.1 points) URI: 'remove' URL contains an email address
SPAM: Hit! (2.1 points) BODY: FONT Size +2 and up or 3 and up
SPAM: Hit! (0.0 points) BODY: Includes a URL link to send an email
SPAM: Hit! (-0.8 points) BODY: Image tag with an ID code to identify you
SPAM:
SPAM: -------------------- End of SpamAssassin results ---------------------
Even if you can identify the problems that raised your score, you can do little about it.
Best practice in e-newsletter publishing -- and now law in many countries -- is to enable your readers to unsubscribe easily yet the word "unsubscribe" or similar would lead to your newsletter being blocked by filters such as SpamAssassin.
Just look at the seemingly innocuous words on the constantly changing list of tests SpamAssassin performs on mail messages to determine whether they're spam.
A growing number of email users also filter their own inboxes by setting up rules to delete messages containing certain keywords or punctuation (for instance, the phrase, "This is not spam", which is among the most commonly used phrase in junk email).
Some desktop applications, such as MailShield and MailWasher, pre-set the rules and tag or delete mail without the user having to do anything.
Some client-side filters prioritise mail into different folders.
To ensure they receive wanted mail, email users can add favourite mailing lists to a "white" or "green" list so the mail ends up in a specific folder.
The problem with email filtering
Arbitrary and unpredictable email filtering, as with web content filtering, can backfire and cost time, money and frustration -- the very things filters were designed to save.
Tracking down problems and dealing with aggravated users or administrators wastes resources that could be spent creating content, marketing and improving customer service.
Many filters can be imposed only after you have received unsolicited email from each source, meaning you have to respond manually to every single spammer.
Spammers regularly change their email addresses to bypass filters.
"Qualitative" filters can try to detect junk mail from unknown sources but legitimate mail can be inadvertently trashed in the process ("false positives") while some junk mail still gets through ("false negatives").
Filters are becoming a serious problem with many legitimate opt-in publishers being mistaken for spammers and blacklisted.
Once on a black list, the only way to be unblocked is to contact the ISP and ask to be placed on a white list.
While some e-newsletter publishing tools let you monitor how many messages are opened or bounced, you might never know which readers are being filtered unless you know which email program they're using.
Even then, the recipient might just be busy, uninterested, on leave or not receiving your message.
Some filter programs don't even notify you that your message was blocked while others bounce back mail with "sensitive" content without specifying the rejected words.
On another occasion my own free weekly e-newsletter was blocked on its way to at least two subscribers thanks to Trend SMEX Content Filter detecting "sensitive content" yet the "naughtiest" word I could find was "teenage".
Pity the poor medical publishers who often use "controversial" words such as "breast" or "penis" in their newsletters.
You might be able to track down the reason you were blocked by examining the full header information (ask your subscribers to forward the entire copy of your junked message).
The header should list filter rules that the message violated, if the ISP uses software such as SpamAssassin.
If not filtering, then what?
Some online publishers advocate web services where you submit your newsletters for screening of content or technical problems that might trigger spam filters before mailing.
Of course, spammers could also abuse such a service to get their own mail past the filters.
Others back the idea of an Internet-wide white list along the lines of web site privacy site TRUSTe.
Spam-busting campaigners believe the only effective method of addressing the problem is through simple, direct legislation to:
- Ban the practice of transmitting unsolicited bulk email
- Ban the sale and marketing of spamming tools
- Provide a right of action and damages to the recipient
- Express damages in terms of penalty units
- Provide for damages to be trebled for wanton violations
- Cover offshore spamming by local interests, and
- Attach to the outgoing revenue stream of foreign interests, which spam locals for the benefit of the spammers' revenue stream.
Meanwhile, ashile the world waits for more countries to introduce tough anti-spam legislation, online publishers must continue to be vigilant.
How to avoid the junk folder
Choose the subject line and words in your emails carefully if you don't want to end up in the junk file.
More people are setting up their email programs to filter incoming mail automatically for classic junk mail keywords and symbols (eg "advertisement", "free", "rich", "porn", "lover,", "opt-in," "e-mail", "money-back guarantee", "teen", "sex", ! # or $, removal instructions, all capitals).
Drop all hype and advertising-speak from your subject lines and messages.
Apart from saving you from the filters, honest concise text is preferred by the impatient, overloaded online reader.
Online publishers wishing to avoid being trashed should send a welcome message to new subscribers or correspondents telling them how your messages will appear (eg "the newsletter will appear from yvette@brizcomm.com.au") and suggesting they add the address to the white or green list of their email program.
Set up test accounts with popular email providers such as AOL, Yahoo and HotMail to see if your messages are getting through.
Beware Microsoft Outlook's "junk e-mail filters" which, when turned on, colour or delete messages considered spam based on a filters.txt file.
I searched for the filters.txt file on my PC to see which words were no-gos and was surprised to see so many seemingly harmless words.
Use a professional list hosting service unless you can afford an experienced in-house support staff.
E-newsletter publishing is becoming a highly specialised and complex field ? don't risk your reputation to amateurs.
Ensure your list host monitors other clients to ensure they're publishing to only opt-in recipients -- if opt-out mailers, rental lists and spammers are blacklisted, you might be guilty by association.
Insist on detailed bounce reports for every issue you send out.
You should be able to see which names bounced and the exact reasons (eg "mailbox full", "address does not exist" or the frustrating "unknown").
Just because your bounce report says your mail was delivered, doesn't mean it did.
Many filters stop email after the "not-bounced" signal has been sent.
Monitor your open and clickthrough reports for unusual patterns.
Read all reader feedback, particularly if readers are having trouble subscribing or getting your mail.
Chances are they might have to ask (or scream at) their ISP or techies to add you to a white list.
(Of course, you need to publish quality content if you want your readers to jump up and down when they don't get it.)
Many permission-based publishers include their newsletter or trademark in square brackets in the subject line to avoid being filtered.
Other ethical publishers, including me, have resorted to disguising known filter trigger words by inserting unusual characters or deliberate typos -- for instance, using f^ee instead of free or sp*m instead of spam.
It's just a matter of time before the spammers work around these "tricks".
Bastardising or censoring our language to suit new communications technology would seem an extreme solution -- not to mention bitterly ironic -- but what's the alternative?
Useful links
Coalition Against Unsolicited Commercial Email
http://www.cauce.org/
The Net Abuse FAQ
http://www.cybernothing.org/faqs/net-
abuse-faq.html#2.1
How to show full header details for your email program -
http://www.uia.net/emailabuse.htm
Put junk mail in its place (tips on using Outlook) -
http://www.microsoft.com/Office/using/colu
mn01.asp
Tips on writing hype-free online content
http://www.brizcomm.com.au/
Yvette pioneered web writing training in Australia in 1998 and has inspired thousands of people through her workshops and presentations from London to LA, Sydney to Seoul.
She has reviewed web sites professionally for print, online and radio for since 1997. Her own e-newsletter and site - www.brizcomm.com.au - won the Smart Communities category in the 2002 Asia Pacific ICT Awards.
 Google News Updated : Wed, 09 Jul 2008 07:08:13 GMT Ex-Secretaries Suggest New War Powers Policy - Washington Post
Washington Post - The next time the president goes to war, Congress should be consulted and vote on whether it agrees, according to a bipartisan US study group chaired by former secretaries of state James Baker III and Warren Christopher. Video: Panel Calls for New War Powers Legislation War Powers Act needs fixing, bipartisan panel says Publ.Date : Wed, 09 Jul 2008 03:48:10 GMT Bush Won't Back Setting Timeline for Troops in Iraq, Aide Says - Bloomberg
Bloomberg - By Catherine Dodge and Roger Runningen July 9 (Bloomberg) -- The Bush administration rejects setting any ``arbitrary'' deadline to withdraw forces from Iraq, the president's spokeswoman said after an Iraqi official said his government wants a timeline ... Video: Iraqi PM Calls for Withdrawal Date Maliki's Withdrawal Card Publ.Date : Wed, 09 Jul 2008 06:24:10 GMT Coalition launches push for health care reform - Milwaukee Journal Sentinel
Milwaukee Journal Sentinel - By GUY BOULTON An array of unions and liberal activist groups in Wisconsin have joined a national coalition that plans to spend $40 million to push for health care reform, particularly universal coverage, in the coming election. Coalition to lobby for US health-care reform $40 Mill Health Care Reform Campaign Launches Publ.Date : Wed, 09 Jul 2008 04:17:57 GMT Afghan Bombing Sends Stark Message to India: With Power Comes Risks - New York Times New York Times - By SOMINI SENGUPTA NEW DELHI - The suicide bombing on Monday outside the Indian Embassy in Kabul was the latest and most audacious attack in recent months on Indian interests in Afghanistan, where New Delhi, since helping to topple the Taliban in 2001, ... Video: Mourning for Kabul blast victims - 08 Jul 08 Pakistani PM calls for joint efforts to fight terrorism Publ.Date : Wed, 09 Jul 2008 03:32:49 GMT Google Introduces a Cartoonlike Method for Talking in Chat Rooms - New York Times
New York Times - By BRAD STONE Google, known for its plain-Jane approach to Web design, has come up with something much wackier. On Tuesday the company introduced Lively, an online tool that allows people to embody a cartoonish online avatar and have text-based ... How Lively? Google’s Me-Too Virtual World Virtual Worlds Are So Hot Right Now: $345 Million Invested So Far ... Publ.Date : Wed, 09 Jul 2008 02:21:46 GMT Study Finds Flawed Practices at Ratings Firms - New York Times
New York Times - By MICHAEL M. GRYNBAUM The analyst at the credit ratings agency was blunt: “Let’s hope we are all wealthy and retired by the time this house of cards falters. SEC criticizes credit-rating firms SEC finds conflicts at rating agencies Publ.Date : Wed, 09 Jul 2008 02:20:01 GMT Alumina Shares Gain as Profit at Partner Alcoa Tops Estimates - Bloomberg
Bloomberg - By Rebecca Keenan July 9 (Bloomberg) -- Alumina Ltd., owner of 40 percent of the world's biggest producer of the material used to make aluminum, rose the most in more than five months in Sydney trading after partner Alcoa Inc. reported profit that ... Alcoa Profit Tops Estimates After Price Rise Alcoa beats the Street Publ.Date : Wed, 09 Jul 2008 03:09:46 GMT Increase Web Traffic |
PARLOT::Ebooks, Scripts,
Websites, and more... Ezine are one of the best source of information on... Read More 1. Share your personality with your subscribers. Your subscribers are... Read More Do you know that many business owners market their businesses... Read More The very name CGI used to send chills up my... Read More Your newsletter name has a big effect on your readership,... Read More I'm working on a report for a company that puts... Read More How to write your ezine in 5 minutes by legally... Read More It's all about numbers - or so some ezine publishers... Read More HiHow'd you go with your product search?Here's another way to... Read More When you have an online business you need to utilize... Read More Imagine you are sitting at home relaxing reading a book... Read More More and more companies are finding the value in informational... Read More The decision to publish a book is very exciting! It... Read More I have to admit to being readily impressed by company... Read More So you'd like to start publishing special reports and ebooks... Read More When I purchased my very first computer, not too long... Read More 1. Fear Of Having Nothing To SayAs a small business... Read More If you publish an e-mail newsletter, or "e-zine," you'll need... Read More So you want to get a book published and add... Read More There's no doubt, publishing information products to sell online is... Read More Marketing is a broad business subject that encompasses a range... Read More When you want to choose a name for your newsletter,... Read More How would you like to reach millions of people with... Read More Good newsletter names are usually 2-4 words. If shorter, they... Read More The main task of a newsletter publisher is to select... Read More
Adsense
websites
10 Ways, How To Get Significant Exposure For Free
10 Winning Ezine Publishing Tips
You Can Develop An E-zine Even If You Dont Enjoy Writing!
Why Arent You Using CGI?
Newsletter Names - Creative Ideas for Newsletter Titles
Don?t Distract Readers from What They are Doing
Write Your Weekly Ezine in 5-Minutes! (or better yet, dont write it at all)
OK People - Lets Get Real!
Finding the GOLD with Ezines and Google!
An Overlooked Fr~e Advertising Opportunity
Top 7 Techniques For Generating Subscribers To A Newsletter
Plagiarism on the High Seas
7 Steps to Successful Publishing
PublishAmerica - Publishing Parasites
Publishing Special Reports And Ebooks At No Cost
Is It a Newsletter or Just One More Commercial?
The Five Deadly Fears of E-Newsletter Publishing
21 Questions to Ask Any List Service Before You Sign on With Them
Good News About Getting Published
Work Less, Earn More As An Infoproduct Publisher
Top 3 Steps to Success Building the Relationships
Newsletter Name Ideas - Creative Ideas to Choose A Good Name for Your Newsletter
Create Your Own Ezine Traffic Machine
How to Choose a Good Newsletter Name
A Newsletter Publishers Main Task: Packaging Value Content
Affordable and Reliable Web Hosting Starting at $4.49/Month
Create An Ezine To Get People Back To Your Site
I know you've worked hard on your website. I know... Read More
Subscriber Incentives: Are They Effective?
Peter Boulder of Pepper and Rodgers Group tells a story... Read More
Publish Articles Online: Start With Your Own ezine
So, you want to publish articles online? It's really quite... Read More
A Blog, 5 Minutes a Week and These 5 Simple Steps Equals Your Own Online E_ZINE
One of the fastest ways to gain "Guru" Status online... Read More
Become an E-Book Author ... Make Money From Your Knowledge!
"E-Book" is short for Electronic Book---an organized set of content... Read More
10 Winning Ezine Publishing Tips
1. Share your personality with your subscribers. Your subscribers are... Read More
10 Newsletter Ideas to Write Articles for Your Newsletter
Since you publish your newsletter on a regular basis, sometimes... Read More
Publishing Your Own Newsletter - Is It Worth Your Time?
Is publishing your own newsletter worth your time and effort?... Read More
Why Arent You Writing Ezine Articles?
I'm amazed!Everywhere I go on the Web, people are desperately... Read More
Your E-zine 13 - A Formatting Checklist
While sending out a text e-zine may seem like a... Read More
10 Benefits Of Submitting Articles To Ezines
1. You'll brand your web site, business and yourself by... Read More
7 Ways to Self-Promote Within Your E-zine
We all know that an e-zine won't attract and keep... Read More
Lesson #6: Six Simple Steps to Writing Magnetically Charged Email Messages!
If you remember, the majority of people (i.e., 68%) need... Read More
5 Tips for Catching Errors in Your Manuscript
What is your worse fear as a self-publishing writer? For... Read More
Covering All The Bases: How to Make Sure Your Newsletter Gets Opened and Read
It's not enough to prepare and distribute a monthly newsletter,... Read More
What Every Ezine Owner Should Know About Unsold Ad Space
The deadline approaches and your ad STILL has not sold.... Read More
Publishing Special Reports And Ebooks At No Cost
So you'd like to start publishing special reports and ebooks... Read More
The Future of Email Newsletter
The future of email Newsletter - Llando Ford 07.28.2004 What... Read More
Free Ezine Advertising That Works!
When I say free ezine advertising, I'm not talking about... Read More
Print On Demand Questions
Print on demand (POD), a cross between self-publishing and digital... Read More
Write an Ezine? But I Dont Know HOW!
If you've been promoting your business on the internet you've... Read More
Employee Newsletter Ideas - 7 Creative Ideas for Your Employee Newsletter
Employee newsletters are an effective tool to communicate with your... Read More
Need Ezine Content - Think Holidays
Publishing an ezine certainly has its benefits and rewards, but... Read More
How To Use Viral Marketing To Grow Your Opt In Email List
If you have read my article called "What is Viral... Read More
Why Arent You Using CGI?
The very name CGI used to send chills up my... Read More
Ezine Publishing |