csua.org/u/628 -> acmqueue.com/modules.php?name=Content&pa=showpage&pid=108
Hear experts and customers discuss key issues every commercial and government enterprise must consider when implementing enterprise search and categorization solutions. Most of what we do today hurts the people who are already being hurt the most. That's what's wrong in the first place--the wrong folks pay for this scourge. The recipients have to actually store the data, which takes disk space, plus the majority of the I/O bandwidth costs: at least once on the network to receive it, and then at least twice on the disk to keep it (storing and then retrieving the space on disk), not to mention the cost of the disk space itself. You might say that "bandwidth is free" and/or "disk space is free," and it's true that they are much cheaper than they were when I was a wee lad (we used to say that disks were shipped full from the factory, given that they never seemed to last long--but then I also remember when having an entire gigabyte of space on one multi-rack system was a really big deal). But bandwidth and disk space have never been free, and when you are a large company or ISP, these things can make a difference. In fact, even if you aren't a large company, spam can pretty trivially saturate your external bandwidth. For all the absurdity of what they taught us back then ("assume a rational buyer"--any good marketer knows that this is a lousy assumption), there are still some good points to take away. Perhaps most important, people optimize locally--that is, they do what's best for themselves. Actually, the "irrational" folks sometimes do what's good for the greater goal, assuming that it will do them or their ancestors good; And thank (insert deity of your choice) for the "irrational" people. We need more of them, especially in the computer business today. So assuming the irrational folks are a minority (alas), what happens? This is done by maximizing sales and minimizing costs (a very crude approximation, but it will do for now). One of the costs is informing folks about your product--after all, they can't buy it if they don't know it exists, right? If you're selling a large-ticket item (a private jet, for example), you use a direct sales force that goes out and gets to know each buyer personally, wines them and dines them, even becomes friends with them--they develop long-term relationships that work for both parties. Suppose you're selling kitchen appliances or organ enhancements or economic success or an opportunity to participate in a multimillion-dollar fraud involving overthrown African dictators (30 percent for you, of course, with only the tiniest commitment). OK, for the last one, if legit, I would use a direct (but discreet) sales force. An honest profession, billions poured into it, with all kinds of creative people with cool ponytails doing cutting-edge work. Oh wait, that "billions" means that I'll have to pay for it. You can call people up during the dinner hour and inform them of how your product will make them richer/prettier/healthier. You can send them pieces of paper that contain that same message, which they of course are eagerly waiting for. If you didn't have to spend that money, you could of course offer a better deal to your buyers. Well, sellers try to maximize profits by maximizing price and minimizing expense. Advertising is an expense, so keeping this cheap is a good thing. Calling people up, even with those annoying predictive dialers, costs a significant amount of money per call. Sending a paper solicitation through the mail costs real money. I've seen claims that acquiring a single lead (not a customer) through direct mail costs close to $10. Sellers limit the amount of mail they send out because every piece costs money, and they want to maximize profit. So they mail only to the people who are most likely to buy their products. But suppose it costs you essentially nothing to send out a mailing. Then your best strategy to maximize profits is to send to any and every address you can find. After all, if you're selling mortgage financing, there might actually be some renters who own property somewhere (there are). You would miss those potential buyers if you trimmed your list. Perhaps some folks who have expressed interest in designer beer mugs are also interested in antique dolls. If you did the "rational" thing you would miss them, and it costs you nothing, right? The sad point of all of this is that I'm going to (sort of) defend the spammers and point out that they are responding to basic economic forces that we all respond to at one level or another. As long as spammers can take in more money than it costs them, they will continue to spam. Well, I've tried to convince you, fair reader, that it's all about economics. And basically the economics of e-mail are severely distorted. By the way, this isn't terribly different from cellphone fee structures in the United States, where if someone calls me on my cellphone I get to pay the airtime costs whether I wanted to talk with the caller or not. In most places in Europe the caller pays the airtime costs when calling a mobile phone. Filtering, quarantining, redirecting, stripping, modifying, deleting--all of these costs are borne by the recipient. Also, the recipient pays the costs of false positives (nonspam that is mistakenly classified as spam) in a variety of ways. When I was first getting into the e-mail business one of my main goals was to eliminate the excuse of "My dog ate my e-mail" (the dog, of course, being the e-mail system itself). Ironically, the less often your spam filter eats your homework, the worse it is. If I've got a lousy filter, I'll check my spambox at least a couple of times a week. But I've done this and found mail I really wanted to receive condemned to spam hell. Once they are a month or so old, they really start to stink--which is when I often find them. When it comes right down to it, heuristics and Bayesian filters and challenge/response systems do improve things from the point of view of the recipient, but not from the point of view of the IT group that has to support all this overhead. Ultimately, e-postage is probably the right way to go, but the costs (implementing the micropayment overhead, plus protocol changes, plus the human frustration) are prohibitive in the short run. Besides, people just hate the idea of paying for their e-mail. Challenge/response systems actually do increase the cost to the sender, in addition to the recipient, and hence have some value as long as the cost to the sender is high enough to change their behavior. Ultimately we have to reassign costs from the recipient back to the sender. Personally, I believe that in this hostile world we may find ourselves limited to "permission-based" mail, where senders can transmit mail to me only if I've already given them permission. If a friend of mine from university has just found me, do I really want to reject their mail just because I've never seen the e-mail address before? A small number of greedy people are polluting a great medium for their own private benefit, regardless of the cost to the rest of the world. They run the risk of damaging their own medium (I think this falls into the class of "pissing into your own well") but they don't care--they are short-term thinkers. The problem is that our approach to the solution has also been short-term thinking. Q ERIC ALLMAN is the cofounder and chief technology officer of Sendmail, one of the first open source-based companies. Allman was previously the lead programmer on the Mammoth Project at the University of California at Berkeley. This was his second incarnation at Berkeley, as he was the chief programmer on the INGRES database management project. In addition to his assigned tasks, he got involved with the early Unix effort at Berkeley. Over the years, he wrote a number of utilities that appeared with various releases of BSD, including the -me macros, tset, trek, syslog, vacation, and, of course, sendmail. Allman spent the years between the two Berkeley incarnations at Britton Lee (later Sharebase) doing database user and application interfaces, and at the International Computer Science Institute contributing t...
|