The Trouble With Klout
Estimating influence is a delicate balance of art and science. People are drawn to quantitative methods because scores are easy to understand. The downside of reducing influence to a number, though, is oversimplification.
Lately, I’ve been looking at Klout, the popular new tool that bills itself as “The Standard” for influence measurement. The more I look at it, the less I like it. Klout’s weaknesses have not stopped it from amassing an impressive list of more than 3,000 business customers and from being incorporated into popular applications like HootSuite as a standard metric. It is “the emerging standard” for measuring influence online, said Klout Marketing Manager Megan Berry in a podcast interview with Eric Schwartzman last month. I just hope those clients aren’t taking this metric too seriously.
Beyond Followers
Klout attempts to determine influence metrics by looking at a person’s online activities and the actions of others that result from them. The thinking is that influence isn’t a matter of how much you say as much as the impact your words have on others.
Many people have a Klout index and don’t know it. The service crawls Twitter and ranks members automatically. If you want to grow your score, you can log in to the site and give it a bunch of information about your online activities. I spent 15 minutes on Klout registering my social networks and grew my score 10 points on the spot. This is a major flaw in Klout, but more on that later.
Klout uses a proprietary algorithm to estimate influence based upon comments, retweets, @replies and mentions, among other things. The company isn’t very transparent about how it calculates the score, and with good reason. The algorithm is a competitive asset and disclosure would inevitably invite people to manipulate the system.
The downside of opacity is confusion. By revealing so little about how its ratings are calculated, Klout essentially asks customers to put their faith in the service to do the right thing. This is dangerous, given Klout’s flaws. Nevertheless, the score is a public record that anyone can see, and its influence is growing to the point that Klout scores are now reportedly showing up on resumes.
The Shirky Effect
The problem is that some of the ratings are nonsense. For example, my Klout score (66) is modestly higher than Clay Shirky‘s (60) and significantly higher than Marc Andreessen‘s (42). This is ludicrous. Shirky is the author of two influential books about online sociology and has been a thought leader on the Internet since the mid-90s. Andreessen invented the browser, cofounded Netscape and is one of the fathers of the modern Internet. Both are sought-after speakers and the subject of extensive Wikipedia articles. Yet Klout says I have more influence.
The problem is that neither of these brilliant innovators plays by Klout’s rules. They aren’t active on Twitter and they don’t have Klout accounts. The fact that a single post on Shirky’s blog can draw more than 1,200 comments or that Andreessen’s occasional writings appear in The Wall Street Journal is of no consequence. Klout doesn’t monitor either of those outlets.
Klout’s bigger flaw is that its scoring system is tied to membership. The more you tell Klout about you, the higher your score is likely to be. This linkage fundamentally undermines the quality of the service. In effect, Klout pays you to endorse its service by rewarding you with a higher rank. If Google did that, Congress would be holding hearings.
A Million and One Improvements
Klout admits that its methodology isn’t perfect. In the interview with Schwartzman, who is the co-author of my B2B social media marketing book, Megan Berry said the company has “a million and one” improvements it wants to make. Schwartzman pressed Berry hard on shortcomings in the Klout methodology, and her responses were a weak defense. In essence, Klout treats every social network the same and all interactions equally, she said. A retweet, which is a one-button operation, is just as good as a thoughtful commentary on a blog. Except that Klout doesn’t currently monitor blogs, other than those on Google’s Blogger service. That must be one of the million-and-one improvements in the pipeline.
A comparison of Berry’s and Schartzman’s Klout profiles showcases the service’s flaws. Berry’s Klout score as of this writing is 70, while Schwartzman’s is 60. Berry does have a couple of thousand more Twitter followers than Schwartzman, but she said Klout ignores follower metrics as meaningless. Berry is very active online, but not nearly as active as Schwartzman. Her blog has been updated eight times this year while Schwartzman has posted 36 episodes of his popular On the Record…Online podcast and more than 30 entries on hisSpinfluencer blog. Berry contributes occasionally to Huffington Post and Mashable, but Schwartzman is also active outside his own channels, contributing to Social Media Today and For Immediate Release. Schwartzman has 44 recommendations on LinkedIn, while Berry has three.
As far as I can tell, there are two principal reasons why Berry outscores Schwartzman on Klout. One is that she knows the system. She has at least a vestigial account on every social network that Klout cares about, whereas Schwartzman limits his activities to fewer outlets. Berry also tweets regularly on behalf of her employer, giving her Twitter account a Klout halo effect that attracts retweets and @replies.
My intention isn’t to pick on Megan Berry. She’s obviously a bright young woman who’s very savvy about social media. However, there’s nothing I can find that qualifies her as significantly more influential than the veteran Schwartzman, not to mention Marc Andreessen.
In her interview with Schwartzman, Berry described Klout as “[Google] PageRank for people.” In my opinion, it’s got a long way to go. Klout has some utility as a way to compare the online presence of active social media users, but measuring influence is much more complicated than counting retweets and Foursquare tips. Klout is betting that it can use its metrics to entice (coerce?) people to join its social network, which it can then monetize through advertising. The link between membership and Klout score is a disturbing weakness. Proceed with caution.
My New Social and Search Seminar is October 11
- Internet Marketing Strategy
- Search Engine Optimization
- Social Media Strategy for Facebook & Twitter
- Calculating Social Media ROI
- Live Site Reviews (submit your site for inclusion)
- 12 Amazing Tools for Search & Social
The full-day seminar happens on October 11, 2011 from 8am to 5pm at the Woburn Courtyard by Marriott in Woburn, MA. The early-bird price of $199 is available through this Friday. After that, it goes to $299.
Tip of the Week: LinkedIn Today
One of the great appeals of social networks is that they deliver news curated by your friends, colleagues and people with whom you share common interests. This information is likely to be more interesting to you than news items selected by a third party you don’t know.
There are a lot of services that organize the links your friends provide into a form that looks like a conventional newspaper (Paper.li is a particularly popular one), but I haven’t found any that measure up to LinkedIn’s new Today.
Today combines activity by your LinkedIn contacts on both LinkedIn and Twitter to choose the stories that your friends are talking about and present them in a constantly updated custom news page. These topics are more likely to be professionally relevant to you, since your LinkedIn connections are usually business contacts. Headlines are organized by the topic areas you choose and you can have a daily e-mail summary sent to your inbox.
Just for Fun: Overheard in New York
How often have you passed someone on the street and caught a snippet of conversation out of context that was so funny or bizarre that you wanted to share it with someone else? There’s no better place for this experience than New York City and not surprisingly, there is a website devoted to capturing these stray asides that make eavesdropping such a fun sport.
Tall female law school know-it-all: “You’ll do fine on his exam as long as you memorize the notes he gives in class –I mean, like, word for word– and then just reverberate it all!”
Overheard in New York has actually been around since 2003, but I only just discovered it recently. Anyone can contribute, so quality varies widely. Many quotes are also profane or risqué, so be forewarned. It’s worth scanning, though, for gems like this:
Subway sandwich maker: “What size? 6″ or foot-long?”
Older suit: “How big is 6″, lemme see?”
Subway sandwich maker, deadpan: “It’s 6 inches long, sir.” (holds up bread)
What was interesting was the impact these references had on the blog’s visibility. Prior to the reference in BuzzMachine, the site was getting about 500 unique visitors per day. After Jeff Jarvis linked to one of my year-end roundup articles, that average jumped by about 200 visitors a day. It jumped again after the mention in the Economist, eventually settling at about 1,000 average daily visitors, or nearly double its traffic at the beginning of the month. However, a prominent reference in the New Yorker, which is one of the most venerable English-language magazines, had no discernible impact.