The State of Paid Research

  I won’t boil the ocean of information economics and attempt a trenchant analysis of paid vs. free content, but a confluence of factors points to a disruption in the historical model of tucking value behind a so-called “cost-wall.”

I see three constituents in the market:

·        End-user recipients seeking answers and knowledge through two channels – online delivery or physical access to printed material.

·        Librarians and professional researchers who, for a fee, perform those searches.

·        Owners and aggregators who compile and store the information.

 
This essay was inspired by my experiences with Highbeam – a web-based, free-to-fee service that provides access to thousand of print sources for a flat annual or monthly fee. In an earlier blog post, I rhetorically asked the provocative question: will Highbeam “nuke” Factiva, the joint-venture between Reuters and Dow Jones that also provides access to a large database of print sources via an annual membership and a per-article charge of $2.95. My experiences with both products, and my experience with flat-fee subscriptions vs. micro-payments, or per-article schemes, led me to the conclusion that Factiva’s model was seriously challenged by Highbeam’s.

Executives from both companies weighed in with comments. Patrick Spain, the founder of Highbeam, notes that the market for paid-research is ripe for disruption as individual users are seeking research via a direct model, whereas Factiva has traditionally sold to enterprises, selling seats to volume-buyers (corporate librarians) who in turn distribute them to end-users.  Factiva, which does offer a tiered subscription system, countered that it is competitive with Highbeam’s offering, and further, offers higher functionality and better data sources.

 
Both companies negotiate, license, and aggregate libraries of articles from the original content creators – the publishers who pay to report, edit, and publish the source material. These include trade journals, newspapers, magazines, and the usual spectrum of professional content which is usually tucked behind a “cost-wall” on the publisher’s website. These archives are valuable assets and are treated as such. While I have no insights into the profitability of a typical newspaper’s archives, I can speculate that direct article sales and licenses to commercial online database such as Highbeam, Factiva, Lexis-Nexis, constitute a nice annuity that publishers can be expected to defend against the “Information Wants to Be Free” barbarians and CopyLeftists.

 
Archives and paid-research are under increasing assault by the masses that have been conditioned by search engines to expect instant gratification from their search requests. From the early days of Brewster Kahle — WAIS and Gopher to the present state of Google, the digitization of libraries, and paid-search services — there has been an inexorable march to take librarians and gatekeepers out of the equation. They don’t like this very much, and argue, sometimes with great credibility, that it takes an information professional to a) perform an efficient search, b) distinguish between the validity of sources, and c) rank-order results in terms of relevance.

 
In corporate environments where unrestricted searching can rack up massive charges, having a gatekeeper makes perfect sense. I can recall instances where reporters at PC Week incurred nasty bills from MCI via its early online research services. And with some commercial databases extracting very expensive pounds of flesh per citation downloaded, it makes sense to put someone who has a clue about what they are doing be in control of the search process.

 
I don’t think high-priced commercial databases are doomed. The more esoteric and technical the information, the less appealing it is to the unwashed Google-masses. The middle-market — for solo “knowledge workers” attempting to save themselves an expensive and inefficient trip to the library — is where Highbeam is going to strike gold … if, and only if, there are enough freelancers like myself with heavy research needs. Factiva? I predict a revision of their model to become more friendly to the individual subscriber. With their business at about $245 million annually in 2003 (according to Hoover’s http://www.hoovers.com/factiva/–ID__59927–/free-co-factsheet.xhtml),  a slight decline from an estimated peak of $250 million in 2001. They aren’t exactly huge, nor are they on a steep growth trajectory. Matching Highbeam with a flat-fee offering to independent researchers could (if they can figure out how not to croak their corporate base) put them back on top with individual reseachers.

 
While I may rail against walled-garden models and how they doom their builders to irrelevance, I can’t safely predict that they’ll come down under pressure from free and flat-fee search. I do think newspapers are fooling themselves with registration requirements, and further I am very dissatisfied by publishers who at the very least can’t distinguish a paid-print subscriber and grant that person unrestricted archive access. New York Times are you listening?

 

Price Comparison – Highbeam vs. Factiva

 
First, let’s look at Factiva’s Individual Subscription model and compare it to Highbeam’s.

 
Factiva: $69 a year for an annual subscription. This doesn’t give the subscriber any searches. Just the price of entry. That comes out to about $5.83 a month. On the surface, Factiva would appear to be a big bargain compared to Highbeam’s $100 annual fee (or monthly $20). But that’s all you can search, full-text.

 
Because I paid Highbeam a monthly fee of $20 per month, lets compare Factiva at $5.83 and what you get is (I assume as I am unwilling to pay Factiva for the test) an account with a password and the right to start searching. (Factiva’s Individual Subscription does not offer a monthly option. It should, with automatic renewal until the subscriber tells them stop.)

 
Let me first define what I mean by a “search” – that’s a keyword(s) query that results in a search result page (SRP) where the results are then opened to their ultimate full-text form. Not just headlines, not headlines and first paragraphs, not executive summaries. The full enchilada taken all the way to full text and ultimately, export to local storage or import into an app like Microsoft Word.

 
Factiva also has some lesser charges. Here they are:

 Full text article, picture or PDF – US$2.95;
 Keywords in Context – US$0.75;
 Full article/report plus indexing – US$2.95;
 Headline, Lead Paragraph and Indexing – US$0.75;
 Custom Format with Lead Paragraph – US$0.75, each charge being per article/document, with the charge being incurred on opening the relevant document.

That puts a little more hair on the deal.

Here’s where Factiva’s economics fall apart for me. While they win the monthly subscription price war hand’s down — Factiva is $6 a month and Highbeam is $20 —  I can open, print, mutilate, spindle and fold as many Highbeam articles as I want for my $20 at Highbeam. Every one I open at Factiva causes the meter to advance $2.95.

 
That means five opened articles on Factiva and I’m paying more than I would for an infinite number of articles at Highbeam.

 
Or does it? A little snooping around on Factiva led me to the discovery of another tier, called iWorks. Here’s the skinny on that:

”Factiva iWorks Individual Subscription Pricing is available via registration in Microsoft Office 2003. Individuals can access Factiva iWorks at a cost of $9.95 for 10 articles per month, or for $2.95 per article (prices listed and charged in USD). After entering a query, unregistered users will get headline results and will be prompted to register when they select a headline. “

So there is a cheaper tier of service priced at $9.95 a month for 10 articles at Factiva. That is waaaay cheaper than Highbeam at $20 for the same 10 articles.

If I stop at ten articles.

Okay. So the “Individual” account at Factiva is obviously not for me. iWorks — to go back to some research I recently performed on railroad gauges — would have worked for the first ten articles, but would have turned expensive very quickly for every one beyond that quota. The search ostensibly would have cost me $59 at Factiva under the Individual plan. Google would have failed out of the gate because it has a bad filter and is stupid in its own endearing way.

 

The Market

 
What are the bigger market dynamics at play here? Factiva is a classic market defender and Highbeam is the attacker. Factiva is defending its market for selling excellent research to companies. Highbeam sells it to individuals like me who need corporate level resources. 

 
Google is already eating at the fringes the old world of professional, expensive research, and Highbeam is moving onto dinner. Of course someone could undercut Highbeam too, but I don’t see a lot of wiggle room in negotiating archive licenses from the publishers.

 
Patrick Spain came up two good insights based on his experience at Hoovers. The “occasional” user wants to know something. So show them something. If they want more, charge ‘em. But don’t just charge ‘em for that piece of information, charge them for the right to see ALL the information..

Hey Now: Closet Deadhead launches

Closet Deadhead: Closet Deadhead

Sam Whitmore launches a podcast for the Deadheads lurking among us. Finally, a use for those racks and racks of bootlegs …

Me, I’ve been out of that closet since Colt Park ’76 

Jim Citrin on Media Execs

Online Extra: Memo to Today’s Media Execs

 

This from BusinessWeek online — a Q&A with Spencer Stuart’s Jim Citrin on what it takes to maker it to the top in the media business. Upshot …

" Don’t try to become a "mogul." The business today is far too complex and interdependent for one person to make all the decisions and wield all the influence."

 

Bye-bye, Nando — a piece of Internet history

Bye-bye, Nando — a piece of Internet history This is the season for a lot of tenth anniversaries for online journalism. 1995 was when the first serious HTML based news services launched — Pathfinder (I think HotWired was out in late 94), WSJ, Forbes, and one of the granddaddies of online news — NANDO.

 

Steve Yelvington writes:

"Over time, Nando evolved into the first serious, professional news site on the World Wide Web — long before CNN, MSNBC and other followers — and one of the nation’s first commercial dialup Internet services providers. When the McClatchy Co. bought the News and Observer in 1995, Nando’s Internet savvy was thought to be a major factor (although the newspaper itself turned out to be a very smart buy)."

The New York Times > Technology > For a Start-Up, Visions of Profit in Podcasting

The New York Times > Technology > For a Start-Up, Visions of Profit in Podcasting

Markoff on the commercial prospects for Podcasting, specifically Odeo.

No Times today. A big dumping of snow here on the Cape has forced me to the nyt.com for my daily read. 

Don’t Feed the Troll

Library Journal – Revenge of the Blog People!

"A blog is a species of interactive electronic diary by means of which the unpublishable, untrammeled by editors or the rules of grammar, can communicate their thoughts via the web. (Though it sounds like something you would find stuck in a drain, the ugly neologism blog is a contraction of "web log.") Until recently, I had not spent much time thinking about blogs or Blog People."

That’s Michael Gorman, president-elect of the American Library Association and Dean of Library Services, Madden Library, California State University, Fresno, writing in the  Library Journal in response to the blogger critics who slagged him for writing an op-ed in the LA Times in December which criticized Google’s avowed plan to digitize library collections.

This is an important piece and I recommend clicking through to read it in its entirety. [clicks to Chris Locke for the alert to its existence]

The topic of digitization and open access to the "stacks" has roiled the professional librarian/research world since ASCII was invented. A story I wrote about WAIS and Gopher and Brewster Kahle in the early 90s sparked a bit of a "s**t-storm" due to its rhetorical prediction that the digitization of the world’s information and easy access to such tools would make the librarian profession as secure as stablehands and paddock boys were the year Henry Ford rolled the first horseless carriage out of a Michigan garage.

 Well, of course that is not the case, and the role of the librarian/searcher will doubtless persist and perhaps intensify over time as the mechanics of the information space continue to explode beyond our capacity to tame the output [sort of Ithiel de Sola Pool meets I Love Lucy on the assembly line of bits]. Librarians have displayed some scorn over the democratization of data access, mostly on the misassumption by laymen that online search tools are comprehensive, but also on the difficulty to verify data sources in an age when any fool can forge an earnings report, release it, and play the options.

 Gorman, and other librarians, aren’t opposed to digitization per se, but to the danger of laymen assuming that if it isn’t in Google, it doesn’t exist. The sin of omission through ignorance of existence.

This tendency is particularly dangerous for amateur searchers when their favorite search tool can’t penetrate the "costwalls"  [ack. to Jim Thompson for my favorite word-of-the-day"] that hide newspaper archives, etc. (costwalls have their own perils for those erect them, per Penenberg’s wirednews piece about the loss of relevance for the WSJ per his Google search to see where the world’s best newspaper ranked on results for the term "Enron." Net result — it didn’t, ergo irrelevance].

 

 

 

Wired News: Whither The Wall Street Journal?

Wired News: Whither The Wall Street Journal? Penenberg on the WSJ and his recommendation they drop the subscription model and open their doors to the traffic.

Two points he touches on, but deserve development. He cites the Battelle meme of irrelevancy due to the walled-garden model which prohibits bloggers from deep linking inside the archive. Same could be said of the NYT. Sites that permit a permalink into their articles will reap what they sow by letting we bloggers funnel scads of traffic into their pages. Highbeam (not another Highbeam reference!) takes it even a step further and lets bloggers deep link into the archives (which could actually end run the newspaper industry’s precious rev. stream from their morgues.

The killer in the open-site model such as the one followed at Forbes (Adam misstates Forbes "…got rid of registration requirements when it discovered they drove away traffic.") Forbes never required registration for access. It was a founding principle to counter the Journal’s model with an open one and make cash from the traffic [CORRECTION: Adam writes: "You are mistaken. Not in your day, though. But a few years ago the site did require registration. I know this for two reasons. Number one, I had to register just to read old friends like Penelope Patsuris. Number two, Michael Noer recently came to the graduate seminar I teach at NYU and reminded me about Forbes.com’s former registration requirement.]) was pointed out yesterday by Forbes.com’s editor, Paul Maidment.

Online operations need coal in the form of stories, articles, content, bus plunge stories, to meet their inventory needs. As long as online arms like Forbes, Businessweek, NYT are dependent on print parents feeding them, they’ll never stand on their own two feet. Force them to build their own editorial capabilities and they sink under the overhead. 

I sense some very interesting days ahead in big print media as they come to terms with their online offspring. The place with the best prospects, imho, is Reuters, which has no print parent and could easily become the arms merchant of linked news by embracing bloggers.

IntelliTXT is bad.

IntelliTXT crosses the line and needs a stake driven through its heart.

I was following some links from Romensko’s daily email yesterday and one landed me on the New York Post which lo and behold was testing IntelliTXT, the contextual adword technology that automatically highlights keywords in a story and provides a link to an advertiser.

Forbes.com was one of the first pubs out of the gate with the technology but pulled the plug in December when the editorial staff righteously stood up and cried foul. Today’s NYT reports that the Times itself is considering implementing the stupid, stupid, stupid technology. Even though Steven Hall at Adrants was quoted as saying the ads are “easy to ignore.” I disagree. They aren’t. Especially for the clueless who may, at first pass, think they are a hyperlink to more detail on the story or a definition. They are annoying as hell, stupid in their blindness, and probably, sigh, the way of the future.

Ad words

This crap completely crosses the line between church and state. Penenberg equates them to the comments in Pop-Up Videos. While Hall says they are easy to process and preferable to flashing banners, skyscrapers and other dancing baloney, I disagree — the news hole needs to be sacred — ads need to be labelled ads and kept out of the content well. Figures Popular Mechanics would use them.

Congratulations to the editorial side of Forbes for swatting it down.

What’s with poker mania?

Sorry, but after swatting down at least a dozen online-poker spams every day, and now a wave of trackback spams from “tigerspice.com” I have to ask:

WTF is it with poker?

My teen-aged son is obsessed with watching it on television — louche men wearing bug sunglasses — and it seems to have encroached into nearly every channel with celebrity poker, world series of poker, dogs playing poker.

I have a dark fantasy of inventing the email equivalent of a neutron bomb and replying to the online poker spammers with some sort of digital missile missive that will cause faces to rot off.