Between the Lines

Larry Dignan, Andrew Nusca and Rachel King

Is Wikipedia maxed out?

By | November 23, 2009, 7:37am PST

Wikipedia may have reached the upper limits of what can be done with crowdsourcing, according to a researcher in Spain.

Felipe Ortega, a researcher at the Universidad Rey Juan Carlos in Madrid, notes that Wikipedia is at risk because its core editors can’t continue to keep up their current pace. And if Wikipedia doesn’t recruit more volunteers its content could suffer.

Ortega’s research, the basis of his Ph.D. thesis, was highlighted by the Wall Street Journal. The PDF of the thesis contains more than you’ll ever want to know about how Wikipedia works. It’s worth reading at least a few pages—it’s 162 pages before you hit the bibliography.

The main conclusion that we can infer from the overall results of our quantitative analysis is that there exists a severe risk on the capacity of the top-ten Wikipedias, to maintain their current activity level in due course. According to our graphs and numbers, the inequality level of the contributions from logged authors is becoming more and more biased towards the core of very active authors. At the same time, the monthly Gini coefficients show that the inequality level of contributions from logged authors has remained stable over time, at the cost of demanding more and more contributions from active authors to alleviate this deficit of monthly revisions.

Furthermore, we have seen that the distribution of the total number of revisions per author follows an upper truncated Pareto distribution. While more core authors begin to reach the upper limit of their human contribution capacity, we will see a point in the future of this language versions in which the steady-state of the monthly Gini coefficient will start to decrease. This situation would not pose a problem in itself, unless for the fact that we have demonstrated that the most significant part of the content creation effort in Wikipedia is not undertaken by casual, passing-by authors, but by members of the core of very active contributors.

On top of that, the lack of new core members seriously threaten the scalability of the top-ten language versions regarding the quality of their content.

Simply put, active editors are carrying too much weight. In the first three months of 2009, Wikipedia lost more than 49,000 editors, compared to 4,900 a year earlier. In the Journal story, Wikipedia officials maintained that the foundation could carry on fine with fewer volunteers, but that premise is questionable given the size of Wikipedia. As Wikipedia is reproduced in more languages it should need a larger army of volunteer editors.

It’s possible that Wikipedia is already being stretched. Ortega noted in the Journal story that the site is becoming increasingly hostile.

Jimmy Wales, founder of Wikipedia, tells the Journal it’s unclear what the optimal number of volunteers is, but the hostility can be corrected.

The larger question is whether crowdsourcing has a cap or not. Is there a point where crowdsourcing gets so big that it crumbles under its own weight? It’s a worth asking the question, but let’s put this in a little perspective. If Wikipedia somehow imploded it would still be one of the best examples of the Web at work. For corporate purposes, you could crowdsource R&D, get huge, perhaps create some neat products and dismantle if it got unwieldy.

Overall, there’s a big coordination problem at work here. But Wikipedia is at the collaboration forefront in terms of doing it at scale. Whatever happens from here with Wikipedia is going to be educational.

Post script: I wonder if the economy has something to do with Wikipedia’s drop-off in volunteers. Let’s say you were an active volunteer with a job. Let’s say you were laid off. Would you spend your time managing Wikipedia or looking for a job? It may be worth looking into other volunteer-based organizations and what happens during a downturn. Do people volunteer more or less?

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Larry Dignan is Editor in Chief of ZDNet and SmartPlanet as well as Editorial Director of ZDNet's sister site TechRepublic.

Disclosure

Larry Dignan

Larry Dignan has nothing to disclose. He doesn’t hold investments in the technology companies he covers.

Biography

Larry Dignan

Larry Dignan is Editor in Chief of ZDNet and SmartPlanet as well as Editorial Director of ZDNet's sister site TechRepublic. He was most recently Executive Editor of News and Blogs at ZDNet. Prior to that he was executive news editor at eWeek and news editor at Baseline. He also served as the East Coast news editor and finance editor at CNET News.com. Larry has covered the technology and financial services industry since 1995, publishing articles in WallStreetWeek.com, Inter@ctive Week, The New York Times, and Financial Planning magazine. He's a graduate of the Columbia School of Journalism and the University of Delaware.

For daily updates, follow Larry on Twitter.

Related Discussions on TechRepublic

Did you know you can take part in these discussions with your ZDNet membership?
17
Comments

Join the conversation!

Just In

Examples are available
LarryPTL 1st Dec 2009
I've listened to Bill O'Reilly on numerous occasions and have heard him more than once absolutely condemn Wikipedia for allowing anyone to post anything about persons of interest. He has given up trying to correct the inaccuracies said about him.

Go to Wikepedia today and you will see several comments designed to attack his integrity (try and find the same negative comments said about Obama - no one can add anything to articles about him anymore without it getting heavily sensored). There is one entry strongly suggesting O'Reilly is a racist, and another suggesting that his verbal attacks on Dr. Tiller the abortionist led to Dr. Tiller being murdered. Every time O'Reilly tries to edit them out, they get put back quickly.

I should not have had to make this post, anyone with a web browser could have gone to the Wikepedia entry for O'Reilly and seen for themselves the slants against him.

As I said before, I shall say again - until Wikepedia apologizes and sets mechanisms in place to prevent politically motivated posts from appearing about persons of interest, they will have a sullied reputation.
0 Votes
+ -
Interesting....
cosuna 23rd Nov 2009
I don't see a reason Wikipedia would max out considering that every day new younger participants are entering the field. It's timeless relevance could diminish as new and younger editors focus on more up-to-date matters as Twitter, Sexting and Cloud computing, and less on the Roman Empire, the Great Depression or even World War II (as opposed to the general media which pounces on this themes over and over again).

As you stated, the Wikipedia, Crowdsourcing or what Don Tapscott and Anthony Williams call Wikinomics are incredible new fields and untamed territory. We have no way of knowing where it will go. But it certainly will not go away, for sure.
With some exceptions the information seems accurate but at times outdated. It is too easy to get "junk science" in if the vetting process becomes too weak and unfocused.
Maybe encouraging school students and classes to develop and publish an entry a month would add credible help?
0 Votes
+ -
And integrity..
minardi 23rd Nov 2009
nt
0 Votes
+ -
You have no idea...
FrankleeMiDeer 24th Nov 2009
...how many times I've objected on discussion pages on certain articles about innacuracies, opinions given as facts, or articles just sounding like they were copied from a company's sales brochure. The general consensus seems to be, in many cases "let's leave well enough alone."

So. Sometimes volunteers just give up. The ones with more edits have more say, it doesn't matter if they are right or wrong. When I fix an article because of something as simple as a grammar or syntax issue, and it gets reverted the next day, I eventually give up. And I have.

Maybe that has a lot to do with loss of volunteer editors. Who knows.

P.S. I make a lot of grammar ans spelling errors in internet posts. When I revise others writing, however, I use a style guide and dictionary. I never assume that I am right. Either Wikipedia is going to be done well, or it is not going to matter. To anyone who cares about accurate information, at least.
0 Votes
+ -
The loss of editors is to be expected
LarryPTL 23rd Nov 2009
Wikepedia blew it big time when they began to engaged in politics.

They edited out anything negative about Obama during the elections, even punishing contributors with being banned from making new contributions for a set length of time. But they continued to allow negative things to be said about other well-known people (i.e, Bill O'Reilly, for example) who presented a point of view opposed to Obama, even if they were flagrant lies.

It was this hypocrisy that cost Wikepedia its reputation and many of its editors. They only way they are going to get the editors to come back is with a full apology and a system in place that allows allows people, or their estates, to preview comments so as to remove lies said about them before being posted.
0 Votes
+ -
Examples, please...
yonian Updated - 24th Nov 2009
of "lies" about Bill O'R that were allowed, or "facts" about Obama that were removed from Wikipedia. One can be negative without being inaccurate. Most - not all - of the negative statements about Obama were and are idiotic fabrications.

It seems to me that Wikipedia does a pretty good (if imperfect) job of staying politically neutral.
0 Votes
+ -
He has no examples
FrankleeMiDeer 24th Nov 2009
He heard it from a friend of a friend who heard it from Rush or Hannity.
0 Votes
+ -
Examples are available
LarryPTL 1st Dec 2009
I've listened to Bill O'Reilly on numerous occasions and have heard him more than once absolutely condemn Wikipedia for allowing anyone to post anything about persons of interest. He has given up trying to correct the inaccuracies said about him.

Go to Wikepedia today and you will see several comments designed to attack his integrity (try and find the same negative comments said about Obama - no one can add anything to articles about him anymore without it getting heavily sensored). There is one entry strongly suggesting O'Reilly is a racist, and another suggesting that his verbal attacks on Dr. Tiller the abortionist led to Dr. Tiller being murdered. Every time O'Reilly tries to edit them out, they get put back quickly.

I should not have had to make this post, anyone with a web browser could have gone to the Wikepedia entry for O'Reilly and seen for themselves the slants against him.

As I said before, I shall say again - until Wikepedia apologizes and sets mechanisms in place to prevent politically motivated posts from appearing about persons of interest, they will have a sullied reputation.
0 Votes
+ -
Experts may hold back
peltierd 23rd Nov 2009
Another contributing factor may be that we're approaching the level of expertise that subject matter experts are *willing* to contribute. SME's may still have the time, but at what point does it erode their livelihood to divulge more knowledge and more detail? There is an economy of textbooks, professional and scientific publications, prestige (publish or perish), and business intellectual property that is threatened by the Open Information culture of Google, Wikipedia, etc. I would expect there to be a natural, community-imposed limit.
0 Votes
+ -
And yet we can borrow books from the Library
PublicComments 23rd Nov 2009
and the same analysis applies from the author's side.
True. But comparatively, the cost and access controls of books in a library effectively limit flow of information in today's paradigm. (When was the last time you were prevented from viewing a Wiki page because someone else was reading it? Never.) Libraries aren't free. You pay for that library with your taxes. That library pays for the books it buys. There's economic incentive to authors to continue that. Until perhaps when libraries stop buying books and colleges award tenure based on the number of Wiki articles they've written...
0 Votes
+ -
RE: Is Wikipedia maxed out?
erisian 23rd Nov 2009
sub-perspective:

many folks i know (including myself) have spent hours working on corrections or additions to Wikipedia, just to be shot down by a higher editor. this is not due to the quality of work, but because the information added is considered "Reason: Not Noteworthy"

attitude like this has turned many would be editors into browse-only users. a few hours put into data collection, research, prose, formatting, cross-referencing other articles/stubs... seeing these articles deleted under the above "Reason" flips off the collaboration switch pretty fast.

dont know how many people fall into this category, but i expect a fair number.

the "out of work" theory is likely a far greater contributor than my paltry example.
0 Votes
+ -
The Achilles' heel of WP
L_Mackinnon 23rd Nov 2009
The trouble with Wikipedia is many of its editors have an insanely shallow view of how "encyclopaedic writing" actually works. They tend to think of science as a patchwork of statements that are each, on their own, raw facts or provable, deducible from raw facts. That way, they think, a wiki or a acience handbook could do away with any synthetic statements, any reasoning and critical judgment, because those are all "original research" in wiki eyes, they can be branded original research. But in any paper encyclopaeida or textbook (except some natural science books) some of the content doesn't squarely boil down to that kind of raw fact. It's *interpreted* and entwined with concepts.

When you've been at WP a little you get to meet these dorrknob guys who don't really know the stuff they're writing about but who think every statement must be sourcable in so many words to an "established source", and if it can't be sourced because no one's ever needed to state it as a soundbite, they'll say "can't write that, son! Original research!! Bad-bad-bad!" That kind of dumbed attitude to science and writing effectively reduces many articles to incoherent parroting of whatever stuff you can find a quote for. And drives good and knowledgeable editors away.
0 Votes
+ -
Can you spell Google ads?
Wait A Minute Here 23rd Nov 2009
Wikipedia should include Google Ads throughout. Everyone
uses Wikipedia. they would make money. and make money and
hire a staff of 50 to do it full time, and they should
use a submission process for at large editors. People who
have rejected materials should be graded. For instance, a
person who's great on science but too emotional on
politics should be graded as such so that the editors
know what to look for.
0 Votes
+ -
RE: Is Wikipedia maxed out?
gstrzok 24th Nov 2009
Sometimes I think that this great resource has received a lot of attention and what was created was beautiful.

Many people are in search of something else worthy of putting their time and energy into, and that is where I think many people are looking to go.

I would say that the next large noble project worth doing is writing a set of text books that can be used universally, and translated. Putting what we know into textbooks, and sharing that knowledge.

Just my thoughts on what to do next. That is where I am going.

G. Lance Strzok
0 Votes
+ -
RE: Is Wikipedia maxed out?
FRHill Updated - 27th Nov 2009
Wikipedia should actively recruit senior citizens through organizations like AARP and local senior centers that have computer centers staffed by volunteers. Also to have an on-line mentoring program for less-savvy senior citizens to learn how to be a Wikipedia Editor. Retired college professors should also be a good source of part-time help. Also, recognition and rewards for outstanding and continuous service.

Frank Hill
frhill@isp.com

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix