KM on a dollar a day

Musing on knowledge management, aid and development with limited resources

The sound of the crowd

with 3 comments

There’s been a lot of good stuff on various aspects of crowdsourcing lately. Makes me wonder if it is finally coming into its own. The debate still rages though about whether the crowd can outperform an expert at determining the best answer to a problem.

Ben Ramalingam has a good piece on his blog that looks at some of the latest research on the necessary conditions for crowds to be “smart” and outperform experts as well as some of the potential implications for the aid world. James Surowiecki also looked at this some years ago in his book “The Wisdom of Crowds” – I summarized some of the main points here a couple of years ago and what I saw then as some of the possibilities for aid and development.

One area where centralized expertise is still king in the aid world at least is in the area of guidance and procedures. We still often think it’s best to decide centrally what is best for  our offices and programmes that are run far from the centre. Nick Milton wrote a great piece on this “Real men don’t f0llow procedures” which looks at why people often don’t follow centrally issued guidance – mainly because it’s  seen to be incorrect and not to reflect the reality of those who have to implement it. His proposed remedy – involve users of guidance in writing guidance – using the expertise of a crowd of users over that of a smaller group of “experts”.

The example of guidance illustrates an important aspect of crowds and crowdsourcing that is often overlooked. The debate on crowdsourcing is often pitched as deep expertise of one versus the aggregation of very limited knowledge of many. In reality crowds often contain large degrees of expertise within them, often unevenly distributed, and which is not easily surfaced by traditional ways of working. Exploring the guidance issue further – users of guidance have a lot of direct relevant experience about what works and what does not which can be very helpful for developing procedures both collectively but also individually. They might not have a full global perspective of all situations where a procedure will be used, and they might not have technical and theoretical expertise in all areas the guidance covers – but they are nevertheless experts in their own right. So it’s not only a question of whether a crowd can outperform an expert – it might well be the case that their knowledge is complementary.

This idea quite likely applies to other topics too. Take crowdsourced data collection in emergencies which has created such a heated debate. It’s clear that those who live through and experience an emergency are not generally likely to be experts in emergency response or emergency data collection. But at the same time they are experts in actually experiencing the crisis in a way that external experts are not – and these can therefore be seen as complementary viewpoints or data points.

I couldn’t finish this blog post without a shoutout to my latest social media must use/time wasting distraction Quora. This is a very interesting experiment in crowdsourcing in that it combines features of existing crowdsourced question and answer systems (such as wikipedia, Yahoo answers etc.) but links them with social networking such that you can follow topics and questions and vote them up, but you can also follow the contributions of individuals. In using social networks, and also some good marketing they seem to have signed up a lot of people with expertise in various fields, some quite high profile, and are getting massive growth and are generating some interesting question and answers.  At the same there’s a lot of dross and inanity there already. I’m curious to see as membership grows and more and more people are contributing things which to put it politely – they don’t have much expertise in – whether the content will go the way of youtube comments, or whether the good answers will be able to rise to the top. It would be interesting to see how much the theoretical conditions for smart crowds are met with Quora, and of course how well it actually works out in practice.

Written by Ian Thorpe

January 6, 2011 at 10:40 am

3 Responses

Subscribe to comments with RSS.

  1. […] here: The sound of the crowd AKPC_IDS += "9066,";Popularity: 50% […]

  2. You must have an incredible organisational culture Ian, if you can get field staff who typically won’t even engage with procedures to the point of feeling enthused to be aware of, maintain currency in and/or occasionally follow them, to engage at a higher level in a crowdsourcing effort to write them….

    I mean it all sounds good in theory, but I can tell you it is something that we haven’t cracked. Getting field / ctry office staff to participate / consult in procedure and/or systems development is like pulling teeth. wisdom teeth. impacted wisdom teeth. I think you have to have a process that takes people offline from their dayjobs to give them the time & space to do it – and who invests that much or thinks like that..? grumble sigh.

    Cynan

    January 10, 2011 at 9:03 am

    • I take your point, it’s not easy at all.

      I think what Nick Milton is getting at though in his post is that by engaging people in themselves in identifying what works (usually through communities of practice) not only will the guidance be better, but there is also a greater chance they will want to use it. Despite the inevitable complaints about guidance people seem to want it nonetheless.

      In our case a few motivated individuals from the field have without prompting taken their own initiative to try to come up with practical guidance in areas where they feel it is missing or not adequate – the trick will be to make use of this input effectively to feed into HQ guidance and to help connect people together with shared interests.

      Ian Thorpe

      January 10, 2011 at 9:54 am


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: