Fark Creator Slams 'the Wisdom of Crowds' 507
GovTechGuy writes with some harsh words from Fark.com founder Drew Curtis, speaking at a conference Tuesday in Washington, DC: "'The "wisdom of the crowds" is the most ridiculous statement I've heard in my life. Crowds are dumb,' Curtis said. 'It takes people to move crowds in the right direction, crowds by themselves just stand around and mutter.' Curtis pointed to his own experience moderating comments on Fark, which allows users to give their often humorous take on the news of the day. He said only one percent of Web comments have any value and called the rest 'garbage.' Another example Curtis pointed to is the America Speaking Out website recently launched by House Republicans to allow the public to weigh in on the issues and vote for policy positions they support. Curtis called the site an 'absolute train wreck.' 'It's an absolute disaster. It's impossible to tell who was kidding and who wasn't,' Curtis said."
Fark.com (Score:5, Insightful)
It cuts both ways (Score:5, Insightful)
He said only one percent of Web comments have any value and called the rest 'garbage.'
Funny, that also seems to be the case with most articles. Garbage in, garbage out.
Re:Wisdom of the crowd. (Score:5, Insightful)
I believe a soon to be classic movie explained it best.
Edwards: Why the big secret? People are smart. They can handle it.
Kay: A person is smart. People are dumb, panicky dangerous animals and you know it. Fifteen hundred years ago everybody knew the Earth was the center of the universe. Five hundred years ago, everybody knew the Earth was flat, and fifteen minutes ago, you knew that humans were alone on this planet. Imagine what you'll know tomorrow.
One man's "garbage"... (Score:2, Insightful)
Keep in mind that Drew is running Fark as a business, and certain comments that might rail against his corporate superiors will get modded or banned. Drew and his modmins are know to ban people based on petty rivalries and personality conflicts. Fark is no bastion of "free speech", and what would he know about "wisdom" from a site that is dedicated to goofball headlines and accelerated political trolling.
Intelligence in crowds (Score:4, Insightful)
Is like resistance in a parallel circuit.
Missing the point (Score:5, Insightful)
Come on. "America Speaking Out" is not about getting wisdom from people, any more than the White House's solicitation of ideas for the oil spill was. It's about allowing people to feel like they have a voice. Don't spoil the illusion!
As to the "wisdom of crowds" in general, it depends entirely on the context. We know for a fact that when crowds have significant enough motivation (like money), they do an excellent job of predicting things, for example. But if your motivation is to have people point at your comment and emote somehow (laugh, get angry, friend you, whatever), then obviously, truth and wisdom are not your goals, so you don't often find truth and wisdom there.
It's about Cherry Picking. (Score:4, Insightful)
Slashdot is not so different, there are some pretty useless comment here. Hell, I make a lot of them on occasion myself.
But if you read between the lines and "cherry pick", there are usually hidden gems about a software package, a piece of advice or something truly fascinating.
The noise to signal ratio is what matters, and on Slashdot it is better some days than others but in general it's a lot better than a lot of other sites. Some sites like YouTube or even to some extent Digg have almost no added value in their comments and the "noise" is pretty high.
It's not just about the freshest content (which is why I think a lot of people frequent Digg or Hacker News), the comments are what makes a user-generated-content site work... at least for me.
That's why I keep coming back here.
Re:Wisdom of the crowd. (Score:3, Insightful)
"None of us is as dumb as all of us!"
There are always standouts in crowds (Score:5, Insightful)
I run a site that targets the same demographic as Curtis and while I concur that the vast majority of posts provide little value, there are a subset that are well reasoned and very helpful.
Any crowd is going to eventually devolve into a set of leaders and a set of followers and I think the problem that we see online is that the leaders are often not the most informed, but the most controversial.
However, i'm not sure that's much different from anywhere in the real world
Re:What ? Wisdom ? Republicans ? (Score:3, Insightful)
Lets just say that both major parties have an underlying sameness that prevents any progress other than over tiny issues.
Misapplication (Score:5, Insightful)
It was noted in the original paper that the wisdom of crowds applies when comprised of aggregate decisions of individuals making decisions as individuals. On most websites this is not what you get.
Drew goes so far as to imply (by my reading) that crowds act more stupidly than individuals. These crowd failures are identified and discussed even on the Wiki page [wikimedia.org], most notably relevant to Fark.com and Americans Speaking Out:
Due to the nature of the websites various factors come into play which ruin contra to requirements for "the wisdom of crowds". Not forgetting that if it's on the internet, it's probably not being taken seriously and therefore is hardly a gauge of anything.
(I'm not wanting to be seen as endorsing the "wisdom of crowds", I'll take the wisdom of a few experts instead thank you very much, but the argument presented here is extremely flawed).
Online anonymity = Trash (Score:5, Insightful)
I suspect that the anonymity granted by a mere handle online gives many people license to compete for "points" on any ground that can get a laugh or comparable reaction from their online peers. The few who may have actually something to contribute to society will either find their attempts drowned out by that crowd, or won't bother to frequent Fark towards that end.
By comparison, I find that Slashdot's peer-based moderation system fares quite well in filtering the noise. It's not perfect, but the Slashdot crowd seems also a good bit less driven to cash in on quick, cheap thrills.
On the whole, though, I trust far more in the thoughtfully conducted discourse of the considerate few, than the multidirectional pull of large crowds. I wonder if that says something, too, about the effectiveness of our democracy.
Re:It's about Cherry Picking. (Score:2, Insightful)
Re:On the stupidity of crowds. (Score:5, Insightful)
Interesting. The thing is that people like to believe that crowds are smart.
A good example for me was in a class I took in college.
It was the classic you are on the far side moon and put this list in order from the most important to the least.
The point of the exercise was to show that one person could make choices faster but as a group you made better choices.
Well when we put our scores together I scored higher than my group did.
They really had a hard time understanding that a compass wouldn't work on the moon or that the radio would be limited to line of sight. The decided they knew better than I did.
The professor was really kind of upset with that result because it sort of messed up her point since I had gotten the best answers correctly and quickly on my own.
The professor asked me why I thought that was. The only thing I could come up with was that once you have an optimal solution bringing more people in only increases the chances that you will end up with a sub optimal solution.
Re:What ? Wisdom ? Republicans ? (Score:4, Insightful)
Both sides of are equally stupid. When you go Far RIght you are hindering all progress. If you go to the far Left you are trying to fix things that doesn't need to be fixed, or with solutions that just makes them worse.
When you open the gates for public opinion you are going to get the Crazies from both sides. And because they feel so insanely strong about their opinion they will be the most vocal... Drowning out the ideas of the more sane people.
Re:Missing the point (Score:5, Insightful)
We know for a fact that when crowds have significant enough motivation (like money), they do an excellent job of predicting things, for example.
Actually, no. We need more research in this area. What we do know is that groups judge better than individuals. Large groups, if there is some selection involves, appear to share that. Don't forget that almost all of the prediction markets used so far have a strong self-selection involved.
If you want to study large-scale crowd predictions, take horse racing or other sports bets.
What crowds are excellent at is predicting the obvious and filtering out the personal bias we all have - you one way, I the other, in a crowd that cancels out and we all together arrive at a pretty good mean estimate. But as soon as the judgement requires any expert knowledge whatsoever, you have strong selection at work (most people don't "bet" on things they don't understand), which kind of violates your core assumption of having a crowd, not just a group of experts.
Re:One man's "garbage"... (Score:2, Insightful)
Re:"Fark" is still around? (Score:3, Insightful)
What makes fark "anonymous" but something like HuffPo not? Perhaps there's a market for a real-name-only, must post your address discussions site, but it'll be largely unused in this world.
Re:What ? Wisdom ? Republicans ? (Score:3, Insightful)
The democrats want a -bit- more government, and are totally willing to enforce the parts of the constitution they like, namely the right to free speech (so long as you aren't promoting "hate" crimes, can't have true freedom now can we?). The republicans want a -bit- less government, and are totally willing to enforce the second amendment but forget any right to privacy (look at the PATRIOT Act), etc.
Ok, so you might get different views on abortion, welfare, etc. but forget any real debate over hard money, real tax reform, elimination of various government programs, etc.
They are two sides to the same coin and any differences serve to cloud the main issue of sameness.
Re:Missing the point (Score:4, Insightful)
It's hardly recent. Look at the early days of our nation and you'll find systemic corruption on even broader scales. Things are bad, sure, but they were even worse(!).
Re:One man's "garbage"... (Score:3, Insightful)
Personal attacks on him or his website does not refute the "wisdom" of his words.
What "wisdom"? Drew is after page hits and maintaining an advertiser-friendly site, not wisdom.
Re:It's about Cherry Picking. (Score:3, Insightful)
If you have ever read the comments sections of the yahoo news posts you will realize that half of all people are dumber than average, and they all have a yahoo account.
I feel "more stupider" after reading those comments for 5 minutes than I did after having my finger sewn back on after a tragic sandwich making accident.
I find slashdot to be remarkably good in the value of the content. 1% of comments ere may be all that have "value", but they tend to float to the top.
Along the way I find some frivolous humor and conversation that may not be valuable, but I enjoy none the less.
Re:Wisdom of the crowd. (Score:3, Insightful)
The truth is that one-on-one, if you explained a comparatively difficult concept to an individual, you have a higher chance of getting the idea across, because you're giving that person your attention and answering any specific questions they might have. If you did the same thing to a room full of people (sound familiar?), and just stopped talking after you *thought* you'd given them enough information, many of the listeners will sit there scratching their heads and think "well, I don't get it now, but I'm not going to be the idiot who raises his hand and asks questions... It'd be better if I just asked one of the smart guys. After class.".
There are enough "smart" people out there who could relay the information to the "dumb" people if they did so with small groups, who could ask questions back. This is why it takes a few days for an idea to "sink in" after a public announcement has been made -- the people who didn't get it are looking for ways to properly understand whatever it was they were told. This reason alone, means that they are not "dumb", it may just take them a bit longer to ingest a new idea.
If you take 100 people, throw them in a room, tell them something that goes against everything they know and then yelled: "Tell me what you think of that! Now!", then sure, you won't get very encouraging result. But that's just because you used the wrong method to convey the information. They're not dumb for not getting it. But you may be, since you chose this method to get your idea across.
Irony (Score:5, Insightful)
there is a danger in his feelings (Score:4, Insightful)
the problem is, his feelings lead one to think this dangerous thought: "99% of the crowd is dumb... therefore, we need some more trustworthy entity for wisdom"
when you say that, you've committed a worse stupidity than the aggregate stupidity of the crowd
what he says is essentially true, the crowd is stupid in aggregate. getting wisdom from the crowd is a process of gleaning the nuggets from the bullshit. the problem comes when the process of separating the wheat from the chaff gets so tedious that you wish there were a shortcut, that you wish there were some special class of people who are better than the average man, and trust them for wisdom instead. which is a FAR more dangerous thought than simply recognizing the plainly obvious stupidity of crowds. there's no shortcuts: placing your trust in some sort of clique or aristocratic division is when the REAL trouble starts
so yes, people are dumb. but yet it is even dumber to trust some small segment of people according to some ill-defined parameters of what wisdom is instead
i think drew has just been modding too much. if i were a proctologist, i would be sick of looking at assholes too. if i were modding comments all day, and i was constantly exposing myself to the kind of mental diarrhea you see when browsing slashdot at -1, then i would hate people and crowds as well
i think reading the shallow end of the comment pool constantly will turn you into a misanthrope, a hater of mankind
limit your exposure to the idiot area of comment boards, or it will give you brain damage
Re:It cuts both ways (Score:3, Insightful)
Re:It cuts both ways (Score:3, Insightful)
The 1% rule applies to nearly everything (actually, I seen estimates vary from 1%-10% and everything in between). Books, music, movies, art, etcetera.
I think something higher than 1% but not quite 10% is a better estimate for garbage, however, that doesn't mean the remainder are automatically masterpieces or anything, just higher than garbage.
Re:Wisdom of the crowd. (Score:5, Insightful)
This same "theory" has been made countless times before, and it's BS.
[...]
"well, I don't get it now, but I'm not going to be the idiot who raises his hand and asks questions..."
You just put forth the perfect evidence to SUPPORT that theory. The fact that a bunch of people getting together makes a person seperate from the logical process of asking for more information.
Re:Irony (Score:3, Insightful)
I think there's a basic problem with talking about the sort of small minded fuckwits who post the same tired cliches to *every single story* on Fark and then extrapolating that to whatever the fuck a `crowd` is.
Re:Irony (Score:5, Insightful)
Re:Intelligence in crowds (Score:3, Insightful)
You're not arguing against him, you know. (Score:1, Insightful)
Who better to point out that crowds are dumb, irrational, and poorly-researched?
Re:Irony (Score:3, Insightful)
What people don't realize is that there is a moronic leader (or malevolence) at the heart of all witch burnings. It isn't the crowd calling for the witch to be burned, it is the moron who rally's the crowd to his cause. It just takes a crowd to make witch burnings palatable for most people.
The Emperor Has No Clothes is another classic about thoughts of crowds. There is a moral to the story, which is lost here, sometimes it takes innocence (or bravery) to say what everyone else is thinking.
Re:Missing the point (Score:4, Insightful)
Many of the earliest examples of corruption were blatant enough that they practically self-announced. Lawrence Lessig has spoken/written extensively on the issue - check out his videos at http://lessig.org/ [lessig.org]
Re:What ? Wisdom ? Republicans ? (Score:5, Insightful)
The best system is adversarial but friendly: liberals arguing for each change that sounded good, conservatives challenging each proposal demanding evidence that it actually is good, but both agreed that the goal is to make the country better. We pretty mich have none of that; it's all meme-parroting and visciousness and stealing from our grandchildren.
Re:Fark.com (Score:3, Insightful)
And there's a reason Florida and Ohio have their own news tags.
religion (Score:4, Insightful)
No single person could ever believe the idea that god had a head of an elephant or jackal, or that god created woman from man's rib. But somehow, when a billion people believe it, it's easier to fall in line.
Re:Fark.com (Score:4, Insightful)
The links can be interesting, but the moderators are pillow-biting nancies who will shadowban you at the drop of a hat.
funny source (Score:5, Insightful)
Do people often associate the word 'wisdom' along with the word 'Fark'? From HIS point of view, I'm sure he's absolutely correct. Depends on the crowd, though. If you go to a TED conference, the crowd is going to be substantially more wise than the crowd on Fark.
It also depends on the subject. Religion and politics can overwhelm even the most wise person. (see also: the 'Conservative Right' in the U.S.)
Yes! We're ALL individuals!! (Score:2, Insightful)
...I'm not.
Selection (Score:3, Insightful)
I understood that the difference between wise crowds and stupid mobs is the processes of selection of good results that have become feasible with modern technologies.
For example, asking random people is not the best way to know about encyclopedic subjects. Wikipedia works because it has crowds and a process (easy edition, easy correction, talk pages, contributions history,...) that preserves good contributions and rejects bad ones.
Same about the Linux kernel, Torvalds' role filters good and bad contributions.
In Slashdot, we have moderation that allows me to read the cream of the comments avoiding hundreds of trolls, redundant comments and not very enlightened sentences.
Re:Wisdom of the crowd. (Score:3, Insightful)
Which reveals the screenwriter as one of the dumb ones...
rj
Re:Irony (Score:5, Insightful)
Considering both are anecdotal it's hard to say what is a "counter" of what. However as an argument I found that book pretty lame - it's a lot of anecdote. Not to mention that I think people extend the title beyond what Surowiecki intended he doesn't even assert that all or even MOST crowds are smart. Rather that crowds which have some attributes are smart. However most of those attributes are far more vague than the questions posed which makes the problem of determining a smart crowd from a dumb crowd a harder problem than asking the question. I'd add that even given his assumptions are true for some crowd the kind of question is crucially important. It must be limited in scope. i.e. multiple choice or have some generally understood bounds (that is if we asked a bunch of people what the weight of something nobody knew what it was you wouldn't get good answers). You can't "average" the cure for cancer, or the proof for P=NP, etc...
So, to me anyway even if James is correct in his assertions that some crowds are smarter than all of their constituents this information isn't very useful.
Oh and the ox experiment isn't even close to useful since it wasn't repeated and unless the results were recorded somewhere it's lesson might not even be true. Perhaps there was someone with the same guess as the crowd or within one pound of the crowd - a variance you might be able to attribute to chance. Which would mean that the crowd isn't appreciably more intelligent than it's smartest person. This wasn't repeated multiple times so it's difficult to figure out if the crowd vs. constituents is simply a random occurrence. Not to mention that it's possible there was some bias in the crowd (it sure wasn't a random sample), etc... So again it's at best unclear if this is a useful trait.
Re:Wisdom of the crowd. (Score:5, Insightful)
There's more to it than that. I've observed many times that stupidity is contagious. People who are smart tend not to be loud and obnoxious, but idiots love to holler. It's hard not to notice someone who's hollering, and as we can all attest, it seems the stupider you are, the louder you're going to holler. Talk radio has become a huge business on this principle alone. So now you've got a bunch of people who are at the fat part of the bell curve, who are all paying attention to the idiot hollering, and after a while, they start to think: "Well, he's pretty loud so he must know what he's talking about". And if the idiot is not only loud, but plays upon most peoples' preference for standing behind the bully instead of in front of him, then you've got a recipe for a stupid stampede. Finally, because a lot of people like to be in the biggest, loudest group just because it seems safest there, you've got a group that's inoculated against the incursion of information. Game over, stupidity becomes the new norm.
No, I'm inclined to believe the article, that crowds are indeed stupid, perhaps dangerously so.
Re:On the stupidity of crowds. (Score:1, Insightful)
That seems like an odd reaction from the prof. It is well known that groups producer better results than the average person, but worse results than the best.
Re:Irony (Score:5, Insightful)
At best, the ox example suggests that given an problem that for which:
then the mean value will likely be at least close to the right answer. In other words, a panel of moderately expert individuals can probably come up with the right answer. That's not the same thing as a "crowd" of random people.
Even if the crowd is truly wise on general matters (or at least is smart enough to not participate in things they don't understand), it's unlikely that you'll ever be able to get rid of all of the outside influences on their answers, and thus their answers for any sufficiently complex issue are unlikely to be precise enough to be useful. If the answers all sound like a mix of Democrat and Republican talking points, an average of their opinions is garbage because neither group of people is expressing any fine detail. A significant percentage of those people haven't even considered that there should be fine detail to consider, instead just answering the questions the way someone else told them to answer them.
Even if you somehow could eliminate outside influences, most problems can't be distilled to a simple average. If you could average the public's opinions on complex social issues, you might come up with some useful information, but it's essentially impossible to average a million paragraph-long answers in any useful way, and anything short of that doesn't provide sufficient detail to accurately discern the opinions of the people involved.
If you try to reduce a complex issue to a series of yes and no questions or even "agree, mostly agree, somewhat agree, somewhat disagree, mostly disagree, disagree" questions, you'll automatically get bias introduced by the way you distill the issue down to those questions. No finite number of questions can realistically express every subtle detail of a person's opinion on an issue. For example, what if I believe that abortions should be allowed in cases of rape and incest, but not on Sunday? I can pretty much guarantee no question writer will ever ask that one, but in theory, somebody might feel that way. That's a rather absurd one, but not all of the fine details would be, and some of them are the very data you're looking for. The outliers provide critical insight into complex issues.
In short, you're trying to extract an instantaneous RMS of a complex analog waveform by looking at a copy of the waveform that gets latches up to the rail just on either side of zero, which in turn gets transmitted through a noisy channel so that the SNR goes negative by about 60 dB. It doesn't work, but not because it's impossible to get the SNR from the original waveform. You just have to get to it before the data gets quantized, clamped to the extremes, and buried in noise.
Re:kettle, meet pot (Score:3, Insightful)
Actually, if that were the case, we'd at least average out to somebody reasonably competent who represents the average view of the public as a whole. That's a heck of lot better than what we usually get.
Generally speaking, voters vote for the person who shouts the loudest/most frequently/most recently. The result is that the person with the most money wins, which in general is the person least like the people voting. If the two candidates shout equally loudly, frequently, and recently, then voters vote for the person who does the best job of telling them that he or she is the most like they are, which is almost never a person who actually resembles them.
Re:Garbage in Diamonds Out (Score:3, Insightful)
Even if 99% of all comments are garbage, that is simply an argument for better filtering, not that the crowd has no wisdom. The whole point of the wisdom of the crowd in the first place was to apply filtering mechanisms to ensure the best gets to the top. It seems to work well for Wikipedia and it even will work for this comment if you mod me +1.
The reason 99% of comments are garbage is the motivation behind the comments, a well though out insightful comment may take too much effort for the little gain (many intelligent comments simply get passed over), while a witty comment or troll that does nothing to advance the discussion takes much less effort and has more gain.
Re:Irony (Score:3, Insightful)
I imagine there are certain classes of problems that "crowd sourcing" will work with, and a much larger class where it does not work.
Re:kettle, meet pot (Score:3, Insightful)
Re:Missing the point (Score:3, Insightful)
That's because the stock market isn't purely a static selection of outcomes.
It dynamically pits each player against all the others, making the outcomes highly interdependent on iteratively changing variables. This creates randomness and volatility based on speculation beyond the intrinsic valuation of the stock(s).
Re:Wisdom of the crowd. (Score:4, Insightful)
Counter example: The recent democratic primary in South Carolina. An unemployed person with no campaign, no money, practically no anything living in his parents basement won. How did he win? Why did he win?
Because his name was placed first on the ballot.
People are only as smart as they want to be, and unfortunately as a country we are intellectually lazy. Look no further than any of the 24 hour news networks for proof. Everything is a soundbite, designed to cause as little original thought and critical thinking as possible. Look at congress, and how campaigns are run. Soundbites that pander to their base, telling people what they want to hear instead of what needs to be heard. Everything is spin and distortion, wrapped in colorful glitz and glamor packages for the masses to make sure they keep the ratings up. Divide and conquer.
Yes, there are enough smart people to relay information to less informed. That isn't the problem. The problem is that people don't want to listen. Thinking is hard. Changing or questioning your perceptions and beliefs is too unsettling. People like being lied to as long as it is the lies they want to hear. Many people are so wrapped up in their own reality distortion field that it takes an act of $DIETY to shake them out of it.
Ignorance really is bliss.
Re:kettle, meet pot (Score:2, Insightful)
*In my experience this is rairly the case. Rather, the crowd tend to follow the the loudest bigot who affirms their prejudices.
Taking his comments at face value (Score:3, Insightful)
He's clearly missing the point behind the concept, but I can't tell if he's doing it on purpose to try to make a joke out of it, or if he simply doesn't understand the term. Since this is the internet, and it's traditional, I'll respond under the assumption that all his comments were intended to be taken at literal face value.
The idea is that the crowd, as a whole, is smarter than the smartest individual within it. If you attract a dumb crowd, you're not necessarily setting a high bar. And, even with a smart crowd, you get a lot of noise. You need a way to filter out all the noise, you can have just one "editor" do it, but that's not really the best way. When the information you want the crowd to process for you can be broken down completely into mathematics, you're in luck because the noise will simply drop out naturally -- as is the case when you, for instance, have everyone guess the weight of an Ox and then simply average the guesses or when you write a search engine that uses links as "votes". Back in the days when Google was new and link farms didn't exist, it was orders of magnitude more effective at returning relevant results (even if you only got a relevant result say 85% of the time, other serach engines could only deliver them maybe 10-20% of the time) simply because it harnessed the "wisdom" of the crowd. It put every other search engine at the time to absolute shame, and that's why it became dominant practically over night. Clearly there is something there.
On the other hand,when its written text like Slashdot or even Fark comments, then you need a good system in place to do it. Yes, you need something akin to editing, but as Wikipedia and Slashdot show us, you can crowd source the editing as well. When you look at the collected moderated-up analysis on Slashdot on any given article, you end up with content that is overall more thoughtful, comprehensive and thorough than any given individual within the crowd could have produced.
Yes, Slashdot could have a single editor in place moderating all the forums, but that would neither be realistic or as effective. Once again, a crowd can do the job better than an individual.
Re:Taking his comments at face value (Score:3, Insightful)
No, he is absolutely correct. There is no such thing as "wisdom of crowds".
That idea is false. A person, an individual, is smart. A crowd is stupid. A crowd is subject to peer pressure and mob mentality. A person in a crowd will do things he would never do alone, such as flipping cars and lynching people.
You mention, indirectly, one of the major problems with crowds: defection. Your example is link farms that skew the "wisdom" of Google's "crowd". The same thing can happen in any crowd.
A crowd is not smarter than the smartest individual because intelligence is not cumulative. Instead, a crowd is only as smart as its most charismatic and/or manipulative member. This is often explored in literature, television, and film.