Real-Time Fact Checking With "Truth Teller" 149
The Washington Post has announced a prototype news application called "Truth Teller", that displays “TRUE" or “FALSE” in real time next to video of politicians as they speak. The Knight Foundation-funded program automatically transcribes speeches and checks the statements against a database of facts. From the article: "For now, the early beta prototype has to be manually hand-fed some facts, and thus only works on topics it has been specifically designed to recognize. Since Congress has yet to pass a budget, and financial discussions are prone to widespread lies and misstatements, Truth Teller is being piloted on the issue of tax policy."
Check truth in political speech (Score:5, Funny)
So basically they've made a static page with the word "FALSE" on it.
Re: (Score:2)
Re: (Score:1, Insightful)
This is WaPo. They'll use this to selectively enforce or dispute statements per their agendas. They're a bit like the MSNBC of the print world.
Who if you haven't seen, was caught AGAIN this week, editing video to create a damning situation consistent with their political motives.
Re: (Score:2)
Re: (Score:2)
He or she is probably referring to Fox News' coverage during the lead-up to the election, where they'd report on the results of early polls where Ron Paul often came in first or second among other Republicans, but just completely omitted his name... like he didn't exist. It was really weird.
Just skip to 1:15 to get past the drama. You'll get a good laugh.
http://www.youtube.com/watch?v=PMO7YG3Ul5g [youtube.com]
Re: (Score:2)
Fox misleads, and has left out context sometimes (although in the case of "you didn't build that" the context didn't actually save the line) but MSNB
Re: (Score:3)
Re:Check truth in political speech (Score:4, Insightful)
Re: (Score:3)
Re: (Score:2)
Political speak is far too nuanced for a computer based approach to detect truthiness. There is too much implied information, context, irony, satire, etc. that it won't accurately reflect.
Re: (Score:1)
You keep using that word...
Re: (Score:2)
Lol, you sound like a journalism major.
Just practice saying " would you like fries with that?"
You can repay that school loan in about 150 years.
Re: (Score:2)
Re: (Score:2)
It's the same with every president. They are all based on nothing but lies.
Re: (Score:2)
Congress never said he couldn't close Guantanamo. Congress only said he couldn't transfer prisoners to the US. If you can't try them, you have to let them go. Unlock the doors at Guantanamo. Shut off the lights. And walk away. It's not hard.
Re: (Score:2)
Re: (Score:2)
And that would be entirely the fault of Congressional Republicans. Indefinite detention is simply not an option for any country that claims to respect the rule of law.
Re: (Score:2)
The fact is, Chrysler is taking their money (billions of which were given them by American taxpayers), and they are investing it into Chinese production, creating new Chinese jobs. That's what happens when Bush II, Obama, and their ilk waste taxpayer money on bailouts of
Re: (Score:3)
I feel this is bad, because people will then be compelled to give more credit to stuff 'TRUE' not realizing that quotes out of context can convey the exact opposite meaning that was intended. In other words, those exact words may have been spoken by the right people, but in the context they were spoken in, they had a different meaning.
TL;DR. You're right. True will not necessarily mean you're not being lied to. Only FALSE can be displayed.
Re: (Score:2, Informative)
This is too true. Politicians are the masters at manipulating "truth" to their own agendas. You can say something completely factually accurate and still subtly *imply* with the statement something completely false. A simple statement like "This President says he wants to fight terrorists, this President Barak Hussein Obama, claims that he's going to fight Muslim terrorists" is 100% factually accurate. But it conveys something much more sinister and 100% false (that the President is somehow sympatheti
Re: (Score:2)
No. "Not Even False."
Re: (Score:2)
So basically they've made a static page with the word "FALSE" on it.
Not to be cynical, but how will we know we can trust the machine? Machines can be manipulated far more easily than humans. A bunch of sheeple relying on a machine for the truth is every politician's wet dream.
Re: (Score:2, Funny)
Simple. Record a video of someone claiming it is reliable. If it says "FALSE" it isn't.
Re: (Score:2)
Duh. It's well known that the way to tell if a politician is lying is to look at his lips.
If they're moving, he's lying.
Re: (Score:2)
Fact check (Score:2, Insightful)
Wow. This will never be abused. Now we are spoon feeding low information voters?
Re: (Score:2)
Doesn't that happen anyway?
It will be interesting to see if the idea develops. Each TV news channel could claim to have their own instance of the software and yet if you were to watch a politician's speech the displayed "truth" results might be very different between a broadcast on, say Fox, and any other channel.
Re: (Score:2)
Keeping in this veign:
What if the public exerted a selection pressure towards harmonizing the results between networks? Wouldn't that open up opportunities for abuse as well?
For instance, the public becomes outraged when, for example, FOX's algo says Obama's lying 84% of the time, while MSNBC says he's lying 22% of the time. If face is going to be saved, then both networks have an incentive to move toward each other's numbers. There'll probably be a point where they'll still differ, but not by enough to
Re: (Score:3)
The third option when there's a disparity like that is that the audience will complain about it / ignore it / turn it off.
Re: (Score:3)
Keeping in this veign:
What if the public exerted a selection pressure towards harmonizing the results between networks?
It won't make any difference. People choose networks which confirm their own personal bias, not because they want to find out the truth.
Re: (Score:1)
This isn't logical. One may be 100% correct. It would be a very rare occasion they are both off by the same percent.
Re: (Score:3)
I'm curious what it will base this on. You can have a given subject that two people will disagree on with regard to what is fact and what isn't, and both could be right depending on your source.
Take for example the Trayvon/Zimmerman mess. If a politician says Zimmerman was racially motivated, will this fact checker say true or false? Likewise if a politician says Trayvon had criminal intent.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I think that there must be at least one indisputable fact that all humans could agree on... I just don't know what it is but I'm certain it will never feature in a political debate.
Re: (Score:2)
I think that there must be at least one indisputable fact that all humans could agree on... I just don't know what it is but I'm certain it will never feature in a political debate.
Exactly. If everyone agrees on it, what's the point of bringing it up in a debate?
Re: (Score:2)
I once argued with a person who refused to acknowledge that 1+1=2.
Really. Not making it up. She rejected the existance of mathematics on religious grounds, arguing that god alone can provide true certainty.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I have no idea what scientism is.
The crazy I met believed that the notion of mathematical proof was blasphemous, as it placed mere imperfect human reason on a par with divine perfection. An idea she considered so dangerous, and suggested that the field of mathematics might have been invented or inspired by Satan himself as a way to inflate the ego of man and inspire rebellion against God.
And yet that is only the second craziest person I have argued with on the internet. Number one slot has to go to the pers
Re: (Score:2)
I have no idea what scientism is.
Let me Google that for you [lmgtfy.com].
That's not to say we don't have to be cautious [xkcd.com] about the claims we make of human reason
Re: (Score:2)
I, for one,... (Score:4, Informative)
The difference is that the T/Z interaction details are not facts.
How much money was allocated to the military in the last ten years in budgets?
How much money was spent by the military in the last ten years?
What percentage of the revenue of the federal budget is collected as income tax on those making in the top X% of income earners?
How many people receive social security who also have assets greater than $2,000,000?
Are there more or fewer naval ships in service today than in 2000?
Do the bottom 50% of income households pay zero income taxes? zero federal taxes? zero taxes?
How many days of vacation has the president taken in the past 4 years? Has the president taken more vacation days per year than the previous president?
How many firearms are purchased in the US in a year?
How many intruders are shot by firearms owners defending their property or person?
How many suicides are the result of firearm use? Of poison use? Of jumping off buildings?
What is the national average price of hamburger?
All verifiable facts from reliable, independent sources. Based on the ability of Watson to parse, search, and manage data, I think it's also possible to determine if the data is in question.
As someone who routinely fact checks and is appalled at the gross inaccuracies out there (not just the twisting or cherry picking, but simply wrong) I, for one, welcome our new robotic fact checking overlord(s).
Re: (Score:2)
Do the bottom 50% of income households pay zero income taxes? zero federal taxes? zero taxes?
You wouldn't trust a guy who runs around breaking windows and complaining about a crime wave.
Why would you trust guys who run around cutting income taxes and then complaining that half the country doesn't pay income taxes?
As someone who routinely fact checks and is appalled at the gross inaccuracies out there (not just the twisting or cherry picking, but simply wrong) I, for one, welcome our new robotic fact checking overlord(s).
It's not enough to verify the answer to a question.
You should always be looking at the question itself,
because within it is great opportunity to shape the answer that is generated.
Re: (Score:2)
If I am already struggling to understand politicians, then how the hell is a computer gonna do any better? Last time I checked humans were still better at understanding language than computers.
Re: (Score:2)
You are such an ignorant person that it is not even funny. The problem here is that people like to stretch things. And even the most intelligent, or knowledgable will get biased towards their own opinions without checking facts. For example I often will debate somebody and that other person will make an assertion, "like most people do this." I ask, really you got facts to back this up? Answer no they don't. Thus by putting the fact checker beside the person talking at least we can get back to the facts.
Me pappy always said... (Score:5, Insightful)
if(lips_move)
then
display("FALSE");
I have one already (Score:4, Funny)
... it's a sticker that reads "bullshit", you slap it on the screen permanently.
Joke aside, who will debunk the dunkers ? Everything we know is false, for vaster and more elaborate definitions of "false" as science progresses.
Re: (Score:2)
Because facts are facts - and if the fact checker is proven to be wrong, there will be outcry. That's the nice thing about facts - they are facts.
Politicians (and mathematicians) will argue that 2 + 2 = 5 (for sufficiently large values of 2), but a computer knows that 2.0000 + 2.0000 does not equal 5.0000 and will note that - for the parameters provided that sum is incorrect. The politician will then have to "admit" that they "fudged" 2 a bit, and they really meant 2.3, and then rounded up. And if you don't
Re: (Score:2)
a computer knows that 2.0000 + 2.0000 does not equal 5.0000
That's because it's not using "Outcome" based Math.
Re: (Score:2)
Because facts are facts - and if the fact checker is proven to be wrong, there will be outcry.
Doubtful, if you've been paying attention to the many fact-checker sites around, you'll see they are wrong a lot, and for the most part people don't care.
That's not possible (Score:5, Interesting)
that displays âoeTRUE" or âoeFALSEâ in real time next to video of politicians as they speak.
Few statements can be classified as "true" or "false" exactly. There is always some fraction of bullshit, but the fraction varies:
Politifact has
True --The statement is accurate and thereâ(TM)s nothing significant missing.
Mostly True -- The statement is accurate but needs clarification or additional information.
Half True -- The statement is partially accurate but leaves out important details or takes things out of context.
Mostly False -- The statement contains some element of truth but ignores critical facts that would give a different impression.
False -- The statement is not accurate.
Pants on Fire -- The statement is not accurate and makes a ridiculous claim.
And even this may be too coarse-grained.
Re: (Score:2)
Re: (Score:2)
Its even worse because a lot of statements that fall into those categories also contain opinion which is neither true or false until after the fact has happened and we can see how accurate it might have been.
Ive seen people who have expressed opinions supported by mountains of evidence and end up being wrong. I'm sure there have been opinions based on little more then gut feelings that have turned out to be correct.
Re: (Score:1)
True and False are easy (Score:2)
No - it's easy: What would you allow your 8 year old (or 12, or 16 year old) to tell you as true?
The top two are TRUE and the rest are FALSE. You provide a "human" error band of a few percent on actual facts (the federal government spent 2.5 Trillion Dollars last year would be true, and I'd take anything from 2.4 to 2.7 as an acceptable answer, since 2.67 was requested and 2.49 was approved).
Why should we allow half or partial truths from our leaders, when we don't accept them from our children?
Re: (Score:2)
Re: (Score:3)
Now one could argue, and Politifact did, that Mitt Romney used that fact in a misleading way, but the fact itself is true.
He said Chrysler is going to be building Jeeps in China to imply that American jobs would be lost.
There is no other reasonable or rational way to interpret what he said. That was a bald faced lie, uttered without actually stating anything that was false
Everyone knows the best lies contain as much truth as possible, and this was easily the lie of the year.
Re: (Score:2)
Re: (Score:2)
As soon as you bring interpretation into it
You can't communicate without interpretation. And quite bluntly if a fact checker is presented with something with multiple reasonable interpretations then that should be called out as well.
"The fences didn't kill the Ostriches. The fire did. I don't think we need to worry about whether fences are leading to trapped birds because birds can fly."
fences didn't kill the Ostriches -- true fact.
fire killed the ostriches -- true fact
I don't think we need to worry about w
Re: (Score:2)
"The fences didn't kill the Ostriches. The fire did. I don't think we need to worry about whether fences are leading to trapped birds because birds can fly."
Fact Checker: It is true that the fences did not kill the ostriches and that the fire did. It is true that SOME birds can fly, however, ostriches can not
Re: (Score:2)
In both of my modifications, the fact checker does not call the original speaker a liar ... they merely add the facts which the original speaker left out
I'm perfectly fine for them to call them out as the half truths that they are. If the fact checker is compelled to 'add facts' to qualify something as true, then that says something about the original speaker don't you think?
Re: (Score:2)
Re: (Score:2)
"Why is a company that just received a generous bailout from the U.S. government creating jobs in China rather than in the U.S.?
Are you suggesting the Chrysler not building a factory in China to build Jeeps for the Chinese would somehow benefit Americans?
Could that money not have been better spent improving production and increasing jobs in the U.S.? If the answer to the second question is 'No", is it really a good use of U.S. taxpayer dollars to help a company create jobs in China?"
If that's the message t
Re: (Score:2)
You are failin
Re: (Score:2)
This statement by Obama was a bigger lie, "I believe the only way to create an economy built to last is to strengthen the middle class, asking the wealthy to pay a little more so we can pay down our debt in a balanced way,"
This is no deception there. Obama was clear. You can agree or disagree with the statement, because it is his opinion.
And its a statement of a pretty abstract belief about macro-economic theory; it is almost ridiculous to compare it to a statement about where jeeps are made.
The theory of
Re: (Score:2)
The "lie" was not that jeeps would be made in china. The lie was that "American jobs were being outsourced and lost because Chrysler would build Jeeps in China."
Except of course that nowhere did the ad say "American jobs were being outsourced and lost because Chrysler would build Jeeps in China." That is your opinion of what the ad meant to communicate. Your opinion may be correct, but it is not a statement of fact made in the ad. Therefore it is not the place of a fact checker to call the campaign on it. It would be perfectly acceptable for Politifact to express your opinion in something they called an opinion peice. It is not acceptable for them to take that posi
Re: (Score:2)
They fact checked the claim "American jobs were being outsourced and lost because Chrysler would build Jeeps in China."
Politifact interpreted what they thought the claim was, and then fact checked it.
Statements like "The sky is blue." are simpler to interpret but you still have to interpret that the speaker is making a claim that the sky is blue. All but the very simplest of statements require interpretation.
You are plainly mistaken when you argue that politifact wasn't checking facts.
Now you can handwave a
Re: (Score:2)
Re: (Score:2)
I don't see it. Here's one...
"We weren't told they wanted more security " for diplomatic facilities in Libya.
Biden -- rated mostly false.
http://www.politifact.com/truth-o-meter/statements/2012/oct/12/joe-biden/biden-says-we-werent-told-Libya-security-requests/ [politifact.com]
They ~interpret~ Biden's statement, to determine what he could have meant a number of groups by "we".
They acknowledge It could very well be true that he and Obama weren't personally told Libya had
And then decide its 'mostly false' because even if by 'w
Re: (Score:2)
I think this will be limited to the absolute facts like
votes for/against bills
verifying quotes
world data facts
domestic data (i.e. job numbers/change in numbers)
Re: (Score:2)
Re: (Score:2)
Glenn Kessler, head of Pinocchio distribution at the Washington Post, wrote a fact-check of Mississippi Gov. Haley Barbour in which he claimed Barbour was lying when he claimed that people driving BMWs were getting Medicaid in his state. This isn’t a tale confined to Mississippi – it’s a problem all across the country. But when I supplied Kessler with a half dozen news stories from that very week from all across the country about individuals owning McMansions and flashy cars getting Medicaid, but Kessler refused to reconsider his ruling.
Re: (Score:2)
How about true is true and false is false. Why do we need all these gray areas of falseness or misleading? It just encourages people to not be truthful.
Not really, check out http://www.politifact.com/ [politifact.com], they don't just put the truth-o-meter next to a statement and leave it at that. They provide a factual reason as to why the rating is given. Take a look at the examples on the link I've given and then try to tell me that 'if you were a politician' you would want anything other than 'true' next to a statement of yours.
Will Truth Teller do mistakes? (Score:1)
Watson (Score:3)
Automated editorializing? (Score:3, Insightful)
Have you ever heard of the concept of garbage in - garbage out? If you ask the majority of people they think that things like return on investment as 'facts', but yet infinite growth in a finite system is impossible, and all economic activity is premised on energy and thermodynamics.
When politicians say things like 'high taxes are hurting business' will the system be 'hand fed' the appropriate answer, regardless of mountains of evidence showing otherwise because it discourages 'non-productive consumption', and that the high taxes pay for government infrastucture, welfare, and investment?
Similarly there have been lots of propaganda referred to as facts in terms of tax policy, by the likes of the 'chicago boys' and people like milton friedman et al, however these people don't believe that economics can be studied empirically, and tax policy as an extension of economic policy.
I have had my share of problems with my local oregon newspaper distorting facts of even its 'politifact', and generaly attacking the institution of government itself as bad, so that it can meet the expectations of the patrons which keep it in business.
Is is any suprise that news media that are conservative make way more ad revenue per viewer than liberal, say for example rachel maddow or the daily show vs fox primetime, even when they have better age demographics of viewership for advertisers?
Re: (Score:1)
why would anyone think that the Was.Post would recognize truth ?
have they published much of it lately ?
What about one that detects bad debating tactics? (Score:2)
I had been thinking "wouldn't it be cool if" for a while about something like this, but I would like to see it taken a few steps further. Though it would be rather difficult, wouldn't it be cool if there was a system like this which detected bad/underhanded debating tactics such as straw man [wikipedia.org], Ad hominem [wikipedia.org], cherry picking [wikipedia.org] and so on.
Re: (Score:2)
"I had been thinking "wouldn't it be cool if" for a while about something like this, but I would like to see it taken a few steps further. Though it would be rather difficult, wouldn't it be cool if there was a system like this which detected bad/underhanded debating tactics such as straw man, Ad hominem, cherry picking and so on."
(Note to mods: the following strange reply has a couple of layers, so be careful what mod category you use!)
We're talking about full Strong AI, aren't we? Political speech is one
Re: (Score:2)
I don't think that anyone is telling you that a computer WILL do it today, only that it would be what is useful. Logical fallacy detection would be, bar none, the most useful tool in debate because it would save so much fucking time if a buzzer went off when something someone says is clearly a bunch of shit from a logical standpoint.
Awesome. I was wishing for that during the debates (Score:2)
This, or later versions, could really be a boon to voters who aren't really interested in politics, so they often don't know an "obvious" lie when they hear it. For example, in some polls most Obam
Great. Can't wait for the... (Score:2)
Fox version!
I bet it'll be a Bill O'Reilly animation shouting...
"facts" ? (Score:1)
The thing about politics is that people do not agree on what the facts are, except in the most obvious, simple cases.
Also, people agree even less on the applicability of a certain "fact" to a certain problem.
This will accomplish very little. It may even be counterproductive because it may classify the speech of a true visionary as a lie because the thing is just to dumb.
Re: (Score:2)
By "facts" usually they're referring to what a "fact checker" (which is an actual journalistic role) would look into: simple, unambiguous statements that the newspaper would be embarrased to get wrong. "X was born in Y". "Under A's tenure, statistic B changed by C". Amazingly enough politicians lie prolifically about even those things.
Is it April 1st already? (Score:1)
I suspect a mechanical Turk, or perhaps a piece of performance art.
Not much is Black and White (Score:3, Insightful)
Re: (Score:2)
But the real problem isn't the politicians... because very few people are interested in hearing "well... it's more complicated than that" (let alone actually educating themselves on the issue). They want a simple black-or-white, true-or-false statement (as anyone who was on Facebook and saw the various image memes around election time) - and this software panders to that...
Easy (Score:2)
if (person.getJobs().containsKey(Jobs.POLITICIAN)) {
return false;
}
Where's the fact database? (Score:2)
Re: (Score:2)
There also clearly needs to be some fuzziness built in. If you have a politician stating that the annual budget of some agency is $15.6 million and it's actually $16.2 million, that's considerably less wrong than saying that the agency is entirely responsible for adding $1 trillion to the debt.
Also, Futurama did it first:
Morbo: Morbo demands an answer to the following question: If you saw delicious candy in the hands of a small child would you seize and consume it?
Jack Johnson: Unthinkable.
John Jackson: I w
Why not apply it to their reporting? (Score:2)
Back in the day, "fact checking" was something a newspaper or such ran against their own product. Readers' Digest was famous for their fact checkers.
If they want to check a speech in real time, why don't they run it on their own reporting and opinion pages?
Going around piously checking everyone else's facts is more creating news than anything else.
humans already have that app -- it's common sense (Score:2)
As a wise man once pointed out, you can fool all of the people some of the time and some of the people all the time, but you can't fool all of the people all of the time. Rupert Murdoch's news empire has made a fortune for him by following this dictum to the letter. Murdoch has figured out which people he can fool all the time -- angry white males who live in the US. And as another wise man once pointed out, a man will hear what he wants to hear, and disregard the rest. Murdoch isn't worried about his a
I have a much better idea (Score:2)
I think such a system should be a required filter before any journalist can publish an article. This filtering system should also red flag words that imply speculation on the part of the author such as "might," "if," or "maybe." And to take that a step further, television news should also have a system that identifies when file footage has been inserted into a report for dramatic effect.
Re: (Score:2)
Lets be honest here... (Score:2)
However, on the same token, when I presented Democrats with facts against what their leaders said, they'd tell me to "stop being a sheeple listening to faux news"
The fact of the matter is is that facts don't matter, people will believe who and whatever is more convenient to them.
Fortunately for the Washington Post... (Score:2)
... Republicans almost always lie, and Democrats almost always tell the truth.
Re: (Score:2)
You'd think so, but fact checking in the election seems to indicate that politicians will tell bald-faced lies whenever they're in the presence of the press, on the entirely correct assumption that a falsity which suggests a controversy will be better-covered by the press than an uncontroversial fact.
Re: (Score:2)
Is it called Knight Industries Truth Teller (K.I.T.T) ?