Advertisement

We need your help now

Support from readers like you keeps The Journal open.

You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.

If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.

HowardLake via Flickr

Column We’re all being misled. Why? Because we don’t understand numbers

Misunderstandings and lazy reporting of statistics can lead to everything from wrongful convictions to tragic deaths, writes David Robert Grimes.

JUST LAST WEEK Fianna Fáil came out with a truly cracking howler: “Fianna Fáil is now getting more than 100 per cent less access to Prime Time than the Labour Party in the same position.”

This is poorly worded on several fronts, but as 100 per cent is the totality of something, this quote actually implies Fianna Fáil were getting minus coverage, a state of affairs that perhaps chunks of the Irish population might wish were possible.

But such faux-pas abound everywhere we look. Statistics can be a useful way to represent data, but lack of understanding and innumeracy often renders them tools of obfuscation, turning potential insight into real ignorance. In this regard, the effervescent Mark Twain’s alleged quip about the three kinds of lie, “lies, damned lies and statistics” was undoubtedly correct.

Take, for example, a HIV test. The western ink blot/ELISA test is 99.99% accurate. Your doctor, ashen faced, apologetically tells you that your test came back positive. Your heart sinks, and a myriad of questions creep up on you. But what is the probability you actually have HIV ? This might seem like a redundant question – it would seem self-evident that it’s practically certain that a positive test result means HIV is present. Yet if you’re a typical Irish person, there is just about a 50% chance that you have HIV with a positive test.

How does this make any sense ? The paradox is resolved by a little bit of extra information: the base infection rate for HIV among low-risk Irish people is 0.01%, which is about 1 in 10,000. If 10,000 low risk people walked into a clinic to get tested, you’d expect one of them to have HIV. It is practically certain this person will test positive for the disease. However, in the remaining 9,999 uninfected people, because the test does have a small margin of error, you expect it to produce one false positive. So with this reference class of low-risk people, you have two positive results, only one of which is a true positive. Hence the 50% figure.

‘If you find this surprising, you are not alone’

If you find this surprising, you are not alone. A statistic in isolation does not give the full picture. Many doctors, scientists and other experts get such odds incredibly wrong, sometimes with tragic consequences – patients sometimes get diagnosed with diseases they don’t have due to a statistical blunder. In the early days of HIV, this led to a number of suicides of patients who were actually HIV free. Even today, a surprising high figure of medical scientists make this mistake with diagnostics.

Statistical thinking is not intuitive. Yet we live in an age where we are constantly assailed by percentages, some potentially informative and some utterly dubious. Statistics can also be reported a multitude of ways, with seemingly different interpretations. Imagine the odds of getting a certain disease were two in a million or 1/500,000. Now let’s say a study finds that eating lots of red meat brings this up to three in a million. The absolute risk increase is 1/million, or 0.000001% – a minor, almost negligible risk.

But this is more likely to be reported as a relative risk increase. Imagine the screaming headlines – “Eating red meat makes you 50 per cent more likely to get this disease!” They both convey the same information, yet one is far more likely to shift copy. The numbers themselves do not lie – it is how they are read that causes problems.

The ambiguity of statistics also appears in finance. With just the right amount of finesse, one can make a loss appear as a profit to the unwary. A stock falling in value by 50% and then increasing by 80% seems to imply the final value of the stock would be greater by 30% than its initial amount. But this is a fallacy because these percentages refer to different things.

Using real numbers, this is easy to see: €1,000 falls by 50% to €500. This then increases by 80% to €900. The stock has fallen in value, but as the statistics subtly refer to different events, it fools us into assuming there has been an increase. This is why all too often talk of currency values, house prices and interest rates are often essentially meaningless – percentages on their own tell us practically nothing.

‘Several women were convicted on the basis of numerical ineptitude’

Yet despite this credo, many experts have the unfortunate habit of abusing statistics. Sir Roy Meadow was expert witness in a number of cot-death trials in the late 1990s . Using atrocious statistics, he convinced a jury it was almost certain these were in fact murder cases. As a result, several women were convicted on the basis of numerical ineptitude. These convictions drew the ire of the Royal Statistical society and were eventually overturned, but not before leading to the death of Sally Clark, one of the wrongly-accused women. Journalists and media outlets regularly commit jaw-dropping statistical abuse, perhaps from the urge to make something more powerful, or through yet another example of our pervasive innumeracy, or perhaps both.

So what can be done about this ? It’s important to state again statistics themselves are not the problem – our lack of understanding is. The first step should be to improve this very understanding. Darrell Huff’s How To Lie With Statistics and Gerd Gigerenzer’s Reckoning with Risk are entertaining introductions to statistics for general audiences and light on math. Wikipedia has a number of well written entries on the subject, including Misuse of Statistics.

When possible, media outlets should report figures in natural terms when statistics are likely to mislead. This would massively reduce confusion as it is a much more intuitive way of stating changes in risks and values. If it is 20 degrees Tuesday, everyone understands a fall of four degrees the next day means 16 degrees on Wednesday. Writing this as a fall of 20% is not nearly as clear. Tuesday was four degrees higher than Wednesday, or 25% higher. The natural frequencies remain consistent with a difference of 4 degrees each way, but the statistical difference changes both ways. For this reason, natural statements of finance, risk and value should be preferred over statistical statements when possible.

The crux of the issue is we must learn to understand statistics. Numeracy can be improved, and it is essential that we, as a society, do so. HG Wells once said “Statistical thinking will one day be as necessary for efficient citizenship as the ability to read and write.” That day is now. Until we understand statistics and data as more than just some arcane numbers or soundbite, we will continue to fall victim to misinformation.

David Robert Grimes is a doctor of medical physics with a keen interest in the public understanding of science. He writes a blog on science and medicine called Three Men Make A Tiger.

Readers like you are keeping these stories free for everyone...
A mix of advertising and supporting contributions helps keep paywalls away from valuable information like this article. Over 5,000 readers like you have already stepped up and support us with a monthly payment or a once-off donation.

Close
35 Comments
    Install the app to use these features.
    Mute Pete Conneely
    Favourite Pete Conneely
    Report
    Nov 22nd 2013, 5:09 PM

    Leave Ireland alone…….. Frack Off !

    101
    Install the app to use these features.
    Mute Johnny Five
    Favourite Johnny Five
    Report
    Nov 22nd 2013, 5:47 PM

    Actually, we should try and persuade more fracking companies to enter Ireland as it would be of great benefit to our economy. Anyone who disagrees is probably the type of person that campaigns against fluoride.

    45
    Install the app to use these features.
    Mute Mark Phillips
    Favourite Mark Phillips
    Report
    Nov 22nd 2013, 6:02 PM

    Not good for the communities involved or our environment. Surely not everything boils down to money.

    58
    See 8 more replies ▾
    Install the app to use these features.
    Mute J. Dunn
    Favourite J. Dunn
    Report
    Nov 22nd 2013, 6:31 PM

    Johnny’s just playing devil’s advocate for the reaction.

    17
    Install the app to use these features.
    Mute Ricky Spanish
    Favourite Ricky Spanish
    Report
    Nov 22nd 2013, 7:22 PM

    When tap water becomes flamable, we’ve gone a tad too far.

    Overall, Im not completely against fracking.
    However I’m happy for Ireland to sit it out for a while….. see how the sh*t hits the fan elsewhere.

    18
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:27 PM

    Tap water is not flammable.
    Fracking has been in use commercially since around 1950, that’s long enough to sit it out.

    “Renee McClure also misleads viewers about the connection between natural gas development and methane in water wells. McClure’s well was sampled by the state of Colorado and it, too, showed only naturally occurring methane.”

    17
    Install the app to use these features.
    Mute Kev O Dowd
    Favourite Kev O Dowd
    Report
    Nov 22nd 2013, 9:33 PM

    Really Aunty?

    Or maybe this is “hippie propaganda”?

    https://www.youtube.com/watch?v=4LBjSXWQRV8

    9
    Install the app to use these features.
    Mute Philip Cooper
    Favourite Philip Cooper
    Report
    Nov 23rd 2013, 7:28 AM

    Well spotted!

    1
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 23rd 2013, 12:21 PM

    Methane occurs naturally in wells at some locations http://pubs.usgs.gov/sir/2013/5085/
    But don’t allow reality to spoil a bit of green propaganda

    2
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 23rd 2013, 12:23 PM

    The tap water blow torch seen in Gasland has nothing to do with hydraulic fracturing. Instead, it’s related to a problem called methane migration.

    Methane migration is what it sounds like – methane gas migrating from deep underground to the surface

    2
    Install the app to use these features.
    Mute Sally Ann
    Favourite Sally Ann
    Report
    Jan 23rd 2014, 4:02 PM

    well johnney five fuk off back to china and lets hope they frack up yer ass there NO FRACKING IN IRELAND NOW !!!

    1
    Install the app to use these features.
    Mute Kev O Dowd
    Favourite Kev O Dowd
    Report
    Nov 22nd 2013, 4:58 PM

    This is the type of damage being done in Alberta, Canada

    http://carbontalks.ca/images/blog/Anderson-OilSands2.jpg

    Fracking is only a viable option in countries the size of Canada, but it’s madness in Ireland. The island of Ireland would fit into Alberta alone 8 times. Its much better putting the land to work for the future generations instead of destroying it for the sake of a few months worth of natural gas.

    Its fantastic for the Canadian economy, but is it worth it in the long run? Aren’t we supposed to be moving away from damaging non renewable energy sources? Short visioned, quick profiteering is slowly defining Ireland.

    78
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 6:13 PM

    That has nothing to do with fracking.

    19
    Install the app to use these features.
    Mute Kev O Dowd
    Favourite Kev O Dowd
    Report
    Nov 22nd 2013, 6:30 PM

    You should do your research if you think that. The Alberta “tar sands” is a slightly different method to this type of fracking. Both have the same environmental consequences.

    Here another example of a fraking site.

    http://www.southwalesawakening.org/wp-content/uploads/2013/07/fracking.jpg

    Sunken land that would be useless for the generations to come.

    26
    See 7 more replies ▾
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:01 PM

    I have done the research which shows that as ever green activists are guilty of exaggeration and outright lies.

    19
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:24 PM

    “Here another example of a fraking site.”
    Another? The first example was of oil sands.

    15
    Install the app to use these features.
    Mute Ricky Spanish
    Favourite Ricky Spanish
    Report
    Nov 22nd 2013, 7:24 PM

    Oh Aunty!

    …. your not funny.

    18
    Install the app to use these features.
    Mute Kev O Dowd
    Favourite Kev O Dowd
    Report
    Nov 22nd 2013, 7:28 PM

    What have I said then that was lies or exaggeration? I agree with you that environmentalists often exaggerate their points. But fracking by definition is a destructive process. All I was saying was that Canada is a good example of how it can work, because of the massive uninhabited (apart from indigenous natives, but whats new?) land masses involved there. Ireland does not have that luxury. With fracking in Ireland, the pro’s far outweigh the cons. Fossil fuels are drying up so we need to stop flogging a dead horse for relatively small profits and sort out a serious, sustainable approach. (Which in my books could include nuclear power, incase I’m accused again of being a green activist)

    19
    Install the app to use these features.
    Mute Kev O Dowd
    Favourite Kev O Dowd
    Report
    Nov 22nd 2013, 7:33 PM

    Google in the last hour is sure doing wonders for you Aunty….. gold star

    9
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:43 PM

    Google is for you greenies, all that I post is from research going back to 1998 on the internet and from books, scientific journals and first hand experience since c1970. Plus study at 2 Universities and seminars.

    9
    Install the app to use these features.
    Mute Kev O Dowd
    Favourite Kev O Dowd
    Report
    Nov 22nd 2013, 7:54 PM

    “You greenies”….. Don’t know too many of them that is ok with modern nuclear energy, but anyway. I’m living in Canada, and have visited mates working on the tarsands near Edmonton, better experience than google. Many here call the tar sands process “fracking”, although probably partially incorrectly, it’s still a destructive process of extracting fuel from within the rock. I’ve read plenty of books that are full of shite and went to college too. Neither have monolopy on truth, so don’t get carried away with yourself. Keep your fingers in your ears if you have already made your mind up on this issue.

    16
    Install the app to use these features.
    Mute werejammin
    Favourite werejammin
    Report
    Nov 22nd 2013, 5:00 PM

    “Pros and cons of fracking in Ireland to be examined by two-year research study”

    The major Pro would be the boost to our brown envelope manufacturing industry as the backhanders fly in the scramble to pillage more of the Irish peoples birthright.

    There will be quite a few sleveen public representatives ‘winning money on the horses’(tm) if fracking gets the green light.

    64
    Install the app to use these features.
    Mute Niall Toher
    Favourite Niall Toher
    Report
    Nov 22nd 2013, 5:29 PM

    Watch gasland it will give you the answers!

    24
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 6:04 PM

    Gasland is a cartoon made by ecoloons.

    16
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 6:59 PM

    “The 2010 movie Gasland brought these claims (and many others) to the public attention. Gasland painted a horrifying and emotionally charged picture of conspiracy, profiteering, environmental ruin, and the reckless wholesale poisoning of people and animals by the drilling companies. The energy industry was quick to respond to the apparent slander, even posting a web page called “Debunking Gasland” (and others) that not only denied virtually all of the movie’s factual claims, but also was heavy on ad-hominem attacks against its maker, an activist whom they describe as an avant-garde stage director with no expertise in either geology or drilling. Whom should the average person on the street believe? Unfortunately, they generally only hear from one of these sources or the other, and rarely or never get the unbiased, science-based facts.”

    4
    See 1 more reply ▾
    Install the app to use these features.
    Mute Thomas Mcgrath
    Favourite Thomas Mcgrath
    Report
    Nov 22nd 2013, 9:11 PM

    Gas land is a movie, you go to movies for your truth, well at least your not heading to church.

    6
    Install the app to use these features.
    Mute Charles O'Dowd
    Favourite Charles O'Dowd
    Report
    Nov 22nd 2013, 7:29 PM

    Fracking will benefit very few and has a real possibility of destroying the lives of many. The best thing to do is leave what’s under the soil where it is and let us all carry on as we are.

    24
    Install the app to use these features.
    Mute Derek Lyster
    Favourite Derek Lyster
    Report
    Nov 22nd 2013, 6:39 PM

    Fracking can contaminate ground water which poses a threat to public health so it should not be allowed no matter how much money it brings in.

    23
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 6:56 PM

    It can but to date has not as the EPA in the US has shown time and time again.

    10
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:02 PM

    In the cartoon,Mike Markham, a landowner, ignites his tap water. The film leaves the viewer with the false impression that the flaming tap water is a result of natural gas drilling. However, according to the Colorado Oil and Gas Conservation Commission, which tested Markham’s water in 2008, there were “no indications of oil & gas related impacts to water well.” Instead the investigation found that the methane was “biogenic” in nature, meaning it was naturally occurring and that his water well was drilled into a natural gas pocket.

    11
    Install the app to use these features.
    Mute Luke Sullivan
    Favourite Luke Sullivan
    Report
    Nov 22nd 2013, 4:59 PM

    Between fracking and fraping we’re in a right mess.

    22
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:15 PM

    What about twerking? Cork has been laid waste by this activity and we have to ask why their holinesses the bishops remain silent on this issue. The statue of Father in Patrick Street has spun around twice this week.

    13
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 6:08 PM

    None of the scaremongering about fracking stands up to scrutiny. Greens don’t want you to have cheap power, they want to ration it and control how you use it by means of smart-meters. People can’t afford this green nonsense any more, we need cheap reliable energy and that is not going to come from any of the scams such as wind and solar.

    16
    Install the app to use these features.
    Mute Edward Malone
    Favourite Edward Malone
    Report
    Nov 23rd 2013, 4:31 AM

    That pesky sun, always out to scam people.. Providing sub standard photons :/

    9
    Install the app to use these features.
    Mute Bluemist
    Favourite Bluemist
    Report
    Nov 22nd 2013, 6:51 PM

    Farming not fracking maybe if the the farmers farmed we would not have to worry about fracking

    15
    Install the app to use these features.
    Mute Joe Traynor
    Favourite Joe Traynor
    Report
    Nov 22nd 2013, 5:45 PM

    Facebook don’t frack with Meath

    14
    Install the app to use these features.
    Mute James Ó Cianáin
    Favourite James Ó Cianáin
    Report
    Nov 22nd 2013, 8:53 PM

    I wish we would do what the Dutch do and set up anaerobic digesters on all farms throughout the country and generate power.

    This would be distributed power grid.

    The more small renewable sources we have throughout the country the better.

    13
    Install the app to use these features.
    Mute Mike McCarthy
    Favourite Mike McCarthy
    Report
    Nov 22nd 2013, 4:55 PM

    What a Joke

    12
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:05 PM

    @turflife 4 of those sycamores mentioned the other day have 4-6 trunks which are 9″ at the base, not bad for 12 years and the 14 year old are just a tiny bit bigger ;-)

    1
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:10 PM

    The destruction around wind farms has to be seen to be believed, the access roads have to take the largest cranes in order to maintain them, these are vehicles would be banned if they were carrying normal goods.
    http://blogs.telegraph.co.uk/news/jamesdelingpole/100232949/wind-farms-are-a-breach-of-human-rights-says-un-no-really/tumblr_lqi9anorde1qjw2is-2/

    This one gives a perspective on the scale and all for so little output.

    http://i.telegraph.co.uk/multimedia/archive/02503/wind-farm_2503696b.jpg

    3
    See 3 more replies ▾
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 22nd 2013, 7:46 PM

    PS @turflife, those multi trunks are natural, the trees were not touched since starting from seed, hard to tell until I knock them but there is maybe a month of fuel there.

    2
    Install the app to use these features.
    Mute Harry Webb
    Favourite Harry Webb
    Report
    Nov 23rd 2013, 9:53 AM

    Auntie, empty vessels make the most noise! Are you on the side of the frackers, and trying to oppose anything that gets in your way!

    5
    Install the app to use these features.
    Mute Aunty Simmonite
    Favourite Aunty Simmonite
    Report
    Nov 23rd 2013, 12:38 PM

    Reports from the 1800’s document gas
    bubbles in water wells, in streams, and in
    fields after heavy rains; this evidence suggests
    that migration has always existed. It
    has now become a problem because of
    new residential development near the
    methane migration pathways. Studies by
    the USGS will help clarify the nature of
    methane migration.
    The USGS is a more reliable source of information than a movie made by some ecoloon.

    1
    Install the app to use these features.
    Mute Kenneth
    Favourite Kenneth
    Report
    Nov 23rd 2013, 1:36 AM

    Pros- it makes money, everything else is irrelevant

    3
    Install the app to use these features.
    Mute Eámonn John Ó HAodha
    Favourite Eámonn John Ó HAodha
    Report
    Dec 23rd 2013, 4:00 AM

    i think people mis-read your comment man

    1
    Install the app to use these features.
    Mute Sally Ann
    Favourite Sally Ann
    Report
    Jan 23rd 2014, 4:09 PM

    if you think the housing market is rock bottom now in ireland then just wait until they start the fracking near you, your property will be worth fuk all just a packet of fags and a tooth pick, nobody is going to buy your property with the pollution and methane gas contaminating your house/s they will not pay to buy your house !! AND NEITHER WOULD I

    1
    Install the app to use these features.
    Mute Derrick Hambleton
    Favourite Derrick Hambleton
    Report
    Dec 5th 2013, 1:07 PM

    James has the right idea. Instead of fracking the bejesus out our earth, farmers should be encourage to install anaerobic digesters. Especially since Minister for everything Coveney wants them to double beef production! Where is all the sh1te thus produced to go otherwise. This contribution to local energy production would have us manage for another few years, while all other countries rush towards self-destruction.
    Old Yorkshire saying: ‘Where there’s muck, there’s energy’.

    1
Submit a report
Please help us understand how this comment violates our community guidelines.
Thank you for the feedback
Your feedback has been sent to our team for review.
JournalTv
News in 60 seconds