- Money Morning Australia

Study Shows Studies Show Nothing


Written on 24 October 2012 by Nick Hubble

Study Shows Studies Show Nothing

If you’ve ever wondered how a study can show something that just can’t be true, or how studies can completely contradict each other, we’ve figured it out. With a little help of course. After today’s Daily Reckoning, I hope you never believe another ‘study’.

Our heartfelt congratulations go out to Mathgen. A mathematics journal provisionally accepted its paper for publication.

Wait, ‘its’ study?

Yes, that’s right. These days a computer program can write an academic paper about mathematics. Then get published in academic journals like ‘Advances in Pure Mathematics’. And you thought those computer programs dominating the stock market were smart!

No longer are your sons and daughters safe from having to compete with machines in the academic world. That’s another ‘safe’ career choice gone. So what was the paper Mathgen wrote about? Here’s the abstract, which describes it:

‘Let ρ = A. Is it possible to extend isomorphisms? We show that D’ is stochastically orthogonal and trivially affine. In [10], the main result was the construction of p-Cardano, compactly Erdös, Weyl functions. This could shed important light on a conjecture of Conway-d’Alembert.’

If you’re confused, that’s sort of the idea.

Only a mathematics academic could decipher that abstract, because it’s completely meaningless. You see, Mathgen creates papers by combining random nouns, verbs, numbers, symbols and the rest of it.

It spits out something that makes grammatical sense, not that you’d know it, but is completely devoid of any meaning. The formatting is said to be nice, though.

Once the paper is randomly generated and submitted for the academic journal’s review, the academics safeguarding the gates of science and knowledge read the paper and figure it must mean something.

That’s how the paper gets past the peer review process. The same process that keeps climate change science squeaky clean, by the way. Here’s what the anonymous peer reviewer wrote about Mathgen’s bizarre creation:

For the abstract, I consider that the author can’t introduce the main idea and work of this topic specifically.

Maybe that’s because there is no main idea. No ideas at all, in fact.

Anyway, once the academics of the peer review process give the paper a once over and decide it’s fine to publish in their illustrious journal, the valuable and useful knowledge in the paper is disseminated around the academic world. That will probably never happen to Mathgen’s paper because the joke was exposed before the journal was finalised.

If all this makes you chuckle and shrug, consider that it’s the norm in academic publishing. A similar computer program managed to get an article about postmodernism published in a Duke University journal. And even when people run coherent scientific experiments (with real people) the results have a habit of being suspect too.

Many studies can’t seem to be replicated these days. Meaning, if you ran exactly the same experiment, you wouldn’t get results that confirm the study’s findings. According to one science journalist, 47 of the top 53 most important cancer studies can’t be replicated. They might be completely wrong, and yet we base modern research on the assumption they are right.

To be clear for any sceptics, the Mathgen paper is a true ‘gotcha’ moment. It wasn’t about the fact that a paper can be written by a clever computer program. It wasn’t about anything. It was complete gibberish. But it did show the fact that academic journals are…academic. Let’s hope nobody reads them.

Unfortunately, finance and economics journals actually do get mentioned in the real world. In fact, their conclusions often determine public policy. Politicians hurl studies at each other proving their opinion.

Luckily for economists, it’s very difficult to disprove an economics study. You never know the ‘counterfactual’ — what would have happened. But if maths and science are corrupted, you’d think economics is corrupted twice over.

So the next time you read ‘a study has shown,’ you can disregard the end of the sentence.

Regards,

Nick Hubble
Editor Money Morning

From the Archives…

Why this Could be the Most Important Day of the Year for the Stock Market
19-10-2012 – Kris Sayce

A Back-Door Way to Invest in the Electric Car Industry
18-10-2012 – Kris Sayce

The Stock Market is Up, What’s Next?
17-10-2012 – Murray Dawes

Debt and Government Spending Means You Should Be Wary of this Stock Market
16-10-2012 – Greg Canavan

The Secret Investment to Buy When GDP Falls
15-10-2012 – Nick Hubble



Already a subscriber to Money Morning... or simply, just like what you're reading? Then show your support and spread the word...
Share this post on...
Share

Nick Hubble
Nick Hubble is a feature Editor of The Daily Reckoning Australia . Nick has spent the last three years discovering lots of new, exciting and surprisingly simple ways to generate money for retirement. He’s put all these ideas into his investment publication The Money for Life Letter. If you're already a subscriber to these publications, or want to follow Nick's financial world view more closely, then we recommend you join him on Google+. It's where he shares investment research, commentary and ideas that he can't always fit into his regular Daily Reckoning emails.

Leave a Comment

Letters will be edited for clarity, punctuation, spelling and length. Abusive or off-topic comments will not be posted. We will not post all comments.

If you would prefer to email the editor, you can do so by sending an email to moneymorning@moneymorning.com.au


Comments are closed.



How Money Morning Can Help You Can Become a Smarter, Better, Investor


Privacy Statement
We value your privacy. We will not sell, rent, or share your email address with any third party. Read our Privacy Policy here.

Diggers and Drillers

A 3-Point Plan to Re-Engage with the Aussie Mining Boom


This new video reveals a way for Aussie share investors like you to RE-ENGAGE with the next phase of the mining boom…while valuations are still dirt-cheap…


The plan centres round three specific stocks.


To find out what they are, click here.

Australian Small-Cap Investigator

The Australian wildcatter
exploring oil's 'final frontier'


The US Geological Survey says this area contains up to 71 billion barrels of oil.

Only a few explorers have secured licences to drill.

One of them is a daring little Aussie firm that begins drilling 'in early 2014'.

According to small-cap analysts Tim Dohrmann it's impossible to speculate just how high this one could go. Find out why here.

World War D

Couldn’t make it to our
‘War Summit’?


Don’t sweat it. Click here for the next best thing…


World War D was the most important meeting of minds of the decade so far. What came out of it will almost certainly force you to reshape your investment plan for the rest of the decade. There's no way to go back in time and get inside the Savoy Ballroom of the Grand Hyatt.

But you can do the next best thing…
to find out what it is, click here.

  • ^NDX3591.029+33.993 - +0.96%
  • ^FTSE6703.00+28.26 - +0.42%
  • ^AORD5515.500+13.300 - +0.24%
  • ^AXJO5531.000+13.200 - +0.24%
  • AUDUSD=X0.9265
  • USDJPY=X102.3115

Graphic Ad 1 – Blue Chip Stocks Report


Revolutionary Tech Investor

This report is about TECH MOON-SHOTS


Four of them, to be precise.


It's an early-days project. But one biotech aiming for the cancer moon-shot is already up - get this - 497.14% since tipped.


For four more tech moon-shots, click here.

Gowdie Family Wealth

WARNING:
The worst mistake you can make when handing wealth on to your kids


This brand new investor briefing shows you what your family’s in for if you don’t take care to leave your wealth to them in exactly the right way.


And it shows you precisely how to prevent infighting, recklessness and misunderstanding over money.


Read it here.

The Money For Life Letter

Holden. Toyota. Qantas. BUST


Do you really expect the share market to boom in times like these? That's why Nick Hubble says the best thing you can do right now is invest for safety and income.


This brand new video shows you how you can get predictable, reliable and rock solid cash flow no matter what happens in the wider economy.


You could lock in up to $20,000 a year - and that's just the start. See how here.



Sound Money. Sound Investments. [bullish prediction]

Greg Canavan's first bullish prediction in four years


Greg Canavan
doesn't make forecasts like this often.


When he does, it's because he’s found something that could make you money for years to come.


Read more here.

Is the Australian Housing Boom Really Back?

The Denning Report

2014 Predicted


Dan Denning accurately forecast 2013's flight from
bonds to stocks, the commodities crash and the
Aussie dollar top…to the exact week


In this brand new forecast report, he shares his
three critical predictions for 2014…

More Recommended Reading Below...

The Pursuit of Happiness & The Daily Reckoning

  • The Pursuit of Happiness
  • The Daily Reckoning Australia

Two days from now Australia will get a taste for what happens in American sports stadiums every day [Read More...]

Would you approve this chemical? Would you allow this to come to market? Table salt would simply not [Read More...]

If these lessons can be passed onto the next generation, what a world it would be. Healthier, genuin [Read More...]

3D printing is changing medicine, consumer products, art and manufacturing. The impact it’s having o [Read More...]

Done properly, a retirement business can not only help fill a retiree’s time and replace their work [Read More...]

It was necessary just to stay in the same place. Take it away, the US stock market crashes...and the [Read More...]

The end of Australia’s recession-less run is waiting somewhere. Even the US is due for another reces [Read More...]

You can see the property cycle and how it moves and turns, all around you. Get used to it. Australia [Read More...]

A high Australian dollar means we’re doing well at exporting. A low one means our trade balance is l [Read More...]

From the invasion of the Philippines to the Vietnam War…the US empire was financed by the rich, prod [Read More...]

TESTIMONIALS

"I think you're fantastic! I love to read what you write...you're so interesting and amusing and I've learned so much" -
Money Morning reader, Chris Gadd

"You guys are brilliant. I feel more relaxed about the future than ever simply because I know what is going on rather than floundering around with smoke screens and mirrors from the government and mainstream" -
Money Morning reader, Helen Carter

"Wow what can I say? I was an economically confused moron until I read your newsletter and even though I've been a subscriber for a short period I can now see how easy it is to understand, if you use common sense and can have the spin translated into everyday language. Thanks for an entertaining read." -
Money Morning reader, John

"Keep up the good independent and well thought out articles offering a view that often debunks mainstream myths." -
Money Morning reader, Craig

"I do admire your straight talking and simple analysis of the situation, I think of you as the Jeremy Clarkson of finance." -
Money Morning reader, Jeffery