fMRI bugs could upend years of research

This is what your brain looks like on bad data

By Richard Chirgwin


A whole pile of “this is how your brain looks like” fMRI-based science has been potentially invalidated because someone finally got around to checking the data.

The problem is simple: to get from a high-resolution magnetic resonance imaging scan of the brain to a scientific conclusion, the brain is divided into tiny “voxels”. Software, rather than humans, then scans the voxels looking for clusters.

When you see a claim that “scientists know when you're about to move an arm: these images prove it”, they're interpreting what they're told by the statistical software.

Now, boffins from Sweden and the UK have cast doubt on the quality of the science, because of problems with the statistical software: it produces way too many false positives.

In this paper at PNAS, they write: “the most common software packages for fMRI analysis (SPM, FSL, AFNI) can result in false-positive rates of up to 70%. These results question the validity of some 40,000 fMRI studies and may have a large impact on the interpretation of neuroimaging results.”

For example, a bug that's been sitting in a package called 3dClustSim for 15 years, fixed in May 2015, produced bad results (3dClustSim is part of the AFNI suite; the others are SPM and FSL).

That's not a gentle nudge that some results might be overstated: it's more like making a bonfire of thousands of scientific papers.

Further: “Our results suggest that the principal cause of the invalid cluster inferences is spatial autocorrelation functions that do not follow the assumed Gaussian shape”.

The researchers used published fMRI results, and along the way they swipe the fMRI community for their “lamentable archiving and data-sharing practices” that prevent most of the discipline's body of work being re-analysed. ®

Sign up to our NewsletterGet IT in your inbox daily


More from The Register

Brain monitor had remote code execution and DoS flaw

I told you I was sick

AI can untangle the jumble of neurons packed in brain scans

Video Which should help neurologists to map the brain

Surprise! Wireless brain implants are not secure, and can be hijacked to kill you or steal thoughts

Science-fiction horror trope now a reality in 2018

Nvidia adds nine nifty AI supercomputing containers to the cloud

Now you can splash out on tons of GPUs if you really need to

AI caramba! Nvidia devs get a host of new kit to build smart systems

Kubernetes for GPUs, a PyTorch extension, TensorRT 4, and much, much more

Shocking. Lightning strike knocks out neuro patient's brain implant

Got electrodes in your head? Invest in a surge protector

AI, AI, Pure: Nvidia cooks deep learning GPU server chips with NetApp

Pure Storage's AIRI reference architecture probably a bit jelly

Bill Gates declined offer to serve as Donald Trump's science advisor

Spontaneous offer made during chat about vaccines (which - phew! - Trump seemed to like)

Boffins stalk house-hunting bees, find colony behaves kind of like a human brain

Oh do beehive!

Boffins upload worm's brain into a computer, teach it tricks

Nematode only has 300 neurons – a snack to simulate