fMRI bugs could upend years of research

This is what your brain looks like on bad data

By Richard Chirgwin


A whole pile of “this is how your brain looks like” fMRI-based science has been potentially invalidated because someone finally got around to checking the data.

The problem is simple: to get from a high-resolution magnetic resonance imaging scan of the brain to a scientific conclusion, the brain is divided into tiny “voxels”. Software, rather than humans, then scans the voxels looking for clusters.

When you see a claim that “scientists know when you're about to move an arm: these images prove it”, they're interpreting what they're told by the statistical software.

Now, boffins from Sweden and the UK have cast doubt on the quality of the science, because of problems with the statistical software: it produces way too many false positives.

In this paper at PNAS, they write: “the most common software packages for fMRI analysis (SPM, FSL, AFNI) can result in false-positive rates of up to 70%. These results question the validity of some 40,000 fMRI studies and may have a large impact on the interpretation of neuroimaging results.”

For example, a bug that's been sitting in a package called 3dClustSim for 15 years, fixed in May 2015, produced bad results (3dClustSim is part of the AFNI suite; the others are SPM and FSL).

That's not a gentle nudge that some results might be overstated: it's more like making a bonfire of thousands of scientific papers.

Further: “Our results suggest that the principal cause of the invalid cluster inferences is spatial autocorrelation functions that do not follow the assumed Gaussian shape”.

The researchers used published fMRI results, and along the way they swipe the fMRI community for their “lamentable archiving and data-sharing practices” that prevent most of the discipline's body of work being re-analysed. ®

Sign up to our NewsletterGet IT in your inbox daily


More from The Register

Pain in the brain! Kaspersky warns of hackable brain implants

That furious clicking you hear is Charlie Brooker frantically writing his next script

Hard to imagine Google, Facebook building AI without (checks notes) Dell EMC's Data Science Provisioning Portal

If you want to do some ML, and you've got a fat budget, they've got some tech to sell you

Brain monitor had remote code execution and DoS flaw

I told you I was sick

Like the Architect in the Matrix... but not: Nvidia trains neural network to generate cityscapes

GPU biz also open sources PhysX and teases beefy graphics card

AI can untangle the jumble of neurons packed in brain scans

Video Which should help neurologists to map the brain

New era for Japan, familiar problems: Microsoft withdraws crash-tastic patches

Upcoming calendar change more than Office can handle

Nvidia just can't grab a break. Revenues up, profit nearly doubles... and stock down 20%

Ongoing Bitcoin woes left the channel holding all the cards, and that's not a good thing

Surprise! Wireless brain implants are not secure, and can be hijacked to kill you or steal thoughts

Science-fiction horror trope now a reality in 2018

Nvidia adds nine nifty AI supercomputing containers to the cloud

Now you can splash out on tons of GPUs if you really need to

AI caramba! Nvidia devs get a host of new kit to build smart systems

Kubernetes for GPUs, a PyTorch extension, TensorRT 4, and much, much more