Science

fMRI bugs could upend years of research

This is what your brain looks like on bad data

By Richard Chirgwin

116 SHARE

A whole pile of “this is how your brain looks like” fMRI-based science has been potentially invalidated because someone finally got around to checking the data.

The problem is simple: to get from a high-resolution magnetic resonance imaging scan of the brain to a scientific conclusion, the brain is divided into tiny “voxels”. Software, rather than humans, then scans the voxels looking for clusters.

When you see a claim that “scientists know when you're about to move an arm: these images prove it”, they're interpreting what they're told by the statistical software.

Now, boffins from Sweden and the UK have cast doubt on the quality of the science, because of problems with the statistical software: it produces way too many false positives.

In this paper at PNAS, they write: “the most common software packages for fMRI analysis (SPM, FSL, AFNI) can result in false-positive rates of up to 70%. These results question the validity of some 40,000 fMRI studies and may have a large impact on the interpretation of neuroimaging results.”

For example, a bug that's been sitting in a package called 3dClustSim for 15 years, fixed in May 2015, produced bad results (3dClustSim is part of the AFNI suite; the others are SPM and FSL).

That's not a gentle nudge that some results might be overstated: it's more like making a bonfire of thousands of scientific papers.

Further: “Our results suggest that the principal cause of the invalid cluster inferences is spatial autocorrelation functions that do not follow the assumed Gaussian shape”.

The researchers used published fMRI results, and along the way they swipe the fMRI community for their “lamentable archiving and data-sharing practices” that prevent most of the discipline's body of work being re-analysed. ®

Sign up to our NewsletterGet IT in your inbox daily

116 Comments

More from The Register

Hard to imagine Google, Facebook building AI without (checks notes) Dell EMC's Data Science Provisioning Portal

If you want to do some ML, and you've got a fat budget, they've got some tech to sell you

Brain monitor had remote code execution and DoS flaw

I told you I was sick

AI can untangle the jumble of neurons packed in brain scans

Video Which should help neurologists to map the brain

Surprise! Wireless brain implants are not secure, and can be hijacked to kill you or steal thoughts

Science-fiction horror trope now a reality in 2018

Nvidia adds nine nifty AI supercomputing containers to the cloud

Now you can splash out on tons of GPUs if you really need to

Curiosity's computer silent on science, baffling boffins

Robot is 'responsive' but for some reason it can't transmit science data

AI caramba! Nvidia devs get a host of new kit to build smart systems

Kubernetes for GPUs, a PyTorch extension, TensorRT 4, and much, much more

Shocking. Lightning strike knocks out neuro patient's brain implant

Got electrodes in your head? Invest in a surge protector

Brain brainiacs figure out what turns folks into El Reg journos, readers

Why are we eternal pessimists? And why's that such a bad thing, eh? Eh? Eh?

AI, AI, Pure: Nvidia cooks deep learning GPU server chips with NetApp

Pure Storage's AIRI reference architecture probably a bit jelly