Info Commish tells we shouldn't let artificial ignorance make all our decisions

Reckons GDPR will help us challenge algo-driven outcomes

By Kat Hall

Posted in Artificial Intelligence, 23rd January 2018 14:58 GMT

Algorithms should not be solely responsible for criminal sentencing, while a change in law may be required to open up public data sets involving health information.

These were just some of the topics Information Commissioner Elizabeth Denham touched on today in a wide-ranging Parliamentary hearing about the use of AI in decision-making.

Denham told MPs on the Science and Technology Committee that companies and organisations must be able to explain how decisions are made by machines, but stopped short of saying they should be required to make that process available to the public, citing concerns over commercial confidentiality.

"When dealing with public-sector data and the use of AI systems, there may be more of an argument for publication of [that] data as long as it's not personal data," she said.

When it comes to using medical information for the purposes of research, she said that a change in law may be required to open up data sets for broad use of AI. The ICO previously said that the Royal Free NHS Foundation Trust failed to comply with the UK's Data Protection Act when it provided 1.6 million patient details to Google's DeepMind.

Asked what her biggest concerns were for the future use of AI in decision making, she said any area in which it has a significant impact on people's lives.

"AI decisions in the criminal justice system could be part of [the] decision [making process], but there needs to be human intervention around sentencing and parole."

Software has been developed to predict how likely a criminal will reoffend and is used by the courts to hand out appropriate punishments. However, it has been criticised for having a racial bias.

Denham was positive that under the forthcoming GDPR changes there will be new rules and rights for individuals to protect them from unfair algorithmic decisions.

"The most important change in data protection law is accountability – organisations have to identify risks, take steps to mitigate them and explain that to the regulator."

However, she said the ICO will need to "upskill" to ensure it is able to perform "algorithmic auditing", adding that the body was working with the Alan Turing Institute to create a framework for understanding the "explainability" of algorithms. "Opaque algorithms are not going to cut it."

On the subject of the ICO's probe into the use of algorithms to target individuals for political campaigns, Denham said it was "probably the most complicated investigation the ICO has ever taken" as it involved various companies, organisations and social media platforms.

She said the body has served an information notice on UKIP to compel it to release information relating to the EU referendum, and one other organisation whose name has not yet been published.

"From a data protection perspective we're looking at how that is happening and make it transparent to the public," she said. "We hope to reveal what is happening in terms of the use of data. It's not an investigation into fake news, bots, or financing, just the data protection issues of micro-targeting." ®

Sign up to our NewsletterGet IT in your inbox daily


More from The Register

National Audit Office report blasts's 'muddled' STEM strategy

More people have skillz, but not in fields that need them

National Audit Office: We'll be in a world of pain with '90s border tech post-Brexit

Can UK's creaky databases uphold the nation's security?

Audit office finds Telstra's universal services were good politics, bad deals

AU$297 million a year bought co-operation as much as services, says ANAO

National Audit Office: Brit aircraft carrier project is fine and dandy... for now

Small matter of an ongoing personnel shortage, though

ATO, Dept of Immigration wrist-slapped for failing security audit, again

Both promise to implement mandatory controls real soon now

MoD: We've got a handle on contract costs. Audit Office: About that...

Complex system leaves big suppliers pushing back hard, Brit watchdog finds

OMG! OIG to audit SLS: NASA probed over big rocket project's big budgets, big delays

Look, it's not rocket science, er, wait

Facebook privacy audit by auditors finds everything is awesome!

FTC's heavily redacted report says everything's hunky dory

White collar crime prosecutions fall as offences rise

Actual reports of transgressions are up, though

Top IT bod Sally Howes leaves the UK's National Audit Office

How are the government's beancounters going to audit 'agile' now?