What It Will Take for Us to Trust AI

Our willingness to accept the unknown could benefit our future.

Guru Banavar | IBM

The early days of artificial intelligence (AI) have been met with some very public hand wringing. Well-respected technologists and business leaders have voiced their concerns over the (responsible) development of AI.

And Hollywood’s appetite for dystopian AI narratives appears to be bottomless. This is not unusual, nor is it unreasonable. Change, technological or otherwise, always excites the imagination. And it often makes us a little uncomfortable.

But in my opinion, we have never known a technology with more potential to benefit society than artificial intelligence. We now have AI systems that learn from vast amounts of complex, unstructured information and turn it into actionable insight.

It is not unreasonable to expect that within this growing body of digital data — 2.5 exabytes every day — lie the secrets to defeating cancer, reversing climate change or managing the complexity of the global economy.

We also expect AI systems to pervasively support the decisions we make in our professional and personal lives in just a few years. In fact, this is already happening in many industries and governments.

However, if we are ever to reap the full spectrum of societal and industrial benefits from artificial intelligence, we will first need to trust it.

Pullquote share icon. Share

Trust of AI systems will be earned over time, just as in any personal relationship.

Trust of AI systems will be earned over time, just as in any personal relationship. Put simply, we trust things that behave as we expect them to.

But that does not mean that time alone will solve the problem of trust in AI. AI systems must be built from the get-go to operate in trust-based partnerships with people.

Threats causing mistrust

The most urgent work is to recognize and minimize bias. Bias could be introduced into an AI system through the training data or the algorithms.

The curated data that is used to train the system could have inherent biases toward a specific demographic, either because the data itself is skewed or because the human curators displayed bias in their choices.

The algorithms that process that information could also have biases in the code, introduced by a developer, intentionally or not. The developer community is just starting to grapple with this topic in earnest.

But most experts believe that by thoroughly testing these systems, we can detect and mitigate bias before the system is deployed.

Managing bias is an element of the larger issue of algorithmic accountability. That is to say, AI systems must be able to explain how and why they arrived at a particular conclusion so that a human can evaluate the system’s rationale.

Finding answers 

Many professions, such as medicine, finance and law, already require evidence-based auditing as normal practice for providing transparency and managing liability.

In many cases, AI systems may need to explain rationale through a conversational interaction (rather than a report) so that a person can dig into as much detail as necessary.

In addition, AI systems can and should have mechanisms to insert a variety of ethical values appropriate to the context, such as the task, the individual, the profession or the culture.

This is not as difficult as it sounds. Ethical systems are built around rules, just like computer algorithms. These rules can be inserted during development, deployment or use.

Pullquote share icon. Share

AI systems can observe human behavior to fill in some of the gaps.

And because these are learning systems, researchers believe that AI systems can over time observe human behavior to fill in some of the gaps.

It is incumbent upon the developers of AI systems to answer these questions in a way that satisfies both the industry and the general public.

This is already well understood throughout the technology industry, which is why IBM is working together with some of its fiercest competitors — including Google, Microsoft, Amazon and Facebook — on the “Partnership on AI,” a unique and open collaboration designed to guide the ethical development of artificial intelligence.

Business leaders considering artificial intelligence solutions should include trust and accountability as part of their criteria for adoption.

They should be thoughtful about how and where this technology is introduced throughout the organization. And they should work with their technology vendors to identify any unwanted behaviors and correct them if necessary.

But delaying the implementation of artificial intelligence is not an option. We pay a significant price every day for not knowing what can be known: not knowing what’s wrong with a patient, not knowing where to find a critical natural resource or not knowing the hidden risks in the global economy.

We believe that many of these ambiguities and inefficiencies can be eliminated with artificial intelligence.

Using AI correctly

Pullquote share icon. Share

Artificial intelligence is an undeniably powerful technology.

Artificial intelligence is an undeniably powerful technology. And as with any powerful technology, great care must be taken in its development and deployment.

Just as it is our obligation to apply this technology to complex, societal problems, it is our obligation to develop it in a way that engenders trust and safeguards humanity. In other words, building trust is essential to the adoption of artificial intelligence.

And we believe that its adoption is essential to humanity. goldbrown2

This article first appeared on IBM TIHNK Blog and was republished with permission.

You might also like:

It’s Pedal to the Metal for Driverless Cars

Robot Knows Best

Bad Robot

button

Every morning, wake up to the blog that gives you the latest trends shaping tomorrow

Guru Banavar is Chief Science Officer of Cognitive Computing and Vice President of IBM. Research

Click the RSS icon to subscribe to future articles by this author. RSS Feed

1 Comment

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s