AI models reflect existing biases if these biases are not explicitly eliminated by the data scientists developing the systems. Constant monitoring of the entire operation is required to detect these shifts. The remedy for such lack of focus is training.
Mercator Advisory Group’s latest research Report, Tracking Mistakes in AI: Use Vigilance to Avoid Errors, discusses modes in which data models can deliver biased results, and the ways and means by which financial institutions (FIs) can correct for these biases.
“AI solutions can unwittingly go astray,” comments Tim Sloane, the Report’s author and director of Mercator Advisory Group’s Emerging Technology Advisory Service and its VP Payments Innovation. “Applying AI to issues that can have large negative social consequences should be avoided. One example of this is using AI to implement the business plan of social networks Facebook, You Tube, and others, as presented in the documentary “The Social Dilemma.” The documentary contends that social networks have optimized AI to drive advertising revenue at the expense of the individual and society. To drive revenue, social networks build psychographic models for each user to predict exactly which content will best engage that user.”
This document contains 15 pages and 3 exhibits.
Companies mentioned in this research note include: The Federal Reserve, ProPublica, The Verge.
One of the exhibits included in this report:
Highlights of the research note include:
- A glossary of terms
- The various modes in which data can evidence biases
- Prophylactic methods
- The appeal—and danger—of shortcuts
Interested In This Report
Private-Label Credit Cards: Still Relevant but Losing Luster
Private-label credit cards are an essential part of the U.S. card market, but they are a product in slow decline and face several threats, including instant point-of-sale financing...
Cobranded Credit Cards 2023
The cobranded card market is a way to generate loyalty, scale your portfolio, and service the next generation of cardholders.
The Credit Card Data Book Part Two: Internal Dynamics
The Credit Card Data Book is a two-part annual publication that covers the internal and external factors affecting the U.S. credit card market. The first part focuses on environmen...