People Are More Open to Algorithmic Judgment Than You Might Think

People Are More Open to Algorithmic Judgment Than You Might Think

When it comes to making judgments based on large data sets, machines are often superior to humans, but many business leaders remain skeptical of the guidance produced by their organizations’ data analytics programs, particularly when it comes to talent analytics. That skepticism derives largely from doubts about the quality of the data the organization is collecting, but there is also a natural tendency among people who make strategic decisions for a living to reject the notion that an algorithm could do parts of their job as well as or better than they can.

While this may be true of executives and high-level professionals, some recent research suggests that most people are actually comfortable with the decisions algorithms make and even more trusting of them than of judgments made by humans. A new study from the Harvard Business School, led by post-doctoral fellow Jennifer M. Logg, finds that “lay people adhere more to advice when they think it comes from an algorithm than from a person”:

People showed this sort of algorithm appreciation when making numeric estimates about a visual stimulus (Experiment 1A) and forecasts about the popularity of songs and romantic matches (Experiments 1B and 1C). Yet, researchers predicted the opposite result (Experiment 1D). Algorithm appreciation persisted when advice appeared jointly or separately (Experiment 2). However, algorithm appreciation waned when people chose between an algorithm’s estimate and their own (versus an external advisor’s—Experiment 3) and they had expertise in forecasting (Experiment 4). Paradoxically, experienced professionals, who make forecasts on a regular basis, relied less on algorithmic advice than lay people did, which hurt their accuracy.

Our colleagues here at Gartner have also investigated consumers’ attitudes toward AI and found that these attitudes are more welcoming than conventional wisdom might lead you to believe. The 2018 Gartner Consumer AI Perceptions Study found that overall, consumers are not skeptical of the potential usefulness of AI, though they do have some concerns about its impact on their skills, social relationships, and privacy. The study was conducted online during January and February 2018 among 4,019 respondents in the US and UK. Respondents ranged in age from 18 through 74 years old, with quotas and weighting applied for age, gender, region, and income.

Read more