What is algorithmic aversion?
A working definition from MIT Sloan
algorithmic aversion (noun)
The conscious or unconscious reluctance of human decision-makers to accept algorithmic recommendations.
Algorithms can help us make better decisions. But to follow their advice, humans must trust them. The way humans view algorithmic recommendations varies based on what they know about how the artificial intelligence model works and how it was created, according to research co-authored by MIT Sloan professor Kate Kellogg. Prior research assumed people are more likely to trust interpretable AI models, in which they can see how the models make their recommendations. But Kellogg found that this isn’t always true.
In an experiment at Tapestry, a New York-based house of lifestyle brands, product allocators were charged with maximizing sales. That involved placing the right number of items in the right stores at the right time. Product allocators received recommendations from either an interpretable algorithm or an uninterpretable machine learning algorithm.
Overall, the human allocators experienced less algorithmic aversion with the uninterpretable model than with the one they could more easily understand. Why? The researchers found that being able to troubleshoot the interpretable algorithm by reviewing its inner workings led allocators to sometimes overrule the recommendations. Meanwhile, knowing peers had developed and tested the uninterpretable algorithm made them more likely to accept its recommendations.
Why employees are more likely to second-guess interpretable algorithms
Working Definitions: Artificial Intelligence
MIT Sloan's Working Definitions explore the words and phrases behind emerging management ideas.
Leading the AI-Driven Organization
In person at MIT Sloan
Register Now
Pro-worker AI, explained
Artificial intelligence can make workers more capable and productive, but only if leaders design and deploy it to augment human judgment.
5 things to consider when working with AI
Researchers at the MIT Initiative on the Digital Economy share the latest insights about getting the most from working with AI, such as personality pairing and reorganizing job tasks.
Balance AI innovation and risk with ‘minimum viable governance’
As organizations scale generative AI, traditional governance models prove to be too rigid or too loose. Minimum viable governance calibrates oversight to risk, enabling responsible innovation.
The surprising power of warmth in AI negotiations
In MIT’s international AI Negotiation Competition, “warmer” agents achieved better outcomes in negotiations with other AI agents.
Seeing real value from AI depends on being able to verify its outputs
A new paper explores how seeing economic value from artificial intelligence hinges on closing the gap between what AI can do and how humans can verify its outputs.
‘AI gravity’ is pulling you toward dependency. Here’s how to push back
AI systems hold the promise of competitive advantage, but they can usher in cognitive decline among workers, says MIT Sloan School of Management’s Eric So. Learn how to protect cognitive capital.
Heeding the pope’s call to ensure AI protects human dignity
Following Pope Leo XIV’s encyclical on AI, MIT Sloan professor emeritus Thomas A. Kochan argues that firms should partner with workers to ensure AI augments human skills and knowledge.
What senior leaders want to know about AI
Leaders are turning to MIT Sloan Executive Education to learn more about AI, including managing humans amid technological change and rethinking their relationships with IT departments.
What leaders still get wrong about AI
Organizations are struggling to succeed with AI. Research from the MIT Center for Information Systems Research shows common mistakes and how to overcome them.
How ‘learnrights’ would compensate creators for AI model training
Learnright laws would give copyright holders the exclusive right to license their content for artificial intelligence model training.