What are power shadows?
A working definition from MIT Sloan
power shadows (noun)
Biases or systemic exclusion of a society, as reflected in data sets.
As a graduate student working on facial analysis software, Joy Buolamwini, SM ’17, PhD ’22, encountered a problem: The software did not detect her dark skin, though it easily identified the faces of people with lighter skin. She had to wear a white mask to be detected by the computer.
The problem was the power shadows that are cast in datasets, Buolamwini, a computer scientist, writes in her book “Unmasking AI.” The dataset she used — created by a government agency with the intent of representing a diverse population — featured images of public figures, often elected officials. Around the world, white men have historically held political power, and that was reflected in the data. The software she used was trained on images in which people were predominantly white and male.
Power shadows have serious consequences. Machine learning models used to inform hiring decisions could reflect past biased decisions made by humans. Models used to diagnose medical conditions could be based on data from mostly white patients, resulting in poor outcomes for Black patients.
The first step to overcoming power shadows is being aware of them, according to Buolamwini. “We must also be intentional in our approach to developing technology that relies on data,” she writes.
Working Definitions: Artificial Intelligence
MIT Sloan's Working Definitions explore the words and phrases behind emerging management ideas.
AI Executive Academy
In person at MIT Sloan
Register Now
Where to look for generative AI risks
New research can help business leaders identify and address AI components that introduce risk, such as training data, foundation models, and user prompts.
Generative AI changes how employees spend their time
Software developers with access to a generative AI tool do more coding and less project management, according to a new study.
Use this AI tool to ask better questions, get more authentic results
The new Question Burst Catalyst tool from MIT Sloan’s Hal Gregersen helps leaders use LLMs as a creative thought partner to help surface ideas that truly matter.
Action items for AI decision makers in 2026
AI industry watchers Thomas Davenport and Randy Bean expect the AI hype cycle to slow as organizations focus on infrastructure and strategy.
What 2 MIT experts are thinking about AI and work
David Autor and Neil Thompson on the importance of using AI tools to collaborate with humans and the nuances of how AI affects productivity and replaces workers.
‘This AI tool helped me define a target customer for my startup’
Learn how Spondi founder Jarret Heflin identified a highly motivated customer base by using the MIT Entrepreneurship JetPack digital adviser.
5 ‘heavy lifts’ of deploying AI agents
New research provides insights for using AI agents in clinical settings.
Future manufacturing: How to solve the US productivity paradox
U.S. manufacturing productivity remains flat despite an uptick in new factory and workforce growth in recent years. MIT experts suggest three solutions.
Agentic AI, explained
The age of agentic AI — systems that are semi- or fully autonomous and can act on their own — has arrived. Here’s what you need to know, according to MIT experts.
The 4 themes shaping new manufacturing
Stagnant productivity, a tightening workforce, and rising global competition are reprioritizing manufacturing in the U.S. What’s needed: new production models.