What are power shadows?
A working definition from MIT Sloan
power shadows (noun)
Biases or systemic exclusion of a society, as reflected in data sets.
As a graduate student working on facial analysis software, Joy Buolamwini, SM ’17, PhD ’22, encountered a problem: The software did not detect her dark skin, though it easily identified the faces of people with lighter skin. She had to wear a white mask to be detected by the computer.
The problem was the power shadows that are cast in datasets, Buolamwini, a computer scientist, writes in her book “Unmasking AI.” The dataset she used — created by a government agency with the intent of representing a diverse population — featured images of public figures, often elected officials. Around the world, white men have historically held political power, and that was reflected in the data. The software she used was trained on images in which people were predominantly white and male.
Power shadows have serious consequences. Machine learning models used to inform hiring decisions could reflect past biased decisions made by humans. Models used to diagnose medical conditions could be based on data from mostly white patients, resulting in poor outcomes for Black patients.
The first step to overcoming power shadows is being aware of them, according to Buolamwini. “We must also be intentional in our approach to developing technology that relies on data,” she writes.
Working Definitions: Artificial Intelligence
MIT Sloan's Working Definitions explore the words and phrases behind emerging management ideas.
AI Executive Academy
In person at MIT Sloan
Register Now
How to shape platform strategy for humans and AI agents
Design, governance, and data decisions need rethinking as AI agents join platforms as participants, according to MIT Sloan School of Management professors Pierre Azoulay and John Horton.
4 MIT Sloan startups to watch in 2026
The 2026 MIT delta v Demo Day showcased startup innovations from the MIT Sloan community.
What effective AI leaders already know
Implementing AI agents at scale requires leaders to deeply understand the technology, invest in domain experts, and learn how to manage agents along with people.
Scale makes firms’ automation efforts worth the investment
Whether a task is worth automating depends not only on whether machines are cheaper than human labor but also on whether the task is performed at scale to spread fixed costs.
4 areas where companies need AI guardrails
To avoid redundant investments, applications that don’t scale, and unexpected costs and risks associated with AI, organizations should determine where oversight is likely to have the greatest impact.
Increase your personal productivity in an AI-enabled workspace
To gain maximum productivity from AI, MIT Sloan’s Robert Pozen advises senior leaders to use AI as a co-worker, focus AI on the final product, and delegate work to AI without abandoning judgment.
The 5 forces creating urgency around ethical AI adoption
In his book “Boundaries of Tolerance,” MIT Sloan School of Management senior lecturer Jeffrey Saviano argues that ethical AI strategy and governance are the defining leadership challenges of our time.
Stop debating automation vs. augmentation
As organizations begin deploying agentic systems that can execute entire workflows, a consequential question is emerging: How can leaders turn agentic AI productivity gains into business growth?
How to level up systematic innovation with AI
Artificial intelligence can boost the systematic innovation of products, processes, and services. MIT Sloan professor Steven Eppinger offers four steps for making that happen.
AI and jobs: 4 takeaways from Google’s chief economist
Google’s Fabien Curto Millet examined how AI is reshaping job roles, workflows, and employee training in an address at the MIT Stone Center on Inequality and Shaping the Future of Work.