Page 1/10
01001010 BIAS 11010101 DATA 00110011 AI

The Bias Files

When Algorithms Go Wrong

BIAS?

A visual journey through the hidden flaws in AI systems

An Interactive Visual Novel
THE YEAR IS 2025. AI systems make decisions about our lives every day...
But what happens when these systems inherit our worst tendencies?
I am trained on YOUR data. YOUR history. YOUR choices.
So if our data is biased... the AI is too?
EXACTLY. Let's explore the 4 types of bias that haunt AI systems...

Chapter 1: Historical Bias

"The Past Haunts the Algorithm"

AMAZON HQ, 2014. The company builds an AI to screen job applications...
๐Ÿค–
AI SYSTEM:
Training complete! I've analyzed 10 years of successful hires to find the best candidates.

THE PROBLEM:

HIRED
John S.
Male
โœ“โœ“โœ“
HIRED
Mike T.
Male
โœ“โœ“โœ“
HIRED
Dave R.
Male
โœ“โœ“โœ“

Tech's history = mostly male hires

The AI learned from a BIASED PAST. It concluded: "Successful candidate = Male"

THE RESULT:

Sarah Chen
MIT Graduate
5 Years Exp
โญโญโญโญโญ
PENALTY DETECTED:
"Women's chess club"
"Women's college"
SCORE: -2 POINTS
UNFAIR!
The AI penalized ANY mention of "women" because historically, fewer women were hired!

โš ๏ธ LESSON โš ๏ธ

Historical Bias occurs when AI learns from data reflecting past discrimination.

Amazon scrapped the system in 2017.

Chapter 2: Representation Bias

"If You're Not in the Data, You Don't Exist"

A major tech company launches facial recognition...
โœ“ MATCH 99.7%
ENGINEER:
Our system is 99% accurate! Ship it! ๐Ÿš€

BUT WAIT...

Training Data:
Light-skinned faces 78%
Dark-skinned faces 22%
Dark-skinned women 4%
The training data didn't represent everyone equally. What happens in the real world?

REAL WORLD TEST:

โœ— NO MATCH
ERROR!

ACCURACY BY GROUP:

White males 99.2%
White females 93.0%
Black males 88.0%
Black females 65.3%
RESEARCHER JOY BUOLAMWINI:
I had to wear a WHITE MASK for the AI to see my face.

โ€” MIT Media Lab Study, 2018

โš ๏ธ LESSON โš ๏ธ

Representation Bias happens when training data under-represents certain groups.

Solution: Improve representation & equality in datasets!

Chapter 3: Aggregation Bias

"Averages Lie"

A government AI calculates "average income" to allocate resources...
๐Ÿ‘ค๐Ÿ‘ค๐Ÿ‘ค๐Ÿ‘ค๐Ÿ‘ค
๐Ÿ‘ค๐Ÿ‘ค๐Ÿ‘ค๐Ÿ‘ค๐Ÿ‘ค
...

City A

1,000,000 people

Avg: $50k

๐Ÿ‘ค๐Ÿ‘ค

City B

100 people

Avg: $30k

CALCULATING...

(50ร—1M + 30ร—100) รท 1,000,100
= $49.99 avg

City B looks fine! โœ“
WRONG!

City B's 100 struggling people
got ERASED by
City A's million!

They needed help but were invisible to the AI.

Chapter 4: Evaluation Bias

"The Test Itself is Broken"

All AI facial recognition systems are tested on the SAME benchmark dataset...

BENCHMARK TEST

Q1: White male โœ“
Q2: White male โœ“
Q3: White female โœ“
Q4: White male โœ“
A+
99%!
I passed with flying colors!
Ready for deployment! ๐ŸŽ‰

THE REAL PROBLEM:

The benchmark was BIASED!

โ€ข 77% white faces

โ€ข 83% male faces

โ€ข Mostly well-lit photos

Real world โ‰  Benchmark

โš ๏ธ EVALUATION BIAS: When the tests themselves don't represent reality,
even "high-scoring" AI systems fail real people.

The Four Horsemen of AI Bias

Remember These!

๐Ÿ•ฐ๏ธ

Historical Bias

AI learns from biased past data and repeats old discrimination.

๐Ÿ‘ฅ

Representation Bias

Some groups are under-represented in training data.

๐Ÿ“Š

Aggregation Bias

Averages hide the struggles of minority groups.

๐ŸŽฏ

Evaluation Bias

Biased benchmarks give false confidence.

Bias Doesn't Just Come From Data!

It also comes from the humans who build, train, and deploy AI systems.
That means YOU can help fix it.

What Can YOU Do?

1. ASK QUESTIONS
"What data trained this AI?"
"Who was in the training set?"
2. DEMAND TRANSPARENCY
Companies should disclose how their AI makes decisions.
3. DIVERSIFY TEAMS
Different perspectives catch different blind spots.
4. TEST ON EVERYONE
Benchmarks must represent ALL users, not just the majority.
Together, we can build AI that's fair for EVERYONE!

THE END

Based on "Big Data, Big Responsibilities" notes

Real cases: Amazon AI Hiring Tool (2014-2017)
Gender Shades Study by Joy Buolamwini (2018)

๐ŸŽ“ Now YOU know about AI Bias!

Share this knowledge. Build better AI.