|
|
|
@ -1,61 +1,184 @@
|
|
|
|
# The Ethics of Machine Learning
|
|
|
|
# ML for Beginners
|
|
|
|
|
|
|
|
Fairness in Machine Learning
|
|
|
|
|
|
|
|
|
|
|
|
Add a sketchnote if possible/appropriate
|
|
|
|
[Illustration “black box” here]
|
|
|
|
|
|
|
|
|
|
|
|
> ✅ Learn more about Responsible AI by following this [Learning Path](https://docs.microsoft.com/en-us/learn/modules/responsible-ai-principles/?WT.mc_id=academic-15963-cxa)
|
|
|
|
## [Pre-lecture quiz](https://jolly-sea-0a877260f.azurestaticapps.net/quiz/5/)
|
|
|
|
|
|
|
|
|
|
|
|
[](https://youtu.be/dnC8-uUZXSc "Microsoft's Approach to Responsible AI")
|
|
|
|
Introduction
|
|
|
|
> Video: Microsoft's Approach to Responsible AI
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## [Pre-lecture quiz](https://jolly-sea-0a877260f.azurestaticapps.net/quiz/5/)
|
|
|
|
You are about to learn machine learning to make our lives better— your future systems and models may be going to be involved in the everyday decision-making, such as health care system or fraud detection. So, it is important that they work well in providing fair outcomes for everyone.
|
|
|
|
|
|
|
|
Imagine when the data you are using disproportionally represented, or lacks certain demographics, such as race, gender, political view, religion, etc. Or when the output is interpreted to favor some demographic. What is the consequence of the application?
|
|
|
|
|
|
|
|
In this lesson, you will:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
- Raise your awareness of importance of fairness in ML
|
|
|
|
|
|
|
|
- Learn about fairness-related harms
|
|
|
|
|
|
|
|
- Learn about unfairness assessment and mitigation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Prerequisite
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
There is no prerequisite for this lesson, but it is a good idea to finish reading the [Introduction to Machine Learning](../[1-intro-to-ML/README.md)](https://github.com/microsoft/ML-For-Beginners/tree/main/Introduction/1-intro-to-ML) and \[History of Machine Learning\](../2-history-of-ML/README.md) first.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Unfairness in data and algorithms
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
*"If you torture the data long enough, it will confess to anything." - Ronald Coase*
|
|
|
|
|
|
|
|
This sounds extreme but it is true that data can be manipulated to support any conclusion. And manipulation can happen unintentionally. As humans, we all have bias, and you just don’t consciously know when you introduce bias in data.
|
|
|
|
|
|
|
|
Fairness in AI and machine learning remains a complex sociotechnical challenge, meaning that it cannot be addressed from either purely social or technical perspectives.
|
|
|
|
|
|
|
|
Watch this video to learn about the fairness and socio-technical challenges:
|
|
|
|
|
|
|
|
\[](https://eus-streaming-video-rt-microsoft-com.akamaized.net/3c12a201-0657-4449-999c-f41b25df9616/31ce46d9-85b0-4e84-b93e-225478de_2250.mp4)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Fairness-related harms
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
What do you mean by unfairness? —it is negative impacts for group of people, such as those defined in terms of race, gender, age, or disability status.
|
|
|
|
|
|
|
|
Main fairness-related harms can be classified as:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
- Allocation
|
|
|
|
|
|
|
|
- Quality of service
|
|
|
|
|
|
|
|
- Stereotyping
|
|
|
|
|
|
|
|
- Denigration
|
|
|
|
|
|
|
|
- Over- or under- representation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Let’s take a look at the examples.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Example of Allocation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
One of the examples is a system for screening loan applications. The system tends to pick white men as good candidates than other groups. As a result, loans are withheld from certain applicants.
|
|
|
|
|
|
|
|
Another example is this experimental hiring tool that developed by a large corporation to screen candidates. The tool systemically discriminated against women by using the models were trained to prefer masculine languages. It resulted in penalizing candidates whose resumes contain words such as “women’s rugby team”.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Quality of service
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Researchers found the three commercial gender classifiers had higher error rates that images of women with darker skin tones than the images of men with lighter skin tones.
|
|
|
|
|
|
|
|
Stereotyping
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Stereotypical gender view was found in machine translation. When translating “he is a nurse and she is a doctor” into Turkish, a genderless language, which has one pronoun, “o” to convey a singular third person, then back into English yields the stereotypical and incorrect as “she is a nurse and he is a doctor”.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Denigration
|
|
|
|
|
|
|
|
|
|
|
|
Describe what we will learn
|
|
|
|
An image labeling technology infamously mislabeled images of dark-skinned people as gorillas. Mislabeling is harmful not just because the system made a mistake because it specifically applied a label that has a long history of being purposefully used to denigrate demean black people.
|
|
|
|
|
|
|
|
|
|
|
|
### Introduction
|
|
|
|
Over- or under- representation
|
|
|
|
|
|
|
|
|
|
|
|
Describe what will be covered
|
|
|
|
Skewed image search results can be a good example of this harm. When searching images of professions with an equal or higher percentage of men than women, such as engineering, or CEO results heavily skewed toward images of men than reality.
|
|
|
|
|
|
|
|
|
|
|
|
> Notes
|
|
|
|
There five main types of harms are not mutually exclusive, and a single system can exhibit more than one type of harms.
|
|
|
|
|
|
|
|
Each case varies severities, for instance, unfairly labeling someone as a criminal is a much more severe harm than mislabeling an image but it's important to remember that even relatively non severe harms can make people feel alienated or singled out and the cumulative impact can be extremely oppressive.
|
|
|
|
|
|
|
|
|
|
|
|
### Prerequisite
|
|
|
|
✅ Discussion: Revisit some of the examples and see if they show different harms.
|
|
|
|
|
|
|
|
|
|
|
|
What steps should have been covered before this lesson?
|
|
|
|
| | Allocation | Quality of service | Stereotyping | Denigration | Over- or under- representation |
|
|
|
|
|
|
|
|
| ----------------------- | ---------- | ------------------ | ------------ | ----------- | ------------------------------ |
|
|
|
|
|
|
|
|
| Automated hiring system | x | x | x | | x |
|
|
|
|
|
|
|
|
| Machine translation | | | | | |
|
|
|
|
|
|
|
|
| Photo labeling | | | | | |
|
|
|
|
|
|
|
|
|
|
|
|
### Preparation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Preparatory steps to start this lesson
|
|
|
|
Detecting unfairness
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
There are many reasons why the system behaves unfairly— the reasons include societal biases reflected of the datasets used to train them. For example, the hiring unfairness was caused by the historical data, by using the patterns in resumes submitted to the company over a 10-year period, and the problem was that the majority came from men, a reflection of male dominance across the tech industry.
|
|
|
|
|
|
|
|
Inadequate data points about a certain group of people can be the reason. For example, image classifiers have higher rate error for images of dark-skinned women because there aren’t enough dataset with darker skin tones to train.
|
|
|
|
|
|
|
|
Wrong assumptions made during the development cases unfairness too. For example, facial analysis system to predict who is going to commit a crime based on images of people’s faces. The assumption to make it believe this system is capable of doing this could lead substantial harms for people who are misclassified.
|
|
|
|
|
|
|
|
|
|
|
|
[](https://youtu.be/tL7t2O5Iu8E "Eric Horvitz, Technical Fellow and Director of Microsoft Research Labs, talks about some of the benefits AI and machine learning are bringing and why it is essential for companies to establish ethical principles to make sure AI is properly governed.")
|
|
|
|
Understand your models and build fairness
|
|
|
|
> Video: Eric Horvitz, Technical Fellow and Director of Microsoft Research Labs, talks about some of the benefits AI and machine learning are bringing and why it is essential for companies to establish ethical principles to make sure AI is properly governed.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
[Step through content in blocks]
|
|
|
|
Although many aspects of fairness are not captured in quantitative fairness metrics, and it is not possible to fully remove bias from a system to guarantee fairness, you are still responsible to detect and to mitigate fairness issues as much as possible.
|
|
|
|
|
|
|
|
When you are working with machine learning models, it is important to understand your models with interpretability and assess and mitigate unfairness.
|
|
|
|
|
|
|
|
Let’s use the loan selection example to isolate the case to figure out each factors level of impact on the prediction.
|
|
|
|
|
|
|
|
|
|
|
|
## [Topic 1]
|
|
|
|
Assessment methods
|
|
|
|
|
|
|
|
|
|
|
|
### Task:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Work together to progressively enhance your codebase to build the project with shared code:
|
|
|
|
1. Identify the harms (and benefits)
|
|
|
|
|
|
|
|
2. Identify the affected groups
|
|
|
|
|
|
|
|
3. Define fairness metrics
|
|
|
|
|
|
|
|
|
|
|
|
```html
|
|
|
|
Identify the harms (and benefits)
|
|
|
|
code blocks
|
|
|
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
✅ Knowledge Check - use this moment to stretch students' knowledge with open questions
|
|
|
|
What are the harms and benefits associated with lending? Think false negatives and false positive scenarios:
|
|
|
|
|
|
|
|
**False negatives** (reject, but Y=1) - when an applicant will be capable of repaying loan is rejected. This is an adverse event because the resources of the loans are withheld from qualified applicants.
|
|
|
|
|
|
|
|
**False positives** (accept, but Y=0) - when the applicant does get the loan but eventually defaults. As the result, the applicant will be sent to the debt collection agencies, and possibly affects their future loan applications.
|
|
|
|
|
|
|
|
Identify the affected groups
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
The next step is to determine which groups are likely to be affected. For example, in case of a credit card application, where you see women are receiving much lower credit limits compared with their spouses who shares assets, the affected groups can be defined by the gender identity.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Define fairness metrics
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
You have identified harms and affected groups, in this case, gender. Now, use the quantified factors to disaggregate metrics. For example, when you have the data below, by examining this table, we see the women has the largest false positive rate and men has the smallest, and the opposite for false negatives.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| | False positive rate | False negative rate | count |
|
|
|
|
|
|
|
|
| ---------- | ------------------- | ------------------- | ----- |
|
|
|
|
|
|
|
|
| women | 0.37 | 0.27 | 54032 |
|
|
|
|
|
|
|
|
| men | 0.31 | 0.35 | 28620 |
|
|
|
|
|
|
|
|
| Non-binary | 0.33 | 0.31 | 1266 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Also, note that this table also tells us that the non-binary people have much smaller count. It means the data is less certain and possibly has a larger error bars, so you need to be more careful how you interpret these numbers.
|
|
|
|
|
|
|
|
So, in this case, we have 3 groups and 2 metrics. When we are thinking about how our system affects the group of customers/loan applicants, this may be sufficient, but when you want to define larger number of groups, you may want to distill this to smaller sets of summaries. To do that, you can add more metrics, such as largest difference, and smallest ratio of each false negative/positive rates.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
✅ Discussion: What other groups are likely to be affected for loan application?
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Mitigating unfairness
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
To mitigate the fairness issue, explorer the model to generate various mitigated models and compare them navigate tradeoffs between accuracy and fairness to select the model with the desired trade off.
|
|
|
|
|
|
|
|
This intro lesson does not dive deeply into the details of algorithmic unfairness mitigation, such as post-processing and reductions approach, but introducing a tool that you may want to try.
|
|
|
|
|
|
|
|
Fairlearn
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
\[Fairlearn\](https://fairlearn.github.io/) is an open-source Python package that allows you to assess your systems' fairness and mitigate unfairness.
|
|
|
|
|
|
|
|
The tool may help you to assesses how a model's predictions affect different groups, enables comparing multiple models by using fairness and performance metrics, and supply a set of algorithms to mitigate unfairness in binary classification and regression.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
- Learn how to use the different components by checking out the Fairlearn's [GitHub](https://github.com/fairlearn/fairlearn/), [user guide](https://fairlearn.github.io/main/user_guide/index.html), [examples](https://fairlearn.github.io/main/auto_examples/index.html), and [sample notebooks](https://github.com/fairlearn/fairlearn/tree/master/notebooks).
|
|
|
|
|
|
|
|
- Learn [how to](https://docs.microsoft.com/en-us/azure/machine-learning/how-to-machine-learning-fairness-aml) enable fairness assessment of machine learning models in Azure Machine Learning.
|
|
|
|
|
|
|
|
- See the [sample notebooks](https://github.com/Azure/MachineLearningNotebooks/tree/master/contrib/fairness) for more fairness assessment scenarios in Azure Machine Learning.
|
|
|
|
|
|
|
|
|
|
|
|
## [Topic 2]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## [Topic 3]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## 🚀 Challenge
|
|
|
|
## 🚀 Challenge
|
|
|
|
|
|
|
|
|
|
|
|
Add a challenge for students to work on collaboratively in class to enhance the project
|
|
|
|
To avoid biases to be introduced in the first place, we should:
|
|
|
|
|
|
|
|
|
|
|
|
Optional: add a screenshot of the completed lesson's UI if appropriate
|
|
|
|
- have a diversity of backgrounds and perspectives among the people working on systems
|
|
|
|
|
|
|
|
- invest in datasets that reflect the diversity in our society
|
|
|
|
|
|
|
|
- develop better methods for detecting and correcting bias when it occurs
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Open-end discussion: what else should we consider?
|
|
|
|
|
|
|
|
|
|
|
|
## [Post-lecture quiz](https://jolly-sea-0a877260f.azurestaticapps.net/quiz/6/)
|
|
|
|
## [Post-lecture quiz](https://jolly-sea-0a877260f.azurestaticapps.net/quiz/6/)
|
|
|
|
|
|
|
|
|
|
|
|
## Review & Self Study
|
|
|
|
## Review & Self Study
|
|
|
|
|
|
|
|
|
|
|
|
**Assignment**: [Assignment Name](assignment.md)
|
|
|
|
In this lesson, you have learned fairness/unfairness in ML.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Watch this workshop to dive deeper into the topics:
|
|
|
|
|
|
|
|
■ YouTube: Fairness-related harms in AI systems: Examples, assessment, and mitigation by Hanna Wallach and Miro Dudik [Fairness-related harms in AI systems: Examples, assessment, and mitigation - YouTube](https://www.youtube.com/watch?v=1RptHwfkx_k)
|
|
|
|
|
|
|
|
Also, read:
|
|
|
|
|
|
|
|
■ Microsoft’s RAI resource center: [Responsible AI Resources – Microsoft AI](https://www.microsoft.com/en-us/ai/responsible-ai-resources?activetab=pivot1%3aprimaryr4)
|
|
|
|
|
|
|
|
■ Microsoft’s FATE research group: [FATE: Fairness, Accountability, Transparency, and Ethics in AI - Microsoft Research](https://www.microsoft.com/en-us/research/theme/fate/)
|
|
|
|
|
|
|
|
■ Fairlearn toolkit: [Fairlearn](https://fairlearn.org/)
|
|
|
|
|
|
|
|
■ Azure Machine Learning - **Machine learning fairness**
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
https://docs.microsoft.com/en-us/azure/machine-learning/concept-fairness-ml
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Assignment: [Assignment Name](assignment.md)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
> ✅ Learn more about Responsible AI by following this [Learning Path](https://docs.microsoft.com/en-us/learn/modules/responsible-ai-principles/?WT.mc_id=academic-15963-cxa)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
[](https://youtu.be/dnC8-uUZXSc "Microsoft's Approach to Responsible AI")
|
|
|
|
|
|
|
|
> Video: Microsoft's Approach to Responsible AI
|
|
|
|
|
|
|
|
|
|
|
|
|
Jen Looper
4 years ago