Examples#

  • Auditing models for Individual Fairness

Task

Jupyter link

Binder link

Adult Income Prediction
Predict if a person makes >$50000 or not. Model should be fair across genders.

Jupyter notebook

Binder

Sentiment Analysis
Predict the sentiment of an input sentence. Model should be fair across names from different ethnicities.

Jupyter notebook

Binder

  • Training models for Individual Fairness

Task

Jupyter link

Binder link

Adult Income Prediction
Predict if a person makes >$50000 or not. Model should be fair across genders.

Jupyter notebook

Binder

Sentiment Analysis
Predict the sentiment of an input sentence. Model should be fair across names from different ethnicities.

Jupyter notebook

Binder

Synthetic Data
Classifier trained on a randomly generated 2-dimensional data with one dimension explicitly specified as a protected attribute.

Jupyter notebook

Binder

Individually fair ranking on synthetic data
Ranking algorithm trained on a randomly generated 2-dimensional data with one dimension explicitly specified as a protected attribute.

Jupyter notebook

Binder

Word Embedding Association Tests
Reduce bias in word embeddings by replacing the metric in the embedding space with an individually fair metric.

Jupyter notebook

Binder

  • Post-processing pre-trained model predictions for Individual Fairness

Task

Jupyter link

Binder link

Sentiment Analysis
Post-process the sentiment predictions of the DistilBERT model from HuggingFace on sentences of template This movie was filed in <country>

Jupyter notebook

Binder