Karimi-Haghighi, Marzieh; Castillo, Carlos
Abstract: This paper addresses a key application of Machine Learning (ML) in the legal domain, studying how ML may be used to increase the effectiveness of a criminal recidivism risk assessment tool named RisCanvi, without introducing undue biases. The two key dimensions of this analysis are predictive accuracy and algorithmic fairness. ML-based prediction models obtained in this study are more accurate at predicting criminal recidivism than the manually-created formula used in RisCanvi, achieving an AUC of 0.76 and 0.73 in predicting violent and general recidivism respectively. However, the improvements are small, and it is noticed that algorithmic discrimination can easily be introduced between groups such as national vs foreigner, or young vs old. It is described how effectiveness and algorithmic fairness objectives can be balanced, applying a method in which a single error disparity in terms of generalized false positive rate is minimized, while calibration is maintained across groups. Obtained results show that this bias mitigation procedure can substantially reduce generalized false positive rate disparities across multiple groups. Based on these results, it is proposed that MLbased criminal recidivism risk prediction should not be introduced without applying algorithmic bias mitigation procedures.