Opioid Use Disorder (OUD) is a major public health crisis in the US affecting over 2.4 million Americans across all age groups and backgrounds. Previous studies have developed machine learning (ML) and deep learning (DL) models with strong predictive performance for OUD; however, bias related to sociodemographic features remains unaddressed. In this study, we propose a bias mitigation algorithm, based on equality of odds (EO), to mitigate ML model bias in OUD prediction. Our algorithm adjusts the classification threshold to minimize the difference between specificity and recall across sociodemographic groups. We develop a neural network (NN) for OUD prediction and analyze bias by comparing the area under the curve (AUC) values. We implement our algorithm to mitigate bias related to gender, marital status, working condition, race, and income. The proposed algorithm achieves significant improvements in bias reduction: 16.96% for gender, 8.87% for marital status, 8.45% for working condition, 41.62% for race, and 0.20% for income. We also propose a fairness-aware weighted majority voting (WMV) classifier, achieving a recall of 92.68% and an accuracy of 90.21%. Furthermore, we evaluate the proposed methods using logistic regression and support vector machine classifiers with linear and radial basis function kernels, confirming the significant bias reduction and high performance of the WMV classifier for OUD prediction