{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T21:35:58Z","timestamp":1758317758814,"version":"3.44.0"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"8","funder":[{"name":"National Science Foundation","award":["IIS-2147276"],"award-info":[{"award-number":["IIS-2147276"]}]},{"name":"J.P. Morgan Chase Artificial Intelligence"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2025,9,30]]},"abstract":"<jats:p>\n            Fair decision-making in Machine Learning (ML) remains a critical challenge, particularly when access to sensitive information is restricted due to legal, ethical, or organizational constraints. These limitations affect both accuracy and fairness, creating tradeoffs central to the deployment of ML systems in the real world. While prior work has studied fairness-accuracy tradeoffs, most approaches focus on model outputs rather than directly examining how restricted data access impacts fairness. This leaves an important gap:\n            <jats:italic toggle=\"yes\">understanding how fairness constraints affect model performance under real-world data restrictions<\/jats:italic>\n            . To address this gap, we propose a framework that explicitly models fairness-accuracy tradeoffs in data-restricted environments. Unlike prior work, our approach analyzes the behavior of the optimal Bayesian classifier using a discrete approximation of the data distribution, allowing us to systematically isolate the effects of fairness constraints. We evaluate our framework on three benchmark datasets\u2014Adult, Law, and Dutch Census\u2014revealing key insights: (1) enforcing equal accuracy on imbalanced datasets can substantially degrade performance under additional fairness constraints, (2) individual and group fairness often impose conflicting constraints, and (3) decorrelating sensitive attributes from features does not usually reduce accuracy. These findings demonstrate that our framework provides an effective, structured approach for practitioners to assess fairness constraints in decision-making pipelines.\n          <\/jats:p>","DOI":"10.1145\/3747850","type":"journal-article","created":{"date-parts":[[2025,7,18]],"date-time":"2025-07-18T14:24:36Z","timestamp":1752848676000},"page":"1-40","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Balancing Fairness and Accuracy in Data-Restricted Binary Classification"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-7400-5547","authenticated-orcid":false,"given":"Zachary McBride","family":"Lazri","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Maryland, College Park, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-6135-561X","authenticated-orcid":false,"given":"Danial","family":"Dervovic","sequence":"additional","affiliation":[{"name":"J. P. Morgan AI Research, Glasgow, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0009-0003-0125-2971","authenticated-orcid":false,"given":"Antigoni","family":"Polychroniadou","sequence":"additional","affiliation":[{"name":"J. P. Morgan AI Research, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-2953-3746","authenticated-orcid":false,"given":"Ivan","family":"Brugere","sequence":"additional","affiliation":[{"name":"J. P. Morgan AI Research, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0001-6797-641X","authenticated-orcid":false,"given":"Dana","family":"Dachman-Soled","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Maryland, College Park, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0001-5171-145X","authenticated-orcid":false,"given":"Furong","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Maryland, College Park, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0001-7672-9357","authenticated-orcid":false,"given":"Min","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Maryland, College Park, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,9,18]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"254","volume-title":"Ethics of Data and Analytics","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine bias. In Ethics of Data and Analytics. Kirsten Martin (Eds.), Auerbach Publications, 254\u2013264."},{"key":"e_1_3_2_3_2","first-page":"62","article-title":"Equal employment opportunity under the Civil Rights Act of 1964","volume":"31","author":"Berg Richard K.","year":"1964","unstructured":"Richard K. Berg. 1964. Equal employment opportunity under the Civil Rights Act of 1964. Brooklyn Law Review 31 (1964), 62.","journal-title":"Brooklyn Law Review"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511804441"},{"key":"e_1_3_2_5_2","first-page":"77","volume-title":"Proceedings of the Conference on Fairness, Accountability and Transparency","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Proceedings of the Conference on Fairness, Accountability and Transparency. PMLR, 77\u201391."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287586"},{"key":"e_1_3_2_7_2","first-page":"560","volume-title":"Proceedings of the Conference on Uncertainty in Artificial Intelligence","author":"Chen Mingliang","year":"2020","unstructured":"Mingliang Chen and Min Wu. 2020. Towards threshold invariant fair classification. In Proceedings of the Conference on Uncertainty in Artificial Intelligence. PMLR, 560\u2013569."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"e_1_3_2_9_2","unstructured":"US Congress. 1968. Fair Housing Act. Retrieved from https:\/\/2.zoppoz.workers.dev:443\/http\/www.justice.gov\/crt\/fair-housing-act-2"},{"key":"e_1_3_2_10_2","unstructured":"US Congress. 1974. Equal Credit Opportunity Act. Retrieved October 1974 from https:\/\/2.zoppoz.workers.dev:443\/http\/www.ecfr.gov\/cgi-bin\/text-idx?tpl=\/ecfrbrowse\/Title12\/12cfr202_main_02.tpl"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.abq6147"},{"key":"e_1_3_2_12_2","volume-title":"Linear Programming and Extensions","author":"Dantzig George","year":"1963","unstructured":"George Dantzig. 1963. Linear Programming and Extensions. Princeton University Press."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3383455.3422567"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390191"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_2_16_2","article-title":"Demystifying local and global fairness trade-offs in federated learning using partial information decomposition","author":"Hamman Faisal","year":"2024","unstructured":"Faisal Hamman and Sanghamitra Dutta. 2024. Demystifying local and global fairness trade-offs in federated learning using partial information decomposition. In Proceedings of the 2024 International Conference on Learning Representations (ICLR \u201924).","journal-title":"Proceedings of the 2024 International Conference on Learning Representations (ICLR \u201924)"},{"key":"e_1_3_2_17_2","article-title":"Equality of opportunity in supervised learning","volume":"29","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems. Daniel D. Lee, Masashi Sugiyama, Ulrike von Luxburg, Isabelle Guyon, and Roman Garnett (Eds.), Vol. 29, Curran Associates Inc.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_18_2","first-page":"32749","volume-title":"Advances in Neural Information Processing Systems","author":"Hsu Brian","year":"2022","unstructured":"Brian Hsu, Rahul Mazumder, Preetam Nandy, and Kinjal Basu. 2022. Pushing the limits of fairness impossibility: Who\u2019s the fairest of them all? In Advances in Neural Information Processing Systems. S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.), Vol. 35, Curran Associates, Inc., 32749\u201332761. Retrieved from https:\/\/2.zoppoz.workers.dev:443\/https\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/d3222559698f41247261b7a6c2bbaedc-Paper-Conference.pdf"},{"key":"e_1_3_2_19_2","first-page":"862","volume-title":"Proceedings of the Uncertainty in Artificial Intelligence","author":"Jiang Ray","year":"2020","unstructured":"Ray Jiang, Aldo Pacchiano, Tom Stepleton, Heinrich Jiang, and Silvia Chiappa. 2020. Wasserstein fair classification. In Proceedings of the Uncertainty in Artificial Intelligence. PMLR, 862\u2013872."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-011-0463-8"},{"key":"e_1_3_2_21_2","first-page":"5264","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Kim Joon Sik","year":"2020","unstructured":"Joon Sik Kim, Jiahao Chen, and Ameet Talwalkar. 2020. FACT: A diagnostic for group fairness trade-offs. In Proceedings of the International Conference on Machine Learning. PMLR, 5264\u20135274."},{"key":"e_1_3_2_22_2","unstructured":"Jon Kleinberg Sendhil Mullainathan and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arxiv:1609.05807. Retrieved from https:\/\/2.zoppoz.workers.dev:443\/https\/arxiv.org\/abs\/1609.05807"},{"key":"e_1_3_2_23_2","first-page":"202","article-title":"Scaling up the accuracy of Naive-Bayes classifiers: A decision-tree hybrid","volume":"96","author":"Kohavi Ron","year":"1996","unstructured":"Ron Kohavi et al. 1996. Scaling up the accuracy of Naive-Bayes classifiers: A decision-tree hybrid. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD), Vol. 96, 202\u2013207.","journal-title":"Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD)"},{"key":"e_1_3_2_24_2","article-title":"Counterfactual fairness","volume":"30","author":"Kusner Matt J.","year":"2017","unstructured":"Matt J. Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. 2017. Counterfactual fairness. In Advances in Neural Information Processing Systems. Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna Wallach, Rob Fergus, S.V.N. Vishwanathan, and Roman Garnett (Eds.), Vol. 30, Curran Associates Inc.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_25_2","article-title":"How we examined racial discrimination in auto insurance prices","author":"Larson Jeff","year":"2017","unstructured":"Jeff Larson, Julia Angwin, Lauren Kirchner, and Surya Mattu. 2017. How we examined racial discrimination in auto insurance prices. ProPublica (5 Apr. 2017). Retrieved from https:\/\/2.zoppoz.workers.dev:443\/https\/www.propublica.org\/article\/minority-neighborhoods-higher-car-insurance-premiums-methodology","journal-title":"ProPublica"},{"key":"e_1_3_2_26_2","unstructured":"Jeff Larson Surya Mattu Lauren Kirchner and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. Retrieved from https:\/\/2.zoppoz.workers.dev:443\/https\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2024.3416040"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCOM.1980.1094577"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10287-022-00425-z"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1982.1056489"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682620"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020488"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2023.3236631"},{"key":"e_1_3_2_34_2","first-page":"107","volume-title":"Proceedings of the Conference on Fairness, Accountability and Transparency","author":"Menon Aditya Krishna","year":"2018","unstructured":"Aditya Krishna Menon and Robert C. Williamson. 2018. The cost of fairness in binary classification. In Proceedings of the Conference on Fairness, Accountability and Transparency. PMLR, 107\u2013118."},{"key":"e_1_3_2_35_2","first-page":"16848","volume-title":"Proceedings of the 39th International Conference on Machine Learning","volume":"162","author":"Nilforoshan Hamed","year":"2022","unstructured":"Hamed Nilforoshan, Johann D. Gaebler, Ravi Shroff, and Sharad Goel. 2022. Causal conceptions of fairness and their consequences. In Proceedings of the 39th International Conference on Machine Learning. Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvari, Gang Niu, and Sivan Sabato (Eds.), Proceedings of Machine Learning Research, Vol. 162, PMLR, 16848\u201316887. Retrieved from https:\/\/2.zoppoz.workers.dev:443\/https\/proceedings.mlr.press\/v162\/nilforoshan22a.html"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1201\/b17700"},{"key":"e_1_3_2_37_2","first-page":"25944","article-title":"Post-processing for individual fairness","volume":"34","author":"Petersen Felix","year":"2021","unstructured":"Felix Petersen, Debarghya Mukherjee, Yuekai Sun, and Mikhail Yurochkin. 2021. Post-processing for individual fairness. In Advances in Neural Information Processing Systems. Marc\u2019Aurelio Ranzato, Alina Beygelzimer, Yann Dauphin, Percy Liang, and Jennifer Wortman Vaughan (Eds.), Vol. 34, Curran Associates Inc, 25944\u201325955.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_38_2","unstructured":"Drago Plecko and Elias Bareinboim. 2024. Fairness-accuracy trade-offs: A causal perspective. arXiv:2405.15443. Retrieved from https:\/\/2.zoppoz.workers.dev:443\/https\/arxiv.org\/abs\/2405.15443"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2447976.2447990"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2022.3152352"},{"key":"e_1_3_2_41_2","unstructured":"Paul Van der Laan. 2001. The 2001 census in the Netherlands: Integration of registers and surveys. In INS\u00c9\u00c9-EUROSTAT Seminar on Censuses After 2001 Paris France November 20\u201321 2000. Institut National de la Statistique et des \u00c9tudes \u00c9conomiques 39\u201352. Retrieved from https:\/\/2.zoppoz.workers.dev:443\/https\/www.researchgate.net\/publication\/269678441_The_2001_Census_in_the_Netherlands_Integration_of_Registers_and_Surveys"},{"key":"e_1_3_2_42_2","unstructured":"Linda F. Wightman. 1998. LSAC National Longitudinal Bar Passage Study. LSAC Research Report Series."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.346"},{"key":"e_1_3_2_44_2","article-title":"Modeling tabular data using conditional GAN","volume":"32","author":"Xu Lei","year":"2019","unstructured":"Lei Xu, Maria Skoularidou, Alfredo Cuesta-Infante, and Kalyan Veeramachaneni. 2019. Modeling tabular data using conditional GAN. In Advances in Neural Information Processing Systems. Hanna Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d'Alch\u00e9-Buc, Emily Fox, and Roman Garnett (Eds.), Vol. 32, Curran Associates Inc.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_45_2","first-page":"962","volume-title":"Proceedings of the Artificial Intelligence and Statistics","author":"Zafar Muhammad Bilal","year":"2017","unstructured":"Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez Rogriguez, and Krishna P. Gummadi. 2017. Fairness constraints: Mechanisms for fair classification. In Proceedings of the Artificial Intelligence and Statistics. PMLR, 962\u2013970."},{"key":"e_1_3_2_46_2","first-page":"325","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Zemel Rich","year":"2013","unstructured":"Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning fair representations. In Proceedings of the International Conference on Machine Learning. PMLR, 325\u2013333."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.5555\/3586589.3586646"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT57864.2024.10619526"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.5555\/3692070.3694635"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/dl.acm.org\/doi\/pdf\/10.1145\/3747850","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T17:09:07Z","timestamp":1758301747000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/dl.acm.org\/doi\/10.1145\/3747850"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,18]]},"references-count":48,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2025,9,30]]}},"alternative-id":["10.1145\/3747850"],"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3747850","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"type":"print","value":"1556-4681"},{"type":"electronic","value":"1556-472X"}],"subject":[],"published":{"date-parts":[[2025,9,18]]},"assertion":[{"value":"2024-10-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}