Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Comment
  • Published:

Computational challenges arising in algorithmic fairness and health equity with generative AI

The use of generative artificial intelligence (AI) in healthcare is advancing, but understanding its potential challenges for fairness and health equity is still in its early stages. This Comment investigates how to define fairness and measure it, and highlights research that can help address challenges in the field.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Challenges in assessing fairness in generative AI.

References

  1. Tierney, A. A. et al. NEJM Catal. Innov. Care Deliv. https://doi.org/10.1056/CAT.23.0404 (2024).

    Article  Google Scholar 

  2. Wachter, R. M. & Brynjolfsson, E. JAMA 331, 65–69 (2024).

    Article  Google Scholar 

  3. Howell, M. D., Corrado, G. S. & DeSalvo, K. B. JAMA 331, 242–244 (2024).

    Article  Google Scholar 

  4. Yang, Y., Zhang, H., Gichoya, J. W., Katabi, D. & Ghassemi, M. Nat. Med. 30, 2838–2848 (2024).

    Article  Google Scholar 

  5. Chen, R. J. et al. Nat. Biomed. Eng. 7, 719–742 (2023).

    Article  Google Scholar 

  6. Gallegos, I. O. et al. Comput. Linguist. Assoc. Comput. Linguist. 50, 1097–1179 (2024).

    Article  Google Scholar 

  7. Brunet, M.-E., Alkalay-Houlihan, C., Anderson, A. & Zemel, R. In Proceedings of the 36th International Conference on Machine Learning, 803–811 (PMLR, 2019).

  8. Hofmann, V., Kalluri, P. R., Jurafsky, D. & King, S. Nature 633, 147–154 (2024).

    Article  Google Scholar 

  9. Huang, Y. et al. IEEE Trans. Softw. Eng. 51, 413–429 (2025).

    Article  Google Scholar 

  10. Martínez, G., Hernández, J. A., Conde, J., Reviriego, P. & Merino-Gómez, E. ACM Trans. Intell. Syst. Technol. https://doi.org/10.1145/3696459 (2024).

    Article  Google Scholar 

  11. Birhane, A., Prabhu, V. U. & Kahembwe, E. Preprint at https://arxiv.org/abs/2110.01963 (2021).

  12. Groeneveld, D. et al. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 15789–15809 (Association for Computational Linguistics, 2024).

  13. Han, T., Kumar, A., Agarwal, C. & Lakkaraju, H. In 38th Conference on Neural Information Processing Systems, 33423–33454 (Curran Associates, Inc., 2024)

  14. Achintalwar, S. et al. Preprint at https://arxiv.org/abs/2403.06009 (2024).

  15. Mitchell, E., Lin, C., Bosselut, A., Finn, C. & Manning, C. D. In Proceedings of 39th International Conference on Machine Learning, 15817–15831 (PMLR, 2022)

Download references

Acknowledgements

B.B.-J. received research funding support from NINDS (R00NS114850) and the Gordon and Betty Moore Foundation.

Author information

Authors and Affiliations

Authors

Contributions

V.M.S., A.Z., and B.B.-J. wrote the initial draft manuscript. All authors revised the manuscript and approved the final submission.

Corresponding author

Correspondence to Brett Beaulieu-Jones.

Ethics declarations

Competing interests

The authors declare no competing interests.

Peer review

Peer review information

Nature Computational Science thanks the anonymous reviewer(s) for their contribution to the peer review of this work.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Suriyakumar, V.M., Zink, A., Hightower, M. et al. Computational challenges arising in algorithmic fairness and health equity with generative AI. Nat Comput Sci (2025). https://doi.org/10.1038/s43588-025-00806-9

Download citation

  • Published:

  • DOI: https://doi.org/10.1038/s43588-025-00806-9

Search

Quick links

Nature Briefing AI and Robotics

Sign up for the Nature Briefing: AI and Robotics newsletter — what matters in AI and robotics research, free to your inbox weekly.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing: AI and Robotics