While clinical AI and medical risk scores have received much attention for their potential to achieve above-human performance, there are many concerns about their ability to mimic societal bias. In this talk, Dr. Ghassemi explores the difficulty of making state-of-the-art machine learning models behave as we say, not as we do, and how technical choices that seems natural in other settings may not work well in health.