Healthcare AI systems make life-altering decisions every day. AI accountability in healthcare means creating verifiable proof of what the AI recommended, when, and under which clinical policy.