The use of artificial intelligence (AI) can benefit healthcare organizations through task automation, database management, patient engagement, and diagnostics enhancement. But AI also introduces significant new risks to data security and compliance, especially when the tool is provided by a third-party vendor.
Valerie Rock, Principal, along with other experts, were invited to discuss the risks and rewards of using AI in healthcare data management in a recent article in Compliance Today.
Rock and co-authors Robert Kantrowitz, Partner at Kirkland & Ellis; Shubha Lakshmanan, Senior Director of Compliance & Privacy at Waud Capital Partners; and Sean Sullivan, Partner at Alston & Bird, describe the risks with third-party AI tools and offer mitigation strategies in the article, “Navigating Risks in the Procurement of Third-Party AI Tools.”
What are the risks of using third-party AI in healthcare?
Among many risks, the authors state, “Placing undue trust in AI recommendations without sufficient human oversight can potentially endanger patient safety…, [and] mistakes and inaccuracies can cause improper coding decisions and medically unnecessary procedures or prescriptions, thus leading to fraud and abuse risk….”
Rock and the coauthors also describe risks related to data privacy and security, algorithm biases, legal exposure, and other complex risks.
What are AI risk mitigation strategies?
The experts offer three strategies to mitigate the many risks and improve the use of AI in healthcare:
- Five-phase vendor due diligence process
- Contract negotiations addressing unique issues with AI vendors
- Continuous auditing and comprehensive team education
Compliance Today is a national publication produced by the Health Care Compliance Association (HCCA) with the Society of Corporate Compliance and Ethics (SCCE) to provide insights on healthcare compliance issues.
PYA is committed to supporting healthcare organizations in incorporating and managing artificial intelligence safely, compliantly, and ethically. Learn more about PYA’s Compliance services.
