Google Health AI – Success Story?

In 2018, Google Health began a program in Thailand to screen for diabetic retinopathy using artificial intelligence (AI). The AI was designed to analyze photos of diabetic patients’ eyes to detect signs of eye disease. The AI was promising in theory – during testing, it was 90% accurate in detecting diabetic retinopathy in eye scans, according to MIT Technology Review. However, in practice, the AI presented various problems for clinical staff. For example, the process of capturing images varied across clinics, many eye scans were rejected by the algorithm due to picture quality issues, and internet issues in the clinics delayed the image uploading process.

This is a reminder that AI needs to be responsive to the ways clinical staff operate in the real world.

Even though the AI demonstrated accuracy in the lab – the algorithm detected eye disease just as well as an ophthalmologist – field performance can be a different story. Machine learning experts need to have input from healthcare professionals before the algorithm is deployed. For example, what would doctors in the field do with an eye scan that is not clear, or that is a borderline case? Perhaps we should expect AI to do more than just reject any imperfect image, when experts in the field would engage in reasoned debate about the interpretation of the image.

According to CBI Insights, Google – more than any other tech company – is focusing on software and artificial intelligence in the healthcare arena. Google plans to use health software for data generation and lifestyle management tools, with their AI efforts focused on disease detection. Despite the hiccups in the Thailand diabetes study, Google looks to be responsive to the challenges of AI – their researchers assert that “the success of a deep learning model does not rest solely on its accuracy, but also on its ability to improve patient care.” That is the right attitude which will help healthcare AI find greater success in coming years.

 

Read more AI content here: AI Tag

About the author

Amy enjoys researching and writing about developments in medical technology and how that intersects with US law. She received her J.D. from the University of Florida Levin College of Law in 2020 and now works as a Regulatory Associate for SoftwareCPR®, a general-purpose regulatory consulting firm that is recognized globally for their expertise with standards and national regulations pertaining to medical device, mobile medical app, and HealthIT software.

SoftwareCPR Training Courses:

IEC 62304 and other emerging standards for Medical Device and HealthIT Software

Our flagship course for preparing regulatory, quality, engineering, operations, and others for the activities and documentation expected for IEC 62304 conformance and for FDA expectations. The goal is to educate on the intent and purpose so that the participants are able to make informed decisions in the future.  Focus is not simply what the standard says, but what is meant and discuss examples and approaches one might implement to comply.  Special deep discount pricing available to FDA attendees and other regulators.

3-days onsite with group exercises, quizzes, examples, Q&A.

Instructor: Brian Pate

Next public offering:  June 5-7, 2024
Boston, MA

Email training@softwarecpr.com to request a special pre-registration discount.  Limited number of pre-registration coupons.

Registration Link:

Register Now

 


 

Being Agile & Yet Compliant (Public or Private)

Our SoftwareCPR unique approach to incorporating agile and lean engineering to your medical device software process training course is now open for scheduling!

  • Agile principles that align well with medical
  • Backlog management
  • Agile risk management
  • Incremental and iterative software development lifecycle management
  •  Frequent release management
  • And more!

2-days onsite (4 days virtual) with group exercises, quizzes, examples, Q&A.

Instructors: Mike Russell, Ron Baerg

Next public offering: February 12-15, 2024

Virtual via Zoom

Registration Link:

Register Now

 


 

Medical Device Cybersecurity (Public or Private)

This course takes a deep dive into the US FDA expectations for cybersecurity activities in the product development process with central focus on the cybersecurity risk analysis process. Overall approach will be tied to relevant standards and FDA guidance documentation. The course will follow the ISO 14971:2019 framework for overall structure but utilize IEC 62304, IEC 81001-5-1, and AAMI TIR57 for specific details regarding cybersecurity planning, risk characterization, threat modeling, and control strategies.

2-days onsite with group exercises, quizzes, examples, Q&A.

Instructor: Dr Peter Rech, 2nd instructor (optional)

Next public offering:  TBD

Corporate Office

15148 Springview St.
Tampa, FL 33624
USA
+1-781-721-2921
Partners located in the US (CA, FL, MA, MN, TX) and Canada.