Google AI now can predict cardiovascular problems from retinal scans

This is a big step forward, Google officials said, because the tech is not imitating an existing diagnostic but rather using machine learning to uncover a new way to predict health problems.
By Bill Siwicki
12:18 PM
Google AI


This is a big step forward scientifically, Google AI officials said, because it is not imitating an existing diagnostic but rather using machine learning to uncover a surprising new way to predict these problems. What's more, the new system shows what parts of the eye image lead to successful predictions, giving researchers new leads into what causes cardiovascular disease.

[Also: Radiology practices using AI and NLP to boost MIPS payments]

The results of the Google AI research have been published in an article entitled "Prediction of Cardiovascular Risk Factors from Retinal Fundus Photographs via Deep Learning" in Nature Biomedical Engineering.

"Using deep learning algorithms trained on data from 284,335 patients, we were able to predict CV risk factors from retinal images with surprisingly high accuracy for patients from two independent data sets of 12,026 and 999 patients," Lily Peng, MD, product manager and a lead on these efforts within Google AI, wrote in the Google AI official blog.


[Also: Machine learning is a big idea, but hospitals need business plans first]

In addition, while doctors can typically distinguish between the retinal images of patients with severe high blood pressure and normal patients, Google AI's algorithm could go further to predict the systolic blood pressure within 11 mmHg on average for patients overall, including those with and without high blood pressure.

In addition to predicting the various risk factors – age, gender, smoking, blood pressure, etc. – from retinal images, Google AI's algorithm was fairly accurate at predicting the risk of a CV event directly. The algorithm used the entire image to quantify the association between the image and the risk of heart attack or stroke, Peng wrote.

"Given the retinal image of one patient who (up to 5 years) later experienced a major CV event (such as a heart attack) and the image of another patient who did not, our algorithm could pick out the patient who had the CV event 70 percent of the time," she said. "This performance approaches the accuracy of other CV risk calculators that require a blood draw to measure cholesterol."

This work may represent a new method of scientific discovery.

"Traditionally, medical discoveries are often made through a sophisticated form of guess and test – making hypotheses from observations and then designing and running experiments to test the hypotheses," wrote Peng. "However, with medical images, observing and quantifying associations can be difficult because of the wide variety of features, patterns, colors, values and shapes that are present in real images."

Google AI's approach uses deep learning to draw connections between changes in the human anatomy and disease, akin to how doctors learn to associate signs and symptoms with the diagnosis of a new disease. This, she added, could help scientists generate more targeted hypotheses and drive a wide range of future research.

Twitter: @SiwickiHealthIT
Email the writer:

More regional news

Your subscription has been saved.
Something went wrong. Please try again.