Can internet search engine queries be used to diagnose diabetes? Analysis of archival search data

Irit Hochberg, Deeb Daoud, Naim Shehadeh, Elad Yom-Tov

Research output: Contribution to journalArticlepeer-review

Abstract

Aims: Diabetes is often diagnosed late. This study aimed to assess the possibility for earlier detection of diabetes from search data, using predictive models trained on large-scale data. Methods: We extracted all English-language queries made by people in the USA to Bing during 1 year and identified queries containing symptoms of diabetes. We compared the ability of four different prediction models (linear regression, logistic regression, decision tree and random forest) to distinguish between users who stated that they were diagnosed with diabetes and users who did not refer to diabetes or diabetes drugs but queried about at least one of the symptoms. Results: We identified 11,050 “new diabetes users” who stated they had been diagnosed with diabetes and approximately 11.5 million “control users” who queried about symptoms without querying for terms related to diabetes. Both the logistic regression and the random forest models were able to distinguish between the populations with an area under curve of 0.92 which translates to a positive predictive value of 56% at a false-positive rate of 1%. The model could identify patients up to 240 days before they mentioned being diagnosed. Conclusions: Some undiagnosed diabetes patients can be detected accurately according to their symptom queries to a search engine. Such earlier diagnosis, especially in cases of type 1 diabetes, could be clinically meaningful. The ability of search engines to serve as a population-wide screening tool could potentially be improved using additional data provided by users.

Original languageEnglish
Pages (from-to)1149-1154
Number of pages6
JournalActa Diabetologica
Volume56
Issue number10
DOIs
StatePublished - 1 Oct 2019

Keywords

  • Diabetes
  • Digital health
  • Internet
  • Symptoms

All Science Journal Classification (ASJC) codes

  • Endocrinology
  • Internal Medicine
  • Endocrinology, Diabetes and Metabolism

Fingerprint

Dive into the research topics of 'Can internet search engine queries be used to diagnose diabetes? Analysis of archival search data'. Together they form a unique fingerprint.

Cite this