Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community

Rory Sayres; Anna Devon-Sand; Mike Schaekermann; Margaret Ann Smith; Patricia Strachan; Grace Hong; Trinh Nguyen; Doris Wong; Naama Hammel; Dawn Siegel; Kexin Ren; Chelsea Belletieri; Vijaytha Muralidharan; Rajeev Rikhye; Yuan Liu; Beverly Freeman; Mike González; Nathan Ashcraft; Heidi Cho; Jimmy Li; Shweta Oak; Megan Shum; Abbi Ward; Yossi Matias; Greg S. Corrado; Dale Webster; Peggy Bui; Preeti Singh; Yun Liu; Justin Ko; Steven Lin

doi:10.1145/3706599.3720531

Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community

Rory Sayres, Anna Devon-Sand, Mike Schaekermann, Margaret Ann Smith, Patricia Strachan, Grace Hong, Trinh Nguyen, Doris Wong, Naama Hammel, Dawn Siegel, Kexin Ren, Chelsea Belletieri, Vijaytha Muralidharan, Rajeev Rikhye, Yuan Liu, Beverly Freeman, Mike González, Nathan Ashcraft, Heidi Cho, Jimmy LiShweta Oak, Megan Shum, Abbi Ward, Yossi Matias, Greg S. Corrado, Dale Webster, Peggy Bui, Preeti Singh, Yun Liu, Justin Ko, Steven Lin

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

AI-powered dermatology apps have the potential to improve access to skin health information, but concerns remain about their accuracy and usability, especially for under-served communities. We contribute a mixed-methods study investigating the impact of an AI-powered skin condition app on a diverse, multilingual population (N=110) in a community setting, involving real skin concerns and in-person consultations with clinicians. We found that app use was associated with a significant increase in participants’ ability to correctly name their condition (p=0.011). Thematic analysis of interview conversations revealed that users relied heavily on visual matching of example images, highlighting the importance of representative imagery for diverse skin tones and condition severities. Clinicians viewed the app as a valuable tool for facilitating patient-provider communication, acting as a shared reference point. We conclude with considerations around the real-world impact AI tools may have on the quality of care, health equity and patient-provider interactions.

Original language	English
Title of host publication	CHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery
ISBN (Electronic)	9798400713958
DOIs	https://doi.org/10.1145/3706599.3720531
State	Published - 26 Apr 2025
Externally published	Yes
Event	2025 CHI Conference on Human Factors in Computing Systems, CHI EA 2025 - Yokohama, Japan Duration: 26 Apr 2025 → 1 May 2025

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2025 CHI Conference on Human Factors in Computing Systems, CHI EA 2025
Country/Territory	Japan
City	Yokohama
Period	26/04/25 → 1/05/25

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 10 Reduced Inequalities

Keywords

Decision-making
Dermatology
Health
Human-AI collaboration
Human-centered AI

All Science Journal Classification (ASJC) codes

Human-Computer Interaction
Computer Graphics and Computer-Aided Design
Software

Access to Document

10.1145/3706599.3720531

Cite this

Sayres, R., Devon-Sand, A., Schaekermann, M., Smith, M. A., Strachan, P., Hong, G., Nguyen, T., Wong, D., Hammel, N., Siegel, D., Ren, K., Belletieri, C., Muralidharan, V., Rikhye, R., Liu, Y., Freeman, B., González, M., Ashcraft, N., Cho, H., ... Lin, S. (2025). Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community. In CHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems Article 414 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/3706599.3720531

Sayres, Rory ; Devon-Sand, Anna ; Schaekermann, Mike et al. / Navigating Skin Concerns with AI : A Human-Centered Investigation of a Dermatology App in a Diverse Community. CHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2025. (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{cbc297cdc67f4e3e89bf45d2f9cca532,

title = "Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community",

abstract = "AI-powered dermatology apps have the potential to improve access to skin health information, but concerns remain about their accuracy and usability, especially for under-served communities. We contribute a mixed-methods study investigating the impact of an AI-powered skin condition app on a diverse, multilingual population (N=110) in a community setting, involving real skin concerns and in-person consultations with clinicians. We found that app use was associated with a significant increase in participants{\textquoteright} ability to correctly name their condition (p=0.011). Thematic analysis of interview conversations revealed that users relied heavily on visual matching of example images, highlighting the importance of representative imagery for diverse skin tones and condition severities. Clinicians viewed the app as a valuable tool for facilitating patient-provider communication, acting as a shared reference point. We conclude with considerations around the real-world impact AI tools may have on the quality of care, health equity and patient-provider interactions.",

keywords = "Decision-making, Dermatology, Health, Human-AI collaboration, Human-centered AI",

author = "Rory Sayres and Anna Devon-Sand and Mike Schaekermann and Smith, \{Margaret Ann\} and Patricia Strachan and Grace Hong and Trinh Nguyen and Doris Wong and Naama Hammel and Dawn Siegel and Kexin Ren and Chelsea Belletieri and Vijaytha Muralidharan and Rajeev Rikhye and Yuan Liu and Beverly Freeman and Mike Gonz{\'a}lez and Nathan Ashcraft and Heidi Cho and Jimmy Li and Shweta Oak and Megan Shum and Abbi Ward and Yossi Matias and Corrado, \{Greg S.\} and Dale Webster and Peggy Bui and Preeti Singh and Yun Liu and Justin Ko and Steven Lin",

note = "Publisher Copyright: {\textcopyright} 2025 Copyright held by the owner/author(s).; 2025 CHI Conference on Human Factors in Computing Systems, CHI EA 2025 ; Conference date: 26-04-2025 Through 01-05-2025",

year = "2025",

month = apr,

day = "26",

doi = "10.1145/3706599.3720531",

language = "الإنجليزيّة",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

booktitle = "CHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems",

address = "الولايات المتّحدة",

}

Sayres, R, Devon-Sand, A, Schaekermann, M, Smith, MA, Strachan, P, Hong, G, Nguyen, T, Wong, D, Hammel, N, Siegel, D, Ren, K, Belletieri, C, Muralidharan, V, Rikhye, R, Liu, Y, Freeman, B, González, M, Ashcraft, N, Cho, H, Li, J, Oak, S, Shum, M, Ward, A, Matias, Y, Corrado, GS, Webster, D, Bui, P, Singh, P, Liu, Y, Ko, J & Lin, S 2025, Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community. in CHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems., 414, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, 2025 CHI Conference on Human Factors in Computing Systems, CHI EA 2025, Yokohama, Japan, 26/04/25. https://doi.org/10.1145/3706599.3720531

Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community. / Sayres, Rory; Devon-Sand, Anna; Schaekermann, Mike et al.
CHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2025. 414 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Navigating Skin Concerns with AI

T2 - 2025 CHI Conference on Human Factors in Computing Systems, CHI EA 2025

AU - Sayres, Rory

AU - Devon-Sand, Anna

AU - Schaekermann, Mike

AU - Smith, Margaret Ann

AU - Strachan, Patricia

AU - Hong, Grace

AU - Nguyen, Trinh

AU - Wong, Doris

AU - Hammel, Naama

AU - Siegel, Dawn

AU - Ren, Kexin

AU - Belletieri, Chelsea

AU - Muralidharan, Vijaytha

AU - Rikhye, Rajeev

AU - Liu, Yuan

AU - Freeman, Beverly

AU - González, Mike

AU - Ashcraft, Nathan

AU - Cho, Heidi

AU - Li, Jimmy

AU - Oak, Shweta

AU - Shum, Megan

AU - Ward, Abbi

AU - Matias, Yossi

AU - Corrado, Greg S.

AU - Webster, Dale

AU - Bui, Peggy

AU - Singh, Preeti

AU - Liu, Yun

AU - Ko, Justin

AU - Lin, Steven

PY - 2025/4/26

Y1 - 2025/4/26

N2 - AI-powered dermatology apps have the potential to improve access to skin health information, but concerns remain about their accuracy and usability, especially for under-served communities. We contribute a mixed-methods study investigating the impact of an AI-powered skin condition app on a diverse, multilingual population (N=110) in a community setting, involving real skin concerns and in-person consultations with clinicians. We found that app use was associated with a significant increase in participants’ ability to correctly name their condition (p=0.011). Thematic analysis of interview conversations revealed that users relied heavily on visual matching of example images, highlighting the importance of representative imagery for diverse skin tones and condition severities. Clinicians viewed the app as a valuable tool for facilitating patient-provider communication, acting as a shared reference point. We conclude with considerations around the real-world impact AI tools may have on the quality of care, health equity and patient-provider interactions.

AB - AI-powered dermatology apps have the potential to improve access to skin health information, but concerns remain about their accuracy and usability, especially for under-served communities. We contribute a mixed-methods study investigating the impact of an AI-powered skin condition app on a diverse, multilingual population (N=110) in a community setting, involving real skin concerns and in-person consultations with clinicians. We found that app use was associated with a significant increase in participants’ ability to correctly name their condition (p=0.011). Thematic analysis of interview conversations revealed that users relied heavily on visual matching of example images, highlighting the importance of representative imagery for diverse skin tones and condition severities. Clinicians viewed the app as a valuable tool for facilitating patient-provider communication, acting as a shared reference point. We conclude with considerations around the real-world impact AI tools may have on the quality of care, health equity and patient-provider interactions.

KW - Decision-making

KW - Dermatology

KW - Health

KW - Human-AI collaboration

KW - Human-centered AI

UR - http://www.scopus.com/inward/record.url?scp=105005734012&partnerID=8YFLogxK

U2 - 10.1145/3706599.3720531

DO - 10.1145/3706599.3720531

M3 - منشور من مؤتمر

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 26 April 2025 through 1 May 2025

ER -

Sayres R, Devon-Sand A, Schaekermann M, Smith MA, Strachan P, Hong G et al. Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community. In CHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. 2025. 414. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3706599.3720531

Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community

Abstract

Publication series

Conference

UN SDGs

Keywords

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this