TY - GEN
T1 - Unified Concept Editing in Diffusion Models
AU - Gandikota, Rohit
AU - Orgad, Hadas
AU - Belinkov, Yonatan
AU - Materzyńska, Joanna
AU - Bau, David
N1 - Publisher Copyright: © 2024 IEEE.
PY - 2024/1/3
Y1 - 2024/1/3
N2 - Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However, in the real world, all of these issues appear simultaneously in the same model. We present a method that tackles all issues with a single approach. Our method, Unified Concept Editing (UCE), edits the model without training using a closed-form solution, and scales seamlessly to concurrent edits on text-conditional diffusion models.We present scalable simultaneous debiasing, style erasure, and content moderation by editing text-to-image projections, and perform extensive experiments demonstrating improved efficacy and scalability over prior work. Our code is available at unified.baulab.info.
AB - Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However, in the real world, all of these issues appear simultaneously in the same model. We present a method that tackles all issues with a single approach. Our method, Unified Concept Editing (UCE), edits the model without training using a closed-form solution, and scales seamlessly to concurrent edits on text-conditional diffusion models.We present scalable simultaneous debiasing, style erasure, and content moderation by editing text-to-image projections, and perform extensive experiments demonstrating improved efficacy and scalability over prior work. Our code is available at unified.baulab.info.
KW - 3D
KW - Algorithms
KW - Algorithms
KW - Generative models for image
KW - Vision + language and/or other modalities
KW - etc.
KW - video
UR - http://www.scopus.com/inward/record.url?scp=85178898580&partnerID=8YFLogxK
U2 - 10.1109/WACV57701.2024.00503
DO - 10.1109/WACV57701.2024.00503
M3 - منشور من مؤتمر
T3 - Proceedings - 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024
SP - 5099
EP - 5108
BT - Proceedings - 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024
T2 - 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024
Y2 - 4 January 2024 through 8 January 2024
ER -