中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesis

文献类型:期刊论文

作者Yueming Lyu; Peibin Chen; Jingna Sun; Bo Peng; Xu Wang; Jing Dong
刊名IEEE Transactions on Multimedia
出版日期2024
页码14
英文摘要

In recent years, conditional image synthesis has attracted growing attention due to its controllability in the image generation process. Although recent works have achieved realistic results, most of them have difficulty handling fine-grained styles with subtle details. To address this problem, a novel normalization module, named Detailed Region-Adaptive Normalization (DRAN), is proposed. It adaptively learns both fine-grained and coarsegrained style representations. Specifically, we first introduce a multi-level structure, Spatiality-aware Pyramid Pooling, to guide the model to learn coarse-to-fine features. Then, to adaptively fuse different levels of styles, we propose Dynamic Gating, making it possible to adaptively fuse different levels of styles according to different spatial regions. Finally, we collect a new makeup dataset (Makeup-Complex dataset) that contains a wide range of complex makeup styles with diverse poses and expressions. To evaluate the effectiveness and show the general use of our method, we conduct a set of experiments on makeup transfer and semantic image synthesis. Quantitative and qualitative experiments show that equipped with DRAN, simple baseline models are able to achieve promising improvements in complex style transfer and detailed texture synthesis.

WOS记录号WOS:001166674800014
源URL[http://ir.ia.ac.cn/handle/173211/56637]  
专题自动化研究所_智能感知与计算研究中心
通讯作者Jing Dong
作者单位1.ByteDance Inc
2.Institute of Automation, Chinese Academy of Sciences
3.University of Chinese Academy of Sciences
推荐引用方式
GB/T 7714
Yueming Lyu,Peibin Chen,Jingna Sun,et al. DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesis[J]. IEEE Transactions on Multimedia,2024:14.
APA Yueming Lyu,Peibin Chen,Jingna Sun,Bo Peng,Xu Wang,&Jing Dong.(2024).DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesis.IEEE Transactions on Multimedia,14.
MLA Yueming Lyu,et al."DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesis".IEEE Transactions on Multimedia (2024):14.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。