DrawingInStyles: Portrait Image Generation and Editing With Spatially Conditioned StyleGAN
文献类型：期刊论文
| 作者 | Su, Wanchao3; Ye, Hui3; Chen, Shu-Yu4; Gao, Lin1,2; Fu, Hongbo3 |
| 刊名 | IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
 |
| 出版日期 | 2023-10-01 |
| 卷号 | 29期号:10页码:4074-4088 |
| ISSN号 | 1077-2626 |
| 关键词 | Faces Semantics Image synthesis Codes Training Transforms Spatial resolution Sketch-based portrait generation suggestive interfaces data-driven approaches StyleGAN conditional generation |
| DOI | 10.1109/TVCG.2022.3178734 |
| 英文摘要 | The research topic of sketch-to-portrait generation has witnessed a boost of progress with deep learning techniques. The recently proposed StyleGAN architectures achieve state-of-the-art generation ability but the original StyleGAN is not friendly for sketch-based creation due to its unconditional generation nature. To address this issue, we propose a direct conditioning strategy to better preserve the spatial information under the StyleGAN framework. Specifically, we introduce Spatially Conditioned StyleGAN (SC-StyleGAN for short), which explicitly injects spatial constraints to the original StyleGAN generation process. We explore two input modalities, sketches and semantic maps, which together allow users to express desired generation results more precisely and easily. Based on SC-StyleGAN, we present DrawingInStyles, a novel drawing interface for non-professional users to easily produce high-quality, photo-realistic face images with precise control, either from scratch or editing existing ones. Qualitative and quantitative evaluations show the superior generation ability of our method to existing and alternative solutions. The usability and expressiveness of our system are confirmed by a user study. |
| 资助项目 | Research Grants Council of the Hong Kong Special Administrative Region,China[CityU 11212119] ; Centre for Applied Computing and Interactive Media (ACIM) of School of Creative Media, CityUniversity of Hong Kong ; National Natural Science Foundation of China[62102403] ; Beijing Municipal Natural Science Foundation for Distinguished Young Scholars[JQ21013] ; Youth Innovation Promotion Association, Chinese Academy of Sciences |
| WOS研究方向 | Computer Science |
| 语种 | 英语 |
| 出版者 | IEEE COMPUTER SOC |
| WOS记录号 | WOS:001060356200004 |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/21171]  |
| 专题 | 中国科学院计算技术研究所期刊论文_英文 |
| 通讯作者 | Fu, Hongbo |
| 作者单位 | 1.Chinese Acad Sci, Beijing Key Lab Mobile Comp & Pervas Device, Inst Comp Technol, Beijing 100045, Peoples R China 2.Univ Chinese Acad Sci, Beijing 101408, Peoples R China 3.City Univ Hong Kong, Sch Creat Media, Kowloon Tong, Hong Kong, Peoples R China 4.Chinese Acad Sci, Beijing Key Lab Mobile Comp & Pervas Device, Inst Comp Technol, Beijing 100045, Peoples R China |
| 推荐引用方式 GB/T 7714 | Su, Wanchao,Ye, Hui,Chen, Shu-Yu,et al. DrawingInStyles: Portrait Image Generation and Editing With Spatially Conditioned StyleGAN[J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS,2023,29(10):4074-4088. |
| APA | Su, Wanchao,Ye, Hui,Chen, Shu-Yu,Gao, Lin,&Fu, Hongbo.(2023).DrawingInStyles: Portrait Image Generation and Editing With Spatially Conditioned StyleGAN.IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS,29(10),4074-4088. |
| MLA | Su, Wanchao,et al."DrawingInStyles: Portrait Image Generation and Editing With Spatially Conditioned StyleGAN".IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 29.10(2023):4074-4088. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。