CAM: Consistency Adversarial Model for Image Generation with High-frequency Image Details
文献类型:会议论文
作者 | Qin ZH(秦子涵)1![]() ![]() |
出版日期 | 2024 |
会议日期 | 2024-03 |
会议地点 | 昆明 |
英文摘要 | As an extension of diffusion models, consistency models reduce the necessary sampling steps to a single iteration when synthesizing an image sample, thereby significantly enhances the efficiency of image generation. In addition, they also allow multi-step generation, providing flexibility for trade-offs between sample quality and computational efficiency. Despite these advantages, traditional consistency models are troubled by loss of high-frequency image details. This issue is attributed to the inherent regression-to-mean property of the L2 training loss, impeding overall improvement of model performance on the image generation task. In this paper, we propose a novel consistency adversarial model to address the loss of high-frequency image details through adversarial generation. In particular, we train a consistency model in an adversarial manner by treating it as an image generator. Then, an additional image discriminator is introduced and optimized along with the consistency model in an adversarial manner. The target of the image discriminator is to punish the image generator when it synthesizes images lacking high-frequency image details. In this way, image samples with high-frequency image details can be obtained and the performance of consistency models can be improved. Extensive experiments demonstrate the effectiveness of our proposed method. Our CAM outperforms the traditional consistency model on two challenging benchmarks: ImageNet and LSUN. |
源URL | [http://ir.ia.ac.cn/handle/173211/57639] ![]() |
专题 | 自动化研究所_模式识别国家重点实验室_图像与视频分析团队 |
通讯作者 | Liu J(刘静) |
作者单位 | 1.中国科学院大学 2.中国科学院大学自动化研究所 |
推荐引用方式 GB/T 7714 | Qin ZH,Sun MZ,Liu J. CAM: Consistency Adversarial Model for Image Generation with High-frequency Image Details[C]. 见:. 昆明. 2024-03. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。