中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
CAM: Consistency Adversarial Model for Image Generation with High-frequency Image Details

文献类型:会议论文

作者Qin ZH(秦子涵)1; Sun MZ(孙铭真)1; Liu J(刘静)1,2
出版日期2024
会议日期2024-03
会议地点昆明
英文摘要

As an extension of diffusion models, consistency models reduce the necessary sampling steps to a single iteration when synthesizing an image sample, thereby significantly enhances the efficiency of image generation. In addition, they also allow multi-step generation, providing flexibility for trade-offs between sample quality and computational efficiency. Despite these advantages, traditional consistency models are troubled by loss of high-frequency image details. This issue is attributed to the inherent regression-to-mean property of the L2 training loss, impeding overall improvement of model performance on the image generation task. In this paper, we propose a novel consistency adversarial model to address the loss of high-frequency image details through adversarial generation. In particular, we train a consistency model in an adversarial manner by treating it as an image generator. Then, an additional image discriminator is introduced and optimized along with the consistency model in an adversarial manner. The target of the image discriminator is to punish the image generator when it synthesizes images lacking high-frequency image details. In this way, image samples with high-frequency image details can be obtained and the performance of consistency models can be improved. Extensive experiments demonstrate the effectiveness of our proposed method. Our CAM outperforms the traditional consistency model on two challenging benchmarks: ImageNet and LSUN.

源URL[http://ir.ia.ac.cn/handle/173211/57639]  
专题自动化研究所_模式识别国家重点实验室_图像与视频分析团队
通讯作者Liu J(刘静)
作者单位1.中国科学院大学
2.中国科学院大学自动化研究所
推荐引用方式
GB/T 7714
Qin ZH,Sun MZ,Liu J. CAM: Consistency Adversarial Model for Image Generation with High-frequency Image Details[C]. 见:. 昆明. 2024-03.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。