Deep Unsupervised Pixelization
文献类型:期刊论文
作者 | CHU HAN; QIANG WEN; SHENGFENG HE; QIANSHU ZHU; YINJIE TAN; GUOQIANG HAN; TIEN-TSIN WONG |
刊名 | ACM Transactions on Graphics
![]() |
出版日期 | 2018 |
文献子类 | 期刊论文 |
英文摘要 | In this paper, we present a novel unsupervised learning method for pixelization. Due to the difficulty in creating pixel art, preparing the paired training data for supervised learning is impractical. Instead, we propose an unsupervised learning framework to circumvent such difficulty.We leverage the dual nature of the pixelization and depixelization, and model these two tasks in the same network in a bi-directional manner with the input itself as training supervision. These two tasks are modeled as a cascaded network which consists of three stages for different purposes. GridNet transfers the input image into multi-scale grid-structured images with different aliasing effects. PixelNet associated with GridNet to synthesize pixel arts with sharpedges and perceptually optimal local structures. DepixelNet connects the previous network and aims to recover the pixelized result to the original image. For the sake of unsupervised learning, the mirror loss is proposed to hold the reversibility of feature representations in the process. In addition, adversarial, L1, and gradient losses are involved in the network to obtain pixel arts by retaining color correctness and smoothness. We show that our technique can synthesize crisper and perceptually more appropriate pixel arts than state-of-the-art image downscaling methods. We evaluate the proposed method with extensive experiments on many images. The proposed method outperforms state-of-the-art methods in terms of visual quality and user preference. |
语种 | 英语 |
源URL | [http://ir.siat.ac.cn:8080/handle/172644/13561] ![]() |
专题 | 深圳先进技术研究院_集成所 |
推荐引用方式 GB/T 7714 | CHU HAN,QIANG WEN,SHENGFENG HE,et al. Deep Unsupervised Pixelization[J]. ACM Transactions on Graphics,2018. |
APA | CHU HAN.,QIANG WEN.,SHENGFENG HE.,QIANSHU ZHU.,YINJIE TAN.,...&TIEN-TSIN WONG.(2018).Deep Unsupervised Pixelization.ACM Transactions on Graphics. |
MLA | CHU HAN,et al."Deep Unsupervised Pixelization".ACM Transactions on Graphics (2018). |
入库方式: OAI收割
来源:深圳先进技术研究院
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。