项目作者: bryandlee

项目描述 :
Freezing generator for pseudo image translation
高级语言: Python
项目地址: git://github.com/bryandlee/FreezeG.git
创建时间: 2020-07-31T12:34:11Z
项目社区:https://github.com/bryandlee/FreezeG

开源协议:MIT License

下载


FreezeG

Freezing generator for *pseudo* image translation

Inspired by the training footage of FreezeD trasfer learning, I have tested a simple idea of freezing the early layers of the generator in transfer learning settings, and it worked pretty well. Reusing the high-level layers of a pre-trained generator for image-to-image translation is not a novel idea [1], [2], and I guess it could be also applied to the transfer learning of noise-to-image GANs. This is a pseudo translation method because the input image should be projected to the learned latent space first, and then the projected vector is propagated again to generate the target image. Therefore, the performance is limited to the in-domain images of the original GAN. I used StyleGAN2 implementation, and below are some of the results I’ve got. By also fixing the latent vector of the early layers and manipulating the ones that are fed into the last layers, the rendering style can be controlled separately. For the datasets with large geometric transformations such as face2simpsons, the connection between the original image and the resulting image becomes less intuitive. See cat2flower for an extreme case.

Cat2Wild [AFHQ]

\

Face2Malnyun [FFHQ, Malnyun]

\
\
\

Interpolation

\
\
\
\

Failures

Face2Simpsons [FFHQ, Simpsons]

\
\
\
\
\
\
\
\

Interpolation

\

Failures

\
\
\

Face2Dog [FFHQ, AFHQ]

\
\
\
\
\
\
\
\

Interpolation

\

Failures

\

Face2Art [FFHQ, MetFaces]

\

Cat2Flower [AFHQ, OxfordFlowers]