After deep generative models were successfully applied to image generation tasks, learning disentangled latent variables of data has become a crucial part of deep generative model research. Many models have been proposed to learn an interpretable and factorized representation of latent variable by modifying their objective function or model architecture. To disentangle the latent variable, some models show lower quality of reconstructed images and others increase the model complexity which is hard to train. In this paper, we propose a simple disentangling method based on a traditional whitening process. The proposed method is applied to the latent variables of variational auto-encoder (VAE), although it can be applied to any generative models with latent variables. In experiment, we apply the proposed method to simple VAE models and experiment results confirm that our method finds more interpretable factors from the latent space while keeping the reconstruction error the same as the conventional VAE's error.


    Access

    Download


    Export, share and cite



    Title :

    Disentangling Latent Factors of Variational Auto-Encoder with Whitening


    Contributors:

    Publication date :

    2018


    Remarks:

    ICANN 2019


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Joint Training of Variational Auto-Encoder and Latent Energy-Based Model

    Han, Tian / Nijkamp, Erik / Zhou, Linqi et al. | ArXiv | 2020

    Free access

    AVAE: Adversarial Variational Auto Encoder

    Plumerault, Antoine / Borgne, Hervé Le / Hudelot, Céline | ArXiv | 2020

    Free access

    Variational auto encoder for mixed data types

    European Patent Office | 2020

    Free access

    Disentangled Variational Auto-Encoder for Semi-supervised Learning

    Li, Yang / Pan, Quan / Wang, Suhang et al. | ArXiv | 2017

    Free access