This paper proposes a joint training method to learn both the variational auto-encoder (VAE) and the latent energy-based model (EBM). The joint training of VAE and latent EBM are based on an objective function that consists of three Kullback-Leibler divergences between three joint distributions on the latent vector and the image, and the objective function is of an elegant symmetric and anti-symmetric form of divergence triangle that seamlessly integrates variational and adversarial learning. In this joint training scheme, the latent EBM serves as a critic of the generator model, while the generator model and the inference model in VAE serve as the approximate synthesis sampler and inference sampler of the latent EBM. Our experiments show that the joint training greatly improves the synthesis quality of the VAE. It also enables learning of an energy function that is capable of detecting out of sample examples for anomaly detection.


    Access

    Download


    Export, share and cite



    Title :

    Joint Training of Variational Auto-Encoder and Latent Energy-Based Model


    Contributors:
    Han, Tian (author) / Nijkamp, Erik (author) / Zhou, Linqi (author) / Pang, Bo (author) / Zhu, Song-Chun (author) / Wu, Ying Nian (author)

    Publication date :

    2020


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Disentangling Latent Factors of Variational Auto-Encoder with Whitening

    Hahn, Sangchul / Choi, Heeyoul | ArXiv | 2018

    Free access

    AVAE: Adversarial Variational Auto Encoder

    Plumerault, Antoine / Borgne, Hervé Le / Hudelot, Céline | ArXiv | 2020

    Free access

    Variational auto encoder for mixed data types

    European Patent Office | 2020

    Free access


    Item-based Variational Auto-encoder for Fair Music Recommendation

    Park, Jinhyeok / Kim, Dain / Kim, Dongwoo | ArXiv | 2022

    Free access