Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its hyperparameters, such as the latent space size. This paper presents a simple extension of VAEs for automatically determining the optimal latent space size during the training process by gradually decreasing the latent size through neuron removal and observing the model performance. The proposed method is compared to traditional hyperparameter grid search and is shown to be significantly faster while still achieving the best optimal dimensionality on four image datasets. Furthermore, we show that the final performance of our method is comparable to training on the optimal latent size from scratch, and might thus serve as a convenient substitute.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Adaptive Compression of the Latent Space in Variational Autoencoders


    Beteiligte:

    Erscheinungsdatum :

    2023


    Anmerkungen:

    10 pages, 4 figures
    33rd International Conference on Artificial Neural Networks (ICANN 2024)



    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Variational Autoencoders

    Ghojogh, Benyamin / Crowley, Mark / Karray, Fakhri et al. | Springer Verlag | 2022


    Cooperation in the Latent Space: The Benefits of Adding Mixture Components in Variational Autoencoders

    Kviman, Oskar / Molén, Ricky / Hotti, Alexandra et al. | ArXiv | 2022

    Freier Zugriff

    Uncertainty in latent representations of variational autoencoders optimized for visual tasks

    Catoni, Josefina / Martos, Domonkos / Csikor, Ferenc et al. | ArXiv | 2024

    Freier Zugriff

    Deep Tracking Portfolios Using Autoencoders and Variational Autoencoders

    Urrego, Daniel Aragón / Nieto, Oscar Eduardo Reyes / Quimbayo, Carlos Andrés Zapata | Springer Verlag | 2024