Latent Space Bayesian Optimization (LSBO) combines generative models, typically Variational Autoencoders (VAE), with Bayesian Optimization (BO) to generate de-novo objects of interest. However, LSBO faces challenges due to the mismatch between the objectives of BO and VAE, resulting in poor exploration capabilities. In this paper, we propose novel contributions to enhance LSBO efficiency and overcome this challenge. We first introduce the concept of latent consistency/inconsistency as a crucial problem in LSBO, arising from the VAE-BO mismatch. To address this, we propose the Latent Consistent Aware-Acquisition Function (LCA-AF) that leverages consistent points in LSBO. Additionally, we present LCA-VAE, a novel VAE method that creates a latent space with increased consistent points through data augmentation in latent space and penalization of latent inconsistencies. Combining LCA-VAE and LCA-AF, we develop LCA-LSBO. Our approach achieves high sample-efficiency and effective exploration, emphasizing the significance of addressing latent consistency through the novel incorporation of data augmentation in latent space within LCA-VAE in LSBO. We showcase the performance of our proposal via de-novo image generation and de-novo chemical design tasks.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Latent Space Bayesian Optimization with Latent Data Augmentation for Enhanced Exploration


    Beteiligte:
    Boyar, Onur (Autor:in) / Takeuchi, Ichiro (Autor:in)

    Erscheinungsdatum :

    2023


    Anmerkungen:

    10 figures, 6 tables


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Mitigating over-exploration in latent space optimization using LES

    Ronen, Omer / Humayun, Ahmed Imtiaz / Baraniuk, Richard et al. | ArXiv | 2024

    Freier Zugriff

    Transforming Latent Capability Into Enhanced Space Situational Awareness

    Smith, Damian / Collinson, Alan / Goodchild, Edward et al. | AIAA | 2007


    Latent Space Reinforcement Learning

    Luck, Kevin Sebastian | BASE | 2014

    Freier Zugriff

    Latent

    Schnee, Ottmar | GWLB - Gottfried Wilhelm Leibniz Bibliothek | 1993


    Transforming Latent Capability Into Enhanced Space Situational Awareness AIAA Paper

    Smith, D. / Collinson, A. / Goodchild, E. et al. | British Library Conference Proceedings | 2007