Latent Space Bayesian Optimization (LSBO) combines generative models, typically Variational Autoencoders (VAE), with Bayesian Optimization (BO) to generate de-novo objects of interest. However, LSBO faces challenges due to the mismatch between the objectives of BO and VAE, resulting in poor exploration capabilities. In this paper, we propose novel contributions to enhance LSBO efficiency and overcome this challenge. We first introduce the concept of latent consistency/inconsistency as a crucial problem in LSBO, arising from the VAE-BO mismatch. To address this, we propose the Latent Consistent Aware-Acquisition Function (LCA-AF) that leverages consistent points in LSBO. Additionally, we present LCA-VAE, a novel VAE method that creates a latent space with increased consistent points through data augmentation in latent space and penalization of latent inconsistencies. Combining LCA-VAE and LCA-AF, we develop LCA-LSBO. Our approach achieves high sample-efficiency and effective exploration, emphasizing the significance of addressing latent consistency through the novel incorporation of data augmentation in latent space within LCA-VAE in LSBO. We showcase the performance of our proposal via de-novo image generation and de-novo chemical design tasks.


    Access

    Download


    Export, share and cite



    Title :

    Latent Space Bayesian Optimization with Latent Data Augmentation for Enhanced Exploration


    Contributors:

    Publication date :

    2023


    Remarks:

    10 figures, 6 tables


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Mitigating over-exploration in latent space optimization using LES

    Ronen, Omer / Humayun, Ahmed Imtiaz / Baraniuk, Richard et al. | ArXiv | 2024

    Free access

    Transforming Latent Capability Into Enhanced Space Situational Awareness

    Smith, Damian / Collinson, Alan / Goodchild, Edward et al. | AIAA | 2007


    Latent Space Reinforcement Learning

    Luck, Kevin Sebastian | BASE | 2014

    Free access

    Transforming Latent Capability Into Enhanced Space Situational Awareness AIAA Paper

    Smith, D. / Collinson, A. / Goodchild, E. et al. | British Library Conference Proceedings | 2007


    Latent

    Schnee, Ottmar | GWLB - Gottfried Wilhelm Leibniz Bibliothek | 1993