Image aesthetics assessment (IAA) is attracting wide interest with the prevalence of social media. The problem is challenging due to its subjective and ambiguous nature. Instead of directly extracting aesthetic features solely from the image, user comments associated with an image could potentially provide complementary knowledge that is useful for IAA. With existing large-scale pre-trained models demonstrating strong capabilities in extracting high-quality transferable visual and textual features, learnable queries are shown to be effective in extracting useful features from the pre-trained visual features. Therefore, in this paper, we propose MMLQ, which utilizes multi-modal learnable queries to extract aesthetics-related features from multi-modal pre-trained features. Extensive experimental results demonstrate that MMLQ achieves new state-of-the-art performance on multi-modal IAA, beating previous methods by 7.7% and 8.3% in terms of SRCC and PLCC, respectively.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Multi-modal Learnable Queries for Image Aesthetics Assessment


    Beteiligte:
    Xiong, Zhiwei (Autor:in) / Zhang, Yunfan (Autor:in) / Shen, Zhiqi (Autor:in) / Ren, Peiran (Autor:in) / Yu, Han (Autor:in)

    Erscheinungsdatum :

    2024


    Anmerkungen:

    Accepted by ICME2024


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    LEARNABLE RADIO CONTROL SYSTEM

    STEVEN L GEERLINGS / MARK ZEINSTRA / JAMES E TRAINOR | Europäisches Patentamt | 2015

    Freier Zugriff

    Empirical Analysis of Learnable Image Resizer for Large-Scale Medical Image Classification and Segmentation

    Rahman, M M Shaifur / Alom, Md Zahangir / Khan, Simon et al. | IEEE | 2024



    Shape Tensors for Efficient and Learnable Indexing

    Werman, M. / Weinshall, D. / Shashua, A. et al. | British Library Conference Proceedings | 1995