We describe how certain tasks in the audio domain can be effectively addressed using computer vision approaches. This paper focuses on the problem of music identification, where the goal is to reliably identify a song given a few seconds of noisy audio. Our approach treats the spectrogram of each music clip as a 2D image and transforms music identification into a corrupted sub-image retrieval problem. By employing pairwise boosting on a large set of Viola-Jones features, our system learns compact, discriminative, local descriptors that are amenable to efficient indexing. During the query phase, we retrieve the set of song snippets that locally match the noisy sample and employ geometric verification in conjunction with an EM-based "occlusion" model to identify the song that is most consistent with the observed signal. We have implemented our algorithm in a practical system that can quickly and accurately recognize music from short audio samples in the presence of distortions such as poor recording quality and significant ambient noise. Our experiments demonstrate that this approach significantly outperforms the current state-of-the-art in content-based music identification.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Computer vision for music identification


    Contributors:
    Yan Ke, (author) / Hoiem, D. (author) / Sukthankar, R. (author)


    Publication date :

    2005-01-01


    Size :

    277935 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Computer vision for music identification: video demonstration

    Ke, Y. / Hoiem, D. / Rahul Sukthankar, | IEEE | 2005

    Free access

    Catfish feature identification via computer vision

    Jia, P. / Evans, M.D. / Ghate, S.R. | Tema Archive | 1996


    Mobile computer vision system for hand-based identification

    Chernyshov, V. G. / Mestetskii, L. M. | British Library Online Contents | 2015



    Automatic identification of kinematic diagrams with computer vision

    Fontenla Carrera, Gabriel / Fernández Vilán, Ángel Manuel / Izquierdo Belmonte, Pablo | BASE | 2023

    Free access