PhD candidate, Pompeu Fabra University, Barcelona
Think of it as karaoke for classical music instruments.
Music Information Retrieval is an interdisciplinary field at the crossroad between computer science and musicology. In particular, I am interested in applications which transform the way classical music is enjoyed. Being able to separate the audio corresponding to the instruments, allowed for interesting applications such as focusing on a particular sections in the orchestra or the re-creating the experience of the concert in virtual reality.
My research concerns audio signal processing and artificial intelligence. Traditionally, music source separation is done through a popular convex optimization technique, namely non-negative matrix factorization or, more recently, through deep learning. These approaches improve if we have the multi-microphone recordings of the piece, if we know which instruments are present in the piece, and if we have the score e.g. the notes played by each instrument. In fact, the more information we have about a music piece, the more we can restrict our model, and the better the resulting separation. For orchestral music the instruments are known, so we train timbre models for each instrument. Because any orchestral piece is accompanied by a score, we use the score information to further improve the separation.
Abstract: In order to better understand the musical properties which elicit an increased sensation of wanting to move when listening to music-groove-we investigate the effect of adding syncopation to simple piano melodies, under the hypothesis that syncopation is correlated to groove. Across two experiments we examine listeners' experience of groove to synthesized musical stimuli covering a range of syncopation levels and densities of musical events, according to formal rules implemented by a computer algorithm that shifts musical events from strong to weak metrical positions. Results indicate that moderate levels of syncopation lead to significantly higher groove ratings than melodies without any syncopation or with maximum possible syncopation. A comparison between the various transformations and the way they were rated shows that there is no simple relation between syncopation magnitude and groove.
Pub.: 04 Oct '14, Pinned: 27 Jul '17