Just sharing some of my inconsequential lunch conversations with you... RSS  

Monday, January 19, 2009

Musical sketchbook

Here’s another cool app from Microsoft research labs: Songsmith software. Microsoft Songsmith lets users create music in a novel way by attaching a microphone to a Windows PC and singing into the mic. Here’s something we’d expect from Apple. Cool!


Here’s how it works:

Songsmith basically does three things when it’s making music to go with your melody:

  1. Songsmith figures out roughly what frequencies (and thus what musical notes) you sang using a technique called autocorrelation. We don’t figure this out quite so precisely that we could write down sheet music for your melody (that’s still something a computer can’t do as well as a trained musician), but it turns out we don’t need to figure out exactly the melody you sang in order to make good backing music.
  2. Songsmith chooses chords to accompany the notes you sang, using the algorithm we describe in our papers about MySong. Basically, we’ve used a database of about 300 popular songs to train a mathematical model with the basic statistics of what chords sound good with each other and what chords sound good with different types of melodies. Note this is a statistical model... we’re not taking your melody and peeking into a database to find similar bits of melody when we make new chords. Instead, Songsmith has learned the basic statistics of chord sequences, and uses those statistics to generate new chords when you sing a new melody.
    Of course, there’s no single correct sequence of chords for a given melody – in fact there are lots and lots and lots of chord sequences that might sound good for your song. So Songsmith incorporates the “happy” and “jazzy” sliders to let users – both musical novices and experienced songwriters – quickly explore all those different sequences. If you want to know howthose work, you’ll have to go visit the MySong project page.
  3. Then we turn those chords into the music you hear using different musical styles (Songsmith comes with 30 styles, ranging from pop to rock to country, etc.). Songsmith tells the styles what chords it wants to play, and the styles help Songsmith turn those chords into a musical arrangement. These styles are provided through a partnership with PG Music, and Songsmith gives you a way to purchase additional styles from PG Music if you want an even broader range of styles. Then we turn that musical arrangement into the sound you hear using a musical synthesizer and a (very high-quality!) set of virtual instruments provided through a partnership with Garritan and Plogue. And yep, you guessed it, Songsmith also gives you a way to purchase additional styles and instruments from Garritan if you want an even broader range of sounds.


No comments:

Development Catharsis :: Copyright 2006 Mário Romano