0.3 Conclusion

Conclusion

Results

Using ICA algorithms, Matlab, Java, and a graphic library, we were able to create a our own visualization of music.

The ICA algorithm in our Matlab code successfully extracted three tracks form the song that were independent enough to represent the notes from the song.

The FFT of the song gave us relevant frequencies which were mapped to the visualization.

Our beat detection worked well and shot out particles whenever there were beats.

Shortcomings

Our music visualization worked well with Drum and Bass music and Instrumental music. However, the ICA algorithm couldn't handle slightly wavering notes, which made voice and vibrato troublesome to work with.

At the same time, the our algorithm couldn't determine harmonics in an instrument, and thus would occassionally display the same note being in two different places.

The algorithm used the relative volume of what was going on in each frame, and thus would occassionally display sustained notes as a dashed line in our code instead of a continuous one.

Future developments

There are many developments that can be implemented to this project, from more visualizations for more parts of the song to using different algorithms to get more accurate sources. We can also include that smoothing out the detection of notes on our current algorithm would benefit the display on our visualization, so our lines appear more continuous when it is the same note.

The most important part that we wish to implement is to have all of our code in Java.

This would allow us to perform the visualization in real time, instead of preprocessed data from Matlab.

Adding an interface to our visualization, with simple things such as scrolling through the song, to changing the amount of sources without having to go to the code and changing it.

Another development that could be added is doing voice visualization, which at the moment is not easy to do, since the voice usually wavers slightly and thus our algorithm doesn't find it as a continuous note.

Future work for this project includes adding an interface for our visualizer. In said interface we could change.