0.11 The team

This project was done by Zhiting Cai, Emmanuel Herrera, Reed Shoho, and Minh Nguyen. All of us are junior ECE students with an emphasis on signals and systems.

In this project, Minh Nguyen was responsible for implementing musical instruments in Matlab, synthesizing 3-D sound, and writing the function that mimics the Doppler effect to encode angular velocity into sound. He then combined all functions written by our group to code the Top_function and create the audio file for the final demo. Furthermore, he wrote the 3-D sound section of the poster. He also wrote the 3-D sound synthesis module and the conclusion module of the final report. Lastly, he collected the reports from other group members to publish them on Connexions.

Emmanuel Herrera carried out initial testing of a wide array of image detection methods including Haar Cascades, ORB and FREAK object descriptors, SIFT, and SURF.  Additionally, he wrote the code to synthesize varying dissonance in the output sound depending on object orientation and did the work required to make this code compatible with output of the object tracking functions.  Lastly, he wrote the Connexions module about "overview on SIFT/SURF," the text on our poster related to image tracking, and part of the future work.

In the earlier stages of this project, Zhiting Cai experimented with a bulb filter to do object detection. She then implemented the Matlab adaptation of the OpenSurf algorithm, calculated parameters for music module inputs, ran feature tracking experiments on videos, and devised the working conditions for the image processing module. She also worked on the content of the image processing and future work sections of our poster, and wrote the OpenSurf adaptation and problems and solutions for Connexions.

Reed Shoho was responsible for mapping the objects used by the dancer to musical instruments, as well as creating the various velocity ranges used by our system. The instantiation of each of these velocity ranges required him to implement a musical tri-tone utilizing a specific pair of musical notes. He was also responsible for the formatting and layout of the group’s research poster, in addition to composing the “Motivation” and “Musical Mapping” sections of that poster. Finally, he authored the introduction to the project’s Connexions module, in addition to writing the “Musical Mapping” section and serving as an editor for other group members’ writing to ensure greater clarity throughout the module.