0.6 Results

We successfully tracked the circuit boards and the anteater when the video image was clear, which thereby enabled us to track the movement of the dancer’s head and hands. However, the requirement that the video image must be clear put many restrictions on the possible dance moves allowed.

After obtaining the positions of the objects, as well as their orientations and velocities from the OpenSurf function, we used musical mapping and 3-D sound effects to create an audio file that demonstrated the movements of Zhiting’s hands and head while she was dancing as represented by the movements of the two circuit boards and the anteater. We combined this audio file with the movie we made using Windows Movie Maker. We let a graduate student listen to the movie file we made while closing his eyes in our poster presentation; he then told us how the hands were moved. His answer was close to the real movements of the dancer’s hands. However, the movement of the left hand was not tracked very well, so instead of being heard from the left side of the head, the horn sound was heard from the right side of the head most of the time. Furthermore, the similarity between the horn sound and the oboe sound made it difficult to distinguish between the movements of the left hand and the head.