For this assignment I used two Pokemon models to represent the frequency spectrum. Larvitar is displayed when the sound frequency is lower, and Pikachu is shown when the frequency is higher. The scale of the models vary based on the amplitude for each frequency. In the video, the audio frequency changes from 1000Hz to 3000Hz, we can clearly see a greater number of Larvitars at the beginning, and Pikachus gradually take over the space toward the end of the video.

I want to capture motion data using camera or Kinect, and translate those data into audio signals using Max. 

More specifically, I’m interested in using different audio patterns to represent the qualities of people’s movement, that is, how people move between two time points. For example, dancers need to move their bodies from one gesture to another between two beats. The two ends of this movement is fixed according to the dance choreography, but how the dancers move from one end to another can vary: the movement can be smooth or jerky, can be accelerated or decelerated, can be soft or hard…

Since the differences between different movement qualities might be too subtle for eyes to grasp, I wanted to see if I can analyze the speed or the changes in the speed of the body parts, and map them to different notes/melodies to help people better understand movement qualities. I want to make this project a real-time piece.

For this project I narrated a horror story. Below are the steps I took:

1. Wrote a short horror story and recorded it in CFA’s sound recording studio;
2. Recorded the balloon poping sounds in Scott Hall elevator (IR1) and CFA Atrium (IR3);
3. Downloaded garden ambient sound (IR2) and scary background sound (IR4) online;
4. Edited the original voice and the IRs in Audacity and convoluted them in Max (IR1=bedroom, IR2=garden, IR3=basement, IR4=horror movie sound effect);
5. Added the audio time shifting+feedback effect to render the scary atmosphere a bit more;
6. Outputted the final audio file from Max using the “sfrecord~” component.

For this assignment I have made a fun photo booth effect using the time-shifting technique. Each pose is transformed into three colorful delayed snapshots coupled with three gradually leveled up voices.

The system I chose is the the “Facet” algorithm located in the Photoshop filter gallery. What I did is that I opened a picture in Photoshop, then applied the “Facet” filter onto the picture over and over so that the color and the composition of the pixels are transformed into something very different from the original.

It’s interesting to see how the result of this feedback system does not look like what I predicted at all. Please see the video documentation below to find out how the picture has evolved. The filter was applied for 1000 times.