For this assignment, I created a patch which takes in an arbitrary sound file and uses it to convolve a video source. In my case, I used my web cam as the video source. The video is convolved at the color level, with the first bin of the sound fft being the first item in the red matrix, then the second is green, then blue, and then it repeats until there is a 5×5 matrix for each color of the video to be convolved with. The video is rendered at about 14 fps to keep the render from lagging, although this can probably be increased. The scale for the fft can also be increased. Each bin is normalized to cap at 1, but the scale multiplies this by some arbitrary factor. I’ve found that three works best in my dorm.

Video of patch in use: https://youtu.be/ySZOQbweElg

Top level patch: https://gist.github.com/TheDreadedAndy/81a7b759f354c176c8ff729a377cd441

fft patch: https://gist.github.com/TheDreadedAndy/7152747cdf6ef599fcdbdcd3f06cc878