For Project 1, I created a self-generated melody & drone patch.
First off, a wav file of single piano notes played consecutively is analyzed. While Max randomly selects portions of the wav file to play in snippets, the frequency of the audio being played is analyzed and triggers the 1st higher-pitched drones in intervals. Meanwhile, the 2nd drone patch can be triggered by using the keyboard as a midi-keyboard.
The drone is achieved via subtractive synthesis. The pink noise generator is send through filters, only letting pass certain frequency bands. Then, the subtractive synthesis is done with a handful of inline reson~ objects.
The ‘analyzer~’ object is referenced from the maxobject.com website.
Delay is added to all sound effects. Piano melody can also go through a noise gate at will. The speed of the piano sampling can also be manipulated, which will immediately also effect the speed of the self-generated higher pitched drones.
Here is an example of the music being played:
Code is Here:
For assignment 4, I decided to utilize the fft object and create an audio effect patch that would mimic the sound of recent favorite music genre ‘Vaporwave’.
I created a noise reduction subpatch. Furthermore, a degrading fft subpatch is also used and linked to the output, playing along with the other signal. After these two subpatches, the audio signal is then run through the original patch where it is stretched out in real time (slowed down). This is done by using the delay effect.
I also added another simple visual presentation, that is very similar to the one we made in class. A japanese city pop song was used in demonstration, to achieve that ‘vaporwave aesthetic’.
Another demo: https://soundcloud.com/thewx/assignment4-demo/s-K8iMc
Top level patch:
Noise Reduction Patch:
For my Project 1, I am thinking of creating a patch that could detect the different audio effects from an audio file (reverb, delay, high/low frequencies etc) and would trigger the proportional amount of effects visually, manipulating a video input. If I have the ability, I would also like to include other features such as generating certain patterns across the video also being dependent on the audio changes.
An inspiration source I am having for this project is as follows:
This is a lot more advanced than what I’m hoping to achieve, but definitely includes certain artistic styles that I’d like to imitate in my project as well.
For this project, I used a recording of a Kalimba riff from a friend.
- Recorded IR1 (Maggie Mo Hallway), IR2 (WestWing staircase, balloon pop at top recorded at bottom). Recorded IR3 (myself saying “Kalimba”. Used a sample for IR4 (a water drip sound effect)
- Ran the kalimba riff in Max through all 4 convolution effects and recorded through ‘sfrecord~’ Code: https://gist.github.com/anonymous/978888ce9c3f36fe2fdfb96b659bee4f
Here are the results:
I really liked the sound of this, and decided to make a track through Ableton Live.
Track explanation as follows:
- Percussions (kick, clap, claves, woodenruffle, drip, underwater-twirl-sound, chimes): except for kick, and chimes, all other reverb effects were used by running the original sample through the Max patch with IR1 as the convolution effect.
- Starts off with the original riff, adding the IR1 IR2 IR3 IR4 riffs each loop. IR3 is pitched down two octaves to provide a bass-ier feel.
- Once all are included, the oiginal riff IR1 IR2 IR4 fades away in order each loop. IR3 is kept at the very end (wanted to end the track with the distant “kalimba” voice within the kalimba reverb.
Apart from a tiny bit of compression (Ableton built-in) and limiter (George Yohng’s W1) added, not much else mixing is done (my apologies).
An audio processing patch that the user is allowed to control the timeshifted delay effect of both high ends and low ends of an audiotrack through filters. The high/low ends are separated so different amounts of timeshifting can be applied, then they are played back together through main audio channel.
The system I used to process my signal through was an algorithm to Pixel Sort images for the application Processing. Pixel sorting is the process of isolating a horizontal or vertical line of pixels in an image and sorting their positions based on any number of criteria, in my case I sorted the pixels of the images through the brightness. In more detail, the script will begin sorting when it finds a pixel which is bright in the column or row, and will stop sorting when it finds a dark pixel. The script identifies black pixels by comparing the pixel’s brightness value to a threshold, if it’s lower than the brightness threshold the pixel is deemed to be dark, if it’s higher it’s deemed to be bright.
I started with a simple image of a bird-eye view picture of an island. I ran my image through the system 630 times to be exact. The effect or changes can be quite noticeable at the beginning, but they slowly become harder to notice as the signal gets twisted even more. I also noticed that the algorithm itself has a few bugs, leaving some blocks of pixels unsorted at all. Especially in the middle (middle of islands) where brightness levels are even and high, the effect won’t be present no matter how many times the process is ran.
For more info about pixel sorting, please see: http://datamoshing.com/2016/06/16/how-to-glitch-images-using-pixel-sorting/