60-212: Interactivity and Computation for Creative Practice
CMU School of Art / IDeATe, Fall 2020 • Prof. Golan Levin
“Expressions” – is a video created by the artist Kynd where the sound is from “Collaged Improvisation In Digital VII” by the musician Yu Miyashita
This video is a procedurally generated animation rendered in real time in response to the music piece by Yu Miyashita. The animation is 3d and was inspired in part from the thickness and texture of oil paints.
The creation process, for me, was more inspiring than the end result. To create convincing 3d graphics in real time with limited GPU, the artist made their own method of rendering. This method was specific to the piece and limited in scope. Perspective and lighting was fixed. The intuitive artistic understanding of how to create a convincing 3d shape (color, shading, details) combined with the computational background knowledge of efficient rendering birthed the generative algorithm behind the piece. It’s shocking they made a rendering method, which is very difficult and purely mathematical in the graphics field, using artistic knowledge.
(basic idea of the rendering used in the video)
This project would benefit from increased length. The animations produced are varied and exploring a wider scope of what the algo could produce would be fulfilling for the viewer. I also think a few parts of the animation were sound wavey. This felt predictable and detracted from the abstractions in the rest of the video.
The artist, Kynd demonstrates the foundational expertise needed to create this work through their pages dedicated to teaching physics in p5.js and the machine learning to artists.