For this weeks LO, I looked into how computational softwares + algorithms could be incorporated into art that combines both visual and sonic elements.
I came across the music video for Howler Monkey by German duo Meier and Erdmann. The video itself was created by Victor Doval, a visual artist, that developed an algorithm that tracks the frequencies in the song to generate an ever-changing landscape.
Image from Victor Doval’s website visualizing his working process for the video.
I felt that this work was especially intriguing because it comments on the human perception of music. Although music and sound can have lasting effects and influences on our lives, the experience of listening is inherently an extremely temporal process.
Doval’s visual interpretation of how we are forever impacted by any sound/song we encounter and engage with while each passing second is temporary through a generative landscape begins to question the purpose of art in our lives. By using algorithm and software to help situate the listener in a virtual (and visual) space, Doval allows us to question why we seek art (in all forms and mediums) when inherently, each fleeting moment with the pieces are so temporal; do we seek immediate pleasure, or hope to grow with each time?
var x = 250;
var y = 25;
var x2 = 300;
var y2 = 250;
function setup() {
createCanvas(300,300);
background('blue');
}
function draw() {
//setting up colors and background to help lines stand out
background(255,5);
stroke(255);
if (mouseIsPressed){
var R = random(200,255);
var B = random(200,255);
strokeWeight(random(0,3));
stroke(R,0,B,random(50,100));
}else{
strokeWeight(random(0,10));
stroke(255);
background(0,random(0,50),random(0,50));
}
line(x,250,100,y);
line(250,height - y,width - x,100);
line(width - x,300,50,height - y);
line(250,y,x,0);
// top left and bottom right corner curves
line(100,y2,x,50);
line(300,height - y2,width - x,300);
//string animation
x += 5;
y += 1;
x2 -= 5;
y2 -= 1;
//trying to set parameters for the line movements
x = constrain(x,100,300);
y = constrain(y,0,300);
x2 = constrain(x2,50,300);
y2 = constrain(y2,25,250);
//loop and reset
if (x == 300 & y == 300 && x2 == 50 && y2 == 25) {
x = x2;
y = y2;
y2 = 250;
}
}
In exploring computational digital fabrication, I began my search with a simple Google of “algorithm based physical sculptures.” I came across one link that talked about MoSculp, an algorithmic system created out of the Computer Science and Artificial Intelligence Laboratory (CSAIL) at Massachusetts Institute of Technology (MIT) in 2018.
A sculpture created by MoSculp.
Mosculp is a computer system that, when fed a 2D video of human movement, can create a 3D-printed sculpture conveying the arcs and curves created through the body’s movements. This is possible through the algorithm’s ability to estimate and detect key points of human body movements that transform the video of 2D frames into a 3D-aware rendering of the (human) subject’s 3D geometry.
Watch to see how MoSculp sculpts!
The pieces created by MoSculp now may simply seem like abstract sculptures without much purpose, but the potential of the technology is clear. Researchers have noted the possible implications of technology like MoSculp; can this improve the ability for athletes and dancers (amongst other careers) to find a new way to micro-analyze the nuances of techniques by studying these motion-capture images? How about using these sculptures as toys and tools for physical rehabilitation?
I found this project to be interesting as it begins an important discussion about the necessity of the visual arts and the ability for people to utilize these computer generated softwares to create real and effective solutions to everyday problems.
A little house on a hill! Move left to right to see clouds, the sun, and the sky change. Move up and down to see the chimney puff smoke and some (abstract flowers).
Generative art has become such a tool to reflect on what we have seen until now and use those tools to create new scenes and dream-like experiences. Refik Anadol does exactly this.
‘Machine Hallucinations’, a synesthetic reality experience explores the connections between collective memories and archival tendencies of humans.
Click images to in larger view.
Powered by an algorithm fed over 100 million photographs of New York City, this 30 minute cinematic installation helps us to understand why we record experiences and hold onto memories into every step of a coming reality. Using the immense data that it has been provided and learned from, the algorithm produces scenes of a transforming New York City (in a possible future) and a multitude of similar dream-like ‘hallucinations’.
Examples of algorithmic studies done based on NYC photography.
Anadol’s work stood out to me as it begins the exploration in answering why we as humans act the way we do, all while introducing machines and AI as the possible vehicle for carrying out these considerations. His work not only serves to explore alternate realities through a visual medium, but also to bring a more hopeful narrative to the apocalyptic relationship between AI and humans that we often see today.
This past July, media-artist collective Breakfast (based in NY) released a Flip-Disk computational art piece to facilitate their ‘Don’t Go Quiet’ campaign in light of recent events with the murder of George Floyd and the insurgence in Black Lives Matter support.
“Dont Go Quiet” by Breakfast (2020) // 34.7 x 34.7 x 3.3 in // Flip-discs, software, camera + computer
The piece is composed of flip-discs triggered by the system’s real-time detection of new social media posts uploaded using the #blacklivesmatter hashtag or mentioning BLM, creating ripples (due to flip-disc movement) on an upside-down American flag. Through this piece, Breakfast hopes to highlight a collective, and hopefully, ongoing conversation to bring about an end to racism.
Flip-disc art has been around for quite some time, sometimes presenting itself in more practical forms: clocks, calendars, sign displays, etc. However, implementing a live internet tracking software to represent these current and highly important conversations brings another meaning to this technology. As an audience, we are drawn to artwork we can relate to; Breakfast has created an experience for its viewers to see the impact of each and every person speaking out against racism. I, like many, are inspired to stand alongside Black people today, tomorrow, and each day until we have created a world equitable enough. Let this be a time where we march harder, protest louder, and create with more empathy to see a world more diverse and inclusive than ever. Let your impact be seen.
![[OLD FALL 2020] 15-104 • Introduction to Computing for Creative Practice](https://courses.ideate.cmu.edu/15-104/f2020/wp-content/uploads/2021/08/cropped-notcurrentsemester.jpg){kind=small}
![[OLD FALL 2020] 15-104 • Introduction to Computing for Creative Practice](https://courses.ideate.cmu.edu/15-104/f2020/wp-content/uploads/2021/09/stop-banner.png)
