Concept (TLDR)
I want to explore individuals reaction of shock or fear when encountering real time, invasive surveillance when private information is verbally revealed by the viewer’s own personal face (think Deepfakes!). I’ll be using Golan’s Face Extractor & FaceWork code from p5.js to capture the indivdual’s face in real time, and manipulate their mouth movements into saying something they don’t believe in OR speaking on their personal information.
Inspiration
I have been playing with projected installations where I project recorded faces onto a white sculpture of a face, and the face begins talking to the viewer. I love probing a reaction of shock, confusion, any type of reaction that probes the viewer into reflecting on the message based on a bit of realization or even fear…
How will I do it?
I’ve manipulated Golan’s p5.js code into manipulating and focusing on the mouth movements. The code also makes sure the face is centralized in the middle of the screen for easy, stabilized projection!!!!! SCORE!!!! Thank you Golan!
Face Extractor & FaceWork1
https://openprocessing.org/sketch/2066195
https://openprocessing.org/sketch/2219047
Where I’m unsure…
I’m not exactly sure what I want the individual’s face to say once I’m able to manipulate their mouths.
A long time idea has been to have the projected face say something the person likely doesn’t agree with, but I think this idea requires more thought & attention then just a few weeks.
I’m leaning towards the face revealing the individual’s personal information of somesort:
Address, phone number (this would require me paying for some governmental record)
Instagram or Twitter
Or I let the individual type in a seceret into the computer and the face verbally reveals it.
With all of these ideas, the main goal is to make sure I can capture the individual’s live reaction to their own projected face almost betraying them in some way.
I’m also unsure of HOW I need to manipulate my code.
I can either pre-write the code to manipulate the mouth with pre-written phrases OR with private information I already know about the individual and I just capture their reaction.
OR
I code the mouth alphabet, and write in sentences in real time. Not sure of the fluidity of the reaction.
Ethical Considerations for this project
I’m somewhat unsure of the capture method.
I think this project would most definitely need verbal consent, or their consent by typing their name into the computer.
Verban consent would likely come from friends, family, classmates, professors. Not sure random viewers would be as willing, unless I just brought my computer to the cut? Debating how to gather individuals to the capture experience.