{"id":1699,"date":"2022-11-03T13:14:06","date_gmt":"2022-11-03T17:14:06","guid":{"rendered":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/?p=1699"},"modified":"2022-11-08T13:13:42","modified_gmt":"2022-11-08T18:13:42","slug":"visibility-through-voice","status":"publish","type":"post","link":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/shrugbread\/11\/03\/visibility-through-voice\/","title":{"rendered":"Visibility Through Voice"},"content":{"rendered":"<p>Visibility Through Voice is a Kinect based capture setup that draws the silhouette of a participants when they speak. I used Touchdesigner as the interface between Kinect, camera, and microphone and explored it as a tool for manipulating the relationship vocalization and visibility. I spoke from a random text generator and did walks in and out of the bounds of the Kinect to make these paintings.<\/p>\n<p>Videos with camera view!<\/p>\n<p><iframe loading=\"lazy\" title=\"kinect video with overlay\" width=\"840\" height=\"473\" src=\"https:\/\/www.youtube.com\/embed\/1n7iaOasVqU?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<p>Videos without camera view<\/p>\n<p>&nbsp;<\/p>\n<p><iframe loading=\"lazy\" title=\"kinect videos\" width=\"840\" height=\"473\" src=\"https:\/\/www.youtube.com\/embed\/G5vMW5NyIGI?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1758\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004637.png\" alt=\"\" width=\"1920\" height=\"1080\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004637.png 1920w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004637-640x360.png 640w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004637-1024x576.png 1024w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004637-768x432.png 768w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004637-1536x864.png 1536w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004637-1200x675.png 1200w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1759\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004448.png\" alt=\"\" width=\"1916\" height=\"1080\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004448.png 1916w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004448-640x361.png 640w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004448-1024x577.png 1024w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004448-768x433.png 768w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004448-1536x866.png 1536w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-02-004448-1200x676.png 1200w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1760\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215517.png\" alt=\"\" width=\"1920\" height=\"1080\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215517.png 1920w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215517-640x360.png 640w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215517-1024x576.png 1024w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215517-768x432.png 768w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215517-1536x864.png 1536w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215517-1200x675.png 1200w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1761\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215304.png\" alt=\"\" width=\"1202\" height=\"772\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215304.png 1202w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215304-640x411.png 640w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215304-1024x658.png 1024w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215304-768x493.png 768w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-01-215304-1200x771.png 1200w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p>I used the CHOP reference feature in Touchdesigner to pull off this effect mainly. It allowed me to take volume and pitch data from the microphone I was using and have it real-time update the brightness of my Kinect data. Once I have the audio reactive capability set up, I create a feedback loop that retains the brightness from the prior frame.<\/p>\n<p><a href=\"http:\/\/www.davidrokeby.com\/PlotAgainstTime.html\"><img decoding=\"async\" src=\"https:\/\/github.com\/golanlevin\/ExperimentalCapture\/raw\/master\/docs\/images\/long-exposure-rokeby-pedestrians.jpg\" \/><\/a><\/p>\n<p>While I was very interested in the silhouette aspect of my project, I was mainly inspired by the visuals of long exposure video and the work of David Rokeby who uses a similar technique in <em>&#8220;Plot Against Time&#8221;\u00a0<\/em><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-1805\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-130853.png\" alt=\"\" width=\"288\" height=\"517\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-130853.png 601w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-130853-267x480.png 267w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-130853-570x1024.png 570w\" sizes=\"(max-width: 288px) 85vw, 288px\" \/><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1810\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-131340.png\" alt=\"\" width=\"1920\" height=\"1080\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-131340.png 1920w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-131340-640x360.png 640w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-131340-1024x576.png 1024w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-131340-768x432.png 768w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-131340-1536x864.png 1536w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-131340-1200x675.png 1200w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1777\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-124149.png\" alt=\"\" width=\"1920\" height=\"1080\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-124149.png 1920w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-124149-640x360.png 640w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-124149-1024x576.png 1024w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-124149-768x432.png 768w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-124149-1536x864.png 1536w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-03-124149-1200x675.png 1200w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p>I started this project knowing I wanted to work and grow in Touchdesigner. The conceptual framework grew around tests in audio reactivity. This project was mainly the result of a handful of experiments. I tried many different types of projection, recording, and methods for producing things in Touchdesigner as well as getting lots of help from the people around me. The only thing I wish I had time to fix in this project is to make the audio reactivity not connected to brightness, but opacity so that I don&#8217;t need to interact with new pixels to create color.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1796\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/11\/ezgif.com-gif-maker-1.gif\" alt=\"\" width=\"480\" height=\"720\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Visibility Through Voice is a Kinect based capture setup that draws the silhouette of a participants when they speak. I used Touchdesigner as the interface between Kinect, camera, and microphone and explored it as a tool for manipulating the relationship vocalization and visibility. I spoke from a random text generator and did walks in and &hellip; <a href=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/shrugbread\/11\/03\/visibility-through-voice\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Visibility Through Voice&#8221;<\/span><\/a><\/p>\n","protected":false},"author":11,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[17],"tags":[],"_links":{"self":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/1699"}],"collection":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/comments?post=1699"}],"version-history":[{"count":5,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/1699\/revisions"}],"predecessor-version":[{"id":1912,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/1699\/revisions\/1912"}],"wp:attachment":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/media?parent=1699"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/categories?post=1699"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/tags?post=1699"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}