{"id":2144,"date":"2022-12-06T12:41:13","date_gmt":"2022-12-06T17:41:13","guid":{"rendered":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/?p=2144"},"modified":"2022-12-09T00:30:09","modified_gmt":"2022-12-09T05:30:09","slug":"miniverse-bad-deepfake-tennis","status":"publish","type":"post","link":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/miniverse\/12\/06\/miniverse-bad-deepfake-tennis\/","title":{"rendered":"miniverse &#8211; bad deepfake tennis"},"content":{"rendered":"<p>inspo:<\/p>\n<p><a href=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/hunan\/11\/03\/hunan-personintime\/\">https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/hunan\/11\/03\/hunan-personintime\/<\/a><\/p>\n<p><a href=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/skrrr\/11\/08\/lost-in-time\/\">https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/skrrr\/11\/08\/lost-in-time\/<\/a><\/p>\n<p>what if I offset a segmentation map by a constant in time?<\/p>\n<p>Find a location to best insert this method.<\/p>\n<p>I was thinking tennis bc contact point w ball is important<\/p>\n<p>plan: use yolov5 to segment ball out. It contains a &#8220;sports ball&#8221; category that is basically a high level circle detector<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-2171\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/zidane.jpg\" alt=\"\" width=\"1280\" height=\"720\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/zidane.jpg 1280w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/zidane-640x360.jpg 640w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/zidane-1024x576.jpg 1024w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/zidane-768x432.jpg 768w, https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/zidane-1200x675.jpg 1200w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p>replace some of the code in yolo to spit out a segmentation mask I can then use:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-2183\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/ezgif.com-gif-maker-8.gif\" alt=\"\" width=\"600\" height=\"169\" \/><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-2185\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/ezgif.com-gif-maker-9.gif\" alt=\"\" width=\"600\" height=\"169\" \/><\/p>\n<p>^use mask to remove ball and inpaint video using cv2 inpaint<\/p>\n<h2><strong>People missing their tennis forehands(?) backhands(?)\u00a0<\/strong><\/h2>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-2198\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/ezgif.com-gif-maker-10.gif\" alt=\"\" width=\"600\" height=\"169\" \/><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-2200\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/ezgif.com-gif-maker-11.gif\" alt=\"\" width=\"600\" height=\"169\" \/><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-2243\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/ezgif.com-gif-maker-12.gif\" alt=\"\" width=\"600\" height=\"169\" \/><\/p>\n<p>final result! frame offset is 20.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>inspo: https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/hunan\/11\/03\/hunan-personintime\/ https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/skrrr\/11\/08\/lost-in-time\/ what if I offset a segmentation map by a constant in time? Find a location to best insert this method. I was thinking tennis bc contact point w ball is important plan: use yolov5 to segment ball out. It contains a &#8220;sports ball&#8221; category that is basically a high level circle detector &hellip; <a href=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/miniverse\/12\/06\/miniverse-bad-deepfake-tennis\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;miniverse &#8211; bad deepfake tennis&#8221;<\/span><\/a><\/p>\n","protected":false},"author":16,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[20],"tags":[],"_links":{"self":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/2144"}],"collection":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/comments?post=2144"}],"version-history":[{"count":11,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/2144\/revisions"}],"predecessor-version":[{"id":2352,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/2144\/revisions\/2352"}],"wp:attachment":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/media?parent=2144"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/categories?post=2144"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/tags?post=2144"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}