{"id":1440,"date":"2022-03-01T01:30:47","date_gmt":"2022-03-01T06:30:47","guid":{"rendered":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/?p=1440"},"modified":"2022-03-01T02:32:54","modified_gmt":"2022-03-01T07:32:54","slug":"merlerker-vqganclip","status":"publish","type":"post","link":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/merlerker\/03\/01\/merlerker-vqganclip\/","title":{"rendered":"merlerker-VQGAN+CLIP"},"content":{"rendered":"<p>prompt: &#8220;nike muji spacecraft collaboration rendered with houdini&#8221;<br \/>\nnoise seed: 05<br \/>\niteration: 100<br \/>\nresult:<br \/>\n<img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1441\" src=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed05_it100.png\" alt=\"\" width=\"512\" height=\"512\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed05_it100.png 512w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed05_it100-480x480.png 480w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed05_it100-150x150.png 150w\" sizes=\"(max-width: 512px) 85vw, 512px\" \/><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1446\" src=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed05_it0-100.gif\" alt=\"\" width=\"512\" height=\"512\" \/><\/p>\n<p>Colab was easy enough to get running, though I didn&#8217;t get the diffusion to work (I think because it requires a starting image rather than starting from noise?). It&#8217;s really interesting to see the images emerge through the iterations &#8211; I found my favorite outcomes were around iteration 100 or 150, when the image had just started to materialize (perhaps because my prompt lent itself well to textures, it didn&#8217;t take long to get there), and beyond that it was further refined but the different between subsequent iterations was hardly discernible after a point.<\/p>\n<p>prompt: &#8220;nike muji spacecraft collaboration rendered with houdini&#8221;<br \/>\nnoise seed: 2046<br \/>\niteration: 50<br \/>\ninit image: dragonfly-sliderule_2.jpeg (from ArtBreeder)<br \/>\n<img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1447\" src=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/dragonfly-sliderule_2.jpeg\" alt=\"\" width=\"1024\" height=\"1024\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/dragonfly-sliderule_2.jpeg 1024w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/dragonfly-sliderule_2-480x480.jpeg 480w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/dragonfly-sliderule_2-150x150.jpeg 150w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/dragonfly-sliderule_2-768x768.jpeg 768w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><br \/>\nresult:<br \/>\n<img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1444\" src=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed2046_init-dragonfly2_it55.png\" alt=\"\" width=\"512\" height=\"512\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed2046_init-dragonfly2_it55.png 512w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed2046_init-dragonfly2_it55-480x480.png 480w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed2046_init-dragonfly2_it55-150x150.png 150w\" sizes=\"(max-width: 512px) 85vw, 512px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>prompt: nike:30 | muji:30 | spacecraft:10 | rendered:15 | houdini:5 | color:10<br \/>\nnoise seed: 2046<br \/>\niteration: 50<br \/>\nresult:<br \/>\n<img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-1445\" src=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed2046_prompt-weight_it50.png\" alt=\"\" width=\"512\" height=\"512\" srcset=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed2046_prompt-weight_it50.png 512w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed2046_prompt-weight_it50-480x480.png 480w, https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/clipvqgan_nike-muji_seed2046_prompt-weight_it50-150x150.png 150w\" sizes=\"(max-width: 512px) 85vw, 512px\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>prompt: &#8220;nike muji spacecraft collaboration rendered with houdini&#8221; noise seed: 05 iteration: 100 result: Colab was easy enough to get running, though I didn&#8217;t get the diffusion to work (I think because it requires a starting image rather than starting from noise?). It&#8217;s really interesting to see the images emerge through the iterations &#8211; I &hellip; <a href=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/merlerker\/03\/01\/merlerker-vqganclip\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;merlerker-VQGAN+CLIP&#8221;<\/span><\/a><\/p>\n","protected":false},"author":18,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[22],"tags":[],"_links":{"self":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/posts\/1440"}],"collection":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/comments?post=1440"}],"version-history":[{"count":5,"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/posts\/1440\/revisions"}],"predecessor-version":[{"id":1450,"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/posts\/1440\/revisions\/1450"}],"wp:attachment":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/media?parent=1440"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/categories?post=1440"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-json\/wp\/v2\/tags?post=1440"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}