{"id":463,"date":"2022-09-07T11:29:03","date_gmt":"2022-09-07T15:29:03","guid":{"rendered":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/?page_id=463"},"modified":"2022-10-12T23:16:53","modified_gmt":"2022-10-13T03:16:53","slug":"sep-08","status":"publish","type":"page","link":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/daily-notes\/september\/sep-08\/","title":{"rendered":"Sep-08"},"content":{"rendered":"<h3>Agenda<\/h3>\n<ul>\n<li>Exit tickets: See the Discord<\/li>\n<li>Follow up: Any Other Questions?<\/li>\n<li>Announcement: Next class will be a work session. We will have a sign up sheet for 1:1 sessions with Nica or Golan.<\/li>\n<li>Workshop: Polycam &gt;&gt; Mixamo<\/li>\n<\/ul>\n<hr \/>\n<h2>Photogrammetry<\/h2>\n<ul>\n<li><a href=\"https:\/\/github.com\/golanlevin\/ExperimentalCapture\/blob\/master\/docs\/photogrammetry.md\">Brief photogrammetry lecture<\/a><\/li>\n<li>Polycam to Mixamo workshop, below.<\/li>\n<\/ul>\n<p><iframe loading=\"lazy\" title=\"Turn Any Object Into a 3D Model Using Your Phone\" width=\"840\" height=\"473\" src=\"https:\/\/www.youtube.com\/embed\/xvQZw9lAN9Y?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>Keep an eye out for the following sorts of common challenges along the way:<\/p>\n<ul>\n<li><strong>3D format issues.<\/strong> The free version of Polycam produces certain formats; Mixamo requires different formats; programs that perform necessary cleanup may require or produce yet other formats.<\/li>\n<li><strong>Pathological 3D files.<\/strong> Meshes can have lots of problems such as holes, backwards faces, etc. that require cleanup. This will depend on your specific mesh. Mixamo may refuse to load your mesh if it has an error.<\/li>\n<li><strong>Loss of textures.<\/strong> Carelessness can cause loss of associated files, such as material and texture files.<\/li>\n<\/ul>\n<h3>Instructions<\/h3>\n<ul>\n<li><strong>Create a Polycam account<\/strong> at <a href=\"https:\/\/poly.cam\/\">https:\/\/poly.cam\/<\/a><\/li>\n<li><strong>Install the Polycam app<\/strong> on your phone and log into your account.<\/li>\n<li><strong>Capture a person<\/strong> standing in the &#8220;A-pose&#8221;, using the Polycam app. Here are some suggestions:<\/li>\n<\/ul>\n<p style=\"padding-left: 40px;\"><em><strong>\u2022 Use good lighting.<\/strong> <\/em>The best lighting is bright, even and diffuse, similar to what you would see on a bright overcast day. I recommend capturing outdoors on a cloudy day, or near a bright window but not in direct sunlight.<\/p>\n<p style=\"padding-left: 40px;\"><strong><em>\u2022 Help your subject stay still during the capture.<\/em> <\/strong>People move a lot, and you want to limit micro-movements of the subject\u2019s head and hands. If you want to rig the eventual mesh, we recommend capturing them in the \u201cA\u201d pose, with their hands resting on chairs or other waist-height things so that their hands can remain as still as possible during the capture.<\/p>\n<p style=\"padding-left: 40px;\"><em><strong>\u2022 Make sure you get good images of your subject<\/strong><\/em>, especially of their face. Great images have no motion blur. I&#8217;d recommend starting with the subject\u2019s face and capturing at least 40 images of it from every possible angle, and then moving on, so they can move their face a bit while you capture the rest of their body. A good path to take is face -&gt; rest of head &amp; neck -&gt; front of torso -&gt; side 1 with arm -&gt; back -&gt; side 2 with arm -&gt; front of legs and shoes -&gt; back of legs and shoes. As you capture each section, try to minimize overlap with earlier sections. For example, once you\u2019ve captured the subject\u2019s face, try not to capture any more images of their face as you get the rest of their body. Try to get at least 150 images of the subject. If you need differentiated fingers, you may need to clean it up in Blender before rigging.<\/p>\n<ul>\n<li><strong>Get the goods.<\/strong> Switch to your laptop, log into <a href=\"https:\/\/poly.cam\/\">poly.cam<\/a>, and select your project. Export your capture in &#8220;GLTF&#8221; format. Note: it will download in GLB (binary) format.<\/li>\n<li><strong>Install <a href=\"https:\/\/www.meshlab.net\/\">Meshlab<\/a> if you haven&#8217;t already.<\/strong> This is a free, open-source, cross-platform mesh visualizer.<\/li>\n<li><strong>View your scan in Meshlab.\u00a0<\/strong><\/li>\n<li><strong>Trim your scan,<\/strong> in order to remove the floor, hand posts, and other stray flotsam. You can trim your scan using free tools like Meshlab, Blender, or MeshMixer. We will demonstrate some ways of doing this. An (old) demonstration video is below.<\/li>\n<li><strong>Clean up your scan.<\/strong> Clean up can mean repairing pathological vertices and faces, filling holes, simplifying your model, etc.<\/li>\n<li><strong>Export your scan<\/strong> as an OBJ from your cleanup tool. Don&#8217;t lose your texture.<\/li>\n<li><strong>Zip up a folder<\/strong> containing your OBJ mesh, MTL file and JPG texture file.<\/li>\n<li><strong>Log into Mixamo<\/strong>, at <a href=\"https:\/\/www.mixamo.com\/#\/\">https:\/\/www.mixamo.com\/#\/<\/a><\/li>\n<li><strong>Auto-rig your model:<\/strong> select &#8220;Upload Character&#8221;, upload the ZIP file, indicate your joints.<\/li>\n<li><strong>Select an animation.<\/strong> Have fun.<\/li>\n<li><strong>Export an FBX for Unity file<\/strong>, and quickly test this FBX <a href=\"https:\/\/www.creators3d.com\/online-viewer\">on this site<\/a>.<\/li>\n<\/ul>\n<p><iframe loading=\"lazy\" title=\"Photoscan Portraits Part 2: Cleaning up a scan in Meshmixer\" src=\"https:\/\/player.vimeo.com\/video\/123702711?h=4c3d85a0d9&amp;dnt=1&amp;app_id=122963\" width=\"840\" height=\"473\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Agenda Exit tickets: See the Discord Follow up: Any Other Questions? Announcement: Next class will be a work session. We will have a sign up sheet for 1:1 sessions with Nica or Golan. Workshop: Polycam &gt;&gt; Mixamo Photogrammetry Brief photogrammetry lecture Polycam to Mixamo workshop, below. Keep an eye out for the following sorts of &hellip; <a href=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/daily-notes\/september\/sep-08\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Sep-08&#8221;<\/span><\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"parent":1430,"menu_order":4,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/pages\/463"}],"collection":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/comments?post=463"}],"version-history":[{"count":4,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/pages\/463\/revisions"}],"predecessor-version":[{"id":469,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/pages\/463\/revisions\/469"}],"up":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/pages\/1430"}],"wp:attachment":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/media?parent=463"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}