Category: 08-FinalPhase1

CrispySalmon-FinalPhase1

I want to make a tool-centric final project, experimenting with training a GAN with images scraped from this ig account:subwayhands.  This was originally an idea for the body tracking project, but I was unable to execute it for that project, so I want to continue with it for the final project.

I think the main reason for wanting to do this project is that after COVID , I became more conscious and paranoid about nyc subways.  While I was in nyc this Christmas I tried to avoid taking the subways, mainly because of health and other safety concerns.  But I still think that nyc subway has its own unique vibes and holds lots of stories. I have followed the Instagram account: subwayhands for a while now, each picture holds a lot of imaginative potentials.

The main challenges for my proposed project are scraping instagram for enough photos to train the GAN, and  whether its possible to make it similar to pix2pix, using webcam captured picture of my hands as the guiding input to generate an nyc subway hand picture.

project sketch: 

Solar-FinalPhase1

My goal for the rest of the course is to learn how to use the basics of Unity and by the end, create a walkable, 3D terrain. I plan to follow tutorials and record evidence of my learnings.

merlerker-FinalPhase1

My goal is to get a working understanding of three.js/WebGL and shaders. I want to learn some basics (geometries, textures/materials, lighting, camera) – just enough to understand what’s involved and how to control it, I know I could go really deep into any of those “basics.” And then learn how to make scroll-based animations and use shaders.

I still need to come up with an actual project to apply all this to – maybe since I’m interested in product repair I could find an exploded model of a Fairphone/iPhone and have it assemble/rotate as you scroll.

  • geometry: three.js Geometry classes, how to load models
  • materials: three.js Material classes, how to load shader materials
  • lights
  • cameras & controls: three.js Camera classes, controls,
  • making my own shaders: shaderpark, GLSL

three.js resources

  • https://threejs.org/manual/
  • https://threejs-journey.com/

three.js animation resources

  • https://tympanus.net/codrops/2022/01/05/crafting-scroll-based-animations-in-three-js/
  • https://sbcode.net/threejs/animate-on-scroll/

demos & guides

  • https://rd.nytimes.com/research/3d-web-technology
  • https://rd.nytimes.com/research/spatial-journalism

Shader resources

  • https://shaderpark.com/
  • https://www.shadertoy.com/
  • https://shaderbooth.com/