Category: FinalProject

Updates for final exhibition:

For the final exhibition, I was mainly thinking about how to bring everything into an interactive experience for the exhibition visitors. My exhibition station had a few components:

Large monitor: shows a variety of media to set the tone–a manifesto of ideas driving the project, an animation/introduction to the project, and a visual of pixels being remapped from one person to another.

Center screen: videos/audios of non-human kin at magnified scales

Left screen: stereo pairs of focus-stacked moss; the screen was shown with a stereo viewer to facilitate the 3D visual effect.

Right screen: red-blue anaglyphs of focus-stacked moss; red-blue glasses were provided nearby so visitors could enjoy the effect

Handheld microscope: provided so visitors can see even more of the installation at scales they wouldn’t otherwise experience.

The screens were surrounded by grass and leaves from my yard (I tried to chose something that would create minimal disruption to the natural surroundings) and some dried plants a friend gifted me in the past. This was done so the media on the screens seemed to merge into the grass/leaves. As visitors leaned in to engage with the material (e.g. the stereo viewer), they would also find themselves getting closer to and smelling the grassy/vegetal scents.

I used my phone as one of the screens, so I both forgot to take an image earlier on during the exhibition (when everything was assembled more nicely) and wasn’t able to take a photo of the full setup, but here’s an image of the overall experience.

Project summary from before:

On the last episode of alice’s ExCap projects… I was playing around with stereo images while reflecting on the history of photography, the spectacle, stereoscopy and voyeurism, and “invisible” non-human labor and non-human physical/temporal scales and worlds. I was getting lost in ideas, so for this current iteration, I wanted to just focus on building the stereo macro capture pipeline I’ve been envisioning earlier (initially because I wanted to explore ways to bring us closer to non-human worlds* and then think about ways to subvert the way that we are gazing and capturing/extracting with our eyes… but I need more time to think about how to actually get that concept across :’)).

*e.g. these stereo videos made at a recent residency I was at (these are “fake stereo”) really spurred the exploration into stereo

Anyway… so in short, my goal for this draft was to achieve a setup for 360, stereoscopic, focus-stacked macro images using my test object, moss. At this point, I may have lost track a bit of the exact reasons for “why,” but I’ve been thinking so much about the ideas in previous projects that I wanted to just see if I can do this tech setup I’ve been thinking about for once and see where it takes me/what ideas it generates… At the very least, now I know I more or less have this tool at my disposal. I do have ideas about turning these images into collage landscapes (e.g. “trees” made of moss, “soil” made of skin) accompanied by soundscapes, playing around with glitches in focus-stacking, and “drawing” through Helicon’s focus stacking algorithm visualization (highlighting the hidden labor of algorithms in a way)… but anyway… here’s documentation of a working-ish pipeline for now.

Feedback request:

I would love to hear any thoughts on what images/what aspects of images in this set appeal to you!

STEP 1: Macro focus-stacking

Panning through focal lengths via pro video mode in Samsung Galaxy S22 Ultra default camera app using macro lens attachment

Focus stacked via HeliconFocus

Actually, I love seeing Helicon’s visualizations:

And when things “glitch” a little:

I took freehand photos of my dog’s eye at different focal lengths (despite being a very active dog, she mainly only moved her eyebrow and pupil here).

2. Stereo macro focus-stacked

Stereoscopic pair of focus-stacked images. I recommend viewing this by crossing your eyes. Change the zoom level so the images are smaller if you’re having trouble.

Red-Cyan Anaglyph of the focus-stacked image. This should be viewed via red-blue glasses.

3. 360 Stereo, macro, focus-stacked

I would say this is an example of focus stacking working really well, because I positioned the object/camera relative to each other in a way that allowed me to capture useful information throughout the entire span of focal lengths allowed on my phone. This is more difficult when capturing 360 from a fixed viewpoint.

Setup:

1. Take stereo pairs of videos panning through different focal lengths, generating the stereo pair by scooting the camera left/right on the rail
2. Rotate turntable holding object and repeat. To reduce vibrations from manipulating the camera app on my phone, I controlled my phone via Vysor on my laptop.
3. Convert videos (74 total, 37 pairs) into folders of images (HeliconFocus cannot batch process videos)
4. Batch process focus stacking in HeliconFocus
5. Take all “focused” images and programmatically arrange into left/right focused stereo pairs
6. Likewise, programmatically or manually arrange into left/right focused anaglyphs

Overall, given that the cameral rail isn’t essential (mostly just used it to help with stereo pairs; the light isn’t really necessarily either given the right time of day), and functional phone macro lenses are fairly cheap, this was a pretty low-cost setup. I also want to eventually develop a more portable setup (which is why I wanted to work with my phone) to avoid having to extract things from nature. However, I might need to eventually transition away from a phone in order to capture a simultaneous stereo pair at macro scales (lenses need to be closer together than phones allow).

The problem of simultaneous stereo capture also remains.

Focus-stacked stereo pairs stitched together. I recommend viewing this by crossing your eyes.

Focus-stacked red-blue anaglyphs stitched together. This needs to be viewed via the red-blue glasses.

The Next Steps:

I’m still interested in my original ideas around highlighting invisible non-human labor, so I’ll think about the possibilities of intersecting that with the work here. I think I’ll try to package this/add some conceptual layers on top of what’s here in order to create an approximately (hopefully?) 2-minute or so interactive experience for exhibition attendees.

Some sample explorations of close-up body capture

For my final I decided to build upon my typology from the beginning of the semester, where I captured the bottoms of bridges using photogrammetry. 

I wanted to focus on the presentation vehicle for my final, inspired by Claire Hentschker’s capture and release philosophy. I really liked the surreal and imposing quality that could be achieved by using augmented reality, which allows you to see these huge and imposing structures in your bedroom or backyard. 

So, I decided to create an app in Unity that could do this and give you a library of browsable bridges to look at, and I mostly succeeded!
There’s a lot of features I would still like to implement in the future, but for a first outing with Unity and app development in general, I’m really satisfied with the results. 

Here’s some videos of the app in action!

And finally, every bridge layered on top of each other outside, in true ExCap fashion.

Did I make this harder on myself by building a new app when there’s plenty that already exist? Oh for sure 10000 percent, but at least I can say I made an app now!

Also this class was great! One of the most fun classes I’ve taken at CMU, even if it was frustrating sometimes learning how to do things I’d never done before. I just discovered (when sitting down to do them) that FCE’s closed yesterday so this is my message to admin: More classes like this!!! I learned so much by just being given free reign to do basically whatever I wanted.

Smallness — the form of being small, the action of having to contort oneself, and how that works when it has to happen consciously, with no immediate threat or reward. This idea came out of considering more formal elements of small bodies along with “smallness” as a symbolic item (as it’s used in movies and other media,) and smallness as a relatable concept.

Started as this:

Started testing which looked like this:

 Looked at some images closer to this:

Changed my setup to something more “official” (magic arm, real camera, fed all to laptop)

Struggled with output, the actual program (I took one coding class and my brain is bad at absorbing those things so just about all of it came out of AI and other people,) and defining the rules of the “game.” Lots of just odd looking problems like this:

Things started kind of working, here are some of the first tests:

After the first critique I wanted to keep working on the problems I had (random artifacts, measuring people in a way which prioritized small frames, etc…)

Here’s a test reel from the first few moments that the program was working semi-correctly:

Kept working and ended up with a cleaner smalling game. People stand against a green screen, everything green is chroma-keyed out, and the surface area of anything not green is measured against the previous size (a person standing at full size when the program starts is 100% of their own surface area, if they bend over, they might be at 65%, etc.). Time is variable and depends on beating one’s own high score—if 10 seconds have elapsed where the participant hasn’t become smaller, the game ends. Set it up for the showcase with the giant touchscreen monitor and a bunch of connections that I barely understood (thank you Golan)

Did the showcase. Here are some favorites:

here’s a larger grid:

 

here’s some photos my mom took:

here’s nica:

here’s golan:

Hi. Here’s a video explaining my project:

That’s the post. Pretend I am in the the Frank-Ratchye studio giving my project presentation, I am not getting paid enough to greenscreen that in as a background.

Here’s the [link to the 3D print parts] tutorial/project used for the servos. Face tracker used from Golan’s [mediapipe_in_p5_2023] code.