I’m still in my 3DGS era, so I’m looking a lot at 3D methods of capturing people, things, etc.
I’m not gonna lie, didn’t understand anything more than the images on this ppt BUT I think the premise of being able to simultaneously record movement + texture + mesh is so cool, especially since capturing a texture with a mesh is time consuming in it and of itself (which makes recording 3D the environment around a singular object and all of its faces kinda computationally expensive)¹. I think I’m reminded of this library from Ready Player One, the Halliday Journals, where players can view a moment from Halliday’s life from multiple different angles, zooming in and out, etc.
related projects:
- Facebook project
- Microsoft/Texas A&M project
- This project seems to be using MoCap + 3D reconstruction + stop motion-esque principles to create a VR/AR experience for demos. (not really what I’m looking for but the pipeline is interesting)
3D Temporal Scanners:
This project on motion analysis uses photogrammetry with markers and something they’re calling 3D temporal scanner to analyze the gaits of adults. It reminds me of the Chronography of a walking man by Mary (c.1883), mainly because both projects are focusing on human movement and how data can be extrapolated from non-linear motion.
3DTS is lowkey what I’m interested in making (but maybe for 3dGS?). Didn’t really get satisfactory results from a Google search of 3D temporal scanners (wtf with wrong with google’s search engine nowadays, so many ads) so I turned to my best friend ChatGPT:
A 3D temporal scanner is a type of device that captures and analyzes changes over time in three-dimensional space. It can track the motion or deformation of objects and environments across multiple time points, essentially combining spatial and temporal data into a single model or dataset. These scanners are typically used in various fields like medicine, animation, architecture, and scientific research. – ChatGPT 4o
ChatGPT says that some 3dTS can do motion capture + reconstruction + texture capture over a period of time and space (dependent on system).
Aydin Buyukta’s work is kinda also along the lines of changing the way we view the work in the same way 3D reconstruction can change how we experience things. It makes me kinda give a go with the drone, especially since there’s been quite a few projects in the PostShot Discord that talk about using drone footage for 3DGS.
Note¹: I’m actually not quite sure if this is true, but I’m drawing from my experience of doing the captures for 3DGS cause I must’ve spent like 1hr on capturing all angles of some of my jars 😭.
words: Anthropometry, Geometric morphometrics
tools: @golan I found the spray you were talking about (I think) –> scroll down to AESUB Blue/Orange sprays