3D scanning technology can restore the 3D object better than flat photography, but they are all static. I want to use touch designer for this project because it can achieve a lot of dynamic interactions. I have tried various things, and two main sections gave me some inspiration. I decided to focus on them to do interactive digital character capture.
1. I can successfully scan the point cloud with a mobile app, restore it in touch designer, and after adding background music, the point cloud will change with different tracks
2. I found a pipeline on the Internet that uses teachmachine to control the model in touch designer. And tried to train my own model with teachamchine.
I have not yet successfully connected the first and second parts. I will spend some time to continue researching. I think the possible solutions are:
The effect I want to achieve in the end is that I made digital animations for each classmate’s avatar. Whoever walks to the computer/puts the photo in front of the computer, the avatar will appear and dance (if my technology can do it, maybe it can dance with the recording of the person himself!).