Virtual & Mixed Reality + Experience Design
Screen Shot 2018-03-10 at 5.54.11 PM.png

Body, My Body : Volumetric Music Video

‘Body, My Body,’ is a music video made in collaboration with Pittsburgh-based movement and music duo, slowdanger, using volumetric capture and marker-based motion capture rigged to photogrammetry scans of the dancers’ bodies. Volumetric content was captured with RBG + depth cameras at the Panoptic Studio at Carnegie Mellon University. Resulting point clouds were rendered through a custom app built with OpenFrameworks. ‘Body, My Body’ explores the continuum of human representation between photo-real and avatar, and the fragmented nature of a digital ‘self.’

Watch the music video below.

‘Body, My Body’ asks, how do we perceive and connect to each other within these new worlds?   

ROLE : Artist, Director, Creative Technologist

TOOLS : Maya, Unity, OpenFrameworks (C++), ZBrush, After Effects, Python

Directed and Edited by Anna Henson
Movement Direction / Performance / Sound: slowdanger
Lead 3D Animator : Catherine Luo
Lead Software Engineer : Ricardo Tucker
3D Scans : Jessica Medenbach
Gridsuit created by studio-hh
Special thanks to Jessica Hodgins, James Duesing, Golan Levin, the CMU Graphics and Motion Capture Lab, and the Panoptic Studio at Carnegie Mellon University.

 
Synced Footage from Panoptic Studio

Synced Footage from Panoptic Studio

 

The Panoptic Studio at CMU uses 480 synced camera feeds and 20 depth cameras to capture volumetrically without using markers. The data is processed through an algorithm which generates Point Clouds files (ply) which can then be meshed and displayed in 3D.   

IMG_1095.JPG
grid_hug.gif
Screen Shot 2018-03-18 at 6.44.11 PM.png
 We also made 3D scans of the dancers bodies, which we rigged to marker-based motion capture to create a second version of the dancers, who appear on a floating planet populated by 3D scanned trees. 

We also made 3D scans of the dancers bodies, which we rigged to marker-based motion capture to create a second version of the dancers, who appear on a floating planet populated by 3D scanned trees. 

Screen Shot 2018-03-18 at 6.49.52 PM.png
Screen Shot 2018-03-18 at 6.45.56 PM.png
Screen Shot 2018-03-11 at 11.17.36 PM.png
Screen Shot 2018-03-16 at 3.34.46 PM.png
IMG_2169.JPG