Virtual & Mixed Reality + Experiential Design
Screen Shot 2018-03-10 at 5.54.11 PM.png

Body, My Body : Music Video

‘Body, My Body,’ is an interdisciplinary artistic and computational exploration of embodied experiences in virtual and mixed realities. The project, a year-long collaboration with Pittsburgh-based movement and music duo, slowdanger, consists of a music video using two types of motion capture (marker-based and volumetric) to create virtual dancers and environment, and a participatory VR experience for one VR guest and two dancers, tracked in real-time using HTC Vive trackers, to create a visual and ambisonic soundscape exploring touch, proprioception, and the overlap between physical and digital environments.

‘Body, My Body’ asks, how do we perceive and connect to each other within these new worlds?   

ROLE : Artist, Director, Creative Technologis

TOOLS : Maya, Unity, OpenFrameworks (C++), ZBrush, After Effects

Body, My Body

 

Directed and Edited by Anna Henson

Movement Direction / Performance / Sound: slowdanger

Lead 3D Animator : Catherine Luo
Lead Software Engineer : Ricardo Tucker
3D Scans : Jessica Medenbach
Gridsuit created by studio-hh

Special thanks to Jessica Hodgins, James Duesing, Golan Levin, the CMU Graphics and Motion Capture Lab, and the Panoptic Studio at Carnegie Mellon University.

Synced Footage from Panoptic Studio

Synced Footage from Panoptic Studio

 

The Panoptic Studio at CMU uses 480 synced camera feeds and 20 depth cameras to capture volumetrically without using markers. The data is processed through an algorithm which generates Point Clouds files (ply) which can then be meshed and displayed in 3D.   

IMG_1095.JPG
grid_hug.gif
Screen Shot 2018-03-18 at 6.44.11 PM.png
 We also made 3D scans of the dancers bodies, which we rigged to marker-based motion capture to create a second version of the dancers, who appear on a floating planet populated by 3D scanned trees. 

We also made 3D scans of the dancers bodies, which we rigged to marker-based motion capture to create a second version of the dancers, who appear on a floating planet populated by 3D scanned trees. 

Screen Shot 2018-03-18 at 6.49.52 PM.png
Screen Shot 2018-03-18 at 6.45.56 PM.png
Screen Shot 2018-03-11 at 11.17.36 PM.png
Screen Shot 2018-03-16 at 3.34.46 PM.png
IMG_2169.JPG