Virtual Body based on Augmented Virtuality
In this project, we presented an augmented virtuality approach to provide a fully-articulated visual self-representation in an immersive virtual environment (IVE) using cameras attached to a head-mounted display (HMD). The described system can be integrated into most HMD designs. Egocentric camera images captured by a video see-through system are segmented in real-time into foreground, showing parts of the user's body, e.g., her hands or feet, and background. The segmented foreground is then displayed as inset in the user's current view of the virtual world. Thus, the user is able to see her physical body in an arbitrary virtual world, including individual characteristics such as skin pigmentation, hairiness etc. We presented different real-time techniques to blend real and virtual information, e.g., based on chroma keying or skin detection. In this project, we compare effects on presence and spatial perception between such augmented virtuality self-representations and full-body motion capture based on marker suits or depth cameras.