Alexander RichardAchieving Social Telepresence

16. Oktober 2023

Foto: UHH/FBI

Wir begrüßen am Montag, 16.10.2023, um 16:15 Uhr Alexander Richard von den Meta Reality Labs Research (RLR), Pittsburgh, mit einem Vortrag zum Thema "Naturalness & Bimodality of Code".

Speaker

Alexander Richard

Meta Reality Labs Research (RLR), Pittsburgh

When: Mo, 16.10.2023, at 16:15

Where: Konrad-Zuse-Hörsaal (Room B-201), Informatikum

Topic

Achieving Social Telepresence

Language: English

Abstract

These days, physical distance between people is one of the biggest obstacles to maintaining meaningful social relationships with family, friends, and co-workers. Even with today’s technology, remote communication is limited to a two-dimensional audio-visual experience and lacks the availability of a shared, three-dimensional space in which people can interact with each other over the distance. Our mission at Reality Labs Research (RLR) in Pittsburgh is to develop a telepresence system that is indistinguishable from reality, i.e., a system that provides photo- and phono-realistic social interactions in VR. Building such a system requires to combine representations of 3D spaces, lifelike avatars, and acoustics.

In this presentation, I will discuss the three major challenges to achieve such a system: completeness, usability, and scale. Completeness describes the challenge to build not only full-body avatars, but environments and acoustic models that can represent the full audio-visual experience. Usability refers to drivability of the avatars, particularly considering that users will not have access to a multi-camera setup, such that our avatars need to be animated from headset input only. Finally, scale refers to the problem of deploying this technology to everyone in the world, i.e., being able to generate a photorealistic representation of everyone from minimal amounts of data.

Bio