POSTURE: Integrating psychology and virtual reality to enable dynamic posture recognition and delivery
ANR-PRC (ANR-22-CE38-0010-01)
The ability to communicate efficiently relies on the ability to understand others’ mental states. Different cues can be used to decode these mental states. Whereas emotional facial expressions (EFEs), mainly the basic ones (e.g., sadness, joy…), have been extensively explored as cues, the role of dynamic postures has yet to be better investigated. The term dynamic postures refers to how the positions and movements of the whole body (including the head and hands, but excluding EFEs) are used to deliver nonverbal information.
The main objective of this project is to determine the respective roles of dynamic postures and EFEs in nonverbal communication, focusing on both basic and more socially complex mental states (e.g., pride, power…), much less probed in the literature. More specifically, we want to determine whether dynamic postures simply serve to reinforce EFEs, or supply specific additional information, and whether these cues are processed similarly by all genders. By combining our expertise in motion capture, computation (LICIIS, URCA), restitution (ICUBE UNISTRA) and experimental psychology (C2S), we plan to answer this research question and provide an open access database of dynamic postures, with or without emotional facial expressions, that can be implemented in virtual reality on expressive avatars.
Key points
body Capture
Body, face and hand motion capture for a psychological study on non-verbal communication and recognition of emotional states.
Consortium
Stéphanie Caillies
Scientific coordinatorProfessor at URCA since 2014, she has led the “Cognition, Santé, Société” (C2S) laboratory (EA 6291), which specializes in social cognition. She has been involved in many projects, including the 2012 ELISE ANR project. She has co-authored 29 peerreviewed papers, one book and six book chapters. She has supervised 6 PhD students, two of whom are now assistant professors. Her research expertise includes verbal and nonverbal communication.
C2S team of URCA
Pr Stéphanie Caillies
Professor of cognitive psychology, URCA Director of the C2S laboratory, URCA.Dr Nicolas Stefaniak
Assistant Professor in psychology, URCA. Member of C2S laboratorySpecialized in neuropsychology, his research themes focus on the links between memory and language. A second research axis is the understanding of emotions.
Dr Ali Oker
Assistant Professor in cognitive psychology, URCA Member of C2S laboratory.His research focuses on the mental processes involved in social interaction. Theory of mind and facial expression recognition are the two major axes of his publications.
Dr Sylvain Caruana
Assistant Professor in psychology, URCA Member of C2S laboratory.His research focuses on social judgment (judgment of oneself, of others), judgment processes (justification of inequalities, power relations, perceptions and decisions of justice) and motivation in educational or professional contexts.
Dr Pamela Gobin
Assistant Professor, URCA Member of C2S laboratoryLaurie Rogez
IGE, URCA Member of C2S laboratoryAs a neuropsychologist by training and an IGE for the C2S laboratory, she works at the intersection of neuroscience and computer science to better understand brain function. I collaborate on experimental protocols to study cognitive functions and emotions.
LICIIS team of URCA
Dr Stéphanie Prévost
Assistant Professor in computer science, URCA Responsible of Centre Image, URCA.Member of LICIIS laboratory.
Her interests focus on 3D scene reconstruction, modelization, vizualisation and VR/AR.
Pr Yannick Rémion
Professor in computer science, URCA. Member of LICIIS laboratoryHis interests focus on 3D scene reconstruction, dynamic animation and simulation.
Dr Hervé Deleau
IGR of Centre Image, URCA Associate member of LICIIS LaboratoryHis interests focus on Remote visualization.
Karim Khater
IGE of LICIIS in computer science, URCA Member of LICIIS laboratory.Main developper of Posture project. his principal objectives are, firstly, to establish an integrated environment that seamlessly synchronizes the various tracking systems used, and secondly, to develop software for 3D visualization of the raw synchronized data.
IGG team of ICUBE at University of Strasbourg
Pr Dominique Bechmann
Professor in computer science, Unistra Head of Geometric and Graphic Computing (IGG) team of the ICube Laboratory, UnistraHead of for the 3rd year of the Bachelor's degree in science, technology and health with a major in computer science - Faculty of Mathematics and Computer Science
Dr Arash Habibi
Assistant Professor, Unistra Member of IGG teamHe has been contributing to the physical modeling and simulation of fluids. His more recent works are in the field of geometric modeling (sketch-based modeling, character skinning) and virtual reality (the animation of avatars and distance perception). He has also been working as a senior VFX graphist in several animation studios (BUF Compagnie, Illumination Entertainment).
Dr Pierre Kraemer
Assistant Professor in computer science, Unistra Member of IGG teamHe has been contributing for several years to the development and exploitation of generic and efficient topological models for the representation of the cellular decomposition of geometric objects (meshes). His most recent activities concern the generation of hexahedral volume meshes by exploiting the skeleton of the shapes to be meshed.
Dr Paul Viville
Post-doc in computer science, Unistra Member of IGG teamNews
- Jan 08, 2024: Karim join Posture's team, as IG of LICIIS. Welcome to him !
- Feb 15, 2023: Laurie join Posture's team, as IG of C2S. Welcome to her !
- Jan 19, 2023: Kick off meeting.
job Offers
Engineer position
-
3 years PhD: In the context of the ANR POSTURE project, we're looking to recruit a motivated individual for a PhD on dynamic posture modeling and emotion detection using multi-modal, multi-scale body motion capture (heterogeneous data). The candidate will join the LICIIS. (Open)
-
15 months IGE: Mise en place (installation et développement) de la couche logiciel sur le système de capture hybride dédié au projet et de concevoir les outils nécessaires à l’exploitation et l’analyse des données. (Close)
Internships
-
2 months internship (BUT informatique): Prise en main de la caméra RGB-D OAK-D et étude de ses capacités : body/hand/face tracking (Provided)
-
6 months internship (Master 2/Engineer student): Intégration d'un système de capture RGB-D (Close)
Publications
Contact
Location:
UFR Lettres et Sciences humaines
57 rue Pierre Taittinger
51100 REIMS , France
IUT de Reims,
Chemin des Rouliers
CS 30012,
51687 REIMS Cedex 2, France
Email:
stephanie.caillies@univ-reims.fr
Call:
03.26.91.36.37