Design of 3D interaction techniques for interacting with deformable surfaces in mixed reality using multimodal haptics

Within the context of ADVHANDTURE, the goal of the PhD is to design 3D interaction techniques for interacting with deformable surfaces in mixed reality. The main scientific question relies on the combination of tactile stimuli within the hand. For that purpose, the main objective of the PhD is to study how we can improve the interaction with mixed reality environments composed of deformable surfaces by taking the best of two simple haptic solutions: tangible objects and wearable haptics. Tangible objects will simulate the global and distributed shape/percept of the virtual/augmented object, while wearable haptics will dynamically change its physical properties.

The PhD will start with the analysis of the literature. We will then proceed by developing four main key aspects:

1. Study the perceptual interaction and conflicts between vision and haptics when interacting with passive deformable surfaces in mixed reality,
2. Design 3D interaction techniques combining the capabilities of wearable haptics and tangible objects for mixed reality, addressing the known limitations of the proposed system (e.g. under-actuation, visual occlusion),
3. Develop use cases augmenting the physical properties of the deformable surfaces through wearable haptics and mixed reality,
4. Evaluate the performance and user experience of the proposed 3D interaction on users.

INSA Rennes is Brittany's largest public engineering school. It has 2,040 students and apprentices. More than 340 engineers, 60 master's students and 40 PhD students graduate from the school each year. Comprising nine teaching departments, eight engineering specialisations (including two apprenticeship programmes) and seven research laboratories, INSA employs around 540 public sector staff (researchers, teachers, administrative and technical staff) and more than 70 temporary staff from the private sector.

These last years have seen an explosion of novel tactile technologies providing various haptic sensations across all the user’s body. However, while these technologies have now been made available, virtual reality systems are still struggling to convey compelling tactile sensations for 3D interaction. The project ADVHANDTURE aims at introducing an original computational approach for handling multimodal tactile feedback within immersive environments. For that purpose, the project relies on a multidisciplinary methodology, gathering knowledge in human perception, haptics, virtual reality, mechanics and 3D interactions.

The applicant should have a strong interest in working in a multidisciplinary team.

Ideally, she/he has an experience in virtual reality/mixed reality/augmented reality domain:

• Knowledge on signal processing and electronics;
• Skills in computer science, C/C++ coding;
• Experience in using VR/AR tools and software.
• Familiarity with computer graphics, 3D printing and haptics;
• The student should be able to speak and write in English.