The candidate will focus on one to the two following research domains:
Multimodal Reconstruction and Inference: The candidate will conduct research on methods for capturing multimodal information from physical environments in real time. This includes leveraging advanced techniques to infer scene properties such as location, object detection, and tactile characteristics from visual data. The work will explore the integration of foundation models to enhance scene understanding and enrich representations with multimodal information, addressing the balance between realism and plausibility.
Haptic and Tactile Rendering: The candidate will design and evaluate haptic interfaces and algorithms to enable spatialized tactile rendering in extended reality. This could involve the creation of modular, lightweight wearable actuators that combine vibrotactile, force-feedback, and skin-stretch mechanisms. Alternatively, cross-modal rendering techniques will be employed to compensate for hardware limitations, and adaptive encoding schemes will balance sensory fidelity with user cognitive load. Effectiveness will be evaluated through quantitative metrics and qualitative user studies.
Furthermore, the candidate will work on user-driven interactive tools for creating and authoring multimodal experiences. This includes developing tools to assist users during the capture process, providing visual feedback and guidance for efficient reconstruction. Additionally, the candidate will explore methods for users to edit captured information, enabling corrections or adjustments for aesthetic or accessibility purposes.
Additional Duties
Joint PhD Supervision: The postdoc will co-supervise PhD students working on related topics within the project, providing mentorship and technical guidance to ensure alignment with the project’s goals.
Research Management: The candidate could contribute to the project management duties, including progress reporting, milestone tracking, and collaboration with international partners. They will also assist in organizing workshops, meetings, and dissemination activities such as publications and conference presentations.
