Paul Streli

PhD student, Department of Computer Science, ETH Zürich

I am a PhD student at the Sensing, Interaction & Perception Lab at ETH Zürich with Christian Holz, supported by a Meta Research PhD Fellowship. My research is on computational interaction, human motion estimation, and applications in emerging Mixed Reality systems. Combining my background in machine learning, computer vision and signal processing, I develop learning-based perception algorithms that infer natural and precise user input and motions from passive sensor observations.

Before starting my PhD, I completed a master’s degree in Electrical & Electronic Engineering at Imperial College London. I worked as a
Research Scientist intern at Meta Reality Labs and an AI research intern at TikTok.
Please reach out via email if you want to know more about my work.

CV / Google Scholar / Github / LinkedIn / X (Twitter)

publications

  1. TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Vision
    Paul Streli, Mark Richardson, Fadi Botros, Shugao Ma, Robert Wang, Christian Holz
    In Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST). 2024.
  1. SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM Reasoning
    Zhipeng Li, Christoph Gebhardt, Yves Inglin, Nicolas Steck, Paul Streli, Christian Holz
    In Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST). 2024.
  1. MANIKIN: Biomechanically Accurate Neural Inverse Kinematics for Human Motion Estimation
    Jiaxi Jiang, Paul Streli, Xuejing Luo, Christoph Gebhardt, Christian Holz
    In Proceedings of the European Conference on Computer Vision (ECCV). 2024.
  1. EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywhere
    Jiaxi Jiang, Paul Streli, Manuel Meier, Christian Holz
    In Proceedings of the European Conference on Computer Vision (ECCV). 2024.
  1. Structured Light Speckle: Joint Ego-Centric Depth Estimation and Low-Latency Contact Detection via Remote Vibrometry
    Paul Streli, Jiaxi Jiang, Juliete Rossie, Christian Holz
    In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST). 2023.
  1. ViGather: Inclusive Virtual Conferencing with a Joint Experience Across Traditional Screen Devices and Mixed Reality Headsets
    Huajian Qiu, Paul Streli, Tiffany Luong, Christoph Gebhardt, Christian Holz
    In Proceedings of the ACM Conference on Mobile Human-Computer Interaction. 2023.
  1. BeliefPPG: Uncertainty-aware Heart Rate Estimation from PPG signals via Belief Propagation
    Valentin Bieri*, Paul Streli*, Berken Utku Demirel, Christian Holz
    In Conference on Uncertainty in Artificial Intelligence (UAI). 2023.
    *Equal contribution
  1. HOOV: Hand Out-Of-View Tracking for Proprioceptive Interaction using Inertial Sensing
    Paul Streli, Rayan Armani, Yi Fei Cheng, Christian Holz
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 2023.
  1. ComforTable User Interfaces: Surfaces Reduce Input Error, Time, and Exertion for Tabletop and Mid-air User Interfaces
    Yi Fei Cheng, Tiffany Luong, Andreas Rene Fender, Paul Streli, Christian Holz
    In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 2022.
  1. AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensing
    Jiaxi Jiang, Paul Streli, Huajian Qiu, Andreas Fender, Larissa Laich, Patrick Snape, Christian Holz
    In Proceedings of the European Conference on Computer Vision (ECCV). 2022.
  1. TapType: Ten-finger text entry on everyday surfaces via Bayesian inference
    Paul Streli, Jiaxi Jiang, Andreas Fender, Manuel Meier, Hugo Romat, Christian Holz
    In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 2022.
  1. TouchPose: Hand Pose Prediction, Depth Estimation, and Touch Classification from Capacitive Images
    Karan Ahuja, Paul Streli, Christian Holz
    In Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology (UIST). 2021.
  1. CapContact: Super-Resolution Contact Areas from Capacitive Touchscreens
    Paul Streli, Christian Holz
    In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 2021. (best paper award).
  1. TapID: Rapid Touch Interaction in Virtual Reality using Wearable Sensing
    Manuel Meier, Paul Streli, Andreas Fender, Christian Holz
    In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 2021. (Accompanying demo received best demonstration award (juried)).