Menu

Luyao Shen

HCI Researcher
Profile Picture

Hi there! I am Luyao Shen, a Ph.D. student at Hong Kong University of Science and Technology (Guangzhou) under the supervision of Prof. Mingming Fan, and Prof. Pan Hui .

My current research interests include Human-Computer Interaction (HCI), User Experience (UX) Design, and Virtual Reality (VR).

Latest News

2022-09-01
I'm coming to HKUST(GZ) šŸŽ“

I'm coming to the Hong Kong University of Science and Technology in 2022 fall. I will be supervised by Prof. Mingming Fan and Prof. Pan Hui. I will be working on the project of User Experience (UX) design.

Publication Professional Experience Education

Publication

CSUR

Paper Image Preview

A Systematic Review of XR-Enabled Remote Human-Robot Interaction Systems [pdf] [doi]

Xian Wang, Luyao Shen, Lik-Hang Lee

This survey provides a comprehensive review of extended reality (XR) applications in remote human-robot interaction (HRI). We developed a systematic search strategy based on the PRISMA methodology, focusing on peer-reviewed publications that demonstrate practical implementations of XR in remote robot control, real robot system deployment, and HRI applications, we analyzed research published between January 2013 and December 2023.

Extended reality Human-robot interaction Survey HRI CSUR Literature review

IEEE VR 2025

Paper Image Preview

A Dual-Stick Controller for Enhancing Raycasting Interactions with Virtual Objects [pdf] [doi]

Nianlong Li, Tong Wu, Zhenxuan He, Luyao Shen, Tianren Luo, Teng Han, Boyu Gao, Yu Zhang, Liuxin Zhang, Feng Tian, Qianying Wang

This work presents Dual-Stick, a novel controller with two sticks connected at the end that innovates a Dual-Ray interaction paradigm to enrich raycasting input in Virtual Reality (VR). Dual-Stick leverages the inherent human dexterity in using everyday tools such as clamps and tweezers to adjust the relative angle between two sticks. This design supports Dual-Ray interactions that provide with a heuristics-based enhanced mechanism. It also offers more flexible manipulation by taking advantages of additional degrees of freedom provided by clamping angle.

Virtual reality Handheld controller Target selection and manipulation VR IEEE VR Controller

TVCG

Paper Image Preview

TeamPortal: Exploring Virtual Reality Collaboration Through Shared and Manipulating Parallel Views [pdf] [doi]

Xian Wang, Luyao Shen, Lei Chen, Mingming Fan, Lik-Hang Lee

Virtual Reality (VR) offers a unique collaborative experience, with parallel views playing a pivotal role in Collaborative Virtual Environments by supporting the transfer and delivery of items. Sharing and manipulating partners' views provides users with a broader perspective that helps them identify the targets and partner actions. We proposed TeamPortal accordingly and conducted two user studies with 72 participants (36 pairs) to investigate the potential benefits of interactive, shared perspectives in VR collaboration.

Virtual reality Collaboration Shared perspectives VR TVCG Interaction technique

IJHCI

Paper Image Preview

EmojiChat: Toward Designing Emoji-Driven Social Interaction in VR Museums [pdf] [doi]

Luyao Shen, Xian Wang, Sijia Li, Lik-Hang Lee, Mingming Fan, Pan Hui

We introduce EmojiChat, an innovative VR museum experience designed to respect the social norms of traditionally keeping quiet while promoting natural interaction. We first design and iterate a customized emoji set for the museum context through semi-structured interviews, participatory design, and an online survey. Then, this emoji set is integrated into a VR museum to facilitate interaction between visitors. Finally, we conduct a comparative study to evaluate the performance of EmojiChat. Our results show that the integration of emojis can improve communication enjoyment and efficiency.

Virtual reality Emoji Multi-user interaction VR IJHCI Empirical studies

DIS 2024

Paper Image Preview

Exploring the Impact of Artificial Intelligence-Generated Content(AIGC) Tools on Social Dynamics in UX Collaboration [pdf] [doi]

Ziyan Wang, Luyao Shen, Emily Kuang, Shumeng Zhang, Mingming Fan

We conducted four focus groups and eight semi-structured interviews with 26 UX practitioners to investigate how AIGC tools influence social dynamics in UX collaboration. Our findings indicated that AIGC tools not only mitigated conflicts but also introduced potential new conflicts. AIGC tools expanded the roles of UX practitioners and fostered a team culture characterized by exploring and discussing.

UX design Social dynamics Collaboration AIGC DIS2024 Empirical studies

Ubicomp 2021

Paper Image Preview

Douleur: Creating Pain Sensation with Chemical Stimulant to Enhance User Experience in Virtual Reality [pdf] [doi] [video]

Chutian Jiang, Yanjun Chen, Mingming Fan, Liuping Wang, Luyao Shen, Nianlong Li, Wei Sun, Yu Zhang, Feng Tian, Teng Han

A wearable haptic device that renders intensity-adjustable pain sensations with chemical stimulants. We found that Douleur played a positive role in safety alert by significantly increasing participantsā€™ immersive experiences with the induced pain sensation.

Haptic Pain sensation Prototype Virtual reality Ubicomp2021 Haptice devices

UIST 2020

Paper Image Preview

HapLinkage: Prototyping Haptic Proxies for Virtual Hand Tools Using Linkage Mechanism [pdf] [doi] [video]

Nianlong Li, Han-Jong Kim, Luyao Shen, Feng Tian, Teng Han, Xing-Dong Yang, Tek-Jin Nam

A prototyping framework based on linkage mechanism, that provides typical motion templates and haptic renderers to facilitate proxy design of virtual hand tools. Based on interviews with expert designers, it was confirmed that HapLinkage is expressive in designing haptic proxy of hand tools to enhance VR experiences.

Virtual hand tool Linkage mechanism Prototyping Virtual reality UIST20 Haptic devices Best paper honorable mention award

Professional Experience

User Experience Designer

Mar 2022 - Sept 2022

Betterlab

HCI Research Assistant

Sept 2019 - May 2021

Institute of Software, Chinese Academy of Sciences

Education

Ph.D.

Sep 2022 - Present

Hong Kong University of Science and Technology (Guangzhou)

Computational Media and Arts Thrust

Master

Sep 2017 - Jan 2020

University of Science and Technology Beijing

Department of Industrial Design

Bachelor

Sep 2013 - Jun 2017

University of Science and Technology Beijing

Department of Industrial Design

Where to find me

E2 3F CMA Lab
Hong Kong University of Science and Technology (Guangzhou)
Nansha, Guangzhou, China

Email Me At

lshen595@connect.hkust-gz.edu.cn

Contact Me At

Mobile: (+86) 18813121790