As immersive technologies mature, Extended Reality (XR) technologies are increasingly considered as tools for professional training, productivity, and collaboration (Bowman et al., 2020). Despite their promise, these systems have yet to achieve widespread workplace adoption (Gong et al., 2021). A key barrier lies in the absence of natural, task-relevant interaction methods that replicate the familiarity and precision of established tools such as the pen (Batmaz et al., 2020).

Stylus-based interaction within XR environments offers a compelling solution. The stylus provides an intuitive bridge between conventional workplace practices and immersive computing, supporting both fine-grained input and the collection of behavioural data. This project aims to extend this interaction paradigm by integrating biometric sensing into XR stylus systems.

In this project, we investigate whether combining stylus telemetry with biometric sensing can be used to detect and encourage flow states during work-oriented tasks in XR. Flow is defined as a state of deep immersion and optimal engagement, and it has been linked to improved productivity, reduced frustration, and higher satisfaction. By embedding an affective computing layer into stylus-based XR interaction, this project will study how adaptive VR environments can respond to users’ cognitive-emotional states in real time to foster flow.

Selected Literature:

Anil Ufuk Batmaz, Mutasim, A. K., & Wolfgang Stuerzlinger. (2020). Precision vs. Power Grip: A Comparison of Pen Grip Styles for Selection in Virtual Reality. 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 23–28. https://doi.org/10.1109/vrw50115.2020.00012

Bowman, Doug & Wingrave, Chadwick & Campbell, Joshua & Ly, Vinh. (2001). Using pinch gloves for both natural and abstract interaction techniques in virtual environments. Proceedings of HCI International.

Gong, Z., Nanjappan, V., Soomro, S. A., & Georgiev, G. V. (2021). Virtual Brainstorming

And Creativity: An Analysis Of Measures, Avatars, Environments, Interfaces, And Applications. Proceedings of the Design Society, 1, 3399–3408. doi:10.1017/pds.2021.601

Knierim, M. T., Stano, F., Kurz, F., Heusch, A., & Wilson, M. L. (2025). Exploring flow in Real-World knowledge work using discrete CEEGRID sensors. CHI 25 Conference, 1–16. https://doi.org/10.1145/3706598.3713512