2025 March 27
Hand Proximate User Interfaces: Design Space For Single-Handed, Always Available and Comfortable Interface for Head Mounted Displays
Authors:
Shariff AM Faleel
Date of publication:
2025 March 27
Abstract:
Head Mounted Displays (HMDs) are increasingly recognized as the next evolution of mobile computing. While HMDs offer a more seamless integration with the environment, they must overcome several challenges to reach their full potential. One significant area of focus is the interaction technique, particularly for 2D interactions such as navigating menus or browsing social media feeds. Although various interaction techniques exist, many have limitations - especially when compared to smartphones, the current de facto mobile computing platform. Inspired by smartphone interactions, this thesis proposes Hand Proximate User Interface (HPUI), in which interactive elements are anchored on and around the hand, and users interact with them using thumb-to-finger interactions. The visual cues of an HPUI enable novice users to operate it intuitively; they simply look at buttons anchored on their fingers and tap them as they would on a smartphone. Furthermore, it provides eyes-free affordance through proprioceptive and tactile cues, allowing users to rely increasingly on non-visual feedback as they become accustomed to a given interface layout. However, the interaction space of an HPUI exhibits unique characteristics, such as being non-contiguous and constantly changing shape as the fingers move. These contrasting properties of the HPUI give rise to two issues explored in this thesis through a series of user studies: (1) How should user interfaces for HPUIs be designed to incorporate the unique properties of their interaction surfaces? (2) Is the user experience of an HPUI affected by these properties? To address these questions, the thesis first explores and defines the design space of an HPUI. It then develops guidelines for creating applications using HPUIs. Next, the thesis validates that displaying content on the hand and interacting with it directly is advantageous, demonstrates that the performance of an HPUI is comparable to that of similar interaction techniques, and validates HPUI’s eyes-free affordance. Finally, the thesis introduces an HPUI toolkit to enable future researchers and designers to incorporate HPUI into their work.
Citation:
Mohommed Faleel, A. S. (2025). Hand proximate user interfaces: design space for single-handed, always available and comfortable interface for head mounted displays (T). University of British Columbia. Retrieved from https://open.library.ubc.ca/collections/ubctheses/24/items/1.0448261
Lay summary:
The thesis proposes Hand Proximate User Interfaces (HPUI) as an interaction technique for smart glasses. This technique is analogous to replacing a physical smartphone with a virtual interface that is projected onto the user’s hands. Users interact with content in the same manner as they would on a smartphone, using one hand. They are physically and socially comfortable. Moreover, their familiarity with using their hands allows them to interact with the interface without looking at it once they become accustomed to it. However, HPUI exhibits unique characteristics, such as an always-moving, non-contiguous interaction surface. Considering these contrasting attributes, the thesis (1) explores how to design effective user interfaces for HPUIs, (2) empirically validates its advantages by comparing it with similar interaction techniques for smart glasses and (3) examines its performance characteristics. Finally, HPUI toolkit is introduced to assist future researchers and designers incorporate HPUI into their work.
@phdthesis{Mohommed_Faleel_2025,
series={Electronic Theses and Dissertations (ETDs) 2008+},
title={Hand proximate user interfaces: design space for single-handed, always available and comfortable interface for head mounted displays},
url={https://open.library.ubc.ca/collections/ubctheses/24/items/1.0448261},
DOI={http://dx.doi.org/10.14288/1.0448261},
school={University of British Columbia},
author={Mohommed Faleel, Ahmed Shariff},
year={2025},
collection={Electronic Theses and Dissertations (ETDs) 2008+}
}