2024 September 1

Validating Eyes-free Affordance of On-Finger Hand Proximate User Interfaces in In-situ Scenarios

An example in-situ activity, where a Hand Proximate User Interface (HPUI) can support the user's primary task (cooking) by providing eyes-free support. In this scenario, Cloe is following a cooking tutorial on how to make a dish while wearing an HMD. She follows the video and also interacts with the HPUI, which is a secondary interaction or task, to play, pause, and rewind the video then go back to cooking. When she further familiarize herself, she can quickly interact with the HPUI and make accurate selections without having to look at her hand. As a result, she can spend more time observing her core activity.

Type:

Conference

Authors:

Shariff AM Faleel, SoonUk Kwon, David Ahlström and Pourang Irani

Venue:

ISMAR '24

Date of publication:

2024 September 1

URL:

10.1109/ISMAR62088.2024.00145

pdf download:

Abstract:

We explore the value of Hand Proximate User Interfaces (HPUIs)for in-situ interactive head-mounted systems, i.e. systems designed to support a user’s primary activity. HPUIs are unencumbered, single-handed, and have tactile and proprioceptive affordances. This allows novice and expert users to rely on the visual cues available in the UI, but to then gradually interact eyes-free such that they minimize interrupting the user’s core task. Prior work on HPUI falls short of validating this premise. We address this gap with comparative analysis in the context of a compound task, where one hand is involved in a primary task and the second interacts with a secondary but supporting task (e.g. selecting items from a menu). We compare HPUI with mid-air direct interactions, a common form of interacting with head-mounted displays. The results show that HPUI performs similarly to mid-air but with better eyes-free affordancesand user preferences

Citation:

Shariff AM Faleel, SoonUk Kwon, David Ahlström, Pourang Irani. "Validating Eyes-free Affordance of On-Finger Hand Proximate User Interfaces in In-situ Scenarios", 2024 IEEE International Symposium on Mixed and Augmented Reality (ISMAR `24)

@inproceedings{faleel24_valid_eyes_free,
author = {Shariff AM Faleel, SoonUk Kwon, David Ahlström, Pourang Irani},
title = {Validating Eyes-free Affordance of On-Finger Hand Proximate User Interfaces in In-situ Scenarios},
year = {2024},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
series = {ISMAR '24}
}