OnBodyQWERTY: An Empirical Evaluation of On-Body Tap Typing for AR HMDs

Rajkumar Darbar, Xuning Hu, Xinan Yan, Yushi Wei, Hai-Ning Liang*, Wenge Xu, Sayan Sarcar

*Corresponding author for this work

    Research output: Contribution to conferencePaperpeer-review

    Abstract

    Text entry is an essential and frequent task in Augmented Reality (AR) applications, yet developing an effective and user-friendly method remains a challenge. This paper introduces OnArmQWERTY, a text entry technique for AR HMDs that allows users to project a virtual QWERTY keyboard onto various locations on their non-dominant hand, including the palm, the back of the hand, and both the anterior and posterior sides of the forearm. Users interact with this overlaid keyboard on their skin by tapping with the index finger of the dominant hand, benefiting from the inherent self-haptic feedback of on-body interaction. A user study involving 13 participants evaluated the performance of OnArmQWERTY compared to a traditional mid-air virtual keyboard. The results demonstrate that OnArmQWERTY significantly improves typing speed and accuracy. Specifically, typing on the palm location outperforms all other on-arm locations, achieving a mean typing speed of 20.18 WPM and a mean error rate of 0.71%, which underscores the importance of comfortable, ergonomic typing postures and effective tactile feedback as key factors enhancing text entry performance.
    Original languageEnglish
    Number of pages18
    DOIs
    Publication statusPublished (VoR) - 7 Oct 2024
    EventProceedings of the 2024 ACM Symposium on Spatial User Interaction
    : SUI '24
    - Tier, Germany
    Duration: 7 Oct 20248 Oct 2024
    Conference number: 24

    Conference

    ConferenceProceedings of the 2024 ACM Symposium on Spatial User Interaction
    Abbreviated titleSUI
    Country/TerritoryGermany
    CityTier
    Period7/10/248/10/24

    Keywords

    • Text Input
    • Virtual Keyboard
    • Augmented Reality
    • Virtual Reality
    • Head-Mounted Displays
    • On-Body User Interface
    • Input Interaction

    Fingerprint

    Dive into the research topics of 'OnBodyQWERTY: An Empirical Evaluation of On-Body Tap Typing for AR HMDs'. Together they form a unique fingerprint.

    Cite this