Multitouch Finger Registration and Its Applications


finger_01finger_02
finger_03finger_04

Abstract

We present a simple finger registration technique that can distinguish in real-time which hand and fingers of the user are touching the touchscreen. The finger registration process is activated whenever the user places a hand, in any orientation, anywhere on the touchscreen. Such a finger registration technique enables the design of intuitive multitouch interfaces that directly map different combinations of the user’s fingers to the interface operations. In this paper, we first study the effectiveness and robustness of the finger registration process. We then demonstrate the usability of our finger registration method for two new interfaces. Specifically, we describe the Palm Menu, which is an intuitive dynamic menu interface that minimizes hand and eye movement during operations, and a virtual mouse interface that enables user to perform mouse operations in multitouch environment. We conducted controlled experiments to compare the performance of the Palm Menu against common command selection interfaces and the virtual mouse against traditional pointing devices.
Stacks Image 199
Paper - pdf (1.4 MB)
Stacks Image 202
Video - mp4 (8.2 MB) - YouTube
Bibtex

@inproceedings{finger_reg:Au10:ozchi,
author = {Oscar Kin-Chung Au and Chiew-Lan Tai},
title = {Multitouch Finger Registration and Its Applications},
booktitle = {OZCHI},
year = {2010}
}
Acknowledgement

We would like to thank Jingbo Liu and Jackson Yuen for implementation help. This work is supported by the Innovation & Technology Fund of Hong Kong (project ITS/117/09).