Sensors for gesture recognition systems

Sigal Berman, Helman Stern

Research output: Contribution to journalReview articlepeer-review


A gesture recognition system (GRS) is comprised of a gesture, gesture-capture device (sensor), tracking algorithm (for motion capture), feature extraction, and classification algorithm. With the impending movement toward natural communication with mechanical and software systems, it is important to examine the first apparatus that separates the human communicator and the device being controlled. Although there are numerous reviews of GRSs, a comprehensive analysis of the integration of sensors into GRSs and their impact on system performance is lacking in the professional literature. Thus, we have undertaken this effort. Determination of the sensor stimulus, context of use, and sensor platform are major preliminary design issues in GRSs. Thus, these three components form the basic structure of our taxonomy. We emphasize the relationship between these critical components and the design of the GRS in terms of its architectural functions and computational requirements. In this treatise, we consider sensors that are capable of capturing dynamic and static arm and hand gestures. Although we discuss various sensor types, our main focus is on visual sensors as we expect these to become the sensor of choice in the foreseeable future. We delineate the challenges ahead for their increased effectiveness in this application domain. We note as a special challenge, the development of sensors that take over many of the functions the GRS designer struggles with today. We believe our contribution, in this first survey on sensors for GRSs, can give valuable insights into this important research and development topic, and encourage advanced research directions and new approaches.

Original languageAmerican English
Article number5976477
Pages (from-to)277-290
Number of pages14
JournalIEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews
Issue number3
StatePublished - 1 May 2012


  • Gesture recognition
  • human-machine interface
  • image sensors
  • reviews

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Software
  • Information Systems
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Sensors for gesture recognition systems'. Together they form a unique fingerprint.

Cite this