Where academic tradition
meets the exciting future

Investigating the Effects of Motion-based Kinect Game System on the User’s Cognition

Akihito Nakai, Aung Pyae, Mika Luimula, Satoshi Hongo, Hannu Vuola, Jouni Smed, Investigating the Effects of Motion-based Kinect Game System on the User’s Cognition. Journal on Multimodal User Interfaces 9(4), 403–411, 2015.


Kinect, which is useful as a multimodal input device, offers multiple features such as voice recognition, facial tracking, object recognition, and gesture recognition. Games with such human-centred, interactive interfaces create an environment that bridges between artificial and natural cognitive capabilities, enabling them to work together more efficiently. This study specifically examines a usability evaluation method that uses Kansei engineering knowledge to identify and remedy difficulties related to user interface development. As a practical application of the suggested evaluation method, we used a particular serious game, “The Glider,” a prototype developed by Serious Games Finland. It exploits Kinect as its game controller. Serious games are usually aimed at promoting specific effects that can be achieved through playing the game. However, such effects can also present tradeoffs in terms of usability. Controlling motions in “The Glider” has been developed in close cooperation with medical doctors, physiotherapists, and patients in terms of well-being and light exercise. However, modulating the difficulty balance and usability of the game is also a very important aspect of game development. As described in this paper, our goal is to evaluate the control motion of the game from a usability perspective. Evaluation consists of state and appearance observations conducted with 12 Japanese subjects. Observed data were tagged into several categories to quantize their behaviours and speeches, and were analysed using both cognitive bias evaluation and statistical evalu- ation. Results show that difficulties for subjects in control motions of the game were curved out, which is a key to bal- ancing usability and difficulty while maintaining the genuine purpose of the serious game.

BibTeX entry:

  title = {Investigating the Effects of Motion-based Kinect Game System on the User’s Cognition},
  author = {Nakai, Akihito and Pyae, Aung and Luimula, Mika and Hongo, Satoshi and Vuola, Hannu and Smed, Jouni},
  journal = {Journal on Multimodal User Interfaces},
  volume = {9},
  number = {4},
  pages = {403–411},
  year = {2015},
  keywords = {Skeletal motion interface, Usability test, Kansei engineering, Serious game},
  ISSN = {1783-7677},

Belongs to TUCS Research Unit(s): Software Development Laboratory (SwDev)

Publication Forum rating of this publication: level 1

Edit publication