Where academic tradition
meets the exciting future

Exploring the Impact of Interface Signs’ Interpretation Accuracy, Design, and Evaluation on Web Usability: A Semiotics Perspective

Muhammad Nazrul Islam, Franck Tetard, Exploring the Impact of Interface Signs’ Interpretation Accuracy, Design, and Evaluation on Web Usability: A Semiotics Perspective. Journal of Systems and Information Technology 16(4), 250–276, 2014.

Abstract:

Purpose: The purpose of this empirical study was to address two important concerns of web usability: (i) how user-intuitive interface signs affect web usability, and (ii) how applying semiotics (i.e., the doctrine of signs) in user interface (UI) design and evaluation helps to improve usability.

Methodology: An empirical research approach is followed here to conduct a total of three user tests. These tests were conducted on a web application with a total of 17 test participants. Data was gathered through laboratory-based think-aloud usability test, questionnaires, and interviews. Following an empirical research approach, statistics and user behavior analysis were used to analyze the data.

Findings: This study explores two important concerns of UI design and evaluation. First, users’ interpretation accuracy of interface signs impact on web usability. The study found that (i) users’ interpretation of signs might be accurate, moderate, conflicting, erroneous, or incapable; (ii) user-intuitive interface signs led participants to interpret signs’ meaning accurately; and (iii) users’ inaccurate interpretation of one or a few task-related interface sign(s) led users to usability problems, resulting in participants performing tasks with lower task-completion performance. Second, considering semiotics perception in UI design and evaluation is important to improve web usability. This study showed that interface signs, when re-designed considering the semiotics guidelines, have increased the end users’ interpretation accuracy and the interface signs’ intuitiveness. This study also provides a small set of semiotics guidelines for sign design and evaluation.

Originality/value: This study empirically demonstrated that signs’ intuitiveness impact on web usability and that considering the semiotics perception in sign design and evaluation is important to improve web usability. These outcomes are valuable in a number of ways to HCI researchers and practitioners: (i) the results provide awareness of the importance of user-intuitive interface signs in UI design; (ii) practitioners can easily adopt the concept of interpretation accuracy classification to conduct a sign test in order to obtain an ‘overall impression of interface signs’ intuitiveness’; (iii) practitioners can easily adopt the methodological approach followed in this study to conduct usability test without additional resources; and (iv) the results raised important fundamental questions for future research such as ‘what does a practitioner need to be aware of when designing or evaluating interface signs?’.

BibTeX entry:

@ARTICLE{jIsTe14a,
  title = {Exploring the Impact of Interface Signs’ Interpretation Accuracy, Design, and Evaluation on Web Usability: A Semiotics Perspective},
  author = {Islam, Muhammad Nazrul and Tetard, Franck},
  journal = {Journal of Systems and Information Technology},
  volume = {16},
  number = {4},
  publisher = {Emerald Group Publishing Limited},
  pages = {250–276},
  year = {2014},
  keywords = {Web usability, think-aloud usability test, human-computer interaction, semiotics, interface signs, web user interface, and user experience},
}

Belongs to TUCS Research Unit(s): Institute for Advanced Management Systems Research (IAMSR)

Publication Forum rating of this publication: level 1

Edit publication