article

UI-design driven model-based testing

Authors:

Steve ReevesAuthors Info & Claims

Innovations in Systems and Software Engineering, Volume 9, Issue 3

Pages 201 - 215

https://doi.org/10.1007/s11334-013-0199-6

Published: 01 September 2013 Publication History

Abstract

Testing interactive systems is a notoriously difficult task. Not only do we need to ensure that the functionality of the developed system is correct with respect to the requirements and specifications, but also we need to ensure that the user interface (UI) to the system is correct (enables a user to access the functionality correctly) and is usable. These different requirements of interactive system testing are not easily combined within a single testing strategy. We investigate the use of models of interactive systems, which have been derived from design artefacts, as the basis for generating tests for an implemented system. We show how automatically generated abstract tests can be used as the basis for a model-based method for testing interactive systems which has low overhead in terms of the models required and which enables testing of UI and system functionality from the perspective of user interaction. We also examine other testing strategies which use the same abstract tests as their basis and discuss general problems in the area of interactive system testing and propose some solutions.

References

[1]

Beck K (2001) Aim, fire. IEEE Softw 18:87---89

Digital Library

[2]

Beck K (2003) Test-driven development by example. The Addison-Wesley signature series. Addison-Wesley, Menlo Park

[3]

Belli F (2001) Finite-state testing and analysis of graphical user interfaces. In: ISSRE '01: Proceedings of the 12th International Symposium on Software Reliability Engineering (ISSRE'01). IEEE Computer Society, Washington, pp 34---43

[4]

Belli F (2003) A holistic view for finite-state modeling and testing of user interactions. Technical Report 2003/1. The University of Paderborn, Institute for Electrical Engineering and Information Technology, Paderborn

[5]

Bowen J (2008) Formal models and refinement for graphical user interface design. PhD thesis, University of Waikato, Department of Computer Science, Hamilton

[6]

Bowen J, Reeves S (2006) Formal models for informal GUI designs. In: 1st international workshop on formal methods for interactive systems, Macau SAR China, 31 (October 2006) Electronic notes in theoretical computer science, vol 183. Elsevier, Amsterdam, pp 57---72

[7]

Bowen J, Reeves S (2008) Formal models for user interface design artefacts. Innov Syst Softw Eng 4(2):125---141

[8]

Bowen J, Reeves S (2008) Refinement for user interface designs. Electron Notes Theor Comput Sci 208:5---22

Digital Library

[9]

Bowen J, Reeves S (2009) UI-design driven model-based testing. Electronic Communications of EASST 22. http://eceasst.cs.tu-berlin.de/index.php/eceasst/issue/view/33

[10]

Bowen J, Reeves S (2010) Developing usability studies via formal models of uis. In: Proceedings of the 2nd ACM SIGCHI symposium on engineering interactive computing systems (Berlin, Germany, June 19---23 (2010) EICS '10. ACM, New York, pp 175---180

Digital Library

[11]

Bowen J, Reeves S (2011) UI-driven test-first development of interactive systems. In: Proceedings of the 3rd ACM SIGCHI symposium on engineering interactive computing systems, EICS '11, pp 165---174

[12]

Bowen J, Reeves S (2012) Modelling user manuals of modal medical devices and learning from the experience. In: Barbosa SDJ, Campos JC, Kazman R, Palanque PA, Harrison MD, Reeves S (eds) EICS. ACM, New York, pp 121---130

[13]

Bowen J, Reeves S, Schweer A (2013) A tale of two studies. Proc. AUIC2013 (to appear)

[14]

Dutta S (2003) Abbot---a friendly JUnit extension for GUI testing. Java Dev J, pp 8---12. http://abbot.sourceforge.net

[15]

FEST (2009) FEST (Fixtures for Easy Software Testing). http://fest.easytesting.org/wiki/pmwiki.php

[16]

Gimblett A, Thimbleby H (2010) User interface model discovery: towards a generic approach. In: Proceedings of the 2nd ACM SIGCHI Symposium on Engineering interactive Computing Systems (Berlin, Germany, June 19---23 (2010) EICS '10. ACM, New York, pp 145---154

Digital Library

[17]

Hierons RM (1997) Testing from a Z specification. Softw Test Verifi Reliab 7(1):19---33

[18]

ISO (1994) ISO/IEC 9646---1-Information Technology-Open Systems Interconnection-Conformance Testing Methodology and Framework, Part 1: General Concepts, 1st edn. International Standards Organisation, ISO/IEC, Geneva

[19]

ISO (2002) ISO/IEC 13568- Information Technology-Z Formal Specification Notation-Syntax, Type System and Semantics, 1st edn. Prentice-Hall International series in computer science, ISO/IEC. Prentice-Hall, Englewood Cliffs

[20]

Legeard B, Peureux F, Utting M (2004) Controlling test case explosion in test generation from B formal models. J Softw Test Verif Reliab 14(2):81---103. http://lifc.univ-fcomte.fr/bztt/docs/article/RR2004-14.pdf

Digital Library

[21]

Memon AM (2007) An event-flow model of GUI-based applications for testing. Softw Test Verif Reliab 17(3):137---157

[22]

Memon AM (2009) Using reverse engineering for automated usability evaluation of GUI-based applications. In: Software engineering models, patterns and architectures for HCI. Springer, London

[23]

Myers GJ, Badgett T, Thomas TM, Sandler C (2004) The art of software testing, 2nd edn. Wiley, New York

[24]

Paiva A, Faria JCP, Vidal RFAM (2007) Towards the integration of visual and formal models for GUI testing. Electron Notes Theor Comput Sci 190(2):99---111

[25]

Paiva A, Tillmann N, Faria J, Vidal R (2005) Modeling and testing hierarchical GUI s. In: Beauquier D, Borger E, Slissenko A (eds) ASM05. Universite de Paris, Paris

[26]

PIMed (2012). http://sourceforge.net/projects/pims1/?_test=b.PIMed

[27]

Pretschner A, Philipps J (2005) Methodological issues in model-based testing. In: Broy M, Jonsson B, Katoen JP, Leucker M, Pretschner A (eds) Model-based testing of reactive systems. LNCS, vol 3472. Springer, Berlin, pp 281---291

[28]

Ruiz A, Price YW (2007) Test-driven GUI development with test NG and Abbot. IEEE Softw 24(3):51---57

Digital Library

[29]

Schweer A, Hinze A (2007) The digital parrot: combining context-awareness and semantics to augment memory. In: Proceedings of the Workshop on Supporting Human Memory with Interactive Systems (MeMos 2007) at the 2007 British HCI International Conference, Las Vegas

[30]

Silva JC, Silva CE, Gonçalo RD, Saraiva J, Campos JC (2010) The GUIS urfer tool: towards a language independent approach to reverse engineering GUI code. In: EICS, pp 181---186

[31]

Spec# (2008) Microsoft technical pages for Spec#. http://research.microsoft.com/specsharp/

[32]

Stocks P, Carrington DA (1996) A framework for specification-based testing. IEEE Trans Softw Eng 22(11):777---793

Digital Library

[33]

UISpec4J (2011) http://www.uispec4j.org/

[34]

Utting M, Legeard B (2006) Practical model-based testing: a tools approach. Morgan Kaufmann, San Francisco

[35]

White L, Almezen H (2000) Generating test cases for GUI responsibilities using complete interaction sequences. In: ISSRE '00: Proceedings of the 11th International Symposium on Software Reliability Engineering, IEEE Computer Society, Washington, pp 110.

[36]

Xie Q, Memon AM (2006) Model-based testing of community-driven open-source GUI applications. In: ICSM '06: Proceedings of the 22nd IEEE international conference on software maintenance. IEEE Computer Society, Washington, pp 145---154

Digital Library

[37]

Yuan X, Cohen MB, Memon AM (2009) Towards dynamic adaptive automated test generation for graphical user interfaces. In: ICSTW '09: Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops. IEEE Computer Society, Washington, pp 263---266

Digital Library

Cited By

Bowen JTurner J(2023)Interactive System Modelling for the Internet of ThingsProceedings of the ACM on Human-Computer Interaction10.1145/35932337:EICS(1-19)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593233
Turner JBowen JReeves S(2020)Model-based Testing of Interactive Systems using Interaction SequencesProceedings of the ACM on Human-Computer Interaction10.1145/33978734:EICS(1-37)Online publication date: 18-Jun-2020
https://dl.acm.org/doi/10.1145/3397873
Turner JBowen JReeves SWinckler M(2020)SeqCheckCompanion Proceedings of the 12th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3393672.3398639(1-6)Online publication date: 23-Jun-2020
https://dl.acm.org/doi/10.1145/3393672.3398639
Show More Cited By

Index Terms

UI-design driven model-based testing
1. Software and its engineering
  1. Software creation and management
    1. Software development process management
    2. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Index terms have been assigned to the content through auto-classification.

Recommendations

Design issues related to pie menus for 5-way joysticks
Mobility '07: Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology

Although linear textual menus are a widely adopted solution in the mobile phone user interfaces, alternatives that would take smaller amount of screen real estate exist, e.g. toolbars and pie menus. Pie menus also provide access to functions with fewer ...
Model-driven Engineering for Optimizing the Usability of User Interfaces
ICEIS 2016: Proceedings of the 18th International Conference on Enterprise Information Systems

Usability is considered to be one of the most important quality factors that determine the success or failure of an interactive system. This can be explained by the ever-increasing number of studies addressing the integration of the usability evaluation ...
Towards virtualization of user interfaces based on UsiXML
Web3D '05: Proceedings of the tenth international conference on 3D Web technology

A model-based approach is presented for structuring a development process of virtual user interfaces based on UsiXML, a XML-compliant User Interface Description Language. UsiXML provides a Concrete User Interface description that remains independent ...

Comments

Information & Contributors

Information

Published In

cover image Innovations in Systems and Software Engineering

Innovations in Systems and Software Engineering Volume 9, Issue 3

September 2013

80 pages

ISSN:1614-5046

Issue’s Table of Contents

Copyright © Copyright © 2013 Springer-Verlag London.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 September 2013

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bowen JTurner J(2023)Interactive System Modelling for the Internet of ThingsProceedings of the ACM on Human-Computer Interaction10.1145/35932337:EICS(1-19)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593233
Turner JBowen JReeves S(2020)Model-based Testing of Interactive Systems using Interaction SequencesProceedings of the ACM on Human-Computer Interaction10.1145/33978734:EICS(1-37)Online publication date: 18-Jun-2020
https://dl.acm.org/doi/10.1145/3397873
Turner JBowen JReeves SWinckler M(2020)SeqCheckCompanion Proceedings of the 12th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3393672.3398639(1-6)Online publication date: 23-Jun-2020
https://dl.acm.org/doi/10.1145/3393672.3398639
Campos JFayollas CMartinie CNavarre DPalanque PPinto MLuyten KPalanque PCampos JSchmidt A(2016)Systematic automation of scenario-based testing of user interfacesProceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/2933242.2948735(138-148)Online publication date: 21-Jun-2016
https://dl.acm.org/doi/10.1145/2933242.2948735
Bowen JZiegler JNebeling MNigay L(2015)Creating models of interactive systems with the support of lightweight reverse-engineering toolsProceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/2774225.2774840(110-119)Online publication date: 23-Jun-2015
https://dl.acm.org/doi/10.1145/2774225.2774840

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents