Automating GUI response time measurements in mobile and web applications
Authors: 
Nivia Cruz Quental, Clauirton de Albuquerque Siebra, Jonysberg Peixoto Quintino, Fabiana Florentin, 
Fabio Queda Bueno da Silva, André Luís de Medeiros SantosAuthors Info & Claims
Nivia Cruz Quental, Clauirton de Albuquerque Siebra, Jonysberg Peixoto Quintino, Fabiana Florentin, Fabio Queda Bueno da Silva, André Luís de Medeiros SantosAuthors Info & ClaimsPages 35 - 41
Abstract
The human perception of the performance of an operation while interacting with an user interface (UI) is subjective, i.e., it may depend on how the visual elements are arranged and how they respond to actions. The research for techniques for measurement of UI response time is a nontrivial task, since most of the solutions are concentrated in specific technologies. For evaluation of web pages, tools of general purpose has been used, focusing only on the download of resources and recommendations for the code structure. This paper proposes a methodology to make feasible the measurement of scenarios specified by the product designers for both web and mobile native applications with minor modifications in the automated test code. The methodology relies on using popular automation test tools originally designed for functional testing. The results found may help product owners and stakeholders to make cost-benefit analysis and make decisions about possible enhancements taking into account how the end user interacts with the application.
References
[1]
Akamai, "Web Performance is User Experience." 2019, Last access: 01-03-2019. {Online}. Available: https://www.akamai.com/us/en/multimedia/documents/infographic/web-performance-is-user-experience-infographic.pdf
[2]
S. C. Seow, Designing and Engineering Time: The Psychology of Time Perception in Software., 1st ed. Boston: Addison-Wesley, 2008.
[3]
Lighthouse, "Lighthouse." 2019, Last access: 01-04-2019. {Online}. Available: https://developers.google.com/web/tools/lighthouse/
[4]
PageSpeed, "PageSpeed Insights." 2019, Last access: 01-04-2019. {Online}. Available: https://developers.google.com/speed/pagespeed/insights/
[5]
M. A. Jadhav, B. R. Sawant, and A. Deshmukh, "Single Page Application using Angularis," International Journal of Computer Science and Information Technologies, vol. 6, 2015, pp. 2876--2879.
[6]
M. Jovic and M. Hauswirth, "Performance Testing of GUI Applications," in Proc. of the Third International Conference on Software Testing, Verification, and Validation Workshops, Paris, 2010, pp. 247--251.
[7]
A. Adamoli, D. Zaparanuks, M. Jovic, and M. Hauswirth, <b>"Automated gui performance testing," Software Quality Journal, vol. 19, no. 4, 2011, pp. 801--839.</b>
[8]
N. Beierle, P. M. Kruse, and T. E. J. Vos, "GUI-Profiling for Performance and Coverage Analysis," in Proc. of the IEEE International Symposium on Software Reliability Engineering Workshops, Toulouse, 2017, pp. 28--31.
[9]
Meiliana, I. Septian, R. S. Alianto, and Daniel, "Comparison Analysis of Android GUI Testing Frameworks by Using an Experimental Study," Procedia Computer Science, vol. 135, 2018, pp. 736--748.
[10]
Behave, "Welcome to Behave." 2019, Last access: 01-08-2019. {Online}. Available: https://behave.readthedocs.io/
[11]
Selenium, "Selenium WebDriver." 2019, Last access: 01-08-2019. {Online}. Available: https://www.seleniumhq.org/projects/webdriver/
[12]
Appium, "Appium: Mobile App Automation Made Awesome." 2019, Last access: 01-08-2019. {Online}. Available: http://appium.io/
[13]
Winium, "Winium for Desktop." 2019, Last access: 01-30-2019. {Online}. Available: https://github.com/2gis/Winium.Desktop
[14]
D. Cuellar, Y. Durr, and S. Russel, "Automate Windows And Mac Apps With The WebDriver Protocol." Selenium Conference, 2017, Last access: 01-30-2019. {Online}. Available: https://pt.slideshare.net/wcmcgeejr/selenium-conference-austin-2017-automate-windows-and-mac-apps-with-the-webdriver-protocol-seleniumconf-austin-2017
[15]
M. Lutz, Learning Python: Powerful Object-Oriented Programming., 5th ed. Sebastopol: O' Reilly, 2013.
Recommendations
Linking GUI elements to tasks: supporting an evolutionary design process
TAMODIA '05: Proceedings of the 4th international workshop on Task models and diagramsIn this paper we discuss an approach for linking GUI specifications to more abstract dialogue models and supporting an evolutionary design process. These specifications are linked to task models describing behavioural characteristics. First prototypes ...
Improving the Accuracy of Automated GUI Testing for Embedded Systems
Automated GUIs test application user interfaces and verify their functionalities. However, due to the uncertainty of runtime execution environments, the device under test (DUT) might not reproduce GUI operations on time, resulting in test failures. The ...
Issues in Accessing Web Sites from Mobile Devices
WSE '01: Proceedings of the 3rd International Workshop on Web Site Evolution (WSE'01)Mobile devices such as PDAs and cellular phones that offer Internet access are proliferating. Due to the many unique characteristics of these devices, such as their small screen size and limited network connectivity, existing Web sites may have to ...
Comments
Information & Contributors
Information
Published In
Sponsors
- SIGSOFT: ACM Special Interest Group on Software Engineering
- IEEE-CS: Computer Society
Publisher
IEEE Press
Publication History
Published: 27 May 2019
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
ICSE '19
Sponsor:
- SIGSOFT
- IEEE-CS
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 113Total Downloads
- Downloads (Last 12 months)10
- Downloads (Last 6 weeks)2
Reflects downloads up to 15 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in