Article

GridUnit: software testing on the grid

Authors:

Alexandre Duarte,

Walfredo Cirne,

Francisco Brasileiro,

Patricia MachadoAuthors Info & Claims

ICSE '06: Proceedings of the 28th international conference on Software engineering

Pages 779 - 782

https://doi.org/10.1145/1134285.1134410

Published: 28 May 2006 Publication History

Abstract

Software testing is a fundamental part of system development. As software grows, its test suite becomes larger and its execution time may become a problem to software developers. This is especially the case for agile methodologies, which preach a short develop/test cycle. Moreover, due to the increasing complexity of systems, there is the need to test software in a variety of environments. In this paper, we introduce GridUnit, an extension of the widely adopted JUnit testing framework, able to automatically distribute the execution of software tests on a computational grid with minimum user intervention. Experiments conducted with this solution have showed a speed-up of almost 70x, reducing the duration of the test phase of a synthetic application from 24 hours to less than 30 minutes. The solution does not require any source-code modification, hides the grid complexity from the user and provides a cost-effectiveness improvement to the software testing experience.

References

[1]

M. Ben-Ari. The bug that destroyed a rocket. Journal of Computer Science Education, 13(2):15--16, 1999.

Digital Library

[2]

P. Mellor, CAD: Computer-Aided Disaster, High. Integr. Syst., 1(2):101--156, 1994.

[3]

C. Kaner, J. Bach and B. Pettichord. Lessons Learned in Software Testing: A Context-Driven Approach. John Wiley & Sons Inc., 2001.

Digital Library

[4]

R. E. Jeffries, A. Anderson and C. Hendrickson, Extreme Programming Installed. Addison-Wesley, 2000.

Digital Library

[5]

G. Rothermel, R. H. Untch and C. Chu. Prioritizing test cases for regression testing, IEEE Transactions on Software Engineering, 27(10):929--948, 2001.

Digital Library

[6]

G. M. Kapfhammer, Automatically and Transparently Distributing the Execution of Regression Test Suites, in: Proceedings of the 18th International Conference on Testing Computer Software, 2001.

[7]

D. Hughes, P. Greenwood,G. Coulson. A Framework for Testing Distributed Systems. Proceedings of the 4th IEEE International Conference on Peer-to-Peer computing (P2P'04), 2004.

Digital Library

[8]

SpiritSoft, SysUnit, http://sysunit.org, 2005.

[9]

F. Berman, G. Fox, A. J. G. Hey, Grid Computing: Making the Global Infrastructure a Reality, John Wiley & Sons Inc., 2003.

Digital Library

[10]

Foster and C. Kesselman. The Grid: Blueprint for a New Computing Infrastructure, 2nd Ed, Morgan Kaufmann, 2004.

Digital Library

[11]

E. Gamma, K. Beck. JUnit: A cook's tour. Java Report, 4(5):27--38, May 1999

[12]

W. Cirne, F. Brasileiro, N. Andrade, R. Santos, A. Andrade, R. Novaes and M. Mowbray, Labs of the World, Unite!!!, Submitted for publication in May 2005. http://www.ourgrid.org/twiki-public/bin/view/OurGrid/OurPublications

[13]

The Globus Alliance, Globus. http://www.globus.org, 2005.

[14]

Andrade, N., Brasileiro, F., Cirne, W., Mowbray, M. Discouraging Free-riding in a Peer-to-Peer CPU-Sharing Grid. Proceedings of the 13th High Performance Distributed Computing Symposium, June 2004.

Digital Library

[15]

D. Paranhos, W. Cirne and F. Brasileiro, Trading Information for Cycles: Using Replication to Schedule Bag of Tasks Applications on Computational Grids, in: Proceedings of the Euro-Par 2003: International Conference on Parallel and Distributed Computing, 2003.

[16]

T. Graves, M. Harrold, J. Kim, A. Porter and G. Rothermel, An empirical study of regression test selection techniques. ACM Transactions on Software Engineering and Methodology, 10(2): 184--208, 2001.

Digital Library

[17]

W. Wong, J. Horgan, S. London,and H. Agrawal, A study of effective regression testing in practice. Proceedings of the Eight International Symposium on Software Reliability Engineering. 1997.

Digital Library

[18]

J. Kim, A. Porter, A history-based test prioritization technique for regression testing in resource constrained environments. Proceedings of the 24th International Conference on Software Engineering. 2002.

Digital Library

Cited By

Bagies TLe WSheaffer JJannesari A(2023)Reducing branch divergence to speed up parallel execution of unit testing on GPUsThe Journal of Supercomputing10.1007/s11227-023-05375-079:16(18340-18374)Online publication date: 13-May-2023
https://doi.org/10.1007/s11227-023-05375-0
Bagies TJannesari A(2021)An Empirical Study of Parallelizing Test Execution Using CUDA Unified Memory and OpenMP GPU Offloading2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW52544.2021.00052(271-278)Online publication date: Apr-2021
https://doi.org/10.1109/ICSTW52544.2021.00052
Coppik NSchwahn OSuri N(2021)Fast Kernel Error Propagation Analysis in Virtualized Environments2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST49551.2021.00027(159-170)Online publication date: Apr-2021
https://doi.org/10.1109/ICST49551.2021.00027
Show More Cited By

Index Terms

GridUnit: software testing on the grid

Recommendations

Multi-environment software testing on the grid
PADTAD '06: Proceedings of the 2006 workshop on Parallel and distributed systems: testing and debugging

We propose a solution to improve the confidence on the correctness of applications designed to be executed in heterogeneous environments, like a grid. Our solution is motivated by the observation that the traditional ways to qualify test processes are ...
Using testing and JUnit across the curriculum

While the usage of unit-testing frameworks such as JUnit has greatly increased over the last several years, it is not immediately apparent to students and instructors how to best use tools like JUnit and how to integrate testing across a computer ...
A Static Approach to Prioritizing JUnit Test Cases

Test case prioritization is used in regression testing to schedule the execution order of test cases so as to expose faults earlier in testing. Over the past few years, many test case prioritization techniques have been proposed in the literature. Most ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '06: Proceedings of the 28th international conference on Software engineering

May 2006

1110 pages

ISBN:1595933751

DOI:10.1145/1134285

General Chair:
Leon J. Osterweil
University of Massachusetts, USA
,
Program Chairs:
Dieter Rombach
TU Kaiserslautern, Germany
,
Mary Lou Soffa
University of Virginia, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 May 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICSE06

Sponsor:

ICSE06: International Conference on Software Engineering

May 20 - 28, 2006

Shanghai, China

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
659
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bagies TLe WSheaffer JJannesari A(2023)Reducing branch divergence to speed up parallel execution of unit testing on GPUsThe Journal of Supercomputing10.1007/s11227-023-05375-079:16(18340-18374)Online publication date: 13-May-2023
https://doi.org/10.1007/s11227-023-05375-0
Bagies TJannesari A(2021)An Empirical Study of Parallelizing Test Execution Using CUDA Unified Memory and OpenMP GPU Offloading2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW52544.2021.00052(271-278)Online publication date: Apr-2021
https://doi.org/10.1109/ICSTW52544.2021.00052
Coppik NSchwahn OSuri N(2021)Fast Kernel Error Propagation Analysis in Virtualized Environments2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST49551.2021.00027(159-170)Online publication date: Apr-2021
https://doi.org/10.1109/ICST49551.2021.00027
Schwahn OCoppik NWinter SSuri NZhang DMøller A(2019)Assessing the state and improving the art of parallel testing for CProceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3293882.3330573(123-133)Online publication date: 10-Jul-2019
https://dl.acm.org/doi/10.1145/3293882.3330573
Chawla PChana IRana A(2019)Framework for cloud‐based software test data generation serviceSoftware: Practice and Experience10.1002/spe.270849:8(1307-1328)Online publication date: 7-Jun-2019
https://doi.org/10.1002/spe.2708
Schwahn OCoppik NWinter SSuri N(2018)FastFI: Accelerating Software Fault Injections2018 IEEE 23rd Pacific Rim International Symposium on Dependable Computing (PRDC)10.1109/PRDC.2018.00035(193-202)Online publication date: Dec-2018
https://doi.org/10.1109/PRDC.2018.00035
Milka GRzadca K(2018)Dfuntest: A Testing Framework for Distributed ApplicationsParallel Processing and Applied Mathematics10.1007/978-3-319-78024-5_35(395-405)Online publication date: 23-Mar-2018
https://doi.org/10.1007/978-3-319-78024-5_35
Miranskyy AAl‐zanbouri ZGodwin DBener A(2018)Database enginesJournal of Software: Evolution and Process10.1002/smr.191530:4Online publication date: 17-Apr-2018
https://dl.acm.org/doi/10.1002/smr.1915
Leeke M(2017)Simultaneous Fault Models for the Generation of Efficient Error Detection Mechanisms2017 IEEE 28th International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE.2017.29(112-123)Online publication date: Oct-2017
https://doi.org/10.1109/ISSRE.2017.29
Chawla PChana IRana A(2016)Cloud-based automatic test data generation frameworkJournal of Computer and System Sciences10.1016/j.jcss.2015.12.00182:5(712-738)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1016/j.jcss.2015.12.001
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents