Article

Free access

Assertion-oriented automated test data generation

Authors:

Ali M. Al-YamiAuthors Info & Claims

ICSE '96: Proceedings of the 18th international conference on Software engineering

Pages 71 - 80

Published: 01 May 1996 Publication History

PDF eReader Publisher Site

Abstract

Assertions are recognized as a powerful tool for automatic run time detection of software errors. However, existing testing methods do not use assertions to generate test cases. We present a novel approach of automated test data generation in which assertions are used to generate test cases. In this approach the goal is to identify test cases on which an assertion is violated. If such a test is found then this test uncovers an error in the program. The problem of finding program input on which an assertion is violated may be reduced to the problem of finding program input on which a selected statement is executed. As a result, the existing methods of automated test data generation for white box testing may be used to generate tests to violate assertions. The experiments have shown that this approach may significantly improve the chances of finding software errors as compared to the existing methods of test generation.

References

[1]

D. BirL C. Munoz, "Automatic generation of random self-checking test cases" IBM Systems Journal, vol. 22, No. 3,1982, pp. 229-245.

Digital Library

[2]

B. Boehxu, R. McClean, D. Urfig, "Some experience with automated aids to the design of large-scale reliable software; Proceedings of the International Conference on Reliable Software, 1975, pp. 105-113.

Digital Library

[3]

R. Boycr, B. Elspas, K. Levitt "SELECT - A fond systemfor testing and debugging programs by symbolic execution: SIGPLAN Notices, vol. 10, No. 6, 1975, pp. 234-245.

Digital Library

[4]

L. Clarke, "A system to generate test data and symbolically execute programsj" IEEE Transactions on Sofhvare Engineering, vol. 2, No. 3,1976, pp. 215-222.

Digital Library

[5]

R. DeMillo, A. ti "Constraint-based automatic test data generation; IEEE Transactions on Software Engineering, vol. 17, No. 9,1991, pp. 900-910.

Digital Library

[6]

P. Gill, W. Murray, Ed., Numerical Methods for Constrained Optimization, New York Academic, 1974.

[7]

R. Ferguaon, B. Korel, "The chaining approach for sotlsvare test data generation," ACM Transactions on software Engineering and Methodology (to appear).

Digital Library

[8]

R. Holg J. Cordy, "The toring programming language," c onummications of ACM vol. 31, No. 12, 1988, pp. 1410-1423.

Digital Library

[9]

W. E. Howden, "Symbolic testing and the DISSECT symbolic evaluation aystemfl IEEE Transactions on S&ware Engineering, vol. 4, No. 4,1977, pp. 266-278.

Digital Library

[10]

C. Hulten, "Simple dynamic assertions for interactive program validation: AFJPs Conference Pmee&lgs, Las Vegas, 1984,pp. 405<10.

[11]

B. Kord, "TESTGEN - A structural test datageneration system: Proceedings of the 6th International Conference on Software Testing, Washingtcm D.C., 1989.

[12]

B. Korel, "Automated test data generation: _ Transactions on Software Er@waing, vol. 16, No. 8, 1990,pp. 870-879.

Digital Library

[13]

B. Korel, "A dynamic approachof automatedtest data generation: Conferenceon SofhvareMaintenance, San Diego, 1990,pp. 311-317.

[14]

B. Korel, 'Dynamic method fw sofhvare test data generation: Journal of Sofhvare Testing, Veritlcation, andReliability, vol. 2, 1992,pp. 203-213.

[15]

B. Korel, "TESTGEN - An executionaiented test data generation systems Technical Report TR-SE954H, _mt of Computer Scienee, Illinois Xnatitute of Technology,1995.

[16]

B. Korel, A. A1-Yami "Assertion+riented test data generation: Technical Repeat TR-SE95414, -at of Computer Science, lllinois Institute of Technology,1995.

[17]

N. Levenson,S. Ck J. KnQM T. Shimeall, 'The use of self checksand voting in sofhvareerror detection An empirical study: IEEE Transactions on Software Engineering, vol. SE-16,No. 4,1990, pp. 4324t3.

Digital Library

[18]

B. Meyer, Object-Oriented Sofhvare Construction. Prentic-Hall>1988.

Digital Library

[19]

C. Ramamoorthy,S. Ho, W. Chen, "on the automated generationof program test datq" IEEE Transactionson SoftwareEngineering, vol. 2, No. 4,1976, pp. 293-300.

Digital Library

[20]

D. Rosenbhun,"Toward a method of progmmmingwith assertions; Procedn" gs of the International Conference on SoflwareEngineering, 1992,pp. 92-104.

Digital Library

[21]

L. Stucki, G. Foshee,"New assertionconceptsfor selfmetric software validation," Proceedings of the International Contkrenee on Reliable S&ware, 1975, pp. 59-71.

Digital Library

[22]

J. Vows, K. Miller "putting assertions in their places of the International Symposium on SoftwareReliability Engineering, 1994.

[23]

S. Yaw R. Cheung,'Ilesign of selfchecking. software:' Proceedings of the International Conference on Reliable Software, 1975,pp. 450-457.

Digital Library

Cited By

Witharana HLyu YCharles SMishra P(2022)A Survey on Assertion-based Hardware VerificationACM Computing Surveys10.1145/351057854:11s(1-33)Online publication date: 9-Sep-2022
https://dl.acm.org/doi/10.1145/3510578
Böhme MPaul SCheung SOrso AStorey M(2014)On the efficiency of automated testingProceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering10.1145/2635868.2635923(632-642)Online publication date: 11-Nov-2014
https://dl.acm.org/doi/10.1145/2635868.2635923
Bhasin H(2014)Artificial life and cellular automata based automated test case generatorACM SIGSOFT Software Engineering Notes10.1145/2557833.255784339:1(1-5)Online publication date: 11-Feb-2014
https://dl.acm.org/doi/10.1145/2557833.2557843
Show More Cited By

Index Terms

Assertion-oriented automated test data generation

Recommendations

Fault-oriented automated test data generation
Constraint-Based Automatic Test Data Generation

A novel technique for automatically generating test data is presented. The technique is based on mutation analysis and creates test data that approximate relative adequacy. It is a fault-based technique that uses algebraic constraints to describe test ...
Automated Test Case Generation for Programs Specified by Relational Algebra Queries

Black-box software testing requires test cases to be generated from specifications alone. However, it is impossible to automate the process completely for arbitrary specifications. Specifications are thus restricted to being written entirely in terms of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '96: Proceedings of the 18th international conference on Software engineering

May 1996

590 pages

ISBN:0818672463

Chairman:
H. Dieter Rombach
Univ. of Kaiserslautern, Germany

Copyright © Copyright (c) 1996 Institute of Electrical and Electronics Engineers, Inc. All rights reserved.

Sponsors

German Comp Soc: GI - Gesellshaft for Informatik
SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS\TCSE: TC on Software Engineering

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 May 1996

Check for updates

Author Tags

Qualifiers

Article

Conference

ICSE96

Sponsor:

German Comp Soc
SIGSOFT
IEEE-CS\TCSE

ICSE96: 18th International Conference on Software Engineering

March 25 - 29, 1996

Berlin, Germany

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
1,102
Total Downloads

Downloads (Last 12 months)71
Downloads (Last 6 weeks)31

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Witharana HLyu YCharles SMishra P(2022)A Survey on Assertion-based Hardware VerificationACM Computing Surveys10.1145/351057854:11s(1-33)Online publication date: 9-Sep-2022
https://dl.acm.org/doi/10.1145/3510578
Böhme MPaul SCheung SOrso AStorey M(2014)On the efficiency of automated testingProceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering10.1145/2635868.2635923(632-642)Online publication date: 11-Nov-2014
https://dl.acm.org/doi/10.1145/2635868.2635923
Bhasin H(2014)Artificial life and cellular automata based automated test case generatorACM SIGSOFT Software Engineering Notes10.1145/2557833.255784339:1(1-5)Online publication date: 11-Feb-2014
https://dl.acm.org/doi/10.1145/2557833.2557843
McMinn PBinkley DHarman M(2009)Empirical evaluation of a nesting testability transformation for evolutionary testingACM Transactions on Software Engineering and Methodology10.1145/1525880.152588418:3(1-27)Online publication date: 4-Jun-2009
https://dl.acm.org/doi/10.1145/1525880.1525884
Penta MCerulo LAversano L(2009)The life and death of statically detected vulnerabilitiesInformation and Software Technology10.1016/j.infsof.2009.04.01351:10(1469-1484)Online publication date: 1-Oct-2009
https://dl.acm.org/doi/10.1016/j.infsof.2009.04.013
Hao DZhang LLiu MLi HSun J(2009)Test-data generation guided by static defect detectionJournal of Computer Science and Technology10.1007/s11390-009-9224-524:2(284-293)Online publication date: 1-Mar-2009
https://dl.acm.org/doi/10.1007/s11390-009-9224-5
Tillmann NDe Halleux J(2008)PexProceedings of the 2nd international conference on Tests and proofs10.5555/1792786.1792798(134-153)Online publication date: 9-Apr-2008
https://dl.acm.org/doi/10.5555/1792786.1792798
Copty SFine SUr SYom-Tov EZiv A(2008)A probabilistic alternative to regression suitesTheoretical Computer Science10.1016/j.tcs.2008.03.020404:3(219-234)Online publication date: 1-Sep-2008
https://dl.acm.org/doi/10.1016/j.tcs.2008.03.020
Aydal EPaige RWoodcock J(2008)Evaluation of OCL for Large-Scale ModellingModels in Software Engineering10.1007/978-3-540-69073-3_21(194-205)Online publication date: 1-Feb-2008
https://dl.acm.org/doi/10.1007/978-3-540-69073-3_21
Packevičius ŠUšaniov ABareiša EVatchkov PZhechev B(2007)Software testing using imprecise OCL constraints as oraclesProceedings of the 2007 international conference on Computer systems and technologies10.1145/1330598.1330726(1-6)Online publication date: 14-Jun-2007
https://dl.acm.org/doi/10.1145/1330598.1330726
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents