| 1 | The test suite was originally written by Steve McGee and Chris Arthur.
|
|---|
| 2 | It is covered by the GNU General Public License (Version 2), described
|
|---|
| 3 | in the file COPYING. It has been maintained as part of GNU make proper
|
|---|
| 4 | since GNU make 3.78.
|
|---|
| 5 |
|
|---|
| 6 | This entire test suite, including all test files, are copyright and
|
|---|
| 7 | distributed under the following terms:
|
|---|
| 8 |
|
|---|
| 9 | -----------------------------------------------------------------------------
|
|---|
| 10 | Copyright (C) 1992-2016 Free Software Foundation, Inc.
|
|---|
| 11 | This file is part of GNU Make.
|
|---|
| 12 |
|
|---|
| 13 | GNU Make is free software; you can redistribute it and/or modify it under the
|
|---|
| 14 | terms of the GNU General Public License as published by the Free Software
|
|---|
| 15 | Foundation; either version 3 of the License, or (at your option) any later
|
|---|
| 16 | version.
|
|---|
| 17 |
|
|---|
| 18 | GNU Make is distributed in the hope that it will be useful, but WITHOUT ANY
|
|---|
| 19 | WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR
|
|---|
| 20 | A PARTICULAR PURPOSE. See the GNU General Public License for more details.
|
|---|
| 21 |
|
|---|
| 22 | You should have received a copy of the GNU General Public License along with
|
|---|
| 23 | this program. If not, see <http://www.gnu.org/licenses/>.
|
|---|
| 24 | -----------------------------------------------------------------------------
|
|---|
| 25 |
|
|---|
| 26 | The test suite requires Perl. These days, you should have at least Perl
|
|---|
| 27 | 5.004 (available from ftp.gnu.org, and portable to many machines). It
|
|---|
| 28 | used to work with Perl 4.036 but official support for Perl 4.x was
|
|---|
| 29 | abandoned a long time ago, due to lack of testbeds, as well as interest.
|
|---|
| 30 |
|
|---|
| 31 | The test suite assumes that the first "diff" it finds on your PATH is
|
|---|
| 32 | GNU diff, but that only matters if a test fails.
|
|---|
| 33 |
|
|---|
| 34 | To run the test suite on a UNIX system, use "perl ./run_make_tests"
|
|---|
| 35 | (or just "./run_make_tests" if you have a perl on your PATH).
|
|---|
| 36 |
|
|---|
| 37 | To run the test suite on Windows NT or DOS systems, use
|
|---|
| 38 | "perl.exe ./run_make-tests.pl".
|
|---|
| 39 |
|
|---|
| 40 | By default, the test engine picks up the first executable called "make"
|
|---|
| 41 | that it finds in your path. You may use the -make_path option (i.e.,
|
|---|
| 42 | "perl run_make_tests -make_path /usr/local/src/make-3.78/make") if
|
|---|
| 43 | you want to run a particular copy. This now works correctly with
|
|---|
| 44 | relative paths and when make is called something other than "make" (like
|
|---|
| 45 | "gmake").
|
|---|
| 46 |
|
|---|
| 47 | Tests cannot end with a "~" character, as the test suite will ignore any
|
|---|
| 48 | that do (I was tired of having it run my Emacs backup files as tests :))
|
|---|
| 49 |
|
|---|
| 50 | Also, sometimes the tests may behave strangely on networked
|
|---|
| 51 | filesystems. You can use mkshadow to create a copy of the test suite in
|
|---|
| 52 | /tmp or similar, and try again. If the error disappears, it's an issue
|
|---|
| 53 | with your network or file server, not GNU make (I believe). This
|
|---|
| 54 | shouldn't happen very often anymore: I've done a lot of work on the
|
|---|
| 55 | tests to reduce the impacts of this situation.
|
|---|
| 56 |
|
|---|
| 57 | The options/dash-l test will not really test anything if the copy of
|
|---|
| 58 | make you are using can't obtain the system load. Some systems require
|
|---|
| 59 | make to be setgid sys or kmem for this; if you don't want to install
|
|---|
| 60 | make just to test it, make it setgid to kmem or whatever group /dev/kmem
|
|---|
| 61 | is (i.e., "chgrp kmem make;chmod g+s make" as root). In any case, the
|
|---|
| 62 | options/dash-l test should no longer *fail* because make can't read
|
|---|
| 63 | /dev/kmem.
|
|---|
| 64 |
|
|---|
| 65 | A directory named "work" will be created when the tests are run which
|
|---|
| 66 | will contain any makefiles and "diff" files of tests that fail so that
|
|---|
| 67 | you may look at them afterward to see the output of make and the
|
|---|
| 68 | expected result.
|
|---|
| 69 |
|
|---|
| 70 | There is a -help option which will give you more information about the
|
|---|
| 71 | other possible options for the test suite.
|
|---|
| 72 |
|
|---|
| 73 |
|
|---|
| 74 | Open Issues
|
|---|
| 75 | -----------
|
|---|
| 76 |
|
|---|
| 77 | The test suite has a number of problems which should be addressed. One
|
|---|
| 78 | VERY serious one is that there is no real documentation. You just have
|
|---|
| 79 | to see the existing tests. Use the newer tests: many of the tests
|
|---|
| 80 | haven't been updated to use the latest/greatest test methods. See the
|
|---|
| 81 | ChangeLog in the tests directory for pointers.
|
|---|
| 82 |
|
|---|
| 83 | The second serious problem is that it's not parallelizable: it scribbles
|
|---|
| 84 | all over its installation directory and so can only test one make at a
|
|---|
| 85 | time. The third serious problem is that it's not relocatable: the only
|
|---|
| 86 | way it works when you build out of the source tree is to create
|
|---|
| 87 | symlinks, which doesn't work on every system and is bogus to boot. The
|
|---|
| 88 | fourth serious problem is that it doesn't create its own sandbox when
|
|---|
| 89 | running tests, so that if a test forgets to clean up after itself that
|
|---|
| 90 | can impact future tests.
|
|---|
| 91 |
|
|---|
| 92 |
|
|---|
| 93 | Bugs
|
|---|
| 94 | ----
|
|---|
| 95 |
|
|---|
| 96 | Any complaints/suggestions/bugs/etc. for the test suite itself (as
|
|---|
| 97 | opposed to problems in make that the suite finds) should be handled the
|
|---|
| 98 | same way as normal GNU make bugs/problems (see the README for GNU make).
|
|---|
| 99 |
|
|---|
| 100 |
|
|---|
| 101 | Paul D. Smith
|
|---|
| 102 | Chris Arthur
|
|---|
