Commit Graph

438 Commits

Author SHA1 Message Date
Marcus Boerger
b8572a0c9c - MFH Section FILE does not exist for redirection tests 2005-12-09 09:50:30 +00:00
Marcus Boerger
6b86285dd2 - MFH Add missing newline 2005-12-09 00:30:41 +00:00
Marcus Boerger
fbeb8ae0d4 - Revert piece of MFH that shows an inconsistency - actually we should fix
this fread() issue.
2005-12-09 00:22:21 +00:00
Marcus Boerger
a4d0a4c625 - MFH
. Add ability to create temp files in separate dir and keep them.
  . Add ability to create links in html results as table.
2005-12-08 22:51:01 +00:00
foobar
bfa084ddba MFH:- Made tests that require CGI skipped if it is not available 2005-12-07 11:28:58 +00:00
foobar
241659ff70 MFH: fixed wrong logic 2005-12-07 11:12:52 +00:00
foobar
e5bd8e32f5 MFH: fixed error messages 2005-12-07 10:08:42 +00:00
Ilia Alshanetsky
0e46f5113c Fixed filename picker.
Various modernizations of the script.
2005-12-07 02:01:58 +00:00
Marcus Boerger
8c8907458c - MFH
. Support for '--' style switches
  . Modularize output
  . Better valgrind integration (valgrind 3.0.0+ required now) (-m)
  . Ability to generate an additional html style output log (--html)
  . Ability to test unicode + native tests in one go (-U)
  . Show list of leaked files in summary if any
  . Use basename correct
2005-12-07 00:03:46 +00:00
Marcus Boerger
cb83e27b02 - MFH (faillog, streams, counting, .......) 2005-10-06 09:42:17 +00:00
Ilia Alshanetsky
be945f9fe2 Make use of 5.0+ features 2005-09-11 17:33:15 +00:00
Ilia Alshanetsky
a022e10c2d Simplify code by making use 5.1+ functions 2005-09-06 00:42:20 +00:00
foobar
23e671a51e - Bumber up year 2005-08-03 14:08:58 +00:00
Hartmut Holzgraefe
46a669b7fa make skipif test use ini options specified by -d command line options 2005-08-02 17:05:01 +00:00
Marcus Boerger
ea71e02c7a - Add ENV support (mike) 2005-07-29 17:25:38 +00:00
Marcus Boerger
ef4931f627 - Show end of relay testing block 2005-07-18 00:19:28 +00:00
Jon Parise
6f1261c70c Removing the automake-related output. The build no longer uses automake.
While I'm here, rewrite the PHP_AUTOCONF-related code to more closely
match the conventions used elsewhere in this section.  The result should
be functionally the same as before.
2005-07-11 06:32:02 +00:00
foobar
60ce60d395 show ugly full path for failed redirected tests 2005-07-09 02:41:19 +00:00
foobar
c0d7215b81 Sanitazione 2005-07-08 21:46:23 +00:00
Wez Furlong
626d318f07 sort redirected tests 2005-07-07 13:58:02 +00:00
Wez Furlong
6253c6c5e1 Fix 2 bugs:
- summary is only displayed if 2 or more tests were detected
- error out of a bogus test name is passed in
2005-07-07 12:58:47 +00:00
Wez Furlong
5b84ae26ab Add a new kind of test to the test harness. REDIRECTTEST sections allow an
extension to piggy-back on the tests defined under another dir and run those.

Example of its use follows shortly with pdo tests.
2005-07-06 06:06:23 +00:00
Jon Parise
901419d028 If the PHP_AUTOCONF and PHP_AUTOMAKE environmental variables are set, use
them when describing the build environment.

Support for these variables was originally added to build/build2.mk:1.36.

As a side note, the build system uses PHP_AUTOHEADER.  Perhaps it should
be listed on its own in the build environment for completeness, despite it
being a component of the autoconf package.
2005-07-04 20:37:07 +00:00
foobar
9d14b408cf fix typo 2005-06-20 07:26:46 +00:00
foobar
34e0ba1f92 silence notices 2005-06-16 17:12:26 +00:00
foobar
97666ab4ef Show borked tests in the summary 2005-06-15 09:21:15 +00:00
foobar
ce36ef5787 - Reword the send-report-part a bit. (bug #32624) 2005-04-07 20:22:55 +00:00
foobar
7adac251e3 - Not every OS has ldd.. 2005-04-06 22:14:27 +00:00
foobar
7f4e28d2bd - Fixed bug #32504 (shtool problem on make test) 2005-04-01 13:40:46 +00:00
Ilia Alshanetsky
978f50c046 Detect shtool properly when build-dir != php source dir. 2005-03-20 19:47:13 +00:00
Marcus Boerger
23b3d1ca24 - Readd revised version of Jani's fix:
'errors with -d having a check for invalid ini entries'
- Add -v for verbose mode
2005-03-18 22:43:40 +00:00
foobar
bbe98a88f3 revert 2005-03-18 22:09:31 +00:00
foobar
1524d4890f Fix stupid typos 2005-03-18 21:59:59 +00:00
foobar
ebb8d72d88 Fix errors with -d having a check for invalid ini entries 2005-03-18 21:59:06 +00:00
Magnus M��tt�
27c43d5991 Since in_array is case sensitive we need to convert the names to lowercase
otherwise it won't run tests for extensions where the case of the name differ from the
extension name.
2005-03-09 04:23:02 +00:00
Wez Furlong
b38f21b99c let the test-suite run from an alternate build dir 2005-02-26 15:23:10 +00:00
Marcus Boerger
d02a2df3f0 - Use PHP not C semantics 2005-02-23 01:16:21 +00:00
foobar
91ea475f4d - Fixed bug #29136 (make test - libtool failure on MacOSX) 2005-01-19 01:30:23 +00:00
foobar
ce742b08b0 - Fix typo (avaliable -> available). (bug #28725) 2004-12-16 12:34:32 +00:00
Ilia Alshanetsky
35540fdee6 Added -d option which allows ini options to be specified via command line.
Patch by: Sean Coates
2004-12-06 23:37:20 +00:00
Ilia Alshanetsky
0e46666591 Save test result file inside the build directory. 2004-11-28 20:40:16 +00:00
Ilia Alshanetsky
479af1e75d Fixed bug #30249 (Incorrect timeout check). 2004-09-27 17:30:46 +00:00
Christian Stocker
7b292e2fba Fix for Bug 29010 "make test does not wait to email address" (by Sebastian Nohn) 2004-07-21 11:19:09 +00:00
Ilia Alshanetsky
190227899a Turn off session.auto_start to prevent test failures. 2004-05-26 18:23:21 +00:00
Marcus Boerger
6f699cea5f Bugfix #28229 (PATCH run-tests tripped up by spaces in names) 2004-04-30 08:18:54 +00:00
Ilia Alshanetsky
8ecdc90763 Fixed generate_array_diff(). 2004-03-30 23:58:47 +00:00
Jan Lehnardt
775387e32d - be more verbose 2004-03-29 07:49:32 +00:00
Marcus Boerger
4da754e868 Add ability to pass -n to the executed php 2004-03-28 23:04:53 +00:00
Marcus Boerger
0019c60902 Show progress 2004-03-28 14:12:14 +00:00
Marcus Boerger
e1127cb514 Make run-tests.php work with xdebug being loaded.
# Lots of ppl use that as a built-in extension already.
2004-03-09 14:39:35 +00:00
Ilia Alshanetsky
a0664d54d1 Fixed division by zero warning. 2004-01-16 15:17:37 +00:00
foobar
ccfc46b0aa - Happy new year and PHP 5 for rest of the files too..
# Should the LICENSE and Zend/LICENSE dates be updated too?
2004-01-08 17:33:29 +00:00
Marcus Boerger
a572d79e0a Fix data source 2003-12-29 22:18:40 +00:00
Marcus Boerger
d001928aa2 Align output if one section shows 100% and display percentages when not
counting skipped tests.
2003-12-29 16:07:08 +00:00
Ilia Alshanetsky
bdc30961d0 Properly detect bundled libtool when PHP is built in a separate directory.
Detect version of system libtool, which is used by phpize.
2003-12-23 18:20:46 +00:00
Derick Rethans
f7b3e30fe1 - Remove debug info :) 2003-12-16 15:00:24 +00:00
Derick Rethans
76ec811b35 - Added %e modifier which gets replaced by the current value of
DIRECTORY_SEPARATOR.
2003-12-16 14:53:43 +00:00
Wez Furlong
c92a2219ef Add optional array argument to proc_open() to specify additional
options for the child process.
The first option is "suppress_errors" which will disable any
dialog boxes that arise from missing DLL's and suppress the
GPF dialog.
Use this new feature in the test suite, so that crashing tests don't block the test run; useful for un-attended execution.
2003-12-05 13:45:00 +00:00
Marcus Boerger
c3fddcab62 Fix tests for E_STRICT and check for E_STRICT in run-tests.php. 2003-11-30 13:57:20 +00:00
Marcus Boerger
3cb67f1719 This check is no longer needed (Andrei) 2003-10-02 18:11:10 +00:00
Marcus Boerger
3658ad4c3f Update necessary test INIs 2003-09-04 14:41:10 +00:00
Moriyoshi Koizumi
8fe4a53877 Ensure CGI binary works like CLI.
# This kind of mess should be removed if other better way is found.
2003-08-11 20:02:05 +00:00
Marcus Boerger
2a13d3f9f7 Simplify 2003-08-10 11:46:03 +00:00
foobar
726eb46767 CS fix 2003-08-10 04:23:02 +00:00
Marcus Boerger
e62926dd5b Better diffing 2003-08-09 20:02:02 +00:00
Marcus Boerger
06b089d63b Complain about borked tests instead of spitting out errors 2003-08-09 17:21:19 +00:00
Marcus Boerger
fe37ce8f66 Don't show matching regex as different 2003-08-09 11:57:02 +00:00
Zeev Suraski
9ff7dff10d Shorten output to prevent messup 2003-08-05 08:39:01 +00:00
Zeev Suraski
fec3fc9331 Remove non-standard vim6 option 2003-08-05 08:32:58 +00:00
Zeev Suraski
0770772385 Display the currently running test 2003-08-05 08:31:56 +00:00
Moriyoshi Koizumi
9fe5094d77 Fix run-test.php so it can correctly handle skip conditions. 2003-07-25 05:51:57 +00:00
Ilia Alshanetsky
64d6421885 When encountering a test that users GET/POST make run-tests.php use CGI
sapi if it is avaliable.
If CLI sapi is not avaliable print a clear error when make test is executed.
2003-07-24 17:44:16 +00:00
James Cox
f68c7ff249 updating license information in the headers. 2003-06-10 20:04:29 +00:00
Marcus Boerger
070803a482 Allow optional directories 2003-06-01 18:34:03 +00:00
Marcus Boerger
7ad9732a94 MFB: This is needed though 2003-05-31 14:10:27 +00:00
Marcus Boerger
aa87c89d35 MFB: Showing info/warning once is enough 2003-05-31 12:14:41 +00:00
Marcus Boerger
bbc3c6089b Add php_uname() to output 2003-05-30 12:41:51 +00:00
Marcus Boerger
23e5004132 Execute --SKIPIF-- like --FILE-- 2003-05-29 19:11:51 +00:00
Marcus Boerger
4980461081 Executing tests once is enough 2003-05-23 22:35:15 +00:00
Marcus Boerger
2537e01c77 Allow writing a list of failed tests.
# use php run-tests.php -h for more.
2003-05-23 22:01:38 +00:00
Marcus Boerger
8cd4933d31 Add warning level for tests.
# You set a test to warning by return "warn <description>" from
# the --SKIPIF-- section. But this only works when you supply
# a reason why it is only a warning.
# Warnings are not called for FAILed tests of corse and hence a
# test result with not FAIL but SKIP/PASS/WARN results is mailed
# as a PASS.
2003-05-23 20:51:09 +00:00
Marcus Boerger
57046f4e3e MFB: info in mail too 2003-05-17 23:58:03 +00:00
Marcus Boerger
1939d27aca The env-var TEST_PHP_EXECUTABLE is needed in tests 2003-04-19 17:22:53 +00:00
Marcus Boerger
f97f219fa7 Include ldd output 2003-04-05 12:16:29 +00:00
Marcus Boerger
d94c98c3f2 if TEST_PHP_EXECUTABLE=auto then use ./sapi/cli/php 2003-03-30 14:38:48 +00:00
Derick Rethans
56a172cc04 - Add the exponent to the float modifier 2003-03-28 21:04:45 +00:00
James Cox
485ee3914a updating for new list 2003-03-21 17:17:54 +00:00
Stig Bakken
0e6fca4f22 * email address change 2003-03-18 12:06:09 +00:00
foobar
9f3a46a12e Be sure we get the correct version.. 2003-03-17 12:43:29 +00:00
foobar
908a942a38 added the version info to be send as-is to buildtest-process 2003-03-17 12:24:09 +00:00
Marcus Boerger
9a6db15d21 summary for selective tests if more than one
# maybe i'll change to present summary only when at least one dir selected
2003-03-08 16:28:35 +00:00
Marcus Boerger
3981be30a8 do not use $GLOBAL[] 2003-03-04 19:32:06 +00:00
Marcus Boerger
cbb3e6fd2f fix problem in current HEAD
# strange why on earth does $GLOBALS['cwd'] produce a warning here?
# however we already have a global declarations so we use it for cwd, too.
2003-03-02 15:12:12 +00:00
Derick Rethans
0799d2db84 - Add check for proc_open() being available 2003-02-18 20:07:59 +00:00
Wez Furlong
0a18a9d744 A add much more useful select(2) implementation than is provided by
windows sockets.  The winsock implementation will only work with sockets;
our implementation works with sockets and file descriptors.
By association, stream_select() will now operate correctly with files, pipes and sockets.

This change required linking against the winsock2 library.  In terms of
compatibility, only older versions of windows 95 do not have winsock2
installed by default.  It is available as a redistributable file, and is most likely installed by any OS patches (eg: Internet Explorer) applied by the user.

Also, add a win32 compatible pipe test when opening a stream from a pipe.  This test will only work on NT, win2k and XP platforms.  Without this test, interleaved fread() and select() calls would cause the read buffer to be clobbered.  I will be working on a fix for this issue for win9x.
2003-02-16 03:48:49 +00:00
Wez Furlong
e035fe14e0 If a test does not have any data after 60 seconds of waiting, assume that
it died a horrible death and kill it.
This is useful on windows when a message box is popped-up during an automated
test-run.
2003-02-15 18:09:52 +00:00
Derick Rethans
db0897161c - Make VIM highlighting happy 2003-02-03 12:14:13 +00:00
Melvyn Sopacua
c4eecf9199 Make it easier to diff results of several runs in one day. 2003-02-01 13:28:32 +00:00
Marcus Boerger
494bec466b Simplify 2003-01-26 17:17:44 +00:00
Marcus Boerger
a7d10f8aa4 Bug #21751: Part one never let this happen again... 2003-01-25 19:45:11 +00:00
Jan Lehnardt
c98f4e9f32 - fix typo 2003-01-12 11:42:29 +00:00
Ilia Alshanetsky
b1fab873c2 Added a check for availability of PCRE extension needed by test-suite. 2003-01-07 15:21:34 +00:00
Melvyn Sopacua
e03bccb1ad Delete some security related env variables 2002-12-22 12:48:49 +00:00
Melvyn Sopacua
a4d56067e2 MFB: libtool detection 2002-12-20 00:28:08 +00:00
Derick Rethans
8507eb00f6 - Also send reports when there are no failed tests 2002-12-17 19:07:15 +00:00
Ilia Alshanetsky
2d8945247b Fix a possible E_NOTICE warning message. 2002-12-12 16:14:32 +00:00
Derick Rethans
c4342de561 - MFB 2002-12-11 20:13:43 +00:00
Ilia Alshanetsky
30f83207fe Ask the user for their e-mail address so that we can contact them if need be. 2002-12-11 16:49:00 +00:00
Marcus Boerger
c7dc6c0e00 Move up general tests
# if MFH is needed should be decided by QA team: because the output # sequence changes
2002-11-23 16:57:25 +00:00
Marcus Boerger
d3e095004c Revert that unwanted debug thing - thanks to Sander Robol 2002-11-21 16:48:39 +00:00
Marcus Boerger
64e45b1287 Force showing the question 2002-11-21 15:09:45 +00:00
Marcus Boerger
b7cd48efdd Make it possible to test language features like newly introduced 'abstract'
independantly from debug mode.
2002-11-21 14:56:06 +00:00
Marcus Boerger
7ba0d505af Use eregi is better (noticed by Jon) 2002-11-15 16:33:05 +00:00
Marcus Boerger
0f66b352e9 -Allow skip in upper letters.
-Add 'info' result to --SKIPIF-- -> see following dba commits
2002-11-15 15:57:00 +00:00
Marcus Boerger
ea971db849 Show Zend version 2002-11-15 14:23:40 +00:00
Sander Roobol
8fb395bb9e Move the build-environment stuff down or the test results up, so you
don't need to scroll down to see the failed tests.
2002-11-15 10:37:41 +00:00
Marcus Boerger
5ad332f846 Add magic_quotes_runtime which affects several tests 2002-11-14 21:02:24 +00:00
Marcus Boerger
6048db9005 Only set the overwrites once 2002-11-14 20:12:36 +00:00
Ilia Alshanetsky
eef51c3d6b Disable safe_mode as it interferes with just about every test that needs
to access the file system, set enviroment variables or execute commands.
2002-11-14 18:38:19 +00:00
Melvyn Sopacua
138a1695f5 - Make it possible for people to save results and/or remove unwanted ENV
data.
- Use more options for the CC 'version' flag
2002-11-10 08:56:28 +00:00
Ilia Alshanetsky
7a552596a4 This option is needed if we need to track errors inside the skip condition. 2002-11-08 01:11:05 +00:00
Marcus Boerger
a71f734dec move the run-test tests to the top
#if one of these fails there is no need for further testing
2002-11-04 10:45:41 +00:00
Marcus Boerger
abdf302599 sort them 2002-11-04 10:09:42 +00:00
Marcus Boerger
604f333113 better use 'Off' here
#thx to Moriyoshi
2002-11-03 20:28:35 +00:00
Marcus Boerger
b0dac08dff without these nearly all tests fail if for example php.ini contains
output_handler=mb_string
mbstring.http_output=UCS-2LE
2002-11-03 17:43:24 +00:00
Marcus Boerger
388bf9f542 force showing progress of test 2002-11-03 17:40:34 +00:00
Ilia Alshanetsky
a078f6ecc6 Fixed ini argument parsing. We now support ini options with = in the argument,
such as the one being used in session test #21, which is once again working
properly.
2002-11-03 15:42:59 +00:00
Marcus Boerger
ee7f37ae58 pass params used for info call to skipif also
#try php.ini with
#output_handler=mb_string
#mbstring.http_output=UCS-2LE
2002-11-03 10:52:19 +00:00
Marcus Boerger
9e73bcaa33 copy paste error
#all these different versions here....
2002-11-02 22:06:03 +00:00
Marcus Boerger
29e8b92f22 -allow parameters to be directories
-"${dir}" -> $dir
2002-11-02 21:48:05 +00:00
Marcus Boerger
8b80515659 older versions do not have this functions 2002-11-02 12:55:06 +00:00
Marcus Boerger
22375de5e6 ws 2002-11-02 12:44:36 +00:00
Marcus Boerger
524994d9e2 this would break tests by modifying EXPECT sections
#it took a LONG time to realize that tests were ok but failed due to this ini
2002-11-02 12:33:24 +00:00
Marcus Boerger
ad414f28a9 -move -d stuff into function and update settings for info call 2002-11-01 13:03:30 +00:00
Derick Rethans
55a7590f3d Discuss first! 2002-10-31 14:01:58 +00:00
Yasuo Ohgaki
1fb8331fc0 Fixed more ini settings.
# Derick. Be responsible to your change and opinion.
# These are settings I know that should be set.
# There may be other settingis must be set to make
# run-tests.php work as expected.
2002-10-31 13:52:58 +00:00
Ilia Alshanetsky
6514fac1c0 Corrected my email address. 2002-10-30 18:36:39 +00:00
Marcus Boerger
fde7dffabd Enough discussion on display_erros it seems 2002-10-30 12:18:48 +00:00
Marcus Boerger
b968f90580 Get infos from php running tests not from php running run-test.php 2002-10-30 10:42:55 +00:00
Marcus Boerger
02d35d26cd better use array_diff_assoc
the old way resulted in erroneus .diff
2002-10-29 14:13:11 +00:00
Ilia Alshanetsky
47e1163e01 This patch addresses the bogus test failures due to error logging/reporting
confusion.
2002-10-28 18:48:07 +00:00
Marcus Boerger
e816c8b176 remove last line commited by error
revert log_errors
2002-10-28 18:21:09 +00:00
Marcus Boerger
35a3b071ad forgot 'error_log=' and 'report_memleaks=1'
#commenting on php-dev
2002-10-28 18:19:38 +00:00
Marcus Boerger
4440188510 forgot 'error_log=' and 'report_memleaks=1'
#commenting on php-dev
2002-10-28 17:17:50 +00:00
Shane Caraveo
3034c31934 windows will not have these, so dont bother, but add an OS to the stuff so that it makes sense why they are N/A 2002-10-28 02:00:56 +00:00
Shane Caraveo
c82c6263e8 fix getting ini values that contain the char =
fix command line quoting.  windows requires double quotes in order to handle & (in ini values) correctly
2002-10-28 01:43:54 +00:00
Marcus Boerger
4a2efd53bf allow default ini overwrites to be overwritten themselves in --INI--
#see followup on dev list
2002-10-28 00:07:11 +00:00
Marcus Boerger
cc4c0634fe -introduce EXPECTREGEX
-add %c for EXPECTF
#i think we must escape the special characters for EXPECTF: ".()" and such
2002-10-26 16:54:30 +00:00
Ilia Alshanetsky
ebd4182b2c The log_errors=1 breaks a number of tests and is useless for our purposes,
removing.
2002-10-25 17:24:09 +00:00
Marcus Boerger
0718785076 -improoved number detection
-display every error/warning only once
2002-10-24 18:14:39 +00:00
Ilia Alshanetsky
26617f8b5f Added failed test summary. 2002-10-24 13:13:23 +00:00
Jan Lehnardt
b2a8031144 - gcc prints -v information on stderr, make sure that we catch it anyway.
- I hope this does not cause problems with other compilers or shells. IMHO we
 - already rely on /bin/sh anyway, right?
2002-10-24 09:06:31 +00:00
Melvyn Sopacua
1de45a050c Implement 'no interaction' for automated tests
Implement exit status 1 to make actions for automated testing selectable

# Sorry Derick, was already working on this and the docs, see next commit
# and forthcoming email
2002-10-23 20:53:20 +00:00
Derick Rethans
6a1f477be9 [0.05]
- Disable html_errors in info sent
2002-10-23 20:13:42 +00:00
Jan Lehnardt
e96e0ae002 - use the cc that was detected by ./configure when determining version
information in run-tests.php
2002-10-23 17:56:42 +00:00
Marcus Boerger
69ce017d28 remove *.php file for EXPECTF tests, too. 2002-10-23 12:54:57 +00:00
Jan Lehnardt
70251bcac0 - be more verbose 2002-10-23 08:51:17 +00:00
Stefan Esser
e83ca7dc85 fix make test for an external build dir setup 2002-10-22 18:53:56 +00:00
Marcus Boerger
8312f1443c Give back the php file and leave it in case test fails. 2002-10-22 08:54:23 +00:00
Moriyoshi Koizumi
a26a849bb3 Fixed typo. 2002-10-21 10:23:31 +00:00
Moriyoshi Koizumi
cd410cbf9f \s cannot be used with ereg() 2002-10-21 10:22:41 +00:00
Sander Roobol
988c355720 The results of each test should go on a single line 2002-10-21 09:04:56 +00:00
Derick Rethans
8e9f83add2 - Stijl polizei 2002-10-21 08:55:49 +00:00
Melvyn Sopacua
7bb87c31f8 Adds a 'reason' for skipping a test.
# See modifications on ext/xml/tests/007.phpt for example
2002-10-21 08:52:45 +00:00
Derick Rethans
ca1e7301ab - Added %x for HEX chars
- Added %d as alias for %i (too much C here :)
- Added beginning and end markers to regexp
2002-10-18 20:34:41 +00:00
Derick Rethans
03cc839d90 - Removing debugging info 2002-10-17 14:07:32 +00:00
Ilia Alshanetsky
8c6a49f001 Fixed a bug in the calculation of the POST request length. 2002-10-15 16:46:57 +00:00
Yasuo Ohgaki
e6bcb07c75 Fixed warnings 2002-10-14 09:32:36 +00:00
Derick Rethans
2b34f26b33 - Added the TEST_PHP_USER environment variable with which you can specify
additional directories with tests to run. This is ideal for having your own
  test suite on your system. You can specify more directories by seperating them
  with a ",", for example:

  TEST_PHP_USER=/dat/dev/xdebug/tests,/dat/dev/srm/tests make test
2002-10-14 07:18:23 +00:00
Derick Rethans
e17d6518b1 - woohooo! Automatic build test submits! 2002-10-12 19:29:56 +00:00
Melvyn Sopacua
b5676a5b3e When you say string, match at least one char in EXPECTF section
Plus a little protection against globbing like ext/foo/tests/* or worse.

# yes, I've done that
2002-10-10 16:08:15 +00:00
Derick Rethans
4fcc3df5eb - Fix .exp output 2002-10-08 17:51:57 +00:00
Derick Rethans
f830c481f3 - Show easier parseable and greppable output 2002-10-08 08:53:51 +00:00
Derick Rethans
ede9bd58b7 - Use getenv, as $_ENV is not available when variables_order= in php.ini
does not include "E".
2002-10-08 08:39:10 +00:00
Derick Rethans
d53dd88854 - Drop requirement for php.ini-dist
- Adjust test script to hard code ini settings
2002-10-08 07:49:36 +00:00
foobar
9a010becf1 ws fixes 2002-10-08 03:00:06 +00:00
Sander Roobol
35dc97df3b Temporary (?) workaround (?) for is_executable() on Windows. 2002-10-07 15:16:47 +00:00
Melvyn Sopacua
bcddd58a92 Add --EXPECTF-- section: 'sprintf' for EXPECT sections. See for usage
example ext/xslt/tests/009.phpt.
# To aid debugging, a little commented section is left in, this can be
# stripped in due time, or properly integrated with some --debugging flag.
# But it's quite useful, when you make such tests.
2002-10-07 00:05:20 +00:00
Rasmus Lerdorf
f32d63a3b3 Add php_ini_scanned_files() so "make test" can tell you when you have
additional .ini files that are scanned.
2002-10-06 17:04:10 +00:00
Marcus Boerger
2e90bbe3c2 Return to old counting where every test is counted (even those of skipped
extensions). Inform about the number of extensions tested and skipped.
This makes the test summary more compareable.

Maybe i'll add a parameter/env-var to skip extension tests. That way we
could fasten tests for changes in the core. But it has to wait some days.
2002-10-04 21:19:51 +00:00
Marcus Boerger
ad120d2e28 $val not in first param to sprintf 2002-10-03 18:25:30 +00:00
foobar
ac1254a59c unify these files to conform with the new files created by run-tests.php 2002-10-02 22:31:37 +00:00
foobar
fc721174c8 - Run ext/* tests only for those modules that are actually compiled
into the php binary. (faster)
- Skip search of .phpt files if they are passed as parameters
2002-10-02 01:52:25 +00:00
Marcus Boerger
54e066b20b Unlink output files even if test is skipped. 2002-09-11 19:42:59 +00:00
Marcus Boerger
9ede240057 -reimplemented old style output (.exp, .out)
-implemented diff format output
-delete error logs on success
@Changed regression tests produce selectable error reports. The tests now
@recognize environment variable TEST_PHP_LOG_FORMAT which can
@contain O and E for old style .out and .exp files, L for new .log format and
@D for an internal diff format that does not require systems diff. (Marcus)
#diff output makes it easier to detect the failure on huge or combined tests.
#It was discussed that the php function's diff output has the advantage that
#it is available on every system. Everyone insisting on systems diff may
#use diff on .exp and .out files.
2002-08-26 23:26:46 +00:00
Marcus Boerger
28ebb82c41 Added ARGS section to allow passing arguments to CLI tests 2002-08-21 23:06:38 +00:00
Sander Roobol
ef9014d95d Don't know what this line was supposed to DO!?!? 2002-08-19 19:42:20 +00:00
Marcus Boerger
02a12b57e9 -additional section INI that allows to set special ini settings on call
by adding '-c foo=bar' strings to php call. Each line must have format
 foo=bar. This of cause only works for cli version.
-made sections SKIPIF,INI,GET,POST optional
2002-08-03 11:44:12 +00:00
Marcus Boerger
6ff0a9ee4a -make it run again 2002-06-23 00:37:16 +00:00
Sander Roobol
fcb692a75d Made the tests (and not only run-tests.php) actually use php.ini-dist, and
removed unused php.ini file.
2002-06-16 10:58:54 +00:00
foobar
dc26e8d8f5 Skip POST data if it is empty. 2002-05-22 23:40:29 +00:00
Sander Roobol
3f156fe6f9 Fix php.ini-related stuff in run-tests.php 2002-05-19 14:48:27 +00:00
Sander Roobol
e3490f1429 Fix temporary filename problems, and update .cvsignores with new extensions 2002-05-19 13:54:37 +00:00
Sander Roobol
f3a8a7d6bb Fix make test and remove a warning 2002-05-19 13:24:38 +00:00
Sander Roobol
c9872c9199 Cleaned up run-tests.php, and fixed it on linux/unix
# and probably broke it on windows :)
2002-05-19 13:16:03 +00:00
Preston L. Bannister
3d1d6022cd Updated to run cleanly on Win32, and perform a more controlled test. 2002-05-16 21:48:28 +00:00
Stig Bakken
fdb724bffc * try the installed cli binary if everything else fails (I'm starting
to agree that looking too hard for a php binary is wrong)
2002-05-09 06:39:05 +00:00
Markus Fischer
1a3c8e6289 - Add a warning if running with safe_mode enabled. 2002-05-08 07:23:54 +00:00
Yasuo Ohgaki
734899e615 Enable CGI binary for testing. CGI binary should be used when it's
available, since some tests cannot be performed by CLI. (And
many of them are just failing now)
Fixed SAPI and VERSION output.
2002-04-12 01:34:06 +00:00
Yasuo Ohgaki
68f63a012f WS fix 2002-03-19 02:59:15 +00:00
Wez Furlong
b98074ee86 fix problems with cgi/cli sapi when running tests 2002-03-17 13:16:35 +00:00
Yasuo Ohgaki
7f8b2a6533 Fix PHP version and sapi printed so that it does not print bogus
version and sapi name.
2002-03-12 06:43:15 +00:00
Yasuo Ohgaki
270a907bad Do not search php binary in search path, since we are not testing older builds.
Print SAPI used.
2002-03-12 05:33:03 +00:00
Yasuo Ohgaki
7457b8a7ed Use CGI binary when CGI SAPI is there.
Make "php run-tests.php" work with cli SAPI.
# Anyone mind if I change spaces to tabs?
# Currently, it is using spaces and it's should use
# tabs just like C source.
2002-03-12 05:18:25 +00:00
Stig Bakken
8802148fcd * work with sapi/cli 2002-03-02 02:37:13 +00:00
Sebastian Bergmann
90613d2282 Maintain headers. 2002-02-28 08:29:35 +00:00
Sebastian Bergmann
38933514e1 Update headers. 2001-12-11 15:32:16 +00:00
foobar
76fcdc1afb Fix these to give correct results even if register_globals=off or
register_argc_argv=off.
2001-10-23 11:11:29 +00:00
Stig Bakken
5cd46bb2e0 * typo 2001-08-27 20:37:06 +00:00
Stig Bakken
fb610787ff * add the directory where php.exe was found to PATH to help Windows
find its DLLs
2001-08-27 20:29:33 +00:00
Stig Bakken
d1d848c171 * Windows fix 2001-08-27 20:17:36 +00:00
Stig Bakken
2186ced3a6 * MTH (merge _to_ head) 2001-08-27 16:39:49 +00:00
Hartmut Holzgraefe
800b863310 once again, make test would not work right with error_reporting=E_ALL 2001-07-11 13:19:07 +00:00
Stig Bakken
48c02a2e93 * use ereg functions instead of preg
* send stderr to the bit bucket
2001-05-27 09:09:00 +00:00
Daniel Beulshausen
3d5b27d46a make run-tests work under win32 too
# this whole thing is pretty ugly...
2001-05-02 16:39:04 +00:00
Stig Bakken
0edbf4242f * using CGI -C option, you no longer have to specify "full" path to tests 2001-04-16 23:28:58 +00:00
James Moore
af02c17d9f Output php version at end of tests. 2001-03-29 12:07:37 +00:00
André Langhorst
ec31b454d5 I don't like to commit this over and over either, but this client definitely seems to dislike branches 2001-03-21 16:01:52 +00:00
André Langhorst
f438554953 fighting against the cvs client, it does not want to let the win32 binary safe change go in... 2001-03-21 13:00:33 +00:00
André Langhorst
3d9871dcf4 win32 fixes again 2001-03-21 12:52:32 +00:00
Sebastian Bergmann
b132c36325 Disable maximum execution time for tests. 2001-03-21 06:33:00 +00:00
André Langhorst
3ec4aa11d1 1) fixed tests on *both* win32+linux
2) made tests more sophisticated (checking against compiled in modules)
3) minor changes
4) win32 improvements
2001-03-21 06:04:36 +00:00
Andi Gutmans
eb6ba01d1c - Fix copyright notices with 2001 2001-02-26 06:11:02 +00:00
Sascha Schumann
14c195a6d8 Fix "make test" in VPATH environments 2000-12-24 14:24:04 +00:00
Hartmut Holzgraefe
a0acd8054a removed a warning when testing against a single .phpt file 2000-12-15 23:18:50 +00:00
Stig Bakken
73155d10c4 * run-tests.php: fixed a few bugs, including the POST/GET problem reported by
Stas
2000-12-15 02:57:11 +00:00
Stig Bakken
a70b01b96e * rename write* to dowrite* to avoid clash with ext/sockets
* sapi/cgi seems to ignore command-line options when running in "real"
  CGI mode, need to find a way to pass include_path to it...
2000-12-13 14:24:15 +00:00
Stig Bakken
fe9290e4a9 * output fix for skipped tests 2000-12-08 12:57:11 +00:00
Stig Bakken
749ed8568a added TODO comment 2000-12-08 00:21:09 +00:00
Andre Langhorst
5604ae2de4 made run-tests.php windows compatible 2000-12-06 18:29:03 +00:00
Hartmut Holzgraefe
5f683e7d78 changed run-tests.php to use 'php -q' instead of 'php -f' 2000-12-03 10:45:53 +00:00
Stig Bakken
fc4b704fca Test descriptions showed up blank, fixed. 2000-10-29 07:19:35 +00:00
Hartmut Holzgraefe
86c0d81253 have you ever tried to run the regression tests with error_reporting=E_ALL ?
now it will run smoothly without all theese 'undefined ...' warnings
2000-10-23 07:40:05 +00:00
Stig Bakken
e2cb8ec02c * don't require "POST" section to be present (TEST, FILE and EXPECT
are enough)
2000-09-09 00:37:39 +00:00
Stanislav Malyshev
f34430de8a Remove deprecated call-time reference 2000-09-03 09:37:20 +00:00
Stig Bakken
1bb90f5805 * all tests should pass now (expect for the interbase stuff that I haven't
had the chance to test)
2000-08-31 22:21:47 +00:00
Stig Bakken
fad9bab629 * Added "test" make target so you can do "make test" in any directory.
* Added copyright header to run-test.php
2000-08-29 09:12:44 +00:00
Stig Bakken
315f4f5658 @PHP 3 regression testing framework re-born (Stig)
Took the old PHP 3 regression testing framework and rewrote it in PHP.
Should work on both Windows and UNIX, however I have not tested it on
Windows.  See tests/README for how to write tests.  Added the PHP 3
tests and converted most of them.
2000-08-27 19:46:06 +00:00