Commit Graph

328 Commits

Author SHA1 Message Date
Dmitry Stogov
08fe0d1da3 Test engine is improved to support unicode mode 2005-08-15 14:37:55 +00:00
Andrei Zmievski
264cec8be6 Unicode support. 2005-08-11 23:36:07 +00:00
foobar
23e671a51e - Bumber up year 2005-08-03 14:08:58 +00:00
Hartmut Holzgraefe
46a669b7fa make skipif test use ini options specified by -d command line options 2005-08-02 17:05:01 +00:00
Marcus Boerger
ea71e02c7a - Add ENV support (mike) 2005-07-29 17:25:38 +00:00
Marcus Boerger
ef4931f627 - Show end of relay testing block 2005-07-18 00:19:28 +00:00
Jon Parise
6f1261c70c Removing the automake-related output. The build no longer uses automake.
While I'm here, rewrite the PHP_AUTOCONF-related code to more closely
match the conventions used elsewhere in this section.  The result should
be functionally the same as before.
2005-07-11 06:32:02 +00:00
foobar
60ce60d395 show ugly full path for failed redirected tests 2005-07-09 02:41:19 +00:00
foobar
c0d7215b81 Sanitazione 2005-07-08 21:46:23 +00:00
Wez Furlong
626d318f07 sort redirected tests 2005-07-07 13:58:02 +00:00
Wez Furlong
6253c6c5e1 Fix 2 bugs:
- summary is only displayed if 2 or more tests were detected
- error out of a bogus test name is passed in
2005-07-07 12:58:47 +00:00
Wez Furlong
5b84ae26ab Add a new kind of test to the test harness. REDIRECTTEST sections allow an
extension to piggy-back on the tests defined under another dir and run those.

Example of its use follows shortly with pdo tests.
2005-07-06 06:06:23 +00:00
Jon Parise
901419d028 If the PHP_AUTOCONF and PHP_AUTOMAKE environmental variables are set, use
them when describing the build environment.

Support for these variables was originally added to build/build2.mk:1.36.

As a side note, the build system uses PHP_AUTOHEADER.  Perhaps it should
be listed on its own in the build environment for completeness, despite it
being a component of the autoconf package.
2005-07-04 20:37:07 +00:00
foobar
9d14b408cf fix typo 2005-06-20 07:26:46 +00:00
foobar
34e0ba1f92 silence notices 2005-06-16 17:12:26 +00:00
foobar
97666ab4ef Show borked tests in the summary 2005-06-15 09:21:15 +00:00
foobar
ce36ef5787 - Reword the send-report-part a bit. (bug #32624) 2005-04-07 20:22:55 +00:00
foobar
7adac251e3 - Not every OS has ldd.. 2005-04-06 22:14:27 +00:00
foobar
7f4e28d2bd - Fixed bug #32504 (shtool problem on make test) 2005-04-01 13:40:46 +00:00
Ilia Alshanetsky
978f50c046 Detect shtool properly when build-dir != php source dir. 2005-03-20 19:47:13 +00:00
Marcus Boerger
23b3d1ca24 - Readd revised version of Jani's fix:
'errors with -d having a check for invalid ini entries'
- Add -v for verbose mode
2005-03-18 22:43:40 +00:00
foobar
bbe98a88f3 revert 2005-03-18 22:09:31 +00:00
foobar
1524d4890f Fix stupid typos 2005-03-18 21:59:59 +00:00
foobar
ebb8d72d88 Fix errors with -d having a check for invalid ini entries 2005-03-18 21:59:06 +00:00
Magnus M��tt�
27c43d5991 Since in_array is case sensitive we need to convert the names to lowercase
otherwise it won't run tests for extensions where the case of the name differ from the
extension name.
2005-03-09 04:23:02 +00:00
Wez Furlong
b38f21b99c let the test-suite run from an alternate build dir 2005-02-26 15:23:10 +00:00
Marcus Boerger
d02a2df3f0 - Use PHP not C semantics 2005-02-23 01:16:21 +00:00
foobar
91ea475f4d - Fixed bug #29136 (make test - libtool failure on MacOSX) 2005-01-19 01:30:23 +00:00
foobar
ce742b08b0 - Fix typo (avaliable -> available). (bug #28725) 2004-12-16 12:34:32 +00:00
Ilia Alshanetsky
35540fdee6 Added -d option which allows ini options to be specified via command line.
Patch by: Sean Coates
2004-12-06 23:37:20 +00:00
Ilia Alshanetsky
0e46666591 Save test result file inside the build directory. 2004-11-28 20:40:16 +00:00
Ilia Alshanetsky
479af1e75d Fixed bug #30249 (Incorrect timeout check). 2004-09-27 17:30:46 +00:00
Christian Stocker
7b292e2fba Fix for Bug 29010 "make test does not wait to email address" (by Sebastian Nohn) 2004-07-21 11:19:09 +00:00
Ilia Alshanetsky
190227899a Turn off session.auto_start to prevent test failures. 2004-05-26 18:23:21 +00:00
Marcus Boerger
6f699cea5f Bugfix #28229 (PATCH run-tests tripped up by spaces in names) 2004-04-30 08:18:54 +00:00
Ilia Alshanetsky
8ecdc90763 Fixed generate_array_diff(). 2004-03-30 23:58:47 +00:00
Jan Lehnardt
775387e32d - be more verbose 2004-03-29 07:49:32 +00:00
Marcus Boerger
4da754e868 Add ability to pass -n to the executed php 2004-03-28 23:04:53 +00:00
Marcus Boerger
0019c60902 Show progress 2004-03-28 14:12:14 +00:00
Marcus Boerger
e1127cb514 Make run-tests.php work with xdebug being loaded.
# Lots of ppl use that as a built-in extension already.
2004-03-09 14:39:35 +00:00
Ilia Alshanetsky
a0664d54d1 Fixed division by zero warning. 2004-01-16 15:17:37 +00:00
foobar
ccfc46b0aa - Happy new year and PHP 5 for rest of the files too..
# Should the LICENSE and Zend/LICENSE dates be updated too?
2004-01-08 17:33:29 +00:00
Marcus Boerger
a572d79e0a Fix data source 2003-12-29 22:18:40 +00:00
Marcus Boerger
d001928aa2 Align output if one section shows 100% and display percentages when not
counting skipped tests.
2003-12-29 16:07:08 +00:00
Ilia Alshanetsky
bdc30961d0 Properly detect bundled libtool when PHP is built in a separate directory.
Detect version of system libtool, which is used by phpize.
2003-12-23 18:20:46 +00:00
Derick Rethans
f7b3e30fe1 - Remove debug info :) 2003-12-16 15:00:24 +00:00
Derick Rethans
76ec811b35 - Added %e modifier which gets replaced by the current value of
DIRECTORY_SEPARATOR.
2003-12-16 14:53:43 +00:00
Wez Furlong
c92a2219ef Add optional array argument to proc_open() to specify additional
options for the child process.
The first option is "suppress_errors" which will disable any
dialog boxes that arise from missing DLL's and suppress the
GPF dialog.
Use this new feature in the test suite, so that crashing tests don't block the test run; useful for un-attended execution.
2003-12-05 13:45:00 +00:00
Marcus Boerger
c3fddcab62 Fix tests for E_STRICT and check for E_STRICT in run-tests.php. 2003-11-30 13:57:20 +00:00
Marcus Boerger
3cb67f1719 This check is no longer needed (Andrei) 2003-10-02 18:11:10 +00:00
Marcus Boerger
3658ad4c3f Update necessary test INIs 2003-09-04 14:41:10 +00:00
Moriyoshi Koizumi
8fe4a53877 Ensure CGI binary works like CLI.
# This kind of mess should be removed if other better way is found.
2003-08-11 20:02:05 +00:00
Marcus Boerger
2a13d3f9f7 Simplify 2003-08-10 11:46:03 +00:00
foobar
726eb46767 CS fix 2003-08-10 04:23:02 +00:00
Marcus Boerger
e62926dd5b Better diffing 2003-08-09 20:02:02 +00:00
Marcus Boerger
06b089d63b Complain about borked tests instead of spitting out errors 2003-08-09 17:21:19 +00:00
Marcus Boerger
fe37ce8f66 Don't show matching regex as different 2003-08-09 11:57:02 +00:00
Zeev Suraski
9ff7dff10d Shorten output to prevent messup 2003-08-05 08:39:01 +00:00
Zeev Suraski
fec3fc9331 Remove non-standard vim6 option 2003-08-05 08:32:58 +00:00
Zeev Suraski
0770772385 Display the currently running test 2003-08-05 08:31:56 +00:00
Moriyoshi Koizumi
9fe5094d77 Fix run-test.php so it can correctly handle skip conditions. 2003-07-25 05:51:57 +00:00
Ilia Alshanetsky
64d6421885 When encountering a test that users GET/POST make run-tests.php use CGI
sapi if it is avaliable.
If CLI sapi is not avaliable print a clear error when make test is executed.
2003-07-24 17:44:16 +00:00
James Cox
f68c7ff249 updating license information in the headers. 2003-06-10 20:04:29 +00:00
Marcus Boerger
070803a482 Allow optional directories 2003-06-01 18:34:03 +00:00
Marcus Boerger
7ad9732a94 MFB: This is needed though 2003-05-31 14:10:27 +00:00
Marcus Boerger
aa87c89d35 MFB: Showing info/warning once is enough 2003-05-31 12:14:41 +00:00
Marcus Boerger
bbc3c6089b Add php_uname() to output 2003-05-30 12:41:51 +00:00
Marcus Boerger
23e5004132 Execute --SKIPIF-- like --FILE-- 2003-05-29 19:11:51 +00:00
Marcus Boerger
4980461081 Executing tests once is enough 2003-05-23 22:35:15 +00:00
Marcus Boerger
2537e01c77 Allow writing a list of failed tests.
# use php run-tests.php -h for more.
2003-05-23 22:01:38 +00:00
Marcus Boerger
8cd4933d31 Add warning level for tests.
# You set a test to warning by return "warn <description>" from
# the --SKIPIF-- section. But this only works when you supply
# a reason why it is only a warning.
# Warnings are not called for FAILed tests of corse and hence a
# test result with not FAIL but SKIP/PASS/WARN results is mailed
# as a PASS.
2003-05-23 20:51:09 +00:00
Marcus Boerger
57046f4e3e MFB: info in mail too 2003-05-17 23:58:03 +00:00
Marcus Boerger
1939d27aca The env-var TEST_PHP_EXECUTABLE is needed in tests 2003-04-19 17:22:53 +00:00
Marcus Boerger
f97f219fa7 Include ldd output 2003-04-05 12:16:29 +00:00
Marcus Boerger
d94c98c3f2 if TEST_PHP_EXECUTABLE=auto then use ./sapi/cli/php 2003-03-30 14:38:48 +00:00
Derick Rethans
56a172cc04 - Add the exponent to the float modifier 2003-03-28 21:04:45 +00:00
James Cox
485ee3914a updating for new list 2003-03-21 17:17:54 +00:00
Stig Bakken
0e6fca4f22 * email address change 2003-03-18 12:06:09 +00:00
foobar
9f3a46a12e Be sure we get the correct version.. 2003-03-17 12:43:29 +00:00
foobar
908a942a38 added the version info to be send as-is to buildtest-process 2003-03-17 12:24:09 +00:00
Marcus Boerger
9a6db15d21 summary for selective tests if more than one
# maybe i'll change to present summary only when at least one dir selected
2003-03-08 16:28:35 +00:00
Marcus Boerger
3981be30a8 do not use $GLOBAL[] 2003-03-04 19:32:06 +00:00
Marcus Boerger
cbb3e6fd2f fix problem in current HEAD
# strange why on earth does $GLOBALS['cwd'] produce a warning here?
# however we already have a global declarations so we use it for cwd, too.
2003-03-02 15:12:12 +00:00
Derick Rethans
0799d2db84 - Add check for proc_open() being available 2003-02-18 20:07:59 +00:00
Wez Furlong
0a18a9d744 A add much more useful select(2) implementation than is provided by
windows sockets.  The winsock implementation will only work with sockets;
our implementation works with sockets and file descriptors.
By association, stream_select() will now operate correctly with files, pipes and sockets.

This change required linking against the winsock2 library.  In terms of
compatibility, only older versions of windows 95 do not have winsock2
installed by default.  It is available as a redistributable file, and is most likely installed by any OS patches (eg: Internet Explorer) applied by the user.

Also, add a win32 compatible pipe test when opening a stream from a pipe.  This test will only work on NT, win2k and XP platforms.  Without this test, interleaved fread() and select() calls would cause the read buffer to be clobbered.  I will be working on a fix for this issue for win9x.
2003-02-16 03:48:49 +00:00
Wez Furlong
e035fe14e0 If a test does not have any data after 60 seconds of waiting, assume that
it died a horrible death and kill it.
This is useful on windows when a message box is popped-up during an automated
test-run.
2003-02-15 18:09:52 +00:00
Derick Rethans
db0897161c - Make VIM highlighting happy 2003-02-03 12:14:13 +00:00
Melvyn Sopacua
c4eecf9199 Make it easier to diff results of several runs in one day. 2003-02-01 13:28:32 +00:00
Marcus Boerger
494bec466b Simplify 2003-01-26 17:17:44 +00:00
Marcus Boerger
a7d10f8aa4 Bug #21751: Part one never let this happen again... 2003-01-25 19:45:11 +00:00
Jan Lehnardt
c98f4e9f32 - fix typo 2003-01-12 11:42:29 +00:00
Ilia Alshanetsky
b1fab873c2 Added a check for availability of PCRE extension needed by test-suite. 2003-01-07 15:21:34 +00:00
Melvyn Sopacua
e03bccb1ad Delete some security related env variables 2002-12-22 12:48:49 +00:00
Melvyn Sopacua
a4d56067e2 MFB: libtool detection 2002-12-20 00:28:08 +00:00
Derick Rethans
8507eb00f6 - Also send reports when there are no failed tests 2002-12-17 19:07:15 +00:00
Ilia Alshanetsky
2d8945247b Fix a possible E_NOTICE warning message. 2002-12-12 16:14:32 +00:00
Derick Rethans
c4342de561 - MFB 2002-12-11 20:13:43 +00:00
Ilia Alshanetsky
30f83207fe Ask the user for their e-mail address so that we can contact them if need be. 2002-12-11 16:49:00 +00:00
Marcus Boerger
c7dc6c0e00 Move up general tests
# if MFH is needed should be decided by QA team: because the output # sequence changes
2002-11-23 16:57:25 +00:00
Marcus Boerger
d3e095004c Revert that unwanted debug thing - thanks to Sander Robol 2002-11-21 16:48:39 +00:00
Marcus Boerger
64e45b1287 Force showing the question 2002-11-21 15:09:45 +00:00
Marcus Boerger
b7cd48efdd Make it possible to test language features like newly introduced 'abstract'
independantly from debug mode.
2002-11-21 14:56:06 +00:00
Marcus Boerger
7ba0d505af Use eregi is better (noticed by Jon) 2002-11-15 16:33:05 +00:00
Marcus Boerger
0f66b352e9 -Allow skip in upper letters.
-Add 'info' result to --SKIPIF-- -> see following dba commits
2002-11-15 15:57:00 +00:00
Marcus Boerger
ea971db849 Show Zend version 2002-11-15 14:23:40 +00:00
Sander Roobol
8fb395bb9e Move the build-environment stuff down or the test results up, so you
don't need to scroll down to see the failed tests.
2002-11-15 10:37:41 +00:00
Marcus Boerger
5ad332f846 Add magic_quotes_runtime which affects several tests 2002-11-14 21:02:24 +00:00
Marcus Boerger
6048db9005 Only set the overwrites once 2002-11-14 20:12:36 +00:00
Ilia Alshanetsky
eef51c3d6b Disable safe_mode as it interferes with just about every test that needs
to access the file system, set enviroment variables or execute commands.
2002-11-14 18:38:19 +00:00
Melvyn Sopacua
138a1695f5 - Make it possible for people to save results and/or remove unwanted ENV
data.
- Use more options for the CC 'version' flag
2002-11-10 08:56:28 +00:00
Ilia Alshanetsky
7a552596a4 This option is needed if we need to track errors inside the skip condition. 2002-11-08 01:11:05 +00:00
Marcus Boerger
a71f734dec move the run-test tests to the top
#if one of these fails there is no need for further testing
2002-11-04 10:45:41 +00:00
Marcus Boerger
abdf302599 sort them 2002-11-04 10:09:42 +00:00
Marcus Boerger
604f333113 better use 'Off' here
#thx to Moriyoshi
2002-11-03 20:28:35 +00:00
Marcus Boerger
b0dac08dff without these nearly all tests fail if for example php.ini contains
output_handler=mb_string
mbstring.http_output=UCS-2LE
2002-11-03 17:43:24 +00:00
Marcus Boerger
388bf9f542 force showing progress of test 2002-11-03 17:40:34 +00:00
Ilia Alshanetsky
a078f6ecc6 Fixed ini argument parsing. We now support ini options with = in the argument,
such as the one being used in session test #21, which is once again working
properly.
2002-11-03 15:42:59 +00:00
Marcus Boerger
ee7f37ae58 pass params used for info call to skipif also
#try php.ini with
#output_handler=mb_string
#mbstring.http_output=UCS-2LE
2002-11-03 10:52:19 +00:00
Marcus Boerger
9e73bcaa33 copy paste error
#all these different versions here....
2002-11-02 22:06:03 +00:00
Marcus Boerger
29e8b92f22 -allow parameters to be directories
-"${dir}" -> $dir
2002-11-02 21:48:05 +00:00
Marcus Boerger
8b80515659 older versions do not have this functions 2002-11-02 12:55:06 +00:00
Marcus Boerger
22375de5e6 ws 2002-11-02 12:44:36 +00:00
Marcus Boerger
524994d9e2 this would break tests by modifying EXPECT sections
#it took a LONG time to realize that tests were ok but failed due to this ini
2002-11-02 12:33:24 +00:00
Marcus Boerger
ad414f28a9 -move -d stuff into function and update settings for info call 2002-11-01 13:03:30 +00:00
Derick Rethans
55a7590f3d Discuss first! 2002-10-31 14:01:58 +00:00
Yasuo Ohgaki
1fb8331fc0 Fixed more ini settings.
# Derick. Be responsible to your change and opinion.
# These are settings I know that should be set.
# There may be other settingis must be set to make
# run-tests.php work as expected.
2002-10-31 13:52:58 +00:00
Ilia Alshanetsky
6514fac1c0 Corrected my email address. 2002-10-30 18:36:39 +00:00
Marcus Boerger
fde7dffabd Enough discussion on display_erros it seems 2002-10-30 12:18:48 +00:00
Marcus Boerger
b968f90580 Get infos from php running tests not from php running run-test.php 2002-10-30 10:42:55 +00:00
Marcus Boerger
02d35d26cd better use array_diff_assoc
the old way resulted in erroneus .diff
2002-10-29 14:13:11 +00:00
Ilia Alshanetsky
47e1163e01 This patch addresses the bogus test failures due to error logging/reporting
confusion.
2002-10-28 18:48:07 +00:00
Marcus Boerger
e816c8b176 remove last line commited by error
revert log_errors
2002-10-28 18:21:09 +00:00
Marcus Boerger
35a3b071ad forgot 'error_log=' and 'report_memleaks=1'
#commenting on php-dev
2002-10-28 18:19:38 +00:00
Marcus Boerger
4440188510 forgot 'error_log=' and 'report_memleaks=1'
#commenting on php-dev
2002-10-28 17:17:50 +00:00
Shane Caraveo
3034c31934 windows will not have these, so dont bother, but add an OS to the stuff so that it makes sense why they are N/A 2002-10-28 02:00:56 +00:00
Shane Caraveo
c82c6263e8 fix getting ini values that contain the char =
fix command line quoting.  windows requires double quotes in order to handle & (in ini values) correctly
2002-10-28 01:43:54 +00:00
Marcus Boerger
4a2efd53bf allow default ini overwrites to be overwritten themselves in --INI--
#see followup on dev list
2002-10-28 00:07:11 +00:00
Marcus Boerger
cc4c0634fe -introduce EXPECTREGEX
-add %c for EXPECTF
#i think we must escape the special characters for EXPECTF: ".()" and such
2002-10-26 16:54:30 +00:00
Ilia Alshanetsky
ebd4182b2c The log_errors=1 breaks a number of tests and is useless for our purposes,
removing.
2002-10-25 17:24:09 +00:00
Marcus Boerger
0718785076 -improoved number detection
-display every error/warning only once
2002-10-24 18:14:39 +00:00
Ilia Alshanetsky
26617f8b5f Added failed test summary. 2002-10-24 13:13:23 +00:00
Jan Lehnardt
b2a8031144 - gcc prints -v information on stderr, make sure that we catch it anyway.
- I hope this does not cause problems with other compilers or shells. IMHO we
 - already rely on /bin/sh anyway, right?
2002-10-24 09:06:31 +00:00
Melvyn Sopacua
1de45a050c Implement 'no interaction' for automated tests
Implement exit status 1 to make actions for automated testing selectable

# Sorry Derick, was already working on this and the docs, see next commit
# and forthcoming email
2002-10-23 20:53:20 +00:00
Derick Rethans
6a1f477be9 [0.05]
- Disable html_errors in info sent
2002-10-23 20:13:42 +00:00
Jan Lehnardt
e96e0ae002 - use the cc that was detected by ./configure when determining version
information in run-tests.php
2002-10-23 17:56:42 +00:00
Marcus Boerger
69ce017d28 remove *.php file for EXPECTF tests, too. 2002-10-23 12:54:57 +00:00
Jan Lehnardt
70251bcac0 - be more verbose 2002-10-23 08:51:17 +00:00
Stefan Esser
e83ca7dc85 fix make test for an external build dir setup 2002-10-22 18:53:56 +00:00
Marcus Boerger
8312f1443c Give back the php file and leave it in case test fails. 2002-10-22 08:54:23 +00:00
Moriyoshi Koizumi
a26a849bb3 Fixed typo. 2002-10-21 10:23:31 +00:00