Commit Graph

307 Commits

Author SHA1 Message Date
foobar
bbe98a88f3 revert 2005-03-18 22:09:31 +00:00
foobar
1524d4890f Fix stupid typos 2005-03-18 21:59:59 +00:00
foobar
ebb8d72d88 Fix errors with -d having a check for invalid ini entries 2005-03-18 21:59:06 +00:00
Magnus M��tt�
27c43d5991 Since in_array is case sensitive we need to convert the names to lowercase
otherwise it won't run tests for extensions where the case of the name differ from the
extension name.
2005-03-09 04:23:02 +00:00
Wez Furlong
b38f21b99c let the test-suite run from an alternate build dir 2005-02-26 15:23:10 +00:00
Marcus Boerger
d02a2df3f0 - Use PHP not C semantics 2005-02-23 01:16:21 +00:00
foobar
91ea475f4d - Fixed bug #29136 (make test - libtool failure on MacOSX) 2005-01-19 01:30:23 +00:00
foobar
ce742b08b0 - Fix typo (avaliable -> available). (bug #28725) 2004-12-16 12:34:32 +00:00
Ilia Alshanetsky
35540fdee6 Added -d option which allows ini options to be specified via command line.
Patch by: Sean Coates
2004-12-06 23:37:20 +00:00
Ilia Alshanetsky
0e46666591 Save test result file inside the build directory. 2004-11-28 20:40:16 +00:00
Ilia Alshanetsky
479af1e75d Fixed bug #30249 (Incorrect timeout check). 2004-09-27 17:30:46 +00:00
Christian Stocker
7b292e2fba Fix for Bug 29010 "make test does not wait to email address" (by Sebastian Nohn) 2004-07-21 11:19:09 +00:00
Ilia Alshanetsky
190227899a Turn off session.auto_start to prevent test failures. 2004-05-26 18:23:21 +00:00
Marcus Boerger
6f699cea5f Bugfix #28229 (PATCH run-tests tripped up by spaces in names) 2004-04-30 08:18:54 +00:00
Ilia Alshanetsky
8ecdc90763 Fixed generate_array_diff(). 2004-03-30 23:58:47 +00:00
Jan Lehnardt
775387e32d - be more verbose 2004-03-29 07:49:32 +00:00
Marcus Boerger
4da754e868 Add ability to pass -n to the executed php 2004-03-28 23:04:53 +00:00
Marcus Boerger
0019c60902 Show progress 2004-03-28 14:12:14 +00:00
Marcus Boerger
e1127cb514 Make run-tests.php work with xdebug being loaded.
# Lots of ppl use that as a built-in extension already.
2004-03-09 14:39:35 +00:00
Ilia Alshanetsky
a0664d54d1 Fixed division by zero warning. 2004-01-16 15:17:37 +00:00
foobar
ccfc46b0aa - Happy new year and PHP 5 for rest of the files too..
# Should the LICENSE and Zend/LICENSE dates be updated too?
2004-01-08 17:33:29 +00:00
Marcus Boerger
a572d79e0a Fix data source 2003-12-29 22:18:40 +00:00
Marcus Boerger
d001928aa2 Align output if one section shows 100% and display percentages when not
counting skipped tests.
2003-12-29 16:07:08 +00:00
Ilia Alshanetsky
bdc30961d0 Properly detect bundled libtool when PHP is built in a separate directory.
Detect version of system libtool, which is used by phpize.
2003-12-23 18:20:46 +00:00
Derick Rethans
f7b3e30fe1 - Remove debug info :) 2003-12-16 15:00:24 +00:00
Derick Rethans
76ec811b35 - Added %e modifier which gets replaced by the current value of
DIRECTORY_SEPARATOR.
2003-12-16 14:53:43 +00:00
Wez Furlong
c92a2219ef Add optional array argument to proc_open() to specify additional
options for the child process.
The first option is "suppress_errors" which will disable any
dialog boxes that arise from missing DLL's and suppress the
GPF dialog.
Use this new feature in the test suite, so that crashing tests don't block the test run; useful for un-attended execution.
2003-12-05 13:45:00 +00:00
Marcus Boerger
c3fddcab62 Fix tests for E_STRICT and check for E_STRICT in run-tests.php. 2003-11-30 13:57:20 +00:00
Marcus Boerger
3cb67f1719 This check is no longer needed (Andrei) 2003-10-02 18:11:10 +00:00
Marcus Boerger
3658ad4c3f Update necessary test INIs 2003-09-04 14:41:10 +00:00
Moriyoshi Koizumi
8fe4a53877 Ensure CGI binary works like CLI.
# This kind of mess should be removed if other better way is found.
2003-08-11 20:02:05 +00:00
Marcus Boerger
2a13d3f9f7 Simplify 2003-08-10 11:46:03 +00:00
foobar
726eb46767 CS fix 2003-08-10 04:23:02 +00:00
Marcus Boerger
e62926dd5b Better diffing 2003-08-09 20:02:02 +00:00
Marcus Boerger
06b089d63b Complain about borked tests instead of spitting out errors 2003-08-09 17:21:19 +00:00
Marcus Boerger
fe37ce8f66 Don't show matching regex as different 2003-08-09 11:57:02 +00:00
Zeev Suraski
9ff7dff10d Shorten output to prevent messup 2003-08-05 08:39:01 +00:00
Zeev Suraski
fec3fc9331 Remove non-standard vim6 option 2003-08-05 08:32:58 +00:00
Zeev Suraski
0770772385 Display the currently running test 2003-08-05 08:31:56 +00:00
Moriyoshi Koizumi
9fe5094d77 Fix run-test.php so it can correctly handle skip conditions. 2003-07-25 05:51:57 +00:00
Ilia Alshanetsky
64d6421885 When encountering a test that users GET/POST make run-tests.php use CGI
sapi if it is avaliable.
If CLI sapi is not avaliable print a clear error when make test is executed.
2003-07-24 17:44:16 +00:00
James Cox
f68c7ff249 updating license information in the headers. 2003-06-10 20:04:29 +00:00
Marcus Boerger
070803a482 Allow optional directories 2003-06-01 18:34:03 +00:00
Marcus Boerger
7ad9732a94 MFB: This is needed though 2003-05-31 14:10:27 +00:00
Marcus Boerger
aa87c89d35 MFB: Showing info/warning once is enough 2003-05-31 12:14:41 +00:00
Marcus Boerger
bbc3c6089b Add php_uname() to output 2003-05-30 12:41:51 +00:00
Marcus Boerger
23e5004132 Execute --SKIPIF-- like --FILE-- 2003-05-29 19:11:51 +00:00
Marcus Boerger
4980461081 Executing tests once is enough 2003-05-23 22:35:15 +00:00
Marcus Boerger
2537e01c77 Allow writing a list of failed tests.
# use php run-tests.php -h for more.
2003-05-23 22:01:38 +00:00
Marcus Boerger
8cd4933d31 Add warning level for tests.
# You set a test to warning by return "warn <description>" from
# the --SKIPIF-- section. But this only works when you supply
# a reason why it is only a warning.
# Warnings are not called for FAILed tests of corse and hence a
# test result with not FAIL but SKIP/PASS/WARN results is mailed
# as a PASS.
2003-05-23 20:51:09 +00:00
Marcus Boerger
57046f4e3e MFB: info in mail too 2003-05-17 23:58:03 +00:00
Marcus Boerger
1939d27aca The env-var TEST_PHP_EXECUTABLE is needed in tests 2003-04-19 17:22:53 +00:00
Marcus Boerger
f97f219fa7 Include ldd output 2003-04-05 12:16:29 +00:00
Marcus Boerger
d94c98c3f2 if TEST_PHP_EXECUTABLE=auto then use ./sapi/cli/php 2003-03-30 14:38:48 +00:00
Derick Rethans
56a172cc04 - Add the exponent to the float modifier 2003-03-28 21:04:45 +00:00
James Cox
485ee3914a updating for new list 2003-03-21 17:17:54 +00:00
Stig Bakken
0e6fca4f22 * email address change 2003-03-18 12:06:09 +00:00
foobar
9f3a46a12e Be sure we get the correct version.. 2003-03-17 12:43:29 +00:00
foobar
908a942a38 added the version info to be send as-is to buildtest-process 2003-03-17 12:24:09 +00:00
Marcus Boerger
9a6db15d21 summary for selective tests if more than one
# maybe i'll change to present summary only when at least one dir selected
2003-03-08 16:28:35 +00:00
Marcus Boerger
3981be30a8 do not use $GLOBAL[] 2003-03-04 19:32:06 +00:00
Marcus Boerger
cbb3e6fd2f fix problem in current HEAD
# strange why on earth does $GLOBALS['cwd'] produce a warning here?
# however we already have a global declarations so we use it for cwd, too.
2003-03-02 15:12:12 +00:00
Derick Rethans
0799d2db84 - Add check for proc_open() being available 2003-02-18 20:07:59 +00:00
Wez Furlong
0a18a9d744 A add much more useful select(2) implementation than is provided by
windows sockets.  The winsock implementation will only work with sockets;
our implementation works with sockets and file descriptors.
By association, stream_select() will now operate correctly with files, pipes and sockets.

This change required linking against the winsock2 library.  In terms of
compatibility, only older versions of windows 95 do not have winsock2
installed by default.  It is available as a redistributable file, and is most likely installed by any OS patches (eg: Internet Explorer) applied by the user.

Also, add a win32 compatible pipe test when opening a stream from a pipe.  This test will only work on NT, win2k and XP platforms.  Without this test, interleaved fread() and select() calls would cause the read buffer to be clobbered.  I will be working on a fix for this issue for win9x.
2003-02-16 03:48:49 +00:00
Wez Furlong
e035fe14e0 If a test does not have any data after 60 seconds of waiting, assume that
it died a horrible death and kill it.
This is useful on windows when a message box is popped-up during an automated
test-run.
2003-02-15 18:09:52 +00:00
Derick Rethans
db0897161c - Make VIM highlighting happy 2003-02-03 12:14:13 +00:00
Melvyn Sopacua
c4eecf9199 Make it easier to diff results of several runs in one day. 2003-02-01 13:28:32 +00:00
Marcus Boerger
494bec466b Simplify 2003-01-26 17:17:44 +00:00
Marcus Boerger
a7d10f8aa4 Bug #21751: Part one never let this happen again... 2003-01-25 19:45:11 +00:00
Jan Lehnardt
c98f4e9f32 - fix typo 2003-01-12 11:42:29 +00:00
Ilia Alshanetsky
b1fab873c2 Added a check for availability of PCRE extension needed by test-suite. 2003-01-07 15:21:34 +00:00
Melvyn Sopacua
e03bccb1ad Delete some security related env variables 2002-12-22 12:48:49 +00:00
Melvyn Sopacua
a4d56067e2 MFB: libtool detection 2002-12-20 00:28:08 +00:00
Derick Rethans
8507eb00f6 - Also send reports when there are no failed tests 2002-12-17 19:07:15 +00:00
Ilia Alshanetsky
2d8945247b Fix a possible E_NOTICE warning message. 2002-12-12 16:14:32 +00:00
Derick Rethans
c4342de561 - MFB 2002-12-11 20:13:43 +00:00
Ilia Alshanetsky
30f83207fe Ask the user for their e-mail address so that we can contact them if need be. 2002-12-11 16:49:00 +00:00
Marcus Boerger
c7dc6c0e00 Move up general tests
# if MFH is needed should be decided by QA team: because the output # sequence changes
2002-11-23 16:57:25 +00:00
Marcus Boerger
d3e095004c Revert that unwanted debug thing - thanks to Sander Robol 2002-11-21 16:48:39 +00:00
Marcus Boerger
64e45b1287 Force showing the question 2002-11-21 15:09:45 +00:00
Marcus Boerger
b7cd48efdd Make it possible to test language features like newly introduced 'abstract'
independantly from debug mode.
2002-11-21 14:56:06 +00:00
Marcus Boerger
7ba0d505af Use eregi is better (noticed by Jon) 2002-11-15 16:33:05 +00:00
Marcus Boerger
0f66b352e9 -Allow skip in upper letters.
-Add 'info' result to --SKIPIF-- -> see following dba commits
2002-11-15 15:57:00 +00:00
Marcus Boerger
ea971db849 Show Zend version 2002-11-15 14:23:40 +00:00
Sander Roobol
8fb395bb9e Move the build-environment stuff down or the test results up, so you
don't need to scroll down to see the failed tests.
2002-11-15 10:37:41 +00:00
Marcus Boerger
5ad332f846 Add magic_quotes_runtime which affects several tests 2002-11-14 21:02:24 +00:00
Marcus Boerger
6048db9005 Only set the overwrites once 2002-11-14 20:12:36 +00:00
Ilia Alshanetsky
eef51c3d6b Disable safe_mode as it interferes with just about every test that needs
to access the file system, set enviroment variables or execute commands.
2002-11-14 18:38:19 +00:00
Melvyn Sopacua
138a1695f5 - Make it possible for people to save results and/or remove unwanted ENV
data.
- Use more options for the CC 'version' flag
2002-11-10 08:56:28 +00:00
Ilia Alshanetsky
7a552596a4 This option is needed if we need to track errors inside the skip condition. 2002-11-08 01:11:05 +00:00
Marcus Boerger
a71f734dec move the run-test tests to the top
#if one of these fails there is no need for further testing
2002-11-04 10:45:41 +00:00
Marcus Boerger
abdf302599 sort them 2002-11-04 10:09:42 +00:00
Marcus Boerger
604f333113 better use 'Off' here
#thx to Moriyoshi
2002-11-03 20:28:35 +00:00
Marcus Boerger
b0dac08dff without these nearly all tests fail if for example php.ini contains
output_handler=mb_string
mbstring.http_output=UCS-2LE
2002-11-03 17:43:24 +00:00
Marcus Boerger
388bf9f542 force showing progress of test 2002-11-03 17:40:34 +00:00
Ilia Alshanetsky
a078f6ecc6 Fixed ini argument parsing. We now support ini options with = in the argument,
such as the one being used in session test #21, which is once again working
properly.
2002-11-03 15:42:59 +00:00
Marcus Boerger
ee7f37ae58 pass params used for info call to skipif also
#try php.ini with
#output_handler=mb_string
#mbstring.http_output=UCS-2LE
2002-11-03 10:52:19 +00:00
Marcus Boerger
9e73bcaa33 copy paste error
#all these different versions here....
2002-11-02 22:06:03 +00:00
Marcus Boerger
29e8b92f22 -allow parameters to be directories
-"${dir}" -> $dir
2002-11-02 21:48:05 +00:00
Marcus Boerger
8b80515659 older versions do not have this functions 2002-11-02 12:55:06 +00:00
Marcus Boerger
22375de5e6 ws 2002-11-02 12:44:36 +00:00
Marcus Boerger
524994d9e2 this would break tests by modifying EXPECT sections
#it took a LONG time to realize that tests were ok but failed due to this ini
2002-11-02 12:33:24 +00:00
Marcus Boerger
ad414f28a9 -move -d stuff into function and update settings for info call 2002-11-01 13:03:30 +00:00
Derick Rethans
55a7590f3d Discuss first! 2002-10-31 14:01:58 +00:00
Yasuo Ohgaki
1fb8331fc0 Fixed more ini settings.
# Derick. Be responsible to your change and opinion.
# These are settings I know that should be set.
# There may be other settingis must be set to make
# run-tests.php work as expected.
2002-10-31 13:52:58 +00:00
Ilia Alshanetsky
6514fac1c0 Corrected my email address. 2002-10-30 18:36:39 +00:00
Marcus Boerger
fde7dffabd Enough discussion on display_erros it seems 2002-10-30 12:18:48 +00:00
Marcus Boerger
b968f90580 Get infos from php running tests not from php running run-test.php 2002-10-30 10:42:55 +00:00
Marcus Boerger
02d35d26cd better use array_diff_assoc
the old way resulted in erroneus .diff
2002-10-29 14:13:11 +00:00
Ilia Alshanetsky
47e1163e01 This patch addresses the bogus test failures due to error logging/reporting
confusion.
2002-10-28 18:48:07 +00:00
Marcus Boerger
e816c8b176 remove last line commited by error
revert log_errors
2002-10-28 18:21:09 +00:00
Marcus Boerger
35a3b071ad forgot 'error_log=' and 'report_memleaks=1'
#commenting on php-dev
2002-10-28 18:19:38 +00:00
Marcus Boerger
4440188510 forgot 'error_log=' and 'report_memleaks=1'
#commenting on php-dev
2002-10-28 17:17:50 +00:00
Shane Caraveo
3034c31934 windows will not have these, so dont bother, but add an OS to the stuff so that it makes sense why they are N/A 2002-10-28 02:00:56 +00:00
Shane Caraveo
c82c6263e8 fix getting ini values that contain the char =
fix command line quoting.  windows requires double quotes in order to handle & (in ini values) correctly
2002-10-28 01:43:54 +00:00
Marcus Boerger
4a2efd53bf allow default ini overwrites to be overwritten themselves in --INI--
#see followup on dev list
2002-10-28 00:07:11 +00:00
Marcus Boerger
cc4c0634fe -introduce EXPECTREGEX
-add %c for EXPECTF
#i think we must escape the special characters for EXPECTF: ".()" and such
2002-10-26 16:54:30 +00:00
Ilia Alshanetsky
ebd4182b2c The log_errors=1 breaks a number of tests and is useless for our purposes,
removing.
2002-10-25 17:24:09 +00:00
Marcus Boerger
0718785076 -improoved number detection
-display every error/warning only once
2002-10-24 18:14:39 +00:00
Ilia Alshanetsky
26617f8b5f Added failed test summary. 2002-10-24 13:13:23 +00:00
Jan Lehnardt
b2a8031144 - gcc prints -v information on stderr, make sure that we catch it anyway.
- I hope this does not cause problems with other compilers or shells. IMHO we
 - already rely on /bin/sh anyway, right?
2002-10-24 09:06:31 +00:00
Melvyn Sopacua
1de45a050c Implement 'no interaction' for automated tests
Implement exit status 1 to make actions for automated testing selectable

# Sorry Derick, was already working on this and the docs, see next commit
# and forthcoming email
2002-10-23 20:53:20 +00:00
Derick Rethans
6a1f477be9 [0.05]
- Disable html_errors in info sent
2002-10-23 20:13:42 +00:00
Jan Lehnardt
e96e0ae002 - use the cc that was detected by ./configure when determining version
information in run-tests.php
2002-10-23 17:56:42 +00:00
Marcus Boerger
69ce017d28 remove *.php file for EXPECTF tests, too. 2002-10-23 12:54:57 +00:00
Jan Lehnardt
70251bcac0 - be more verbose 2002-10-23 08:51:17 +00:00
Stefan Esser
e83ca7dc85 fix make test for an external build dir setup 2002-10-22 18:53:56 +00:00
Marcus Boerger
8312f1443c Give back the php file and leave it in case test fails. 2002-10-22 08:54:23 +00:00
Moriyoshi Koizumi
a26a849bb3 Fixed typo. 2002-10-21 10:23:31 +00:00
Moriyoshi Koizumi
cd410cbf9f \s cannot be used with ereg() 2002-10-21 10:22:41 +00:00
Sander Roobol
988c355720 The results of each test should go on a single line 2002-10-21 09:04:56 +00:00
Derick Rethans
8e9f83add2 - Stijl polizei 2002-10-21 08:55:49 +00:00
Melvyn Sopacua
7bb87c31f8 Adds a 'reason' for skipping a test.
# See modifications on ext/xml/tests/007.phpt for example
2002-10-21 08:52:45 +00:00
Derick Rethans
ca1e7301ab - Added %x for HEX chars
- Added %d as alias for %i (too much C here :)
- Added beginning and end markers to regexp
2002-10-18 20:34:41 +00:00
Derick Rethans
03cc839d90 - Removing debugging info 2002-10-17 14:07:32 +00:00
Ilia Alshanetsky
8c6a49f001 Fixed a bug in the calculation of the POST request length. 2002-10-15 16:46:57 +00:00
Yasuo Ohgaki
e6bcb07c75 Fixed warnings 2002-10-14 09:32:36 +00:00
Derick Rethans
2b34f26b33 - Added the TEST_PHP_USER environment variable with which you can specify
additional directories with tests to run. This is ideal for having your own
  test suite on your system. You can specify more directories by seperating them
  with a ",", for example:

  TEST_PHP_USER=/dat/dev/xdebug/tests,/dat/dev/srm/tests make test
2002-10-14 07:18:23 +00:00
Derick Rethans
e17d6518b1 - woohooo! Automatic build test submits! 2002-10-12 19:29:56 +00:00
Melvyn Sopacua
b5676a5b3e When you say string, match at least one char in EXPECTF section
Plus a little protection against globbing like ext/foo/tests/* or worse.

# yes, I've done that
2002-10-10 16:08:15 +00:00
Derick Rethans
4fcc3df5eb - Fix .exp output 2002-10-08 17:51:57 +00:00
Derick Rethans
f830c481f3 - Show easier parseable and greppable output 2002-10-08 08:53:51 +00:00
Derick Rethans
ede9bd58b7 - Use getenv, as $_ENV is not available when variables_order= in php.ini
does not include "E".
2002-10-08 08:39:10 +00:00
Derick Rethans
d53dd88854 - Drop requirement for php.ini-dist
- Adjust test script to hard code ini settings
2002-10-08 07:49:36 +00:00
foobar
9a010becf1 ws fixes 2002-10-08 03:00:06 +00:00
Sander Roobol
35dc97df3b Temporary (?) workaround (?) for is_executable() on Windows. 2002-10-07 15:16:47 +00:00
Melvyn Sopacua
bcddd58a92 Add --EXPECTF-- section: 'sprintf' for EXPECT sections. See for usage
example ext/xslt/tests/009.phpt.
# To aid debugging, a little commented section is left in, this can be
# stripped in due time, or properly integrated with some --debugging flag.
# But it's quite useful, when you make such tests.
2002-10-07 00:05:20 +00:00
Rasmus Lerdorf
f32d63a3b3 Add php_ini_scanned_files() so "make test" can tell you when you have
additional .ini files that are scanned.
2002-10-06 17:04:10 +00:00
Marcus Boerger
2e90bbe3c2 Return to old counting where every test is counted (even those of skipped
extensions). Inform about the number of extensions tested and skipped.
This makes the test summary more compareable.

Maybe i'll add a parameter/env-var to skip extension tests. That way we
could fasten tests for changes in the core. But it has to wait some days.
2002-10-04 21:19:51 +00:00
Marcus Boerger
ad120d2e28 $val not in first param to sprintf 2002-10-03 18:25:30 +00:00