php-src/Zend
Alex Dowad 80598f1250 Syntax errors caused by unclosed {, [, ( mention specific location
Aside from a few very specific syntax errors for which detailed exceptions are
thrown, generally PHP just emits the default error messages generated by bison on syntax
error. These messages are very uninformative; they just say "Unexpected ... at line ...".

This is most problematic with constructs which can span an arbitrary number of lines, such
as blocks of code delimited by { }, 'if' conditions delimited by ( ), and so on. If a closing
delimiter is missed, the block will run for the entire remainder of the source file (which
could be thousands of lines), and then at the end, a parse error will be thrown with the
dreaded words: "Unexpected end of file".

Therefore, track the positions of opening and closing delimiters and ensure that they match
up correctly. If any mismatch or missing delimiter is detected, immediately throw a parse
error which points the user to the offending line. This is best done in the *lexer* and not
in the parser.

Thanks to Nikita Popov and George Peter Banyard for suggesting improvements.

Fixes bug #79368.
Closes GH-5364.
2020-04-14 11:22:23 +02:00
..
tests Syntax errors caused by unclosed {, [, ( mention specific location 2020-04-14 11:22:23 +02:00
bench.php Apply tidy formatting 2020-02-03 13:41:31 +01:00
LICENSE
Makefile.frag Clean up the generation of the parsers 2020-02-01 14:21:53 +01:00
micro_bench.php Apply tidy formatting 2020-02-03 13:41:31 +01:00
README.md [ci skip] Join Zend engine docs-alike files to readme 2019-05-18 20:39:18 +02:00
zend_alloc_sizes.h
zend_alloc.c Merge branch 'PHP-7.4' 2020-02-27 12:28:09 +03:00
zend_alloc.h fix cross compilation failure due to size_t typecast in define 2020-01-30 15:51:54 +01:00
zend_API.c Export the zend_string_concat3() API 2020-04-09 15:06:53 +02:00
zend_API.h Generate method entries from stubs for a couple of extensions 2020-04-11 13:28:53 +02:00
zend_arena.h Add tracked arena allocator 2019-06-28 12:44:18 +02:00
zend_ast.c Handle static return type in AST printer 2020-02-19 09:45:41 +01:00
zend_ast.h Implement union types 2019-11-08 15:15:48 +01:00
zend_bitset.h
zend_build.h
zend_builtin_functions_arginfo.h Store default parameter values of internal functions in arg info 2020-04-08 18:37:51 +02:00
zend_builtin_functions.c Fix #79462: method_exists and property_exists incoherent behavior 2020-04-09 11:38:47 +02:00
zend_builtin_functions.h
zend_builtin_functions.stub.php Promote some warnings to Errors in Zend basic functions 2020-03-31 16:32:58 +02:00
zend_closures_arginfo.h Add Zend class/interface arginfo stubs 2019-10-15 16:21:00 +02:00
zend_closures.c Store aliased name of trait method 2020-03-03 11:55:48 +01:00
zend_closures.h
zend_closures.stub.php Add missing visibility modifiers in stubs 2020-04-11 10:23:51 +02:00
zend_compile.c Export the zend_string_concat3() API 2020-04-09 15:06:53 +02:00
zend_compile.h Store default parameter values of internal functions in arg info 2020-04-08 18:37:51 +02:00
zend_config.w32.h Drop duplicate definitions of zend_isnan and friends 2019-12-08 14:55:26 +01:00
zend_constants.c Don't index NULL pointer when fetching non-existent constant 2020-01-28 11:20:57 +01:00
zend_constants.h Add support for deprecating constants 2020-01-17 10:05:06 +01:00
zend_cpuinfo.c
zend_cpuinfo.h Merge branch 'PHP-7.4' 2019-07-01 09:44:53 +02:00
zend_default_classes.c zend_weakrefs 2019-03-12 00:35:35 +01:00
zend_dtrace.c
zend_dtrace.d
zend_dtrace.h
zend_errors.h Use clean shutdown on uncaught exception 2019-10-11 12:41:15 +02:00
zend_exceptions_arginfo.h Store default parameter values of internal functions in arg info 2020-04-08 18:37:51 +02:00
zend_exceptions.c Define Stringable with __toString():string method 2020-03-02 15:25:32 +01:00
zend_exceptions.h add ValueError 2019-09-09 21:06:00 +01:00
zend_exceptions.stub.php Add missing visibility modifiers in stubs 2020-04-11 10:23:51 +02:00
zend_execute_API.c Fix [-Werror=missing-braces] compiler warning 2020-04-13 23:03:31 +02:00
zend_execute.c Merge branch 'PHP-7.3' into PHP-7.4 2020-04-02 16:34:21 +02:00
zend_execute.h Make type error messages more consistent 2020-02-17 14:22:17 +01:00
zend_extensions.c
zend_extensions.h Free two bits in fn_flags by merging ZEND_ACC_HEAP_RT_CACHE/ZEND_ACC_USER_ARG_INFO and ZEND_ACC_DONE_PASS_TWO/ZEND_ACC_ARENA_ALLOCATED that may be used only for user/internal functions 2019-09-02 14:05:28 +03:00
zend_float.c
zend_float.h Fix typos in code comments in Zend/ [skip ci] 2019-02-18 17:56:28 +01:00
zend_gc.c Handle reallocated root buffer during GC destroy phase (v2) 2019-11-23 10:45:20 -05:00
zend_gc.h Set expectation to reduce hot code fragmentation 2019-07-10 18:29:35 +03:00
zend_gdb.c Both readlink args should not point to the same buffer 2019-04-15 15:55:00 +02:00
zend_gdb.h Change to php.net mail address 2019-04-08 17:16:07 +08:00
zend_generators_arginfo.h Add union return types for function stubs 2019-11-11 14:54:55 +01:00
zend_generators.c Merge branch 'PHP-7.4' 2020-04-09 10:35:50 +02:00
zend_generators.h
zend_generators.stub.php Add missing visibility modifiers in stubs 2020-04-11 10:23:51 +02:00
zend_globals_macros.h Implemented a faster way to access predefined TSRM resources - CG(), EG(), etc. 2019-03-14 03:01:01 +03:00
zend_globals.h Syntax errors caused by unclosed {, [, ( mention specific location 2020-04-14 11:22:23 +02:00
zend_hash.c Merge branch 'PHP-7.4' 2020-03-11 08:57:17 +01:00
zend_hash.h Use separate typedef for bucket comparison function 2020-03-04 12:46:06 +01:00
zend_highlight.c Revert "Switch to bison location tracking" 2019-03-28 09:29:08 +01:00
zend_highlight.h Constify some char* arguments or return values of ZEND_API 2019-06-12 16:49:32 +02:00
zend_inheritance.c Improve the default value format in incompatible signature error messages 2020-04-10 22:50:33 +02:00
zend_inheritance.h Merge branch 'PHP-7.4' 2019-09-12 16:41:45 +02:00
zend_ini_parser.y Clean up the generation of the parsers 2020-02-01 14:21:53 +01:00
zend_ini_scanner.h
zend_ini_scanner.l Fixed bug #79244 (php crashes during parsing INI file). (Laruence) 2020-02-10 13:01:51 +08:00
zend_ini.c Use separate typedef for bucket comparison function 2020-03-04 12:46:06 +01:00
zend_ini.h Use strlen for INI_* macros 2020-02-17 11:11:14 +01:00
zend_interfaces_arginfo.h Define Stringable with __toString():string method 2020-03-02 15:25:32 +01:00
zend_interfaces.c Fixed bug #62609: Allow implementing Traversable in abstract class 2020-03-06 11:12:43 +01:00
zend_interfaces.h Define Stringable with __toString():string method 2020-03-02 15:25:32 +01:00
zend_interfaces.stub.php Add missing visibility modifiers in stubs 2020-04-11 10:23:51 +02:00
zend_istdiostream.h
zend_iterators.c Fix [-Wmissing-field-initializers] compiler warning in zend_iterator 2020-02-10 11:46:19 +01:00
zend_iterators.h
zend_language_parser.y Add static return type 2020-02-17 11:51:09 +01:00
zend_language_scanner.h Syntax errors caused by unclosed {, [, ( mention specific location 2020-04-14 11:22:23 +02:00
zend_language_scanner.l Syntax errors caused by unclosed {, [, ( mention specific location 2020-04-14 11:22:23 +02:00
zend_list.c Merge branch 'PHP-7.4' 2019-06-25 14:30:24 +02:00
zend_list.h Fix stream leak in phar cache_list 2019-06-25 14:28:58 +02:00
zend_llist.c
zend_llist.h
zend_long.h
zend_map_ptr.h Perform map ptr base arithmetic through uintptr_t 2020-01-28 11:24:04 +01:00
zend_modules.h Free two bits in fn_flags by merging ZEND_ACC_HEAP_RT_CACHE/ZEND_ACC_USER_ARG_INFO and ZEND_ACC_DONE_PASS_TWO/ZEND_ACC_ARENA_ALLOCATED that may be used only for user/internal functions 2019-09-02 14:05:28 +03:00
zend_multibyte.c
zend_multibyte.h
zend_multiply.h
zend_object_handlers.c Make cast_object handler required 2020-03-31 14:37:49 +02:00
zend_object_handlers.h Make cast_object handler required 2020-03-31 14:37:49 +02:00
zend_objects_API.c Remove delref in free_object_storage 2019-08-28 17:04:36 +02:00
zend_objects_API.h Use ZEND_TYPE_IS_SET() when checking for property types 2019-09-23 16:53:54 +02:00
zend_objects.c Merge branch 'PHP-7.4' 2019-10-25 16:32:14 +02:00
zend_objects.h
zend_opcode.c Store aliased name of trait method 2020-03-03 11:55:48 +01:00
zend_operators.c Avoid control flow warning 2020-04-02 10:54:32 +02:00
zend_operators.h Remove op_func from TRY_BINARY_OP1 macro 2020-04-01 10:15:03 +02:00
zend_portability.h Revert "Merge branch 'PHP-7.4'" 2020-01-23 13:12:16 +01:00
zend_ptr_stack.c
zend_ptr_stack.h
zend_range_check.h
zend_signal.c Merge branch 'PHP-7.3' into PHP-7.4 2019-07-29 17:14:40 +02:00
zend_signal.h Remove HAVE_SIGNAL_H 2019-04-07 15:55:34 +02:00
zend_smart_str_public.h Remove mention of PHP major version in Copyright headers 2019-09-25 14:51:43 +02:00
zend_smart_str.c Remove mention of PHP major version in Copyright headers 2019-09-25 14:51:43 +02:00
zend_smart_str.h Remove mention of PHP major version in Copyright headers 2019-09-25 14:51:43 +02:00
zend_smart_string_public.h Remove mention of PHP major version in Copyright headers 2019-09-25 14:51:43 +02:00
zend_smart_string.h Remove mention of PHP major version in Copyright headers 2019-09-25 14:51:43 +02:00
zend_sort.c
zend_sort.h
zend_stack.c
zend_stack.h
zend_stream.c Fixed bug #78340 2019-07-29 10:07:12 +02:00
zend_stream.h Revert "Drop free_filename field from zend_file_handle" 2019-07-24 10:43:37 +02:00
zend_string.c Export the zend_string_concat3() API 2020-04-09 15:06:53 +02:00
zend_string.h Export the zend_string_concat3() API 2020-04-09 15:06:53 +02:00
zend_strtod_int.h
zend_strtod.c Revert "Merge branch 'PHP-7.4'" 2020-01-23 13:12:16 +01:00
zend_strtod.h
zend_ts_hash.c Use separate typedef for bucket comparison function 2020-03-04 12:46:06 +01:00
zend_ts_hash.h Use separate typedef for bucket comparison function 2020-03-04 12:46:06 +01:00
zend_type_info.h Add static return type 2020-02-17 11:51:09 +01:00
zend_types.h Fix [-Werror=missing-braces] compiler warning 2020-04-13 23:03:31 +02:00
zend_variables.c
zend_variables.h
zend_virtual_cwd.c Remove HAVE_REALPATH checks 2020-03-26 11:46:00 +01:00
zend_virtual_cwd.h Remove mention of PHP major version in Copyright headers 2019-09-25 14:51:43 +02:00
zend_vm_def.h Improve undefined variable error messages 2020-03-31 13:02:32 +02:00
zend_vm_execute.h Improve undefined variable error messages 2020-03-31 13:02:32 +02:00
zend_vm_execute.skl Revert "Merge branch 'PHP-7.4'" 2020-01-23 13:12:16 +01:00
zend_vm_gen.php Remove spurious const qualifier from function return type 2020-02-06 11:59:52 +01:00
zend_vm_handlers.h Revert "Fetch for read in nested property assignments" 2020-03-18 14:54:43 +01:00
zend_vm_opcodes.c Revert "Fetch for read in nested property assignments" 2020-03-18 14:54:43 +01:00
zend_vm_opcodes.h Throw Error when writing property of non-object 2019-09-27 10:11:47 +02:00
zend_vm_trace_handlers.h
zend_vm_trace_map.h
zend_vm.h
zend_weakrefs_arginfo.h Implement WeakMap 2020-01-03 10:43:24 +01:00
zend_weakrefs.c Implement WeakMap 2020-01-03 10:43:24 +01:00
zend_weakrefs.h Remove mention of PHP major version in Copyright headers 2019-09-25 14:51:43 +02:00
zend_weakrefs.stub.php Implement WeakMap 2020-01-03 10:43:24 +01:00
zend.c Merge branch 'PHP-7.4' 2020-03-13 11:42:07 +03:00
zend.h Next is 7.3.18 2020-03-31 10:22:55 +02:00
Zend.m4 Remove obsolete configure checks for isinf, isnan, and isfinite 2019-12-04 15:17:57 +01:00

Zend Engine

Zend memory manager

General

The goal of the new memory manager (available since PHP 5.2) is to reduce memory allocation overhead and speedup memory management.

Debugging

Normal:

sapi/cli/php -r 'leak();'

Zend MM disabled:

USE_ZEND_ALLOC=0 valgrind --leak-check=full sapi/cli/php -r 'leak();'

Shared extensions

Since PHP 5.3.11 it is possible to prevent shared extensions from unloading so that valgrind can correctly track the memory leaks in shared extensions. For this there is the ZEND_DONT_UNLOAD_MODULES environment variable. If set, then DL_UNLOAD() is skipped during the shutdown of shared extensions.

ZEND_VM

ZEND_VM architecture allows specializing opcode handlers according to op_type fields and using different execution methods (call threading, switch threading and direct threading). As a result ZE2 got more than 20% speedup on raw PHP code execution (with specialized executor and direct threading execution method). As in most PHP applications raw execution speed isn't the limiting factor but system calls and database calls are, your mileage with this patch will vary.

Most parts of the old zend_execute.c go into zend_vm_def.h. Here you can find opcode handlers and helpers. The typical opcode handler template looks like this:

ZEND_VM_HANDLER(<OPCODE-NUMBER>, <OPCODE>, <OP1_TYPES>, <OP2_TYPES>)
{
    <HANDLER'S CODE>
}

<OPCODE-NUMBER> is a opcode number (0, 1, ...) <OPCODE> is an opcode name (ZEN_NOP, ZEND_ADD, :) <OP1_TYPES> and <OP2_TYPES> are masks for allowed operand op_types. Specializer will generate code only for defined combination of types. You can use any combination of the following op_types UNUSED, CONST, VAR, TMP and CV also you can use ANY mask to disable specialization according operand's op_type. <HANDLER'S CODE> is a handler's code itself. For most handlers it stills the same as in old zend_execute.c, but now it uses macros to access opcode operands and some internal executor data.

You can see the conformity of new macros to old code in the following list:

EXECUTE_DATA
    execute_data
ZEND_VM_DISPATCH_TO_HANDLER(<OP>)
    return <OP>_helper(ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_DISPATCH_TO_HELPER(<NAME>)
    return <NAME>(ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_DISPATCH_TO_HELPER_EX(<NAME>,<PARAM>,<VAL>)
    return <NAME>(<VAL>, ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_CONTINUE()
    return 0
ZEND_VM_NEXT_OPCODE()
    NEXT_OPCODE()
ZEND_VM_SET_OPCODE(<TARGET>
    SET_OPCODE(<TARGET>
ZEND_VM_INC_OPCODE()
    INC_OPCOD()
ZEND_VM_RETURN_FROM_EXECUTE_LOOP()
    RETURN_FROM_EXECUTE_LOOP()
ZEND_VM_C_LABEL(<LABEL>):
    <LABEL>:
ZEND_VM_C_GOTO(<LABEL>)
    goto <LABEL>
OP<X>_TYPE
    opline->op<X>.op_type
GET_OP<X>_ZVAL_PTR(<TYPE>)
    get_zval_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_ZVAL_PTR_PTR(<TYPE>)
    get_zval_ptr_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_OBJ_ZVAL_PTR(<TYPE>)
    get_obj_zval_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_OBJ_ZVAL_PTR_PTR(<TYPE>)
    get_obj_zval_ptr_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
IS_OP<X>_TMP_FREE()
    IS_TMP_FREE(free_op<X>)
FREE_OP<X>()
    FREE_OP(free_op<X>)
FREE_OP<X>_IF_VAR()
    FREE_VAR(free_op<X>)
FREE_OP<X>_VAR_PTR()
    FREE_VAR_PTR(free_op<X>)

Executor's helpers can be defined without parameters or with one parameter. This is done with the following constructs:

ZEND_VM_HELPER(<HELPER-NAME>, <OP1_TYPES>, <OP2_TYPES>)
{
    <HELPER'S CODE>
}

ZEND_VM_HELPER_EX(<HELPER-NAME>, <OP1_TYPES>, <OP2_TYPES>, <PARAM_SPEC>)
{
    <HELPER'S CODE>
}

Executor's code is generated by PHP script zend_vm_gen.php it uses zend_vm_def.h and zend_vm_execute.skl as input and produces zend_vm_opcodes.h and zend_vm_execute.h. The first file is a list of opcode definitions. It is included from zend_compile.h. The second one is an executor code itself. It is included from zend_execute.c.

zend_vm_gen.php can produce different kind of executors. You can select different opcode threading model using --with-vm-kind=CALL|SWITCH|GOTO. You can disable opcode specialization using --without-specializer. You can include or exclude old executor together with specialized one using --without-old-executor. At last you can debug executor using original zend_vm_def.h or generated file zend_vm_execute.h. Debugging with original file requires --with-lines option. By default ZE2 uses the following command to generate executor:

php zend_vm_gen.php --with-vm-kind=CALL