php-src/Zend
Dmitry Stogov 683285165e Fix memory leak
Fixes oss-fuzz #54320
2022-12-19 12:11:16 +03:00
..
asm Add IBT support for fiber 2022-05-25 13:42:31 -05:00
Optimizer Fix memory leak 2022-11-07 11:07:58 +03:00
tests Fix memory leak 2022-12-19 12:11:16 +03:00
bench.php Apply tidy formatting 2020-02-03 13:41:31 +01:00
LICENSE
Makefile.frag Fix race condition in automatic zend_vm_gen.php invocation 2021-07-16 10:03:00 +02:00
micro_bench.php Apply tidy formatting 2020-02-03 13:41:31 +01:00
README.md
zend_alloc_sizes.h Fix GH-9361: Segmentation fault on script exit 2022-08-22 12:59:17 +02:00
zend_alloc.c Fix GH-9650: Can't initialize heap: [0x000001e7] 2022-11-17 14:16:10 +01:00
zend_alloc.h Fix output buffer discard on memory limit 2021-05-31 16:30:36 +02:00
zend_API.c Merge branch 'PHP-8.0' into PHP-8.1 2022-06-09 19:55:46 +01:00
zend_API.h Merge branch 'PHP-8.0' into PHP-8.1 2022-06-09 19:55:46 +01:00
zend_arena.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_ast.c Fix GH-9769: Misleading error message for unpacking of objects 2022-12-02 13:10:59 +01:00
zend_ast.h Add support for internal enums 2021-07-27 09:19:14 +02:00
zend_attributes_arginfo.h Add support for tentative return types of internal methods 2021-05-14 15:55:25 +02:00
zend_attributes.c Merge branch 'PHP-8.0' into PHP-8.1 2022-03-07 22:06:58 +01:00
zend_attributes.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_attributes.stub.php Add support for tentative return types of internal methods 2021-05-14 15:55:25 +02:00
zend_bitset.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_build.h
zend_builtin_functions_arginfo.h Add support for generating MAY_BE_ARRAY_OF_REF func info flag (#7416) 2021-08-30 13:50:34 +02:00
zend_builtin_functions.c Fix backtraces with overridden zend_execute_ex 2021-09-29 16:25:00 +02:00
zend_builtin_functions.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_builtin_functions.stub.php Add support for generating MAY_BE_ARRAY_OF_REF func info flag (#7416) 2021-08-30 13:50:34 +02:00
zend_closures_arginfo.h Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_closures.c Fix null static_variable_ptr for uncalled fake closures 2022-02-19 11:37:52 +01:00
zend_closures.h Add first-class callables 2021-07-14 14:37:25 +02:00
zend_closures.stub.php Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_compile.c Merge branch 'PHP-8.0' into PHP-8.1 2022-09-08 10:53:45 +02:00
zend_compile.h Fix class name FQN when AST dumping new and class const 2022-09-02 08:57:26 +02:00
zend_config.w32.h Remove "inline" defines on Windows (#7071) 2021-05-31 10:05:18 +02:00
zend_constants.c Add ZEND_CLASS_CONST_FLAGS() macro 2021-04-28 14:51:54 +02:00
zend_constants.h Fix memory leak 2022-05-11 11:43:01 +03:00
zend_cpuinfo.c Merge branch 'PHP-8.0' into PHP-8.1 2021-12-23 16:21:28 +01:00
zend_cpuinfo.h fix [-Wstrict-prototypes] buid warnings 2021-11-24 14:55:11 +01:00
zend_default_classes.c Implement Fibers 2021-04-26 11:07:06 -05:00
zend_dtrace.c fix dtrace observer callback prototype 2021-06-04 16:03:09 +02:00
zend_dtrace.d
zend_dtrace.h fix dtrace observer callback prototype 2021-06-04 16:03:09 +02:00
zend_enum_arginfo.h Implement enums 2021-03-17 19:08:03 +01:00
zend_enum.c Fix Enum::from/tryFrom memory leak in JIT for internal enums 2022-05-28 10:51:17 +02:00
zend_enum.h Add missing const qualitier in zend_register_internal_enum() 2021-08-31 13:12:31 +02:00
zend_enum.stub.php Implement enums 2021-03-17 19:08:03 +01:00
zend_errors.h Use clean shutdown on uncaught exception 2019-10-11 12:41:15 +02:00
zend_exceptions_arginfo.h Fix a few more classsynopsis generation issues 2021-09-22 23:09:43 +02:00
zend_exceptions.c Merge branch 'PHP-8.0' into PHP-8.1 2022-10-23 00:46:25 +01:00
zend_exceptions.h Allow creating Graceful/UnwindExit and use when destroying a fiber (#7174) 2021-06-28 15:23:34 -05:00
zend_exceptions.stub.php Fix a few more classsynopsis generation issues 2021-09-22 23:09:43 +02:00
zend_execute_API.c Fallback to first line of function when ex->opline is NULL (#10003) 2022-12-02 17:21:30 +01:00
zend_execute.c Merge branch 'PHP-8.0' into PHP-8.1 2022-11-04 15:59:14 +01:00
zend_execute.h Merge branch 'PHP-8.0' into PHP-8.1 2022-11-04 15:59:14 +01:00
zend_extensions.c Fix GH-8082: Prevent leaking memory on observed transient run_time_caches 2022-03-01 14:49:44 +01:00
zend_extensions.h Merge branch 'PHP-8.0' into PHP-8.1 2022-03-01 14:54:09 +01:00
zend_fibers_arginfo.h Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_fibers.c Add IBT support for fiber 2022-05-25 13:42:31 -05:00
zend_fibers.h Extend resource reservation to Fibers (#7292) 2021-07-21 20:19:20 +02:00
zend_fibers.stub.php Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_float.c Revert "Fix #79595: zend_init_fpu() alters FPU precision" 2020-05-22 16:57:14 +02:00
zend_float.h Fix #79595: zend_init_fpu() alters FPU precision 2020-05-26 17:19:54 +02:00
zend_gc.c Fix GH-9266: GC root buffer keeps growing when dtors are present 2022-08-09 14:16:11 +02:00
zend_gc.h Don't perform recursive get_gc call 2021-06-09 11:15:59 +02:00
zend_gdb.c Merge branch 'PHP-8.0' into PHP-8.1 2021-12-21 07:19:58 +01:00
zend_gdb.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_generators_arginfo.h Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_generators.c Merge branch 'PHP-8.0' into PHP-8.1 2022-11-04 15:59:14 +01:00
zend_generators.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_generators.stub.php Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_globals_macros.h
zend_globals.h Revert "Fix GH-8409: SSL handshake timeout persistent connections hanging" 2022-08-14 19:41:06 +08:00
zend_hash.c Fix arsort() crash on recursion 2022-04-04 12:03:39 +03:00
zend_hash.h Remove dynamic defs from methods as well 2021-08-02 10:29:58 +02:00
zend_highlight.c Introduce pseudo-keyword ZEND_FALLTHROUGH 2021-04-07 00:46:29 +01:00
zend_highlight.h Accept zend_string in highlight_string API 2020-10-22 14:35:40 +02:00
zend_inheritance.c Fix memory leak 2022-12-19 12:11:16 +03:00
zend_inheritance.h Added Inheritance Cache. 2021-02-09 22:53:57 +03:00
zend_ini_parser.y Fix ZEND_RC_MOD_CHECK() for thread local ini parser strings 2022-09-12 23:31:26 +02:00
zend_ini_scanner.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_ini_scanner.l Fix/improve handling of escaping in ini parser 2021-08-30 16:59:22 +02:00
zend_ini.c Fix unregistering ini entries of dynamically loaded extension (#8435) 2022-05-06 15:25:44 +02:00
zend_ini.h Fix unregistering ini entries of dynamically loaded extension (#8435) 2022-05-06 15:25:44 +02:00
zend_interfaces_arginfo.h Drop serial denier functions 2021-07-20 13:11:11 +02:00
zend_interfaces.c Fix memory leak 2022-09-19 13:03:24 +03:00
zend_interfaces.h Fix GH-7958: Nested CallbackFilterIterator is leaking memory 2022-02-21 12:39:07 +01:00
zend_interfaces.stub.php Drop serial denier functions 2021-07-20 13:11:11 +02:00
zend_istdiostream.h
zend_iterators.c Add get_gc handle for object iterators 2020-07-01 15:17:22 +02:00
zend_iterators.h Add get_gc handle for object iterators 2020-07-01 15:17:22 +02:00
zend_language_parser.y Implement readonly properties 2021-07-20 12:05:46 +02:00
zend_language_scanner.h Fix parsing of semi-reserved tokens at offset > 4 GB 2021-01-25 14:37:36 +01:00
zend_language_scanner.l Allow using readonly as function name 2021-09-13 08:50:32 +02:00
zend_list.c Use zend_long for resource ID 2021-08-31 14:58:59 +02:00
zend_list.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_llist.c Change Zend Stream API to use zend_string* instead of char*. 2021-03-16 20:31:36 +03:00
zend_llist.h Fix MSVC level 1 (severe) warnings 2020-06-05 11:17:05 +02:00
zend_long.h Return value from ZEND_ATOL 2021-07-12 16:51:24 +02:00
zend_map_ptr.h Explicitly store real map ptr base 2021-08-26 12:29:44 +02:00
zend_modules.h Prepare for PHP 8.1.0RC1 2021-08-31 18:57:44 +02:00
zend_multibyte.c Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_multibyte.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_multiply.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_object_handlers.c Disallow assigning reference to unset readonly property 2022-07-01 12:16:32 +02:00
zend_object_handlers.h Optimized object conversion to array without rebulding properties HashTable 2021-03-01 22:37:37 +03:00
zend_objects_API.c Add API to prevent Fiber switch in select contexts 2021-06-14 14:19:00 -05:00
zend_objects_API.h We don't have to clear zend_object structure, it's initialized by zend_object_std_init() anyway. 2021-04-02 16:11:34 +03:00
zend_objects.c Fixed use-after-free introduced by ca49e53670 2021-04-19 18:16:14 +03:00
zend_objects.h
zend_observer.c Merge branch 'PHP-8.0' into PHP-8.1 2022-03-01 14:54:09 +01:00
zend_observer.h Merge branch 'PHP-8.0' into PHP-8.1 2022-03-01 14:54:09 +01:00
zend_opcode.c Fix memory leak 2022-05-11 11:43:01 +03:00
zend_operators.c Merge remote-tracking branch 'upstream/PHP-8.0' into PHP-8.1 2022-08-05 00:06:04 +09:00
zend_operators.h Merge remote-tracking branch 'upstream/PHP-8.0' into PHP-8.1 2022-08-05 00:06:04 +09:00
zend_portability.h Add IBT support for fiber 2022-05-25 13:42:31 -05:00
zend_ptr_stack.c Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_ptr_stack.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_range_check.h
zend_signal.c Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_signal.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_smart_str_public.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_smart_str.c Merge branch 'PHP-8.0' into PHP-8.1 2021-09-16 16:30:01 +02:00
zend_smart_str.h Fix bug #81303 improve match errors 2021-08-02 17:31:26 +02:00
zend_smart_string_public.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_smart_string.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_sort.c Remove zend_qsort 2020-05-12 16:57:53 +02:00
zend_sort.h Remove zend_qsort 2020-05-12 16:57:53 +02:00
zend_stack.c Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_stack.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_stream.c Fix GH-7883 don't close not open file handle 2022-01-18 14:49:56 +01:00
zend_stream.h Change Zend Stream API to use zend_string* instead of char*. 2021-03-16 20:31:36 +03:00
zend_string.c Fix build with Valgrind without I_REPLACE_SONAME_FNNAME_ZU symbol 2022-05-07 16:45:03 +01:00
zend_string.h Merge branch 'PHP-8.0' into PHP-8.1 2021-11-29 19:17:16 +01:00
zend_strtod_int.h Drop unnecessary stdint and inttypes header checks 2020-04-22 20:18:19 +02:00
zend_strtod.c Move php_gcvt to zend_gcvt 2021-08-02 14:51:46 +02:00
zend_strtod.h Move php_gcvt to zend_gcvt 2021-08-02 14:51:46 +02:00
zend_system_id.c Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_system_id.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_type_info.h Better specialization for packed/hash arrays 2021-08-13 14:30:41 +03:00
zend_types.h Extended map_ptr before copying class table (#9188) 2022-08-01 19:25:07 +02:00
zend_variables.c Fixed bug #81514 2021-10-08 10:31:24 +02:00
zend_variables.h Drop various unused macros/APIs 2020-08-26 12:59:43 +02:00
zend_virtual_cwd.c Merge branch 'PHP-8.0' 2021-05-25 11:41:06 +02:00
zend_virtual_cwd.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_vm_def.h Merge branch 'PHP-8.0' into PHP-8.1 2022-10-22 10:44:06 +02:00
zend_vm_execute.h Merge branch 'PHP-8.0' into PHP-8.1 2022-10-22 10:44:06 +02:00
zend_vm_execute.skl Cleanup observer API and add JIT support 2020-09-18 12:55:58 +03:00
zend_vm_gen.php Handle holes in zend_get_opcode_id() 2021-12-30 16:56:03 +01:00
zend_vm_handlers.h Merge branch 'PHP-8.0' into PHP-8.1 2022-02-01 16:25:03 +03:00
zend_vm_opcodes.c Merge branch 'PHP-8.0' into PHP-8.1 2022-02-01 16:25:03 +03:00
zend_vm_opcodes.h Add first-class callables 2021-07-14 14:37:25 +02:00
zend_vm_trace_handlers.h
zend_vm_trace_lines.h A helper to trace executed source lines 2020-06-10 00:13:39 +03:00
zend_vm_trace_map.h Fixed typecast 2020-05-22 12:36:52 +03:00
zend_vm.h
zend_weakrefs_arginfo.h Not serializable flag permeation 2021-07-20 12:28:35 +02:00
zend_weakrefs.c Merge branch 'PHP-8.0' into PHP-8.1 2022-07-15 13:15:05 +02:00
zend_weakrefs.h Add ZEND_API for weakmap functionality via zend_weakrefs_hash_add/del 2021-10-21 13:34:22 +02:00
zend_weakrefs.stub.php Not serializable flag permeation 2021-07-20 12:28:35 +02:00
zend.c Revert "Fix GH-8409: SSL handshake timeout persistent connections hanging" 2022-08-14 19:41:06 +08:00
zend.h PHP-8.1 is now for PHP 8.1.15-dev 2022-12-07 11:29:37 -06:00
Zend.m4 Merge remote-tracking branch 'upstream/PHP-8.0' into PHP-8.1 2022-08-05 00:06:04 +09:00

Zend Engine

Zend memory manager

General

The goal of the new memory manager (available since PHP 5.2) is to reduce memory allocation overhead and speedup memory management.

Debugging

Normal:

sapi/cli/php -r 'leak();'

Zend MM disabled:

USE_ZEND_ALLOC=0 valgrind --leak-check=full sapi/cli/php -r 'leak();'

Shared extensions

Since PHP 5.3.11 it is possible to prevent shared extensions from unloading so that valgrind can correctly track the memory leaks in shared extensions. For this there is the ZEND_DONT_UNLOAD_MODULES environment variable. If set, then DL_UNLOAD() is skipped during the shutdown of shared extensions.

ZEND_VM

ZEND_VM architecture allows specializing opcode handlers according to op_type fields and using different execution methods (call threading, switch threading and direct threading). As a result ZE2 got more than 20% speedup on raw PHP code execution (with specialized executor and direct threading execution method). As in most PHP applications raw execution speed isn't the limiting factor but system calls and database calls are, your mileage with this patch will vary.

Most parts of the old zend_execute.c go into zend_vm_def.h. Here you can find opcode handlers and helpers. The typical opcode handler template looks like this:

ZEND_VM_HANDLER(<OPCODE-NUMBER>, <OPCODE>, <OP1_TYPES>, <OP2_TYPES>)
{
    <HANDLER'S CODE>
}

<OPCODE-NUMBER> is a opcode number (0, 1, ...) <OPCODE> is an opcode name (ZEN_NOP, ZEND_ADD, :) <OP1_TYPES> and <OP2_TYPES> are masks for allowed operand op_types. Specializer will generate code only for defined combination of types. You can use any combination of the following op_types UNUSED, CONST, VAR, TMP and CV also you can use ANY mask to disable specialization according operand's op_type. <HANDLER'S CODE> is a handler's code itself. For most handlers it stills the same as in old zend_execute.c, but now it uses macros to access opcode operands and some internal executor data.

You can see the conformity of new macros to old code in the following list:

EXECUTE_DATA
    execute_data
ZEND_VM_DISPATCH_TO_HANDLER(<OP>)
    return <OP>_helper(ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_DISPATCH_TO_HELPER(<NAME>)
    return <NAME>(ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_DISPATCH_TO_HELPER_EX(<NAME>,<PARAM>,<VAL>)
    return <NAME>(<VAL>, ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_CONTINUE()
    return 0
ZEND_VM_NEXT_OPCODE()
    NEXT_OPCODE()
ZEND_VM_SET_OPCODE(<TARGET>
    SET_OPCODE(<TARGET>
ZEND_VM_INC_OPCODE()
    INC_OPCOD()
ZEND_VM_RETURN_FROM_EXECUTE_LOOP()
    RETURN_FROM_EXECUTE_LOOP()
ZEND_VM_C_LABEL(<LABEL>):
    <LABEL>:
ZEND_VM_C_GOTO(<LABEL>)
    goto <LABEL>
OP<X>_TYPE
    opline->op<X>.op_type
GET_OP<X>_ZVAL_PTR(<TYPE>)
    get_zval_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_ZVAL_PTR_PTR(<TYPE>)
    get_zval_ptr_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_OBJ_ZVAL_PTR(<TYPE>)
    get_obj_zval_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_OBJ_ZVAL_PTR_PTR(<TYPE>)
    get_obj_zval_ptr_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
IS_OP<X>_TMP_FREE()
    IS_TMP_FREE(free_op<X>)
FREE_OP<X>()
    FREE_OP(free_op<X>)
FREE_OP<X>_IF_VAR()
    FREE_VAR(free_op<X>)
FREE_OP<X>_VAR_PTR()
    FREE_VAR_PTR(free_op<X>)

Executor's helpers can be defined without parameters or with one parameter. This is done with the following constructs:

ZEND_VM_HELPER(<HELPER-NAME>, <OP1_TYPES>, <OP2_TYPES>)
{
    <HELPER'S CODE>
}

ZEND_VM_HELPER_EX(<HELPER-NAME>, <OP1_TYPES>, <OP2_TYPES>, <PARAM_SPEC>)
{
    <HELPER'S CODE>
}

Executor's code is generated by PHP script zend_vm_gen.php it uses zend_vm_def.h and zend_vm_execute.skl as input and produces zend_vm_opcodes.h and zend_vm_execute.h. The first file is a list of opcode definitions. It is included from zend_compile.h. The second one is an executor code itself. It is included from zend_execute.c.

zend_vm_gen.php can produce different kind of executors. You can select different opcode threading model using --with-vm-kind=CALL|SWITCH|GOTO. You can disable opcode specialization using --without-specializer. You can include or exclude old executor together with specialized one using --without-old-executor. At last you can debug executor using original zend_vm_def.h or generated file zend_vm_execute.h. Debugging with original file requires --with-lines option. By default ZE2 uses the following command to generate executor:

php zend_vm_gen.php --with-vm-kind=CALL