php-src/Zend
Joe Watkins d0b09a7be4 Add first-class callables
Support acquiring a Closure to a callable using the syntax
func(...), $obj->method(...), etc. This is essentially a
shortcut for Closure::fromCallable().

RFC: https://wiki.php.net/rfc/first_class_callable_syntax

Closes GH-7019.

Co-Authored-By: Nikita Popov <nikita.ppv@gmail.com>
2021-07-14 14:37:25 +02:00
..
asm Implement Fibers 2021-04-26 11:07:06 -05:00
Optimizer Add first-class callables 2021-07-14 14:37:25 +02:00
tests Add first-class callables 2021-07-14 14:37:25 +02:00
bench.php
LICENSE
Makefile.frag Don't check executability 2021-03-16 14:36:10 +01:00
micro_bench.php
README.md
zend_alloc_sizes.h
zend_alloc.c Fix typo 2021-07-13 14:00:18 +02:00
zend_alloc.h Fix output buffer discard on memory limit 2021-05-31 16:30:36 +02:00
zend_API.c Add limited support for new in initializers 2021-07-13 14:03:20 +02:00
zend_API.h Merge branch 'PHP-8.0' 2021-06-08 10:14:58 +02:00
zend_arena.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_ast.c Add first-class callables 2021-07-14 14:37:25 +02:00
zend_ast.h Add first-class callables 2021-07-14 14:37:25 +02:00
zend_attributes_arginfo.h Add support for tentative return types of internal methods 2021-05-14 15:55:25 +02:00
zend_attributes.c Merge branch 'PHP-8.0' 2021-05-21 11:42:11 +02:00
zend_attributes.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_attributes.stub.php Add support for tentative return types of internal methods 2021-05-14 15:55:25 +02:00
zend_bitset.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_build.h
zend_builtin_functions_arginfo.h Revert "Fix bug #24214 implement access to skip_last in user API for backtrace" 2021-06-08 11:30:37 +02:00
zend_builtin_functions.c Fixed some spaces used instead of tabs 2021-06-29 11:30:26 +02:00
zend_builtin_functions.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_builtin_functions.stub.php Revert "Fix bug #24214 implement access to skip_last in user API for backtrace" 2021-06-08 11:30:37 +02:00
zend_closures_arginfo.h Use NO_DYNAMIC_PROPERTIES for Closure 2021-05-14 14:48:56 +02:00
zend_closures.c Add first-class callables 2021-07-14 14:37:25 +02:00
zend_closures.h Add first-class callables 2021-07-14 14:37:25 +02:00
zend_closures.stub.php Use NO_DYNAMIC_PROPERTIES for Closure 2021-05-14 14:48:56 +02:00
zend_compile.c Add first-class callables 2021-07-14 14:37:25 +02:00
zend_compile.h Add limited support for new in initializers 2021-07-13 14:03:20 +02:00
zend_config.w32.h Remove "inline" defines on Windows (#7071) 2021-05-31 10:05:18 +02:00
zend_constants.c Add ZEND_CLASS_CONST_FLAGS() macro 2021-04-28 14:51:54 +02:00
zend_constants.h Fix spelling and grammar mistakes 2021-04-13 12:09:37 +02:00
zend_cpuinfo.c Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_cpuinfo.h Mark various functions with void arguments. 2021-05-12 14:55:53 +01:00
zend_default_classes.c Implement Fibers 2021-04-26 11:07:06 -05:00
zend_dtrace.c fix dtrace observer callback prototype 2021-06-04 16:03:09 +02:00
zend_dtrace.d
zend_dtrace.h fix dtrace observer callback prototype 2021-06-04 16:03:09 +02:00
zend_enum_arginfo.h Implement enums 2021-03-17 19:08:03 +01:00
zend_enum.c Add ZEND_CLASS_CONST_FLAGS() macro 2021-04-28 14:51:54 +02:00
zend_enum.h Implement enums 2021-03-17 19:08:03 +01:00
zend_enum.stub.php Implement enums 2021-03-17 19:08:03 +01:00
zend_errors.h
zend_exceptions_arginfo.h Make some exception properties typed 2021-04-22 10:22:50 +02:00
zend_exceptions.c Fixed some spaces used instead of tabs 2021-06-29 11:30:26 +02:00
zend_exceptions.h Allow creating Graceful/UnwindExit and use when destroying a fiber (#7174) 2021-06-28 15:23:34 -05:00
zend_exceptions.stub.php Make some exception properties typed 2021-04-22 10:22:50 +02:00
zend_execute_API.c Check internal function type consistency in zend_call_function 2021-07-13 11:50:07 +02:00
zend_execute.c Check internal function type consistency in zend_call_function 2021-07-13 11:50:07 +02:00
zend_execute.h Check internal function type consistency in zend_call_function 2021-07-13 11:50:07 +02:00
zend_extensions.c Check linker compatibility directly from HMODULE 2020-09-21 16:25:31 +02:00
zend_extensions.h Add const to zend_extension_version_info.build_id 2021-03-02 18:42:58 -07:00
zend_fibers_arginfo.h Rename Fiber::this() to Fiber::getCurrent() (#7155) 2021-06-18 11:02:02 -05:00
zend_fibers.c Fiber ucontext support (#7226) 2021-07-11 15:40:11 -05:00
zend_fibers.h Fiber ucontext support (#7226) 2021-07-11 15:40:11 -05:00
zend_fibers.stub.php Rename Fiber::this() to Fiber::getCurrent() (#7155) 2021-06-18 11:02:02 -05:00
zend_float.c Revert "Fix #79595: zend_init_fpu() alters FPU precision" 2020-05-22 16:57:14 +02:00
zend_float.h Fix #79595: zend_init_fpu() alters FPU precision 2020-05-26 17:19:54 +02:00
zend_gc.c Clean up gc_scan() implementation 2021-07-12 11:49:12 +02:00
zend_gc.h Don't perform recursive get_gc call 2021-06-09 11:15:59 +02:00
zend_gdb.c Mark various functions with void arguments. 2021-05-12 14:55:53 +01:00
zend_gdb.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_generators_arginfo.h Improve class entry generation 2021-02-16 13:09:56 +01:00
zend_generators.c Close generator already in dtor phase 2021-05-04 16:59:59 +02:00
zend_generators.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_generators.stub.php Add missing classes to stubs 2021-02-09 22:38:06 +01:00
zend_globals_macros.h
zend_globals.h Improve fiber interoperability (#7128) 2021-06-10 23:00:07 -05:00
zend_hash.c Fixed some spaces used instead of tabs 2021-06-29 11:30:26 +02:00
zend_hash.h Convert some recently introduced zend_bool to bool 2021-06-18 15:21:39 +01:00
zend_highlight.c Introduce pseudo-keyword ZEND_FALLTHROUGH 2021-04-07 00:46:29 +01:00
zend_highlight.h Accept zend_string in highlight_string API 2020-10-22 14:35:40 +02:00
zend_inheritance.c Add support for final class constants 2021-07-06 21:42:38 +02:00
zend_inheritance.h Added Inheritance Cache. 2021-02-09 22:53:57 +03:00
zend_ini_parser.y Change Zend Stream API to use zend_string* instead of char*. 2021-03-16 20:31:36 +03:00
zend_ini_scanner.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_ini_scanner.l Remove 'register' type qualifier (#6980) 2021-05-14 13:38:01 +01:00
zend_ini.c Fixed some spaces used instead of tabs 2021-06-29 11:30:26 +02:00
zend_ini.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_interfaces_arginfo.h Improve class entry generation 2021-02-16 13:09:56 +01:00
zend_interfaces.c Partially deprecate Serializable 2021-04-28 16:55:14 +02:00
zend_interfaces.h Generate zend class entries based on stubs 2021-02-14 23:18:28 +01:00
zend_interfaces.stub.php Generate zend class entries based on stubs 2021-02-14 23:18:28 +01:00
zend_istdiostream.h
zend_iterators.c Add get_gc handle for object iterators 2020-07-01 15:17:22 +02:00
zend_iterators.h Add get_gc handle for object iterators 2020-07-01 15:17:22 +02:00
zend_language_parser.y Add first-class callables 2021-07-14 14:37:25 +02:00
zend_language_scanner.h Fix parsing of semi-reserved tokens at offset > 4 GB 2021-01-25 14:37:36 +01:00
zend_language_scanner.l Pure Intersection types (#6799) 2021-07-05 14:11:03 +02:00
zend_list.c Assert on unknown list entry type 2020-09-21 14:58:23 +02:00
zend_list.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_llist.c Change Zend Stream API to use zend_string* instead of char*. 2021-03-16 20:31:36 +03:00
zend_llist.h Fix MSVC level 1 (severe) warnings 2020-06-05 11:17:05 +02:00
zend_long.h Return value from ZEND_ATOL 2021-07-12 16:51:24 +02:00
zend_map_ptr.h Fast Class Cache 2021-04-08 23:37:40 +03:00
zend_modules.h Prepare for PHP 8.1 2020-10-09 11:37:27 +02:00
zend_multibyte.c Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_multibyte.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_multiply.h Improve type declarations for Zend APIs 2020-08-28 15:41:27 +02:00
zend_object_handlers.c Fix GC of object properties HT 2021-07-12 11:30:20 +02:00
zend_object_handlers.h Optimized object conversion to array without rebulding properties HashTable 2021-03-01 22:37:37 +03:00
zend_objects_API.c Add API to prevent Fiber switch in select contexts 2021-06-14 14:19:00 -05:00
zend_objects_API.h We don't have to clear zend_object structure, it's initialized by zend_object_std_init() anyway. 2021-04-02 16:11:34 +03:00
zend_objects.c Fixed use-after-free introduced by ca49e53670 2021-04-19 18:16:14 +03:00
zend_objects.h
zend_observer.c Alternative Fiber Internals Refactoring (#7101) 2021-06-04 23:25:35 -05:00
zend_observer.h Alternative Fiber Internals Refactoring (#7101) 2021-06-04 23:25:35 -05:00
zend_opcode.c Don't duplicate internal prop info (#6929) 2021-04-29 20:31:24 +02:00
zend_operators.c Use unsigned arithmetic in zend_atol 2021-07-13 11:01:42 +02:00
zend_operators.h Remove zend_atoi() (#7232) 2021-07-13 09:22:31 +02:00
zend_portability.h Implement Fibers 2021-04-26 11:07:06 -05:00
zend_ptr_stack.c Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_ptr_stack.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_range_check.h
zend_signal.c Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_signal.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_smart_str_public.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_smart_str.c Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_smart_str.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_smart_string_public.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_smart_string.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_sort.c
zend_sort.h
zend_stack.c Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_stack.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_stream.c Change Zend Stream API to use zend_string* instead of char*. 2021-03-16 20:31:36 +03:00
zend_stream.h Change Zend Stream API to use zend_string* instead of char*. 2021-03-16 20:31:36 +03:00
zend_string.c Always define valgrind replacement symbol for zend_string_equal_val 2021-05-21 21:00:34 +02:00
zend_string.h Convert error filename to zend_string 2021-04-23 11:05:14 +02:00
zend_strtod_int.h
zend_strtod.c Remove all *_EXTERN_C() in C source files (#7054) 2021-05-27 15:52:54 +08:00
zend_strtod.h
zend_system_id.c Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_system_id.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_ts_hash.c Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_ts_hash.h Replace zend_bool uses with bool 2021-01-15 12:33:06 +01:00
zend_type_info.h Implement never return type 2021-04-19 11:27:29 +02:00
zend_types.h Pure Intersection types (#6799) 2021-07-05 14:11:03 +02:00
zend_variables.c
zend_variables.h Drop various unused macros/APIs 2020-08-26 12:59:43 +02:00
zend_virtual_cwd.c Merge branch 'PHP-8.0' 2021-05-25 11:41:06 +02:00
zend_virtual_cwd.h Update http->https in license (#6945) 2021-05-06 12:16:35 +02:00
zend_vm_def.h Add first-class callables 2021-07-14 14:37:25 +02:00
zend_vm_execute.h Add first-class callables 2021-07-14 14:37:25 +02:00
zend_vm_execute.skl Cleanup observer API and add JIT support 2020-09-18 12:55:58 +03:00
zend_vm_gen.php Correct DWARF frame description. 2021-05-18 18:21:08 +03:00
zend_vm_handlers.h Add first-class callables 2021-07-14 14:37:25 +02:00
zend_vm_opcodes.c Add first-class callables 2021-07-14 14:37:25 +02:00
zend_vm_opcodes.h Add first-class callables 2021-07-14 14:37:25 +02:00
zend_vm_trace_handlers.h
zend_vm_trace_lines.h A helper to trace executed source lines 2020-06-10 00:13:39 +03:00
zend_vm_trace_map.h
zend_vm.h
zend_weakrefs_arginfo.h Improve class entry generation 2021-02-16 13:09:56 +01:00
zend_weakrefs.c Don't return embedded HT from WeakMap get_gc() handler 2021-07-12 12:24:59 +02:00
zend_weakrefs.h Fix warnings of strict-prototypes 2020-07-23 00:59:00 +08:00
zend_weakrefs.stub.php Generate zend class entries based on stubs 2021-02-14 23:18:28 +01:00
zend.c Remove incorrect uses of zend_atoi() 2021-07-12 16:56:00 +02:00
zend.h Fix typedef redefinition warnings. 2021-06-28 10:11:43 +02:00
Zend.m4 Remove unnecessary LIBZEND_MM_ALIGN assignment 2021-05-17 18:44:57 +02:00

Zend Engine

Zend memory manager

General

The goal of the new memory manager (available since PHP 5.2) is to reduce memory allocation overhead and speedup memory management.

Debugging

Normal:

sapi/cli/php -r 'leak();'

Zend MM disabled:

USE_ZEND_ALLOC=0 valgrind --leak-check=full sapi/cli/php -r 'leak();'

Shared extensions

Since PHP 5.3.11 it is possible to prevent shared extensions from unloading so that valgrind can correctly track the memory leaks in shared extensions. For this there is the ZEND_DONT_UNLOAD_MODULES environment variable. If set, then DL_UNLOAD() is skipped during the shutdown of shared extensions.

ZEND_VM

ZEND_VM architecture allows specializing opcode handlers according to op_type fields and using different execution methods (call threading, switch threading and direct threading). As a result ZE2 got more than 20% speedup on raw PHP code execution (with specialized executor and direct threading execution method). As in most PHP applications raw execution speed isn't the limiting factor but system calls and database calls are, your mileage with this patch will vary.

Most parts of the old zend_execute.c go into zend_vm_def.h. Here you can find opcode handlers and helpers. The typical opcode handler template looks like this:

ZEND_VM_HANDLER(<OPCODE-NUMBER>, <OPCODE>, <OP1_TYPES>, <OP2_TYPES>)
{
    <HANDLER'S CODE>
}

<OPCODE-NUMBER> is a opcode number (0, 1, ...) <OPCODE> is an opcode name (ZEN_NOP, ZEND_ADD, :) <OP1_TYPES> and <OP2_TYPES> are masks for allowed operand op_types. Specializer will generate code only for defined combination of types. You can use any combination of the following op_types UNUSED, CONST, VAR, TMP and CV also you can use ANY mask to disable specialization according operand's op_type. <HANDLER'S CODE> is a handler's code itself. For most handlers it stills the same as in old zend_execute.c, but now it uses macros to access opcode operands and some internal executor data.

You can see the conformity of new macros to old code in the following list:

EXECUTE_DATA
    execute_data
ZEND_VM_DISPATCH_TO_HANDLER(<OP>)
    return <OP>_helper(ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_DISPATCH_TO_HELPER(<NAME>)
    return <NAME>(ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_DISPATCH_TO_HELPER_EX(<NAME>,<PARAM>,<VAL>)
    return <NAME>(<VAL>, ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_CONTINUE()
    return 0
ZEND_VM_NEXT_OPCODE()
    NEXT_OPCODE()
ZEND_VM_SET_OPCODE(<TARGET>
    SET_OPCODE(<TARGET>
ZEND_VM_INC_OPCODE()
    INC_OPCOD()
ZEND_VM_RETURN_FROM_EXECUTE_LOOP()
    RETURN_FROM_EXECUTE_LOOP()
ZEND_VM_C_LABEL(<LABEL>):
    <LABEL>:
ZEND_VM_C_GOTO(<LABEL>)
    goto <LABEL>
OP<X>_TYPE
    opline->op<X>.op_type
GET_OP<X>_ZVAL_PTR(<TYPE>)
    get_zval_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_ZVAL_PTR_PTR(<TYPE>)
    get_zval_ptr_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_OBJ_ZVAL_PTR(<TYPE>)
    get_obj_zval_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_OBJ_ZVAL_PTR_PTR(<TYPE>)
    get_obj_zval_ptr_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
IS_OP<X>_TMP_FREE()
    IS_TMP_FREE(free_op<X>)
FREE_OP<X>()
    FREE_OP(free_op<X>)
FREE_OP<X>_IF_VAR()
    FREE_VAR(free_op<X>)
FREE_OP<X>_VAR_PTR()
    FREE_VAR_PTR(free_op<X>)

Executor's helpers can be defined without parameters or with one parameter. This is done with the following constructs:

ZEND_VM_HELPER(<HELPER-NAME>, <OP1_TYPES>, <OP2_TYPES>)
{
    <HELPER'S CODE>
}

ZEND_VM_HELPER_EX(<HELPER-NAME>, <OP1_TYPES>, <OP2_TYPES>, <PARAM_SPEC>)
{
    <HELPER'S CODE>
}

Executor's code is generated by PHP script zend_vm_gen.php it uses zend_vm_def.h and zend_vm_execute.skl as input and produces zend_vm_opcodes.h and zend_vm_execute.h. The first file is a list of opcode definitions. It is included from zend_compile.h. The second one is an executor code itself. It is included from zend_execute.c.

zend_vm_gen.php can produce different kind of executors. You can select different opcode threading model using --with-vm-kind=CALL|SWITCH|GOTO. You can disable opcode specialization using --without-specializer. You can include or exclude old executor together with specialized one using --without-old-executor. At last you can debug executor using original zend_vm_def.h or generated file zend_vm_execute.h. Debugging with original file requires --with-lines option. By default ZE2 uses the following command to generate executor:

php zend_vm_gen.php --with-vm-kind=CALL