clones/php-src
1
0
Fork 0
mirror of https://github.com/php/php-src.git synced 2024-09-22 10:27:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
96,295 Commits 491 Branches 1,363 Tags 838 MiB
69b48f83df
Commit Graph

3 Commits

Author SHA1 Message Date
Márcio Almada
110759386e ext tokenizer port + cleanup unused lexer states 
we basically added a mechanism to store the token stream during parsing
and exposed the entire parser stack on the tokenizer extension through
an opt in flag: token_get_all($src, TOKEN_PARSE).

this change allows easy future language enhancements regarding context
aware parsing & scanning without further maintance on the tokenizer
extension while solves known inconsistencies "parseless" tokenizer
extension has when it handles `__halt_compiler()` presence.
 2015-04-30 03:03:29 -03:00
Stefan Marr
03f514d0a0 Added: SKIP when tokenizer extension is not available 2011-07-31 16:35:09 +00:00
Raghubansh Kumar
035dc8bdf6 New testcases for token_get_all() function 2007-12-14 16:21:33 +00:00