.\" -*- mode: troff; coding: utf-8 -*- .\" Automatically generated by Pod::Man 5.01 (Pod::Simple 3.43) .\" .\" Standard preamble: .\" ======================================================================== .de Sp \" Vertical space (when we can't use .PP) .if t .sp .5v .if n .sp .. .de Vb \" Begin verbatim text .ft CW .nf .ne \\$1 .. .de Ve \" End verbatim text .ft R .fi .. .\" \*(C` and \*(C' are quotes in nroff, nothing in troff, for use with C<>. .ie n \{\ . ds C` "" . ds C' "" 'br\} .el\{\ . ds C` . ds C' 'br\} .\" .\" Escape single quotes in literal strings from groff's Unicode transform. .ie \n(.g .ds Aq \(aq .el .ds Aq ' .\" .\" If the F register is >0, we'll generate index entries on stderr for .\" titles (.TH), headers (.SH), subsections (.SS), items (.Ip), and index .\" entries marked with X<> in POD. Of course, you'll have to process the .\" output yourself in some meaningful fashion. .\" .\" Avoid warning from groff about undefined register 'F'. .de IX .. .nr rF 0 .if \n(.g .if rF .nr rF 1 .if (\n(rF:(\n(.g==0)) \{\ . if \nF \{\ . de IX . tm Index:\\$1\t\\n%\t"\\$2" .. . if !\nF==2 \{\ . nr % 0 . nr F 2 . \} . \} .\} .rr rF .\" ======================================================================== .\" .IX Title "re::engine::RE2 3pm" .TH re::engine::RE2 3pm 2024-03-07 "perl v5.38.2" "User Contributed Perl Documentation" .\" For nroff, turn off justification. Always turn off hyphenation; it makes .\" way too many mistakes in technical documents. .if n .ad l .nh .SH NAME re::engine::RE2 \- RE2 regex engine .SH SYNOPSIS .IX Header "SYNOPSIS" .Vb 1 \& use re::engine::RE2; \& \& if ("Hello, world" =~ /Hello, (world)/) { \& print "Greetings, $1!"; \& } .Ve .SH DESCRIPTION .IX Header "DESCRIPTION" This module replaces perl's regex engine in a given lexical scope with RE2. .PP RE2 is a primarily DFA based regexp engine from Google that is very fast at matching large amounts of text. However it does not support look behind and some other Perl regular expression features. See RE2's website for more information. .PP Fallback to normal Perl regexp is implemented by this module. If RE2 is unable to compile a regexp it will use Perl instead, therefore features not implemented by RE2 don't suddenly stop working, they will just use Perl's regexp implementation. .SH METHODS .IX Header "METHODS" To access extra functionality of RE2 methods can be called on a compiled regular expression (i.e. a \f(CW\*(C`qr//\*(C'\fR). .IP \(bu 4 \&\f(CW\*(C`possible_match_range([length = 10])\*(C'\fR .Sp Returns an array of two strings: where the expression will start matching and just after where it will finish matching. See RE2's documentation on PossibleMatchRange for further details. .Sp Example: .Sp .Vb 3 \& my($min, $max) = qr/^(a|b)/\->possible_match_range; \& is $min, \*(Aqa\*(Aq; \& is $max, \*(Aqc\*(Aq;\*(Aq .Ve .IP \(bu 4 \&\f(CWnamed_captures()\fR .Sp Returns a hash of the name captures and index. .Sp Example: .Sp .Vb 3 \& my $named_captures = qr/(?P\ew+) (?P\ew+)/\->named_captures; \& is $named_captures\->{a}, 1; \& is $named_captures\->{d}, 2; .Ve .IP \(bu 4 \&\f(CWnumber_of_capture_groups()\fR .Sp Return number of capture groups .Sp Example: .Sp .Vb 2 \& my $captures = qr/(Hello), (world)/\->number_of_capture_groups; \& is $captures, 2; .Ve .SH "PRAGMA OPTIONS" .IX Header "PRAGMA OPTIONS" Various options can be set by providing options to the \f(CW\*(C`use\*(C'\fR line. These will be pragma scoped. .IP \(bu 4 \&\f(CW\*(C`\-max_mem => 1<<24\*(C'\fR .Sp Configure RE2's memory limit. .IP \(bu 4 \&\f(CW\*(C`\-strict => 1\*(C'\fR .Sp Be strict, i.e. don't allow regexps that are not supported by RE2. .IP \(bu 4 \&\f(CW\*(C`\-longest_match => 1\*(C'\fR .Sp Match on the longest match in alternations. For example with this option set matching \f(CW"abc"\fR against \f(CW\*(C`(a|abc)\*(C'\fR will match \f(CW"abc"\fR, without depending on order. .IP \(bu 4 \&\f(CW\*(C`\-never_nl => 1\*(C'\fR .Sp Never match a newline (\f(CW"\en"\fR) even if the provided regexp contains it. .SH PERFORMANCE .IX Header "PERFORMANCE" Performance is really the primary reason for using RE2, so here's some benchmarks. Like any benchmark take them with a pinch of salt. .SS "Simple matching" .IX Subsection "Simple matching" .Vb 3 \& my $foo = "foo bar baz"; \& $foo =~ /foo/; \& $foo =~ /foox/; .Ve .PP On this very simple match RE2 is actually slower: .PP .Vb 3 \& Rate re2 re \& re2 674634/s \-\- \-76% \& re 2765739/s 310% \-\- .Ve .SS "URL matching" .IX Subsection "URL matching" Matching \f(CW\*(C`m{([a\-zA\-Z][a\-zA\-Z0\-9]*)://([^ /]+)(/[^ ]*)?|([^ @]+)@([^ @]+)}\*(C'\fR against a several KB file: .PP .Vb 3 \& Rate re re2 \& re 35.2/s \-\- \-99% \& re2 2511/s 7037% \-\- .Ve .SS "Many alternatives" .IX Subsection "Many alternatives" Matching a string against a regexp with 17,576 alternatives (\f(CW\*(C`aaa .. zzz\*(C'\fR). .PP This uses trie matching on Perl (obviously RE2 does similar by default). .PP .Vb 4 \& $ perl misc/altern.pl \& Rate re re2 \& re 52631/s \-\- \-91% \& re2 554938/s 954% \-\- .Ve .SH NOTES .IX Header "NOTES" .IP \(bu 4 No support for \f(CW\*(C`m//x\*(C'\fR .Sp The \f(CW\*(C`/x\*(C'\fR modifier is not supported. (There's no particular reason for this, just RE2 itself doesn't support it). Fallback to Perl regexp will happen automatically if \f(CW\*(C`//x\*(C'\fR is used. .IP \(bu 4 "re2/dfa.cc:447: DFA out of memory: prog size xxx mem yyy" .Sp If you attempt to compile a really large regular expression you may get this error. RE2 has an internal limit on memory consumption for the DFA state tables. By default this is 8 MiB. .Sp If you need to increase this size then use the max_mem parameter: .Sp .Vb 1 \& use re::engine::RE2 \-max_mem => 8<<23; # 64MiB .Ve .IP \(bu 4 How do I tell if RE2 will be used? .Sp See if your regexp is matching quickly or slowly ;). .Sp Alternatively normal OO concepts apply and you may examine the object returned by \f(CW\*(C`qr//\*(C'\fR: .Sp .Vb 1 \& use re::engine::RE2; \& \& ok qr/foo/\->isa("re::engine::RE2"); \& \& # Perl Regexp used instead \& ok not qr/(?<=foo)bar/\->isa("re::engine::RE2"); .Ve .Sp If you wish to force RE2, use the \f(CW\*(C`\-strict\*(C'\fR option. .SH BUGS .IX Header "BUGS" Known issues: .IP \(bu 4 Unicode handling .Sp Currently the Unicode handling of re::engine::RE2 does not fully match Perl's behaviour. .Sp The UTF\-8 flag of the regexp currently determines how the string is matched. This is obviously broken, so will be fixed at some point. .IP \(bu 4 Final newline matching differs to Perl .Sp .Vb 1 \& "\en" =~ /$/ .Ve .Sp The above is true in Perl, false in RE2. To work around the issue you can write \&\f(CW\*(C`\en?\ez\*(C'\fR when you mean Perl's \f(CW\*(C`$\*(C'\fR. .PP Please report bugs or provide patches at . .SH AUTHORS .IX Header "AUTHORS" David Leadbeater .SH COPYRIGHT .IX Header "COPYRIGHT" Copyright 2010 David Leadbeater. .PP Based on re::engine::PCRE: .PP Copyright 2007 Ævar Arnfjörð Bjarmason. .PP The original version was copyright 2006 Audrey Tang and Yves Orton. .PP This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself. .PP (However the bundled copy of RE2 has a different copyright owner and is under a BSD-like license, see \fIre2/LICENSE\fR.)