- 浏览: 176296 次
- 性别:
- 来自: 北京
-
文章分类
最新评论
Often unknown, or heralded as confusing, regular expressions have defined the standard for powerful text manipulation and search. Without them, many of the applications we know today would not function. This two-part series explores the basics of regular expressions in Java, and provides tutorial examples in the hopes of spreading love for our pattern-matching friends. (Read part one.)
Part 2: Look-ahead & Configuration flags
Have you ever wanted to find something in a string, but you only wanted to find it when it came before another pattern in that string? Or maybe you wanted to find a piece of text that was not followed by another piece of text? Normally, with standard string searching, you would have to write a somewhat complex function to perform the exact operation you wanted. This can, however, all be done on one line using regular expressions. This chapter will also cover the configuration flags available to modify some of the behaviors of the regular expression patterns language.
This article is part two in the series: “Regular Expressions.” Read part one for more information on basic matching, grouping, extracting, and substitution.
1. Look-ahead & Look-behind
Look-ahead and look-behind operations use syntax that could be confused with grouping (See Ch. 1 – Basic Grouping,) but these patterns do not capture values; therefore, using these constructs, no values will be stored for later retrieval, and they do not affect group numbering. Look-ahead operations look forward, starting from their location in the pattern, continuing to the end of the input. Look-behind expressions do not search backwards, but instead start at the beginning of the pattern and continue up to/until the look-behind expression. E.g.: The statement “my dog is (?!(green|red))\\w+” asserts that ‘green’ will not the word to the look-ahead’s direct right. In other words: My dog is not green or red, but my dog is blue.
Look-ahead/behind constructs (non-capturing)
(?:X) X, as a non-capturing group
(?=X) X, via zero-width positive look-ahead
(?!X) X, via zero-width negative look-ahead
(?<=X) X, via zero-width positive look-behind
(?<!X) X, via zero-width negative look-behind
(?<X) X, as an independent, non-capturing group
So what does this all mean? What does a look-ahead really do for me? Say, for example, we wanted to know if our input string contains the word “incident” but that the word “theft” should not be found anywhere. We can use a negative look-ahead to ensure that there are no occurrences.
“(?!.*theft).*incident.*”
This expression exhibits the following behavior:
"There was a crime incident" matches
"The incident involved a theft" does not match
"The theft was a serious incident" does not match
A more complex example is password validation. Let’s say we want to ensure that a password is made at least 8, but at most 12 alphanumeric characters, and at least two numbers, in any position. We will need to use a look-ahead expression in order to enforce a requirement of two numbers. This look-ahead expression will require any number of characters to be followed by a single digit, followed by any number of characters, and another single digit. E.g.: …4…2, or …42, or 42…, or 4…2.
1.1. Example
Sample code
import java.util.ArrayList;
import java.util.List;
public class LookaheadDemo {
public static void main(String[] args) {
List<String> input = new ArrayList<String>();
input.add("password");
input.add("p4ssword");
input.add("p4ssw0rd");
input.add("p45sword");
for (String ssn : input) {
if (ssn.matches("^(?=.*[0-9].*[0-9])[0-9a-zA-Z]{8,12}$")) {
System.out.println(ssn + ": matches");
} else {
System.out.println(ssn + ": does not match");
}
}
}
}
This produces the following output:
password: does not match
p4ssword: does not match
p4ssw0rd: matches
p45sword: matches
Try this example online with our Visual Java Regex Tester
Dissecting the pattern:
"^(?=.*[0-9].*[0-9])[0-9a-zA-Z]{8,12}$"
^ match the beginning of the line
(?=.*[0-9].*[0-9]) a look-ahead expression, requires 2 digits to be present
.* match n characters, where n >= 0
[0-9] match a digit from 0 to 9
[0-9a-zA-Z] match any numbers or letters
{8,12} match 8 to 12 of whatever is specified by the last group
$ match the end of the line
Multiple look-ahead operations do not evaluate in a specific order. They must all be satisfied equally, and if they logically contradict each other, the pattern will never match.
Visual Regex Tester
To get a more visual look into how regular expressions work, try our visual java regex tester.
2. Configuring the Matching Engine
Pattern configuration flags for Java appear very similar to look-ahead operations. Flags are used to configure case sensitivity, multi-line matching, and more. Flags can be specified in collections, or as individual statements. Again, these expressions are not literal, and do not capture values.
2.1. Configuration flags
(?idmsux-idmsux) Turns match flags on - off for entire expression
(?idmsux-idmsux:X) X, as a non-capturing group with the given flags on – off
2.2. Case insensitivity mode
(?i) Toggle case insensitivity (default: off, (?-i)) for the text in this group only
2.3. UNIX lines mode
(?d) Enables UNIX line mode (default: off, (?-d))
In this mode, only the '\n' line terminator is recognized in the behavior of ., ^, and $
2.4. Multi-line mode
(?m) Toggle treat newlines as whitespace (default: off, (?-m))
The ^ and $ expressions will no longer match to the beginning and end of a line,
respectively, but will match the beginning and end of the entire input sequence/string.
2.5. Dot-all mode
(?s) Toggle dot ‘.’ matches any character (default: off, (?-s))
Normally, the dot character will match everything except newline characters.
2.6. Unicode-case mode
(?u) Toggle Unicode standard case matching (default: off, (?-u)
By default, case-insensitive matching assumes that only characters
in the US-ASCII charset are being matched.
2.7. Comments mode
(?x) Allow comments in pattern (default: off, (?-x))
In this mode, whitespace is ignored, and embedded comments starting with '#'
are ignored until the end of a line.
2.8. Examples
2.8.1. Global toggle
In order to toggle flags for the entire expression, the statement must be at the head of the expression.
"(?idx)^I\s lost\s my\s .+ #this comment and all spaces will be ignored"
The above expression will ignore case, and will set the dot ‘.’ character to include newlines.
Try this example online with our Visual Java Regex Tester
2.8.2. Local toggle
In order to toggle flags for the a single non-capturing group, the group must adhere to the following syntax
"(?idx:Cars)[a-z]+
The above expression will ignore case within the group, but adhere to case beyond.
Try this example online with our Visual Java Regex Tester
2.8.3. Applied in Java
Sample code
public class ConfigurationDemo {
public static void main(String[] args) {
String input = "My dog is Blue.\n" +
"He is not red or green.";
Boolean controlResult = input.matches("(?=.*Green.*).*Blue.*");
Boolean caseInsensitiveResult = input.matches("(?i)(?=.*Green.*).*Blue.*");
Boolean dotallResult = input.matches("(?s)(?=.*Green.*).*Blue.*");
Boolean configuredResult = input.matches("(?si)(?=.*Green.*).*Blue.*");
System.out.println("Control result was: " + controlResult);
System.out.println("Case ins. result was: " + caseInsensitiveResult);
System.out.println("Dot-all result was: " + dotallResult);
System.out.println("Configured result was: " + configuredResult);
}
}
This produces the following output:
Control result was: false
Case insensitive result was: false
Dot-all result was: false
Configured result was: true
Dissecting the pattern:
"(?si)(?=.*Green.*).*Blue.*"
(?si) turn on case insensitivity and dotall modes
(?=.*Green.*) ‘Green’ must be found somewhere to the right of this look-ahead
.*Blue.* ‘Blue’ must be found somewhere in the input
We had to enable multi-line and case-insensitive modes for our pattern to match. The look-ahead in this example is very similar to the pattern itself, and in this case, the pattern could be substituted for another look-ahead. Because we don’t care in which order we find these two items, the way this is written, substituting “(?=.*Blue.*)” for “.*Blue.*” would be an acceptable change; however, if we did care in which order we wanted to find these colors, we would need to be more precise with our ordering. If we wanted to ensure that the ‘Green’ came after ‘Blue’ we would need to move the look-ahead as seen below, and so on.
"(?si).*Blue.*(?=.*Green.*)"
3. Conclusion
Regular expressions provide an extremely flexible and powerful text processing system. Try to imagine doing this work using String.substring(…) or String.indexOf(…), with loops, nested loops, and dozens of if statements. I don’t even want to try… so play around! Think about using regular expressions next time you find yourself doing text or pattern manipulation with looping and other painful methods. Let us know how you do.
This article is part two in the series: “Guide to Regular Expressions in Java.” Read part one for more information on basic matching, grouping, extracting, and substitution.
Part 2: Look-ahead & Configuration flags
Have you ever wanted to find something in a string, but you only wanted to find it when it came before another pattern in that string? Or maybe you wanted to find a piece of text that was not followed by another piece of text? Normally, with standard string searching, you would have to write a somewhat complex function to perform the exact operation you wanted. This can, however, all be done on one line using regular expressions. This chapter will also cover the configuration flags available to modify some of the behaviors of the regular expression patterns language.
This article is part two in the series: “Regular Expressions.” Read part one for more information on basic matching, grouping, extracting, and substitution.
1. Look-ahead & Look-behind
Look-ahead and look-behind operations use syntax that could be confused with grouping (See Ch. 1 – Basic Grouping,) but these patterns do not capture values; therefore, using these constructs, no values will be stored for later retrieval, and they do not affect group numbering. Look-ahead operations look forward, starting from their location in the pattern, continuing to the end of the input. Look-behind expressions do not search backwards, but instead start at the beginning of the pattern and continue up to/until the look-behind expression. E.g.: The statement “my dog is (?!(green|red))\\w+” asserts that ‘green’ will not the word to the look-ahead’s direct right. In other words: My dog is not green or red, but my dog is blue.
Look-ahead/behind constructs (non-capturing)
(?:X) X, as a non-capturing group
(?=X) X, via zero-width positive look-ahead
(?!X) X, via zero-width negative look-ahead
(?<=X) X, via zero-width positive look-behind
(?<!X) X, via zero-width negative look-behind
(?<X) X, as an independent, non-capturing group
So what does this all mean? What does a look-ahead really do for me? Say, for example, we wanted to know if our input string contains the word “incident” but that the word “theft” should not be found anywhere. We can use a negative look-ahead to ensure that there are no occurrences.
“(?!.*theft).*incident.*”
This expression exhibits the following behavior:
"There was a crime incident" matches
"The incident involved a theft" does not match
"The theft was a serious incident" does not match
A more complex example is password validation. Let’s say we want to ensure that a password is made at least 8, but at most 12 alphanumeric characters, and at least two numbers, in any position. We will need to use a look-ahead expression in order to enforce a requirement of two numbers. This look-ahead expression will require any number of characters to be followed by a single digit, followed by any number of characters, and another single digit. E.g.: …4…2, or …42, or 42…, or 4…2.
1.1. Example
Sample code
import java.util.ArrayList;
import java.util.List;
public class LookaheadDemo {
public static void main(String[] args) {
List<String> input = new ArrayList<String>();
input.add("password");
input.add("p4ssword");
input.add("p4ssw0rd");
input.add("p45sword");
for (String ssn : input) {
if (ssn.matches("^(?=.*[0-9].*[0-9])[0-9a-zA-Z]{8,12}$")) {
System.out.println(ssn + ": matches");
} else {
System.out.println(ssn + ": does not match");
}
}
}
}
This produces the following output:
password: does not match
p4ssword: does not match
p4ssw0rd: matches
p45sword: matches
Try this example online with our Visual Java Regex Tester
Dissecting the pattern:
"^(?=.*[0-9].*[0-9])[0-9a-zA-Z]{8,12}$"
^ match the beginning of the line
(?=.*[0-9].*[0-9]) a look-ahead expression, requires 2 digits to be present
.* match n characters, where n >= 0
[0-9] match a digit from 0 to 9
[0-9a-zA-Z] match any numbers or letters
{8,12} match 8 to 12 of whatever is specified by the last group
$ match the end of the line
Multiple look-ahead operations do not evaluate in a specific order. They must all be satisfied equally, and if they logically contradict each other, the pattern will never match.
Visual Regex Tester
To get a more visual look into how regular expressions work, try our visual java regex tester.
2. Configuring the Matching Engine
Pattern configuration flags for Java appear very similar to look-ahead operations. Flags are used to configure case sensitivity, multi-line matching, and more. Flags can be specified in collections, or as individual statements. Again, these expressions are not literal, and do not capture values.
2.1. Configuration flags
(?idmsux-idmsux) Turns match flags on - off for entire expression
(?idmsux-idmsux:X) X, as a non-capturing group with the given flags on – off
2.2. Case insensitivity mode
(?i) Toggle case insensitivity (default: off, (?-i)) for the text in this group only
2.3. UNIX lines mode
(?d) Enables UNIX line mode (default: off, (?-d))
In this mode, only the '\n' line terminator is recognized in the behavior of ., ^, and $
2.4. Multi-line mode
(?m) Toggle treat newlines as whitespace (default: off, (?-m))
The ^ and $ expressions will no longer match to the beginning and end of a line,
respectively, but will match the beginning and end of the entire input sequence/string.
2.5. Dot-all mode
(?s) Toggle dot ‘.’ matches any character (default: off, (?-s))
Normally, the dot character will match everything except newline characters.
2.6. Unicode-case mode
(?u) Toggle Unicode standard case matching (default: off, (?-u)
By default, case-insensitive matching assumes that only characters
in the US-ASCII charset are being matched.
2.7. Comments mode
(?x) Allow comments in pattern (default: off, (?-x))
In this mode, whitespace is ignored, and embedded comments starting with '#'
are ignored until the end of a line.
2.8. Examples
2.8.1. Global toggle
In order to toggle flags for the entire expression, the statement must be at the head of the expression.
"(?idx)^I\s lost\s my\s .+ #this comment and all spaces will be ignored"
The above expression will ignore case, and will set the dot ‘.’ character to include newlines.
Try this example online with our Visual Java Regex Tester
2.8.2. Local toggle
In order to toggle flags for the a single non-capturing group, the group must adhere to the following syntax
"(?idx:Cars)[a-z]+
The above expression will ignore case within the group, but adhere to case beyond.
Try this example online with our Visual Java Regex Tester
2.8.3. Applied in Java
Sample code
public class ConfigurationDemo {
public static void main(String[] args) {
String input = "My dog is Blue.\n" +
"He is not red or green.";
Boolean controlResult = input.matches("(?=.*Green.*).*Blue.*");
Boolean caseInsensitiveResult = input.matches("(?i)(?=.*Green.*).*Blue.*");
Boolean dotallResult = input.matches("(?s)(?=.*Green.*).*Blue.*");
Boolean configuredResult = input.matches("(?si)(?=.*Green.*).*Blue.*");
System.out.println("Control result was: " + controlResult);
System.out.println("Case ins. result was: " + caseInsensitiveResult);
System.out.println("Dot-all result was: " + dotallResult);
System.out.println("Configured result was: " + configuredResult);
}
}
This produces the following output:
Control result was: false
Case insensitive result was: false
Dot-all result was: false
Configured result was: true
Dissecting the pattern:
"(?si)(?=.*Green.*).*Blue.*"
(?si) turn on case insensitivity and dotall modes
(?=.*Green.*) ‘Green’ must be found somewhere to the right of this look-ahead
.*Blue.* ‘Blue’ must be found somewhere in the input
We had to enable multi-line and case-insensitive modes for our pattern to match. The look-ahead in this example is very similar to the pattern itself, and in this case, the pattern could be substituted for another look-ahead. Because we don’t care in which order we find these two items, the way this is written, substituting “(?=.*Blue.*)” for “.*Blue.*” would be an acceptable change; however, if we did care in which order we wanted to find these colors, we would need to be more precise with our ordering. If we wanted to ensure that the ‘Green’ came after ‘Blue’ we would need to move the look-ahead as seen below, and so on.
"(?si).*Blue.*(?=.*Green.*)"
3. Conclusion
Regular expressions provide an extremely flexible and powerful text processing system. Try to imagine doing this work using String.substring(…) or String.indexOf(…), with loops, nested loops, and dozens of if statements. I don’t even want to try… so play around! Think about using regular expressions next time you find yourself doing text or pattern manipulation with looping and other painful methods. Let us know how you do.
This article is part two in the series: “Guide to Regular Expressions in Java.” Read part one for more information on basic matching, grouping, extracting, and substitution.
发表评论
-
java中byte, int的转换 [转]
2013-12-24 16:09 2331转自:http://freewind886.blog.163. ... -
【转】 出现java.lang.UnsupportedClassVersionError 错误的原因
2013-08-14 09:45 1587转自:http://blog.csdn.net/shendl ... -
Java多线程sleep(),join(),interrupt(),wait(),notify()
2013-07-23 23:40 9171. sleep() & interrupt() ... -
[转]java 正则表达式 非捕获组(特殊构造)
2012-08-21 16:52 3153原文出处:http://blog.chenlb.com/ ... -
Java 正则 flags
2012-08-20 14:09 871几下几个常用的正则Pattern的标示 Pattern ...
相关推荐
零宽断言包括零宽正向前瞻、零宽正向后顾、零宽负向前瞻和零宽负向后顾断言,它们在不消耗字符的情况下进行匹配检测。 零宽正向前瞻断言(positive lookahead)的格式为(?=exp),它断言所要匹配的字符或者子字符串...
3. **正向最大匹配法(Forward Maximum Matching, FMM)**:从文本的开头开始,尽可能匹配词典中的最长词汇。 4. **逆向最大匹配法(Backward Maximum Matching, BMM)**:从文本末尾开始,尽可能匹配词典中的最长...
- 支持正向推理与逆向推理。 - 能够在运行环境中直接调用Java类库。 #### 二、JESS的应用场景 - 尽管JESS本身可以作为独立的程序运行,但在实际开发中更常将其嵌入到Java代码中。这种方式通常通过使用JESS提供的...
知识点:SQL 注入可以分为 Boolean 盲注、Union 注入、文件读写、报错注入、时间盲注、REGEXP 正则匹配、宽字节注入、堆叠注入、二次注入、User-Agent 注入、Cookie 注入、过滤绕过、万能密码等类型。 12. SQL 注入...
11. SQL注入分类:包括布尔盲注、联合查询注入、文件读写注入、报错注入、时间盲注、正则匹配注入、宽字节注入、堆叠注入、二次注入等。 12. SQL注入预防措施:使用预编译语句(如PDO)、输入验证、参数化查询、...