428
|
1 @c -*-texinfo-*-
|
|
2 @c This is part of the XEmacs Lisp Reference Manual.
|
|
3 @c Copyright (C) 1990, 1991, 1992, 1993, 1994 Free Software Foundation, Inc.
|
|
4 @c See the file lispref.texi for copying conditions.
|
|
5 @setfilename ../../info/searching.info
|
|
6 @node Searching and Matching, Syntax Tables, Text, Top
|
|
7 @chapter Searching and Matching
|
|
8 @cindex searching
|
|
9
|
|
10 XEmacs provides two ways to search through a buffer for specified
|
|
11 text: exact string searches and regular expression searches. After a
|
|
12 regular expression search, you can examine the @dfn{match data} to
|
|
13 determine which text matched the whole regular expression or various
|
|
14 portions of it.
|
|
15
|
|
16 @menu
|
|
17 * String Search:: Search for an exact match.
|
|
18 * Regular Expressions:: Describing classes of strings.
|
|
19 * Regexp Search:: Searching for a match for a regexp.
|
|
20 * POSIX Regexps:: Searching POSIX-style for the longest match.
|
|
21 * Search and Replace:: Internals of @code{query-replace}.
|
|
22 * Match Data:: Finding out which part of the text matched
|
|
23 various parts of a regexp, after regexp search.
|
|
24 * Searching and Case:: Case-independent or case-significant searching.
|
|
25 * Standard Regexps:: Useful regexps for finding sentences, pages,...
|
|
26 @end menu
|
|
27
|
|
28 The @samp{skip-chars@dots{}} functions also perform a kind of searching.
|
|
29 @xref{Skipping Characters}.
|
|
30
|
|
31 @node String Search
|
|
32 @section Searching for Strings
|
|
33 @cindex string search
|
|
34
|
|
35 These are the primitive functions for searching through the text in a
|
|
36 buffer. They are meant for use in programs, but you may call them
|
|
37 interactively. If you do so, they prompt for the search string;
|
|
38 @var{limit} and @var{noerror} are set to @code{nil}, and @var{repeat}
|
|
39 is set to 1.
|
|
40
|
|
41 @deffn Command search-forward string &optional limit noerror repeat
|
|
42 This function searches forward from point for an exact match for
|
|
43 @var{string}. If successful, it sets point to the end of the occurrence
|
|
44 found, and returns the new value of point. If no match is found, the
|
|
45 value and side effects depend on @var{noerror} (see below).
|
|
46 @c Emacs 19 feature
|
|
47
|
|
48 In the following example, point is initially at the beginning of the
|
|
49 line. Then @code{(search-forward "fox")} moves point after the last
|
|
50 letter of @samp{fox}:
|
|
51
|
|
52 @example
|
|
53 @group
|
|
54 ---------- Buffer: foo ----------
|
|
55 @point{}The quick brown fox jumped over the lazy dog.
|
|
56 ---------- Buffer: foo ----------
|
|
57 @end group
|
|
58
|
|
59 @group
|
|
60 (search-forward "fox")
|
|
61 @result{} 20
|
|
62
|
|
63 ---------- Buffer: foo ----------
|
|
64 The quick brown fox@point{} jumped over the lazy dog.
|
|
65 ---------- Buffer: foo ----------
|
|
66 @end group
|
|
67 @end example
|
|
68
|
|
69 The argument @var{limit} specifies the upper bound to the search. (It
|
|
70 must be a position in the current buffer.) No match extending after
|
|
71 that position is accepted. If @var{limit} is omitted or @code{nil}, it
|
|
72 defaults to the end of the accessible portion of the buffer.
|
|
73
|
|
74 @kindex search-failed
|
|
75 What happens when the search fails depends on the value of
|
|
76 @var{noerror}. If @var{noerror} is @code{nil}, a @code{search-failed}
|
|
77 error is signaled. If @var{noerror} is @code{t}, @code{search-forward}
|
|
78 returns @code{nil} and does nothing. If @var{noerror} is neither
|
|
79 @code{nil} nor @code{t}, then @code{search-forward} moves point to the
|
|
80 upper bound and returns @code{nil}. (It would be more consistent now
|
|
81 to return the new position of point in that case, but some programs
|
|
82 may depend on a value of @code{nil}.)
|
|
83
|
|
84 If @var{repeat} is supplied (it must be a positive number), then the
|
|
85 search is repeated that many times (each time starting at the end of the
|
|
86 previous time's match). If these successive searches succeed, the
|
|
87 function succeeds, moving point and returning its new value. Otherwise
|
|
88 the search fails.
|
|
89 @end deffn
|
|
90
|
|
91 @deffn Command search-backward string &optional limit noerror repeat
|
|
92 This function searches backward from point for @var{string}. It is
|
|
93 just like @code{search-forward} except that it searches backwards and
|
|
94 leaves point at the beginning of the match.
|
|
95 @end deffn
|
|
96
|
|
97 @deffn Command word-search-forward string &optional limit noerror repeat
|
|
98 @cindex word search
|
|
99 This function searches forward from point for a ``word'' match for
|
|
100 @var{string}. If it finds a match, it sets point to the end of the
|
|
101 match found, and returns the new value of point.
|
|
102 @c Emacs 19 feature
|
|
103
|
|
104 Word matching regards @var{string} as a sequence of words, disregarding
|
|
105 punctuation that separates them. It searches the buffer for the same
|
|
106 sequence of words. Each word must be distinct in the buffer (searching
|
|
107 for the word @samp{ball} does not match the word @samp{balls}), but the
|
|
108 details of punctuation and spacing are ignored (searching for @samp{ball
|
|
109 boy} does match @samp{ball. Boy!}).
|
|
110
|
|
111 In this example, point is initially at the beginning of the buffer; the
|
|
112 search leaves it between the @samp{y} and the @samp{!}.
|
|
113
|
|
114 @example
|
|
115 @group
|
|
116 ---------- Buffer: foo ----------
|
|
117 @point{}He said "Please! Find
|
|
118 the ball boy!"
|
|
119 ---------- Buffer: foo ----------
|
|
120 @end group
|
|
121
|
|
122 @group
|
|
123 (word-search-forward "Please find the ball, boy.")
|
|
124 @result{} 35
|
|
125
|
|
126 ---------- Buffer: foo ----------
|
|
127 He said "Please! Find
|
|
128 the ball boy@point{}!"
|
|
129 ---------- Buffer: foo ----------
|
|
130 @end group
|
|
131 @end example
|
|
132
|
|
133 If @var{limit} is non-@code{nil} (it must be a position in the current
|
|
134 buffer), then it is the upper bound to the search. The match found must
|
|
135 not extend after that position.
|
|
136
|
|
137 If @var{noerror} is @code{nil}, then @code{word-search-forward} signals
|
|
138 an error if the search fails. If @var{noerror} is @code{t}, then it
|
|
139 returns @code{nil} instead of signaling an error. If @var{noerror} is
|
|
140 neither @code{nil} nor @code{t}, it moves point to @var{limit} (or the
|
|
141 end of the buffer) and returns @code{nil}.
|
|
142
|
|
143 If @var{repeat} is non-@code{nil}, then the search is repeated that many
|
|
144 times. Point is positioned at the end of the last match.
|
|
145 @end deffn
|
|
146
|
|
147 @deffn Command word-search-backward string &optional limit noerror repeat
|
|
148 This function searches backward from point for a word match to
|
|
149 @var{string}. This function is just like @code{word-search-forward}
|
|
150 except that it searches backward and normally leaves point at the
|
|
151 beginning of the match.
|
|
152 @end deffn
|
|
153
|
|
154 @node Regular Expressions
|
|
155 @section Regular Expressions
|
|
156 @cindex regular expression
|
|
157 @cindex regexp
|
|
158
|
|
159 A @dfn{regular expression} (@dfn{regexp}, for short) is a pattern that
|
|
160 denotes a (possibly infinite) set of strings. Searching for matches for
|
|
161 a regexp is a very powerful operation. This section explains how to write
|
|
162 regexps; the following section says how to search for them.
|
|
163
|
|
164 To gain a thorough understanding of regular expressions and how to use
|
|
165 them to best advantage, we recommend that you study @cite{Mastering
|
|
166 Regular Expressions, by Jeffrey E.F. Friedl, O'Reilly and Associates,
|
|
167 1997}. (It's known as the "Hip Owls" book, because of the picture on its
|
|
168 cover.) You might also read the manuals to @ref{(gawk)Top},
|
|
169 @ref{(ed)Top}, @cite{sed}, @cite{grep}, @ref{(perl)Top},
|
|
170 @ref{(regex)Top}, @ref{(rx)Top}, @cite{pcre}, and @ref{(flex)Top}, which
|
|
171 also make good use of regular expressions.
|
|
172
|
|
173 The XEmacs regular expression syntax most closely resembles that of
|
|
174 @cite{ed}, or @cite{grep}, the GNU versions of which all utilize the GNU
|
|
175 @cite{regex} library. XEmacs' version of @cite{regex} has recently been
|
|
176 extended with some Perl--like capabilities, described in the next
|
|
177 section.
|
|
178
|
|
179 @menu
|
|
180 * Syntax of Regexps:: Rules for writing regular expressions.
|
|
181 * Regexp Example:: Illustrates regular expression syntax.
|
|
182 @end menu
|
|
183
|
|
184 @node Syntax of Regexps
|
|
185 @subsection Syntax of Regular Expressions
|
|
186
|
|
187 Regular expressions have a syntax in which a few characters are
|
|
188 special constructs and the rest are @dfn{ordinary}. An ordinary
|
|
189 character is a simple regular expression that matches that character and
|
|
190 nothing else. The special characters are @samp{.}, @samp{*}, @samp{+},
|
|
191 @samp{?}, @samp{[}, @samp{]}, @samp{^}, @samp{$}, and @samp{\}; no new
|
|
192 special characters will be defined in the future. Any other character
|
|
193 appearing in a regular expression is ordinary, unless a @samp{\}
|
|
194 precedes it.
|
|
195
|
|
196 For example, @samp{f} is not a special character, so it is ordinary, and
|
|
197 therefore @samp{f} is a regular expression that matches the string
|
|
198 @samp{f} and no other string. (It does @emph{not} match the string
|
|
199 @samp{ff}.) Likewise, @samp{o} is a regular expression that matches
|
|
200 only @samp{o}.@refill
|
|
201
|
|
202 Any two regular expressions @var{a} and @var{b} can be concatenated. The
|
|
203 result is a regular expression that matches a string if @var{a} matches
|
|
204 some amount of the beginning of that string and @var{b} matches the rest of
|
|
205 the string.@refill
|
|
206
|
|
207 As a simple example, we can concatenate the regular expressions @samp{f}
|
|
208 and @samp{o} to get the regular expression @samp{fo}, which matches only
|
|
209 the string @samp{fo}. Still trivial. To do something more powerful, you
|
|
210 need to use one of the special characters. Here is a list of them:
|
|
211
|
|
212 @need 1200
|
|
213 @table @kbd
|
|
214 @item .@: @r{(Period)}
|
|
215 @cindex @samp{.} in regexp
|
|
216 is a special character that matches any single character except a newline.
|
|
217 Using concatenation, we can make regular expressions like @samp{a.b}, which
|
|
218 matches any three-character string that begins with @samp{a} and ends with
|
|
219 @samp{b}.@refill
|
|
220
|
|
221 @item *
|
|
222 @cindex @samp{*} in regexp
|
|
223 is not a construct by itself; it is a quantifying suffix operator that
|
|
224 means to repeat the preceding regular expression as many times as
|
|
225 possible. In @samp{fo*}, the @samp{*} applies to the @samp{o}, so
|
|
226 @samp{fo*} matches one @samp{f} followed by any number of @samp{o}s.
|
|
227 The case of zero @samp{o}s is allowed: @samp{fo*} does match
|
|
228 @samp{f}.@refill
|
|
229
|
|
230 @samp{*} always applies to the @emph{smallest} possible preceding
|
|
231 expression. Thus, @samp{fo*} has a repeating @samp{o}, not a
|
|
232 repeating @samp{fo}.@refill
|
|
233
|
|
234 The matcher processes a @samp{*} construct by matching, immediately, as
|
|
235 many repetitions as can be found; it is "greedy". Then it continues
|
|
236 with the rest of the pattern. If that fails, backtracking occurs,
|
|
237 discarding some of the matches of the @samp{*}-modified construct in
|
|
238 case that makes it possible to match the rest of the pattern. For
|
|
239 example, in matching @samp{ca*ar} against the string @samp{caaar}, the
|
|
240 @samp{a*} first tries to match all three @samp{a}s; but the rest of the
|
|
241 pattern is @samp{ar} and there is only @samp{r} left to match, so this
|
|
242 try fails. The next alternative is for @samp{a*} to match only two
|
|
243 @samp{a}s. With this choice, the rest of the regexp matches
|
|
244 successfully.@refill
|
|
245
|
|
246 Nested repetition operators can be extremely slow if they specify
|
|
247 backtracking loops. For example, it could take hours for the regular
|
|
248 expression @samp{\(x+y*\)*a} to match the sequence
|
|
249 @samp{xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxz}. The slowness is because
|
|
250 Emacs must try each imaginable way of grouping the 35 @samp{x}'s before
|
|
251 concluding that none of them can work. To make sure your regular
|
|
252 expressions run fast, check nested repetitions carefully.
|
|
253
|
|
254 @item +
|
|
255 @cindex @samp{+} in regexp
|
|
256 is a quantifying suffix operator similar to @samp{*} except that the
|
|
257 preceding expression must match at least once. It is also "greedy".
|
|
258 So, for example, @samp{ca+r} matches the strings @samp{car} and
|
|
259 @samp{caaaar} but not the string @samp{cr}, whereas @samp{ca*r} matches
|
|
260 all three strings.
|
|
261
|
|
262 @item ?
|
|
263 @cindex @samp{?} in regexp
|
|
264 is a quantifying suffix operator similar to @samp{*}, except that the
|
|
265 preceding expression can match either once or not at all. For example,
|
|
266 @samp{ca?r} matches @samp{car} or @samp{cr}, but does not match anything
|
|
267 else.
|
|
268
|
|
269 @item *?
|
|
270 @cindex @samp{*?} in regexp
|
|
271 works just like @samp{*}, except that rather than matching the longest
|
|
272 match, it matches the shortest match. @samp{*?} is known as a
|
|
273 @dfn{non-greedy} quantifier, a regexp construct borrowed from Perl.
|
|
274 @c Did perl get this from somewhere? What's the real history of *? ?
|
|
275
|
442
|
276 This construct is very useful for when you want to match the text inside
|
|
277 a pair of delimiters. For instance, @samp{/\*.*?\*/} will match C
|
|
278 comments in a string. This could not easily be achieved without the use
|
|
279 of a non-greedy quantifier.
|
428
|
280
|
|
281 This construct has not been available prior to XEmacs 20.4. It is not
|
|
282 available in FSF Emacs.
|
|
283
|
|
284 @item +?
|
|
285 @cindex @samp{+?} in regexp
|
442
|
286 is the non-greedy version of @samp{+}.
|
|
287
|
|
288 @item ??
|
|
289 @cindex @samp{??} in regexp
|
|
290 is the non-greedy version of @samp{?}.
|
428
|
291
|
|
292 @item \@{n,m\@}
|
|
293 @c Note the spacing after the close brace is deliberate.
|
|
294 @cindex @samp{\@{n,m\@} }in regexp
|
|
295 serves as an interval quantifier, analogous to @samp{*} or @samp{+}, but
|
|
296 specifies that the expression must match at least @var{n} times, but no
|
|
297 more than @var{m} times. This syntax is supported by most Unix regexp
|
|
298 utilities, and has been introduced to XEmacs for the version 20.3.
|
|
299
|
442
|
300 Unfortunately, the non-greedy version of this quantifier does not exist
|
|
301 currently, although it does in Perl.
|
|
302
|
428
|
303 @item [ @dots{} ]
|
|
304 @cindex character set (in regexp)
|
|
305 @cindex @samp{[} in regexp
|
|
306 @cindex @samp{]} in regexp
|
|
307 @samp{[} begins a @dfn{character set}, which is terminated by a
|
|
308 @samp{]}. In the simplest case, the characters between the two brackets
|
|
309 form the set. Thus, @samp{[ad]} matches either one @samp{a} or one
|
|
310 @samp{d}, and @samp{[ad]*} matches any string composed of just @samp{a}s
|
|
311 and @samp{d}s (including the empty string), from which it follows that
|
|
312 @samp{c[ad]*r} matches @samp{cr}, @samp{car}, @samp{cdr},
|
|
313 @samp{caddaar}, etc.@refill
|
|
314
|
|
315 The usual regular expression special characters are not special inside a
|
|
316 character set. A completely different set of special characters exists
|
|
317 inside character sets: @samp{]}, @samp{-} and @samp{^}.@refill
|
|
318
|
|
319 @samp{-} is used for ranges of characters. To write a range, write two
|
|
320 characters with a @samp{-} between them. Thus, @samp{[a-z]} matches any
|
|
321 lower case letter. Ranges may be intermixed freely with individual
|
|
322 characters, as in @samp{[a-z$%.]}, which matches any lower case letter
|
|
323 or @samp{$}, @samp{%}, or a period.@refill
|
|
324
|
|
325 To include a @samp{]} in a character set, make it the first character.
|
|
326 For example, @samp{[]a]} matches @samp{]} or @samp{a}. To include a
|
|
327 @samp{-}, write @samp{-} as the first character in the set, or put it
|
|
328 immediately after a range. (You can replace one individual character
|
|
329 @var{c} with the range @samp{@var{c}-@var{c}} to make a place to put the
|
|
330 @samp{-}.) There is no way to write a set containing just @samp{-} and
|
|
331 @samp{]}.
|
|
332
|
|
333 To include @samp{^} in a set, put it anywhere but at the beginning of
|
|
334 the set.
|
|
335
|
|
336 @item [^ @dots{} ]
|
|
337 @cindex @samp{^} in regexp
|
|
338 @samp{[^} begins a @dfn{complement character set}, which matches any
|
|
339 character except the ones specified. Thus, @samp{[^a-z0-9A-Z]}
|
|
340 matches all characters @emph{except} letters and digits.@refill
|
|
341
|
|
342 @samp{^} is not special in a character set unless it is the first
|
|
343 character. The character following the @samp{^} is treated as if it
|
|
344 were first (thus, @samp{-} and @samp{]} are not special there).
|
|
345
|
|
346 Note that a complement character set can match a newline, unless
|
|
347 newline is mentioned as one of the characters not to match.
|
|
348
|
|
349 @item ^
|
|
350 @cindex @samp{^} in regexp
|
|
351 @cindex beginning of line in regexp
|
|
352 is a special character that matches the empty string, but only at the
|
|
353 beginning of a line in the text being matched. Otherwise it fails to
|
|
354 match anything. Thus, @samp{^foo} matches a @samp{foo} that occurs at
|
|
355 the beginning of a line.
|
|
356
|
|
357 When matching a string instead of a buffer, @samp{^} matches at the
|
|
358 beginning of the string or after a newline character @samp{\n}.
|
|
359
|
|
360 @item $
|
|
361 @cindex @samp{$} in regexp
|
|
362 is similar to @samp{^} but matches only at the end of a line. Thus,
|
|
363 @samp{x+$} matches a string of one @samp{x} or more at the end of a line.
|
|
364
|
|
365 When matching a string instead of a buffer, @samp{$} matches at the end
|
|
366 of the string or before a newline character @samp{\n}.
|
|
367
|
|
368 @item \
|
|
369 @cindex @samp{\} in regexp
|
|
370 has two functions: it quotes the special characters (including
|
|
371 @samp{\}), and it introduces additional special constructs.
|
|
372
|
|
373 Because @samp{\} quotes special characters, @samp{\$} is a regular
|
|
374 expression that matches only @samp{$}, and @samp{\[} is a regular
|
|
375 expression that matches only @samp{[}, and so on.
|
|
376
|
|
377 Note that @samp{\} also has special meaning in the read syntax of Lisp
|
|
378 strings (@pxref{String Type}), and must be quoted with @samp{\}. For
|
|
379 example, the regular expression that matches the @samp{\} character is
|
|
380 @samp{\\}. To write a Lisp string that contains the characters
|
|
381 @samp{\\}, Lisp syntax requires you to quote each @samp{\} with another
|
|
382 @samp{\}. Therefore, the read syntax for a regular expression matching
|
|
383 @samp{\} is @code{"\\\\"}.@refill
|
|
384 @end table
|
|
385
|
|
386 @strong{Please note:} For historical compatibility, special characters
|
|
387 are treated as ordinary ones if they are in contexts where their special
|
|
388 meanings make no sense. For example, @samp{*foo} treats @samp{*} as
|
|
389 ordinary since there is no preceding expression on which the @samp{*}
|
|
390 can act. It is poor practice to depend on this behavior; quote the
|
|
391 special character anyway, regardless of where it appears.@refill
|
|
392
|
|
393 For the most part, @samp{\} followed by any character matches only
|
|
394 that character. However, there are several exceptions: characters
|
|
395 that, when preceded by @samp{\}, are special constructs. Such
|
|
396 characters are always ordinary when encountered on their own. Here
|
|
397 is a table of @samp{\} constructs:
|
|
398
|
|
399 @table @kbd
|
|
400 @item \|
|
|
401 @cindex @samp{|} in regexp
|
|
402 @cindex regexp alternative
|
|
403 specifies an alternative.
|
|
404 Two regular expressions @var{a} and @var{b} with @samp{\|} in
|
|
405 between form an expression that matches anything that either @var{a} or
|
|
406 @var{b} matches.@refill
|
|
407
|
|
408 Thus, @samp{foo\|bar} matches either @samp{foo} or @samp{bar}
|
|
409 but no other string.@refill
|
|
410
|
|
411 @samp{\|} applies to the largest possible surrounding expressions. Only a
|
|
412 surrounding @samp{\( @dots{} \)} grouping can limit the grouping power of
|
|
413 @samp{\|}.@refill
|
|
414
|
|
415 Full backtracking capability exists to handle multiple uses of @samp{\|}.
|
|
416
|
|
417 @item \( @dots{} \)
|
|
418 @cindex @samp{(} in regexp
|
|
419 @cindex @samp{)} in regexp
|
|
420 @cindex regexp grouping
|
|
421 is a grouping construct that serves three purposes:
|
|
422
|
|
423 @enumerate
|
|
424 @item
|
|
425 To enclose a set of @samp{\|} alternatives for other operations.
|
|
426 Thus, @samp{\(foo\|bar\)x} matches either @samp{foox} or @samp{barx}.
|
|
427
|
|
428 @item
|
|
429 To enclose an expression for a suffix operator such as @samp{*} to act
|
|
430 on. Thus, @samp{ba\(na\)*} matches @samp{bananana}, etc., with any
|
|
431 (zero or more) number of @samp{na} strings.@refill
|
|
432
|
|
433 @item
|
|
434 To record a matched substring for future reference.
|
|
435 @end enumerate
|
|
436
|
|
437 This last application is not a consequence of the idea of a
|
|
438 parenthetical grouping; it is a separate feature that happens to be
|
|
439 assigned as a second meaning to the same @samp{\( @dots{} \)} construct
|
|
440 because there is no conflict in practice between the two meanings.
|
|
441 Here is an explanation of this feature:
|
|
442
|
|
443 @item \@var{digit}
|
|
444 matches the same text that matched the @var{digit}th occurrence of a
|
|
445 @samp{\( @dots{} \)} construct.
|
|
446
|
|
447 In other words, after the end of a @samp{\( @dots{} \)} construct. the
|
|
448 matcher remembers the beginning and end of the text matched by that
|
|
449 construct. Then, later on in the regular expression, you can use
|
|
450 @samp{\} followed by @var{digit} to match that same text, whatever it
|
|
451 may have been.
|
|
452
|
|
453 The strings matching the first nine @samp{\( @dots{} \)} constructs
|
|
454 appearing in a regular expression are assigned numbers 1 through 9 in
|
|
455 the order that the open parentheses appear in the regular expression.
|
|
456 So you can use @samp{\1} through @samp{\9} to refer to the text matched
|
|
457 by the corresponding @samp{\( @dots{} \)} constructs.
|
|
458
|
|
459 For example, @samp{\(.*\)\1} matches any newline-free string that is
|
|
460 composed of two identical halves. The @samp{\(.*\)} matches the first
|
|
461 half, which may be anything, but the @samp{\1} that follows must match
|
|
462 the same exact text.
|
|
463
|
|
464 @item \(?: @dots{} \)
|
|
465 @cindex @samp{\(?:} in regexp
|
|
466 @cindex regexp grouping
|
|
467 is called a @dfn{shy} grouping operator, and it is used just like
|
|
468 @samp{\( @dots{} \)}, except that it does not cause the matched
|
|
469 substring to be recorded for future reference.
|
|
470
|
|
471 This is useful when you need a lot of grouping @samp{\( @dots{} \)}
|
442
|
472 constructs, but only want to remember one or two -- or if you have
|
|
473 more than nine groupings and need to use backreferences to refer to
|
|
474 the groupings at the end.
|
428
|
475
|
|
476 Using @samp{\(?: @dots{} \)} rather than @samp{\( @dots{} \)} when you
|
|
477 don't need the captured substrings ought to speed up your programs some,
|
|
478 since it shortens the code path followed by the regular expression
|
|
479 engine, as well as the amount of memory allocation and string copying it
|
|
480 must do. The actual performance gain to be observed has not been
|
|
481 measured or quantified as of this writing.
|
|
482 @c This is used to good advantage by the font-locking code, and by
|
442
|
483 @c `regexp-opt.el'.
|
428
|
484
|
|
485 The shy grouping operator has been borrowed from Perl, and has not been
|
|
486 available prior to XEmacs 20.3, nor is it available in FSF Emacs.
|
|
487
|
|
488 @item \w
|
|
489 @cindex @samp{\w} in regexp
|
|
490 matches any word-constituent character. The editor syntax table
|
|
491 determines which characters these are. @xref{Syntax Tables}.
|
|
492
|
|
493 @item \W
|
|
494 @cindex @samp{\W} in regexp
|
|
495 matches any character that is not a word constituent.
|
|
496
|
|
497 @item \s@var{code}
|
|
498 @cindex @samp{\s} in regexp
|
|
499 matches any character whose syntax is @var{code}. Here @var{code} is a
|
|
500 character that represents a syntax code: thus, @samp{w} for word
|
|
501 constituent, @samp{-} for whitespace, @samp{(} for open parenthesis,
|
|
502 etc. @xref{Syntax Tables}, for a list of syntax codes and the
|
|
503 characters that stand for them.
|
|
504
|
|
505 @item \S@var{code}
|
|
506 @cindex @samp{\S} in regexp
|
|
507 matches any character whose syntax is not @var{code}.
|
|
508 @end table
|
|
509
|
|
510 The following regular expression constructs match the empty string---that is,
|
|
511 they don't use up any characters---but whether they match depends on the
|
|
512 context.
|
|
513
|
|
514 @table @kbd
|
|
515 @item \`
|
|
516 @cindex @samp{\`} in regexp
|
|
517 matches the empty string, but only at the beginning
|
|
518 of the buffer or string being matched against.
|
|
519
|
|
520 @item \'
|
|
521 @cindex @samp{\'} in regexp
|
|
522 matches the empty string, but only at the end of
|
|
523 the buffer or string being matched against.
|
|
524
|
|
525 @item \=
|
|
526 @cindex @samp{\=} in regexp
|
|
527 matches the empty string, but only at point.
|
|
528 (This construct is not defined when matching against a string.)
|
|
529
|
|
530 @item \b
|
|
531 @cindex @samp{\b} in regexp
|
|
532 matches the empty string, but only at the beginning or
|
|
533 end of a word. Thus, @samp{\bfoo\b} matches any occurrence of
|
|
534 @samp{foo} as a separate word. @samp{\bballs?\b} matches
|
|
535 @samp{ball} or @samp{balls} as a separate word.@refill
|
|
536
|
|
537 @item \B
|
|
538 @cindex @samp{\B} in regexp
|
|
539 matches the empty string, but @emph{not} at the beginning or
|
|
540 end of a word.
|
|
541
|
|
542 @item \<
|
|
543 @cindex @samp{\<} in regexp
|
|
544 matches the empty string, but only at the beginning of a word.
|
|
545
|
|
546 @item \>
|
|
547 @cindex @samp{\>} in regexp
|
|
548 matches the empty string, but only at the end of a word.
|
|
549 @end table
|
|
550
|
|
551 @kindex invalid-regexp
|
|
552 Not every string is a valid regular expression. For example, a string
|
|
553 with unbalanced square brackets is invalid (with a few exceptions, such
|
|
554 as @samp{[]]}), and so is a string that ends with a single @samp{\}. If
|
|
555 an invalid regular expression is passed to any of the search functions,
|
|
556 an @code{invalid-regexp} error is signaled.
|
|
557
|
|
558 @defun regexp-quote string
|
|
559 This function returns a regular expression string that matches exactly
|
|
560 @var{string} and nothing else. This allows you to request an exact
|
|
561 string match when calling a function that wants a regular expression.
|
|
562
|
|
563 @example
|
|
564 @group
|
|
565 (regexp-quote "^The cat$")
|
|
566 @result{} "\\^The cat\\$"
|
|
567 @end group
|
|
568 @end example
|
|
569
|
|
570 One use of @code{regexp-quote} is to combine an exact string match with
|
|
571 context described as a regular expression. For example, this searches
|
|
572 for the string that is the value of @code{string}, surrounded by
|
|
573 whitespace:
|
|
574
|
|
575 @example
|
|
576 @group
|
|
577 (re-search-forward
|
|
578 (concat "\\s-" (regexp-quote string) "\\s-"))
|
|
579 @end group
|
|
580 @end example
|
|
581 @end defun
|
|
582
|
|
583 @node Regexp Example
|
|
584 @subsection Complex Regexp Example
|
|
585
|
|
586 Here is a complicated regexp, used by XEmacs to recognize the end of a
|
|
587 sentence together with any whitespace that follows. It is the value of
|
|
588 the variable @code{sentence-end}.
|
|
589
|
|
590 First, we show the regexp as a string in Lisp syntax to distinguish
|
|
591 spaces from tab characters. The string constant begins and ends with a
|
|
592 double-quote. @samp{\"} stands for a double-quote as part of the
|
|
593 string, @samp{\\} for a backslash as part of the string, @samp{\t} for a
|
|
594 tab and @samp{\n} for a newline.
|
|
595
|
|
596 @example
|
|
597 "[.?!][]\"')@}]*\\($\\| $\\|\t\\| \\)[ \t\n]*"
|
|
598 @end example
|
|
599
|
|
600 In contrast, if you evaluate the variable @code{sentence-end}, you
|
|
601 will see the following:
|
|
602
|
|
603 @example
|
|
604 @group
|
|
605 sentence-end
|
|
606 @result{}
|
|
607 "[.?!][]\"')@}]*\\($\\| $\\| \\| \\)[
|
|
608 ]*"
|
|
609 @end group
|
|
610 @end example
|
|
611
|
|
612 @noindent
|
|
613 In this output, tab and newline appear as themselves.
|
|
614
|
|
615 This regular expression contains four parts in succession and can be
|
|
616 deciphered as follows:
|
|
617
|
|
618 @table @code
|
|
619 @item [.?!]
|
|
620 The first part of the pattern is a character set that matches any one of
|
|
621 three characters: period, question mark, and exclamation mark. The
|
|
622 match must begin with one of these three characters.
|
|
623
|
|
624 @item []\"')@}]*
|
|
625 The second part of the pattern matches any closing braces and quotation
|
|
626 marks, zero or more of them, that may follow the period, question mark
|
|
627 or exclamation mark. The @code{\"} is Lisp syntax for a double-quote in
|
|
628 a string. The @samp{*} at the end indicates that the immediately
|
|
629 preceding regular expression (a character set, in this case) may be
|
|
630 repeated zero or more times.
|
|
631
|
|
632 @item \\($\\|@ $\\|\t\\|@ @ \\)
|
|
633 The third part of the pattern matches the whitespace that follows the
|
|
634 end of a sentence: the end of a line, or a tab, or two spaces. The
|
|
635 double backslashes mark the parentheses and vertical bars as regular
|
|
636 expression syntax; the parentheses delimit a group and the vertical bars
|
|
637 separate alternatives. The dollar sign is used to match the end of a
|
|
638 line.
|
|
639
|
|
640 @item [ \t\n]*
|
|
641 Finally, the last part of the pattern matches any additional whitespace
|
|
642 beyond the minimum needed to end a sentence.
|
|
643 @end table
|
|
644
|
|
645 @node Regexp Search
|
|
646 @section Regular Expression Searching
|
|
647 @cindex regular expression searching
|
|
648 @cindex regexp searching
|
|
649 @cindex searching for regexp
|
|
650
|
|
651 In XEmacs, you can search for the next match for a regexp either
|
|
652 incrementally or not. Incremental search commands are described in the
|
|
653 @cite{The XEmacs Reference Manual}. @xref{Regexp Search, , Regular Expression
|
|
654 Search, emacs, The XEmacs Reference Manual}. Here we describe only the search
|
|
655 functions useful in programs. The principal one is
|
|
656 @code{re-search-forward}.
|
|
657
|
|
658 @deffn Command re-search-forward regexp &optional limit noerror repeat
|
|
659 This function searches forward in the current buffer for a string of
|
|
660 text that is matched by the regular expression @var{regexp}. The
|
|
661 function skips over any amount of text that is not matched by
|
|
662 @var{regexp}, and leaves point at the end of the first match found.
|
|
663 It returns the new value of point.
|
|
664
|
|
665 If @var{limit} is non-@code{nil} (it must be a position in the current
|
|
666 buffer), then it is the upper bound to the search. No match extending
|
|
667 after that position is accepted.
|
|
668
|
|
669 What happens when the search fails depends on the value of
|
|
670 @var{noerror}. If @var{noerror} is @code{nil}, a @code{search-failed}
|
|
671 error is signaled. If @var{noerror} is @code{t},
|
|
672 @code{re-search-forward} does nothing and returns @code{nil}. If
|
|
673 @var{noerror} is neither @code{nil} nor @code{t}, then
|
|
674 @code{re-search-forward} moves point to @var{limit} (or the end of the
|
|
675 buffer) and returns @code{nil}.
|
|
676
|
|
677 If @var{repeat} is supplied (it must be a positive number), then the
|
|
678 search is repeated that many times (each time starting at the end of the
|
|
679 previous time's match). If these successive searches succeed, the
|
|
680 function succeeds, moving point and returning its new value. Otherwise
|
|
681 the search fails.
|
|
682
|
|
683 In the following example, point is initially before the @samp{T}.
|
|
684 Evaluating the search call moves point to the end of that line (between
|
|
685 the @samp{t} of @samp{hat} and the newline).
|
|
686
|
|
687 @example
|
|
688 @group
|
|
689 ---------- Buffer: foo ----------
|
|
690 I read "@point{}The cat in the hat
|
|
691 comes back" twice.
|
|
692 ---------- Buffer: foo ----------
|
|
693 @end group
|
|
694
|
|
695 @group
|
|
696 (re-search-forward "[a-z]+" nil t 5)
|
|
697 @result{} 27
|
|
698
|
|
699 ---------- Buffer: foo ----------
|
|
700 I read "The cat in the hat@point{}
|
|
701 comes back" twice.
|
|
702 ---------- Buffer: foo ----------
|
|
703 @end group
|
|
704 @end example
|
|
705 @end deffn
|
|
706
|
|
707 @deffn Command re-search-backward regexp &optional limit noerror repeat
|
|
708 This function searches backward in the current buffer for a string of
|
|
709 text that is matched by the regular expression @var{regexp}, leaving
|
|
710 point at the beginning of the first text found.
|
|
711
|
|
712 This function is analogous to @code{re-search-forward}, but they are not
|
|
713 simple mirror images. @code{re-search-forward} finds the match whose
|
|
714 beginning is as close as possible to the starting point. If
|
|
715 @code{re-search-backward} were a perfect mirror image, it would find the
|
|
716 match whose end is as close as possible. However, in fact it finds the
|
|
717 match whose beginning is as close as possible. The reason is that
|
|
718 matching a regular expression at a given spot always works from
|
|
719 beginning to end, and starts at a specified beginning position.
|
|
720
|
|
721 A true mirror-image of @code{re-search-forward} would require a special
|
|
722 feature for matching regexps from end to beginning. It's not worth the
|
|
723 trouble of implementing that.
|
|
724 @end deffn
|
|
725
|
|
726 @defun string-match regexp string &optional start
|
|
727 This function returns the index of the start of the first match for
|
|
728 the regular expression @var{regexp} in @var{string}, or @code{nil} if
|
|
729 there is no match. If @var{start} is non-@code{nil}, the search starts
|
|
730 at that index in @var{string}.
|
|
731
|
|
732 For example,
|
|
733
|
|
734 @example
|
|
735 @group
|
|
736 (string-match
|
|
737 "quick" "The quick brown fox jumped quickly.")
|
|
738 @result{} 4
|
|
739 @end group
|
|
740 @group
|
|
741 (string-match
|
|
742 "quick" "The quick brown fox jumped quickly." 8)
|
|
743 @result{} 27
|
|
744 @end group
|
|
745 @end example
|
|
746
|
|
747 @noindent
|
|
748 The index of the first character of the
|
|
749 string is 0, the index of the second character is 1, and so on.
|
|
750
|
|
751 After this function returns, the index of the first character beyond
|
|
752 the match is available as @code{(match-end 0)}. @xref{Match Data}.
|
|
753
|
|
754 @example
|
|
755 @group
|
|
756 (string-match
|
|
757 "quick" "The quick brown fox jumped quickly." 8)
|
|
758 @result{} 27
|
|
759 @end group
|
|
760
|
|
761 @group
|
|
762 (match-end 0)
|
|
763 @result{} 32
|
|
764 @end group
|
|
765 @end example
|
|
766 @end defun
|
|
767
|
|
768 @defun split-string string &optional pattern
|
|
769 This function splits @var{string} to substrings delimited by
|
|
770 @var{pattern}, and returns a list of substrings. If @var{pattern} is
|
|
771 omitted, it defaults to @samp{[ \f\t\n\r\v]+}, which means that it
|
|
772 splits @var{string} by white--space.
|
|
773
|
|
774 @example
|
|
775 @group
|
|
776 (split-string "foo bar")
|
|
777 @result{} ("foo" "bar")
|
|
778 @end group
|
|
779
|
|
780 @group
|
|
781 (split-string "something")
|
|
782 @result{} ("something")
|
|
783 @end group
|
|
784
|
|
785 @group
|
|
786 (split-string "a:b:c" ":")
|
|
787 @result{} ("a" "b" "c")
|
|
788 @end group
|
|
789
|
|
790 @group
|
|
791 (split-string ":a::b:c" ":")
|
|
792 @result{} ("" "a" "" "b" "c")
|
|
793 @end group
|
|
794 @end example
|
|
795 @end defun
|
|
796
|
|
797 @defun split-path path
|
|
798 This function splits a search path into a list of strings. The path
|
|
799 components are separated with the characters specified with
|
|
800 @code{path-separator}. Under Unix, @code{path-separator} will normally
|
|
801 be @samp{:}, while under Windows, it will be @samp{;}.
|
|
802 @end defun
|
|
803
|
|
804 @defun looking-at regexp
|
|
805 This function determines whether the text in the current buffer directly
|
|
806 following point matches the regular expression @var{regexp}. ``Directly
|
|
807 following'' means precisely that: the search is ``anchored'' and it can
|
|
808 succeed only starting with the first character following point. The
|
|
809 result is @code{t} if so, @code{nil} otherwise.
|
|
810
|
|
811 This function does not move point, but it updates the match data, which
|
|
812 you can access using @code{match-beginning} and @code{match-end}.
|
|
813 @xref{Match Data}.
|
|
814
|
|
815 In this example, point is located directly before the @samp{T}. If it
|
|
816 were anywhere else, the result would be @code{nil}.
|
|
817
|
|
818 @example
|
|
819 @group
|
|
820 ---------- Buffer: foo ----------
|
|
821 I read "@point{}The cat in the hat
|
|
822 comes back" twice.
|
|
823 ---------- Buffer: foo ----------
|
|
824
|
|
825 (looking-at "The cat in the hat$")
|
|
826 @result{} t
|
|
827 @end group
|
|
828 @end example
|
|
829 @end defun
|
|
830
|
|
831 @node POSIX Regexps
|
|
832 @section POSIX Regular Expression Searching
|
|
833
|
|
834 The usual regular expression functions do backtracking when necessary
|
|
835 to handle the @samp{\|} and repetition constructs, but they continue
|
|
836 this only until they find @emph{some} match. Then they succeed and
|
|
837 report the first match found.
|
|
838
|
|
839 This section describes alternative search functions which perform the
|
|
840 full backtracking specified by the POSIX standard for regular expression
|
|
841 matching. They continue backtracking until they have tried all
|
|
842 possibilities and found all matches, so they can report the longest
|
|
843 match, as required by POSIX. This is much slower, so use these
|
|
844 functions only when you really need the longest match.
|
|
845
|
|
846 In Emacs versions prior to 19.29, these functions did not exist, and
|
|
847 the functions described above implemented full POSIX backtracking.
|
|
848
|
|
849 @defun posix-search-forward regexp &optional limit noerror repeat
|
|
850 This is like @code{re-search-forward} except that it performs the full
|
|
851 backtracking specified by the POSIX standard for regular expression
|
|
852 matching.
|
|
853 @end defun
|
|
854
|
|
855 @defun posix-search-backward regexp &optional limit noerror repeat
|
|
856 This is like @code{re-search-backward} except that it performs the full
|
|
857 backtracking specified by the POSIX standard for regular expression
|
|
858 matching.
|
|
859 @end defun
|
|
860
|
|
861 @defun posix-looking-at regexp
|
|
862 This is like @code{looking-at} except that it performs the full
|
|
863 backtracking specified by the POSIX standard for regular expression
|
|
864 matching.
|
|
865 @end defun
|
|
866
|
|
867 @defun posix-string-match regexp string &optional start
|
|
868 This is like @code{string-match} except that it performs the full
|
|
869 backtracking specified by the POSIX standard for regular expression
|
|
870 matching.
|
|
871 @end defun
|
|
872
|
|
873 @ignore
|
|
874 @deffn Command delete-matching-lines regexp
|
|
875 This function is identical to @code{delete-non-matching-lines}, save
|
|
876 that it deletes what @code{delete-non-matching-lines} keeps.
|
|
877
|
|
878 In the example below, point is located on the first line of text.
|
|
879
|
|
880 @example
|
|
881 @group
|
|
882 ---------- Buffer: foo ----------
|
|
883 We hold these truths
|
|
884 to be self-evident,
|
|
885 that all men are created
|
|
886 equal, and that they are
|
|
887 ---------- Buffer: foo ----------
|
|
888 @end group
|
|
889
|
|
890 @group
|
|
891 (delete-matching-lines "the")
|
|
892 @result{} nil
|
|
893
|
|
894 ---------- Buffer: foo ----------
|
|
895 to be self-evident,
|
|
896 that all men are created
|
|
897 ---------- Buffer: foo ----------
|
|
898 @end group
|
|
899 @end example
|
|
900 @end deffn
|
|
901
|
|
902 @deffn Command flush-lines regexp
|
|
903 This function is the same as @code{delete-matching-lines}.
|
|
904 @end deffn
|
|
905
|
|
906 @defun delete-non-matching-lines regexp
|
|
907 This function deletes all lines following point which don't
|
|
908 contain a match for the regular expression @var{regexp}.
|
|
909 @end defun
|
|
910
|
|
911 @deffn Command keep-lines regexp
|
|
912 This function is the same as @code{delete-non-matching-lines}.
|
|
913 @end deffn
|
|
914
|
|
915 @deffn Command how-many regexp
|
|
916 This function counts the number of matches for @var{regexp} there are in
|
|
917 the current buffer following point. It prints this number in
|
|
918 the echo area, returning the string printed.
|
|
919 @end deffn
|
|
920
|
|
921 @deffn Command count-matches regexp
|
|
922 This function is a synonym of @code{how-many}.
|
|
923 @end deffn
|
|
924
|
|
925 @deffn Command list-matching-lines regexp nlines
|
|
926 This function is a synonym of @code{occur}.
|
|
927 Show all lines following point containing a match for @var{regexp}.
|
|
928 Display each line with @var{nlines} lines before and after,
|
|
929 or @code{-}@var{nlines} before if @var{nlines} is negative.
|
|
930 @var{nlines} defaults to @code{list-matching-lines-default-context-lines}.
|
|
931 Interactively it is the prefix arg.
|
|
932
|
|
933 The lines are shown in a buffer named @samp{*Occur*}.
|
|
934 It serves as a menu to find any of the occurrences in this buffer.
|
|
935 @kbd{C-h m} (@code{describe-mode} in that buffer gives help.
|
|
936 @end deffn
|
|
937
|
|
938 @defopt list-matching-lines-default-context-lines
|
|
939 Default value is 0.
|
|
940 Default number of context lines to include around a @code{list-matching-lines}
|
|
941 match. A negative number means to include that many lines before the match.
|
|
942 A positive number means to include that many lines both before and after.
|
|
943 @end defopt
|
|
944 @end ignore
|
|
945
|
|
946 @node Search and Replace
|
|
947 @section Search and Replace
|
|
948 @cindex replacement
|
|
949
|
|
950 @defun perform-replace from-string replacements query-flag regexp-flag delimited-flag &optional repeat-count map
|
|
951 This function is the guts of @code{query-replace} and related commands.
|
|
952 It searches for occurrences of @var{from-string} and replaces some or
|
|
953 all of them. If @var{query-flag} is @code{nil}, it replaces all
|
|
954 occurrences; otherwise, it asks the user what to do about each one.
|
|
955
|
|
956 If @var{regexp-flag} is non-@code{nil}, then @var{from-string} is
|
|
957 considered a regular expression; otherwise, it must match literally. If
|
|
958 @var{delimited-flag} is non-@code{nil}, then only replacements
|
|
959 surrounded by word boundaries are considered.
|
|
960
|
|
961 The argument @var{replacements} specifies what to replace occurrences
|
|
962 with. If it is a string, that string is used. It can also be a list of
|
|
963 strings, to be used in cyclic order.
|
|
964
|
|
965 If @var{repeat-count} is non-@code{nil}, it should be an integer. Then
|
|
966 it specifies how many times to use each of the strings in the
|
|
967 @var{replacements} list before advancing cyclicly to the next one.
|
|
968
|
|
969 Normally, the keymap @code{query-replace-map} defines the possible user
|
|
970 responses for queries. The argument @var{map}, if non-@code{nil}, is a
|
|
971 keymap to use instead of @code{query-replace-map}.
|
|
972 @end defun
|
|
973
|
|
974 @defvar query-replace-map
|
|
975 This variable holds a special keymap that defines the valid user
|
|
976 responses for @code{query-replace} and related functions, as well as
|
|
977 @code{y-or-n-p} and @code{map-y-or-n-p}. It is unusual in two ways:
|
|
978
|
|
979 @itemize @bullet
|
|
980 @item
|
|
981 The ``key bindings'' are not commands, just symbols that are meaningful
|
|
982 to the functions that use this map.
|
|
983
|
|
984 @item
|
|
985 Prefix keys are not supported; each key binding must be for a single event
|
|
986 key sequence. This is because the functions don't use read key sequence to
|
|
987 get the input; instead, they read a single event and look it up ``by hand.''
|
|
988 @end itemize
|
|
989 @end defvar
|
|
990
|
|
991 Here are the meaningful ``bindings'' for @code{query-replace-map}.
|
|
992 Several of them are meaningful only for @code{query-replace} and
|
|
993 friends.
|
|
994
|
|
995 @table @code
|
|
996 @item act
|
|
997 Do take the action being considered---in other words, ``yes.''
|
|
998
|
|
999 @item skip
|
|
1000 Do not take action for this question---in other words, ``no.''
|
|
1001
|
|
1002 @item exit
|
|
1003 Answer this question ``no,'' and give up on the entire series of
|
|
1004 questions, assuming that the answers will be ``no.''
|
|
1005
|
|
1006 @item act-and-exit
|
|
1007 Answer this question ``yes,'' and give up on the entire series of
|
|
1008 questions, assuming that subsequent answers will be ``no.''
|
|
1009
|
|
1010 @item act-and-show
|
|
1011 Answer this question ``yes,'' but show the results---don't advance yet
|
|
1012 to the next question.
|
|
1013
|
|
1014 @item automatic
|
|
1015 Answer this question and all subsequent questions in the series with
|
|
1016 ``yes,'' without further user interaction.
|
|
1017
|
|
1018 @item backup
|
|
1019 Move back to the previous place that a question was asked about.
|
|
1020
|
|
1021 @item edit
|
|
1022 Enter a recursive edit to deal with this question---instead of any
|
|
1023 other action that would normally be taken.
|
|
1024
|
|
1025 @item delete-and-edit
|
|
1026 Delete the text being considered, then enter a recursive edit to replace
|
|
1027 it.
|
|
1028
|
|
1029 @item recenter
|
|
1030 Redisplay and center the window, then ask the same question again.
|
|
1031
|
|
1032 @item quit
|
|
1033 Perform a quit right away. Only @code{y-or-n-p} and related functions
|
|
1034 use this answer.
|
|
1035
|
|
1036 @item help
|
|
1037 Display some help, then ask again.
|
|
1038 @end table
|
|
1039
|
|
1040 @node Match Data
|
|
1041 @section The Match Data
|
|
1042 @cindex match data
|
|
1043
|
|
1044 XEmacs keeps track of the positions of the start and end of segments of
|
|
1045 text found during a regular expression search. This means, for example,
|
|
1046 that you can search for a complex pattern, such as a date in an Rmail
|
|
1047 message, and then extract parts of the match under control of the
|
|
1048 pattern.
|
|
1049
|
|
1050 Because the match data normally describe the most recent search only,
|
|
1051 you must be careful not to do another search inadvertently between the
|
|
1052 search you wish to refer back to and the use of the match data. If you
|
|
1053 can't avoid another intervening search, you must save and restore the
|
|
1054 match data around it, to prevent it from being overwritten.
|
|
1055
|
|
1056 @menu
|
|
1057 * Simple Match Data:: Accessing single items of match data,
|
|
1058 such as where a particular subexpression started.
|
|
1059 * Replacing Match:: Replacing a substring that was matched.
|
|
1060 * Entire Match Data:: Accessing the entire match data at once, as a list.
|
|
1061 * Saving Match Data:: Saving and restoring the match data.
|
|
1062 @end menu
|
|
1063
|
|
1064 @node Simple Match Data
|
|
1065 @subsection Simple Match Data Access
|
|
1066
|
|
1067 This section explains how to use the match data to find out what was
|
|
1068 matched by the last search or match operation.
|
|
1069
|
|
1070 You can ask about the entire matching text, or about a particular
|
|
1071 parenthetical subexpression of a regular expression. The @var{count}
|
|
1072 argument in the functions below specifies which. If @var{count} is
|
|
1073 zero, you are asking about the entire match. If @var{count} is
|
|
1074 positive, it specifies which subexpression you want.
|
|
1075
|
|
1076 Recall that the subexpressions of a regular expression are those
|
|
1077 expressions grouped with escaped parentheses, @samp{\(@dots{}\)}. The
|
|
1078 @var{count}th subexpression is found by counting occurrences of
|
|
1079 @samp{\(} from the beginning of the whole regular expression. The first
|
|
1080 subexpression is numbered 1, the second 2, and so on. Only regular
|
|
1081 expressions can have subexpressions---after a simple string search, the
|
|
1082 only information available is about the entire match.
|
|
1083
|
|
1084 @defun match-string count &optional in-string
|
|
1085 This function returns, as a string, the text matched in the last search
|
|
1086 or match operation. It returns the entire text if @var{count} is zero,
|
|
1087 or just the portion corresponding to the @var{count}th parenthetical
|
|
1088 subexpression, if @var{count} is positive. If @var{count} is out of
|
|
1089 range, or if that subexpression didn't match anything, the value is
|
|
1090 @code{nil}.
|
|
1091
|
|
1092 If the last such operation was done against a string with
|
|
1093 @code{string-match}, then you should pass the same string as the
|
|
1094 argument @var{in-string}. Otherwise, after a buffer search or match,
|
|
1095 you should omit @var{in-string} or pass @code{nil} for it; but you
|
|
1096 should make sure that the current buffer when you call
|
|
1097 @code{match-string} is the one in which you did the searching or
|
|
1098 matching.
|
|
1099 @end defun
|
|
1100
|
|
1101 @defun match-beginning count
|
|
1102 This function returns the position of the start of text matched by the
|
|
1103 last regular expression searched for, or a subexpression of it.
|
|
1104
|
|
1105 If @var{count} is zero, then the value is the position of the start of
|
|
1106 the entire match. Otherwise, @var{count} specifies a subexpression in
|
|
1107 the regular expression, and the value of the function is the starting
|
|
1108 position of the match for that subexpression.
|
|
1109
|
|
1110 The value is @code{nil} for a subexpression inside a @samp{\|}
|
|
1111 alternative that wasn't used in the match.
|
|
1112 @end defun
|
|
1113
|
|
1114 @defun match-end count
|
|
1115 This function is like @code{match-beginning} except that it returns the
|
|
1116 position of the end of the match, rather than the position of the
|
|
1117 beginning.
|
|
1118 @end defun
|
|
1119
|
|
1120 Here is an example of using the match data, with a comment showing the
|
|
1121 positions within the text:
|
|
1122
|
|
1123 @example
|
|
1124 @group
|
|
1125 (string-match "\\(qu\\)\\(ick\\)"
|
|
1126 "The quick fox jumped quickly.")
|
|
1127 ;0123456789
|
|
1128 @result{} 4
|
|
1129 @end group
|
|
1130
|
|
1131 @group
|
|
1132 (match-string 0 "The quick fox jumped quickly.")
|
|
1133 @result{} "quick"
|
|
1134 (match-string 1 "The quick fox jumped quickly.")
|
|
1135 @result{} "qu"
|
|
1136 (match-string 2 "The quick fox jumped quickly.")
|
|
1137 @result{} "ick"
|
|
1138 @end group
|
|
1139
|
|
1140 @group
|
|
1141 (match-beginning 1) ; @r{The beginning of the match}
|
|
1142 @result{} 4 ; @r{with @samp{qu} is at index 4.}
|
|
1143 @end group
|
|
1144
|
|
1145 @group
|
|
1146 (match-beginning 2) ; @r{The beginning of the match}
|
|
1147 @result{} 6 ; @r{with @samp{ick} is at index 6.}
|
|
1148 @end group
|
|
1149
|
|
1150 @group
|
|
1151 (match-end 1) ; @r{The end of the match}
|
|
1152 @result{} 6 ; @r{with @samp{qu} is at index 6.}
|
|
1153
|
|
1154 (match-end 2) ; @r{The end of the match}
|
|
1155 @result{} 9 ; @r{with @samp{ick} is at index 9.}
|
|
1156 @end group
|
|
1157 @end example
|
|
1158
|
|
1159 Here is another example. Point is initially located at the beginning
|
|
1160 of the line. Searching moves point to between the space and the word
|
|
1161 @samp{in}. The beginning of the entire match is at the 9th character of
|
|
1162 the buffer (@samp{T}), and the beginning of the match for the first
|
|
1163 subexpression is at the 13th character (@samp{c}).
|
|
1164
|
|
1165 @example
|
|
1166 @group
|
|
1167 (list
|
|
1168 (re-search-forward "The \\(cat \\)")
|
|
1169 (match-beginning 0)
|
|
1170 (match-beginning 1))
|
|
1171 @result{} (9 9 13)
|
|
1172 @end group
|
|
1173
|
|
1174 @group
|
|
1175 ---------- Buffer: foo ----------
|
|
1176 I read "The cat @point{}in the hat comes back" twice.
|
|
1177 ^ ^
|
|
1178 9 13
|
|
1179 ---------- Buffer: foo ----------
|
|
1180 @end group
|
|
1181 @end example
|
|
1182
|
|
1183 @noindent
|
|
1184 (In this case, the index returned is a buffer position; the first
|
|
1185 character of the buffer counts as 1.)
|
|
1186
|
|
1187 @node Replacing Match
|
|
1188 @subsection Replacing the Text That Matched
|
|
1189
|
|
1190 This function replaces the text matched by the last search with
|
|
1191 @var{replacement}.
|
|
1192
|
|
1193 @cindex case in replacements
|
|
1194 @defun replace-match replacement &optional fixedcase literal string
|
|
1195 This function replaces the text in the buffer (or in @var{string}) that
|
|
1196 was matched by the last search. It replaces that text with
|
|
1197 @var{replacement}.
|
|
1198
|
|
1199 If you did the last search in a buffer, you should specify @code{nil}
|
|
1200 for @var{string}. Then @code{replace-match} does the replacement by
|
|
1201 editing the buffer; it leaves point at the end of the replacement text,
|
|
1202 and returns @code{t}.
|
|
1203
|
|
1204 If you did the search in a string, pass the same string as @var{string}.
|
|
1205 Then @code{replace-match} does the replacement by constructing and
|
|
1206 returning a new string.
|
|
1207
|
|
1208 If @var{fixedcase} is non-@code{nil}, then the case of the replacement
|
|
1209 text is not changed; otherwise, the replacement text is converted to a
|
|
1210 different case depending upon the capitalization of the text to be
|
|
1211 replaced. If the original text is all upper case, the replacement text
|
|
1212 is converted to upper case. If the first word of the original text is
|
|
1213 capitalized, then the first word of the replacement text is capitalized.
|
|
1214 If the original text contains just one word, and that word is a capital
|
|
1215 letter, @code{replace-match} considers this a capitalized first word
|
|
1216 rather than all upper case.
|
|
1217
|
|
1218 If @code{case-replace} is @code{nil}, then case conversion is not done,
|
|
1219 regardless of the value of @var{fixed-case}. @xref{Searching and Case}.
|
|
1220
|
|
1221 If @var{literal} is non-@code{nil}, then @var{replacement} is inserted
|
|
1222 exactly as it is, the only alterations being case changes as needed.
|
|
1223 If it is @code{nil} (the default), then the character @samp{\} is treated
|
|
1224 specially. If a @samp{\} appears in @var{replacement}, then it must be
|
|
1225 part of one of the following sequences:
|
|
1226
|
|
1227 @table @asis
|
|
1228 @item @samp{\&}
|
|
1229 @cindex @samp{&} in replacement
|
|
1230 @samp{\&} stands for the entire text being replaced.
|
|
1231
|
|
1232 @item @samp{\@var{n}}
|
|
1233 @cindex @samp{\@var{n}} in replacement
|
|
1234 @samp{\@var{n}}, where @var{n} is a digit, stands for the text that
|
|
1235 matched the @var{n}th subexpression in the original regexp.
|
|
1236 Subexpressions are those expressions grouped inside @samp{\(@dots{}\)}.
|
|
1237
|
|
1238 @item @samp{\\}
|
|
1239 @cindex @samp{\} in replacement
|
|
1240 @samp{\\} stands for a single @samp{\} in the replacement text.
|
|
1241 @end table
|
|
1242 @end defun
|
|
1243
|
|
1244 @node Entire Match Data
|
|
1245 @subsection Accessing the Entire Match Data
|
|
1246
|
|
1247 The functions @code{match-data} and @code{set-match-data} read or
|
|
1248 write the entire match data, all at once.
|
|
1249
|
|
1250 @defun match-data
|
|
1251 This function returns a newly constructed list containing all the
|
|
1252 information on what text the last search matched. Element zero is the
|
|
1253 position of the beginning of the match for the whole expression; element
|
|
1254 one is the position of the end of the match for the expression. The
|
|
1255 next two elements are the positions of the beginning and end of the
|
|
1256 match for the first subexpression, and so on. In general, element
|
|
1257 @ifinfo
|
|
1258 number 2@var{n}
|
|
1259 @end ifinfo
|
|
1260 @tex
|
|
1261 number {\mathsurround=0pt $2n$}
|
|
1262 @end tex
|
|
1263 corresponds to @code{(match-beginning @var{n})}; and
|
|
1264 element
|
|
1265 @ifinfo
|
|
1266 number 2@var{n} + 1
|
|
1267 @end ifinfo
|
|
1268 @tex
|
|
1269 number {\mathsurround=0pt $2n+1$}
|
|
1270 @end tex
|
|
1271 corresponds to @code{(match-end @var{n})}.
|
|
1272
|
|
1273 All the elements are markers or @code{nil} if matching was done on a
|
|
1274 buffer, and all are integers or @code{nil} if matching was done on a
|
|
1275 string with @code{string-match}. (In Emacs 18 and earlier versions,
|
|
1276 markers were used even for matching on a string, except in the case
|
|
1277 of the integer 0.)
|
|
1278
|
|
1279 As always, there must be no possibility of intervening searches between
|
|
1280 the call to a search function and the call to @code{match-data} that is
|
|
1281 intended to access the match data for that search.
|
|
1282
|
|
1283 @example
|
|
1284 @group
|
|
1285 (match-data)
|
|
1286 @result{} (#<marker at 9 in foo>
|
|
1287 #<marker at 17 in foo>
|
|
1288 #<marker at 13 in foo>
|
|
1289 #<marker at 17 in foo>)
|
|
1290 @end group
|
|
1291 @end example
|
|
1292 @end defun
|
|
1293
|
|
1294 @defun set-match-data match-list
|
|
1295 This function sets the match data from the elements of @var{match-list},
|
|
1296 which should be a list that was the value of a previous call to
|
|
1297 @code{match-data}.
|
|
1298
|
|
1299 If @var{match-list} refers to a buffer that doesn't exist, you don't get
|
|
1300 an error; that sets the match data in a meaningless but harmless way.
|
|
1301
|
|
1302 @findex store-match-data
|
|
1303 @code{store-match-data} is an alias for @code{set-match-data}.
|
|
1304 @end defun
|
|
1305
|
|
1306 @node Saving Match Data
|
|
1307 @subsection Saving and Restoring the Match Data
|
|
1308
|
|
1309 When you call a function that may do a search, you may need to save
|
|
1310 and restore the match data around that call, if you want to preserve the
|
|
1311 match data from an earlier search for later use. Here is an example
|
|
1312 that shows the problem that arises if you fail to save the match data:
|
|
1313
|
|
1314 @example
|
|
1315 @group
|
|
1316 (re-search-forward "The \\(cat \\)")
|
|
1317 @result{} 48
|
|
1318 (foo) ; @r{Perhaps @code{foo} does}
|
|
1319 ; @r{more searching.}
|
|
1320 (match-end 0)
|
|
1321 @result{} 61 ; @r{Unexpected result---not 48!}
|
|
1322 @end group
|
|
1323 @end example
|
|
1324
|
|
1325 You can save and restore the match data with @code{save-match-data}:
|
|
1326
|
|
1327 @defmac save-match-data body@dots{}
|
|
1328 This special form executes @var{body}, saving and restoring the match
|
|
1329 data around it.
|
|
1330 @end defmac
|
|
1331
|
|
1332 You can use @code{set-match-data} together with @code{match-data} to
|
|
1333 imitate the effect of the special form @code{save-match-data}. This is
|
|
1334 useful for writing code that can run in Emacs 18. Here is how:
|
|
1335
|
|
1336 @example
|
|
1337 @group
|
|
1338 (let ((data (match-data)))
|
|
1339 (unwind-protect
|
|
1340 @dots{} ; @r{May change the original match data.}
|
|
1341 (set-match-data data)))
|
|
1342 @end group
|
|
1343 @end example
|
|
1344
|
|
1345 Emacs automatically saves and restores the match data when it runs
|
|
1346 process filter functions (@pxref{Filter Functions}) and process
|
|
1347 sentinels (@pxref{Sentinels}).
|
|
1348
|
|
1349 @ignore
|
|
1350 Here is a function which restores the match data provided the buffer
|
|
1351 associated with it still exists.
|
|
1352
|
|
1353 @smallexample
|
|
1354 @group
|
|
1355 (defun restore-match-data (data)
|
|
1356 @c It is incorrect to split the first line of a doc string.
|
|
1357 @c If there's a problem here, it should be solved in some other way.
|
|
1358 "Restore the match data DATA unless the buffer is missing."
|
|
1359 (catch 'foo
|
|
1360 (let ((d data))
|
|
1361 @end group
|
|
1362 (while d
|
|
1363 (and (car d)
|
|
1364 (null (marker-buffer (car d)))
|
|
1365 @group
|
|
1366 ;; @file{match-data} @r{buffer is deleted.}
|
|
1367 (throw 'foo nil))
|
|
1368 (setq d (cdr d)))
|
|
1369 (set-match-data data))))
|
|
1370 @end group
|
|
1371 @end smallexample
|
|
1372 @end ignore
|
|
1373
|
|
1374 @node Searching and Case
|
|
1375 @section Searching and Case
|
|
1376 @cindex searching and case
|
|
1377
|
|
1378 By default, searches in Emacs ignore the case of the text they are
|
|
1379 searching through; if you specify searching for @samp{FOO}, then
|
|
1380 @samp{Foo} or @samp{foo} is also considered a match. Regexps, and in
|
|
1381 particular character sets, are included: thus, @samp{[aB]} would match
|
|
1382 @samp{a} or @samp{A} or @samp{b} or @samp{B}.
|
|
1383
|
|
1384 If you do not want this feature, set the variable
|
|
1385 @code{case-fold-search} to @code{nil}. Then all letters must match
|
|
1386 exactly, including case. This is a buffer-local variable; altering the
|
|
1387 variable affects only the current buffer. (@xref{Intro to
|
|
1388 Buffer-Local}.) Alternatively, you may change the value of
|
|
1389 @code{default-case-fold-search}, which is the default value of
|
|
1390 @code{case-fold-search} for buffers that do not override it.
|
|
1391
|
|
1392 Note that the user-level incremental search feature handles case
|
|
1393 distinctions differently. When given a lower case letter, it looks for
|
|
1394 a match of either case, but when given an upper case letter, it looks
|
|
1395 for an upper case letter only. But this has nothing to do with the
|
|
1396 searching functions Lisp functions use.
|
|
1397
|
|
1398 @defopt case-replace
|
|
1399 This variable determines whether the replacement functions should
|
|
1400 preserve case. If the variable is @code{nil}, that means to use the
|
|
1401 replacement text verbatim. A non-@code{nil} value means to convert the
|
|
1402 case of the replacement text according to the text being replaced.
|
|
1403
|
|
1404 The function @code{replace-match} is where this variable actually has
|
|
1405 its effect. @xref{Replacing Match}.
|
|
1406 @end defopt
|
|
1407
|
|
1408 @defopt case-fold-search
|
|
1409 This buffer-local variable determines whether searches should ignore
|
|
1410 case. If the variable is @code{nil} they do not ignore case; otherwise
|
|
1411 they do ignore case.
|
|
1412 @end defopt
|
|
1413
|
|
1414 @defvar default-case-fold-search
|
|
1415 The value of this variable is the default value for
|
|
1416 @code{case-fold-search} in buffers that do not override it. This is the
|
|
1417 same as @code{(default-value 'case-fold-search)}.
|
|
1418 @end defvar
|
|
1419
|
|
1420 @node Standard Regexps
|
|
1421 @section Standard Regular Expressions Used in Editing
|
|
1422 @cindex regexps used standardly in editing
|
|
1423 @cindex standard regexps used in editing
|
|
1424
|
|
1425 This section describes some variables that hold regular expressions
|
|
1426 used for certain purposes in editing:
|
|
1427
|
|
1428 @defvar page-delimiter
|
|
1429 This is the regexp describing line-beginnings that separate pages. The
|
|
1430 default value is @code{"^\014"} (i.e., @code{"^^L"} or @code{"^\C-l"});
|
|
1431 this matches a line that starts with a formfeed character.
|
|
1432 @end defvar
|
|
1433
|
|
1434 The following two regular expressions should @emph{not} assume the
|
|
1435 match always starts at the beginning of a line; they should not use
|
|
1436 @samp{^} to anchor the match. Most often, the paragraph commands do
|
|
1437 check for a match only at the beginning of a line, which means that
|
|
1438 @samp{^} would be superfluous. When there is a nonzero left margin,
|
|
1439 they accept matches that start after the left margin. In that case, a
|
|
1440 @samp{^} would be incorrect. However, a @samp{^} is harmless in modes
|
|
1441 where a left margin is never used.
|
|
1442
|
|
1443 @defvar paragraph-separate
|
|
1444 This is the regular expression for recognizing the beginning of a line
|
|
1445 that separates paragraphs. (If you change this, you may have to
|
|
1446 change @code{paragraph-start} also.) The default value is
|
|
1447 @w{@code{"[@ \t\f]*$"}}, which matches a line that consists entirely of
|
|
1448 spaces, tabs, and form feeds (after its left margin).
|
|
1449 @end defvar
|
|
1450
|
|
1451 @defvar paragraph-start
|
|
1452 This is the regular expression for recognizing the beginning of a line
|
|
1453 that starts @emph{or} separates paragraphs. The default value is
|
|
1454 @w{@code{"[@ \t\n\f]"}}, which matches a line starting with a space, tab,
|
|
1455 newline, or form feed (after its left margin).
|
|
1456 @end defvar
|
|
1457
|
|
1458 @defvar sentence-end
|
|
1459 This is the regular expression describing the end of a sentence. (All
|
|
1460 paragraph boundaries also end sentences, regardless.) The default value
|
|
1461 is:
|
|
1462
|
|
1463 @example
|
|
1464 "[.?!][]\"')@}]*\\($\\| $\\|\t\\| \\)[ \t\n]*"
|
|
1465 @end example
|
|
1466
|
|
1467 This means a period, question mark or exclamation mark, followed
|
|
1468 optionally by a closing parenthetical character, followed by tabs,
|
|
1469 spaces or new lines.
|
|
1470
|
|
1471 For a detailed explanation of this regular expression, see @ref{Regexp
|
|
1472 Example}.
|
|
1473 @end defvar
|