annotate etc/VEGETABLES @ 5648:3f4a234f4672

Support non-ASCII correctly in character classes, test this. src/ChangeLog addition: 2012-04-21 Aidan Kehoe <kehoea@parhasard.net> Support non-ASCII correctly in character classes ([:alnum:] and friends). * regex.c: * regex.c (ISBLANK, ISUNIBYTE): New. Make these and friends independent of the locale, since we want them to be consistent in XEmacs. * regex.c (print_partial_compiled_pattern): Print the flags for charset_mule; don't print non-ASCII as the character values in ranges, this breaks with locales. * regex.c (enum): Define various flags the charset_mule and charset_mule_not opcodes can now take. * regex.c (CHAR_CLASS_MAX_LENGTH): Update this. * regex.c (re_iswctype, re_wctype): New, from GNU. * regex.c (re_wctype_can_match_non_ascii): New; used when deciding on whether to use charset_mule or the ASCII-only regex character set opcode. * regex.c (regex_compile): Error correctly on long, non-existent character class names. Break out the handling of charsets that can match non-ASCII into a separate clause. Use compile_char_class when compiling character classes. * regex.c (compile_char_class): New. Used in regex_compile when compiling character sets that may match non-ASCII. * regex.c (re_compile_fastmap): If there are flags set for charset_mule or charset_mule_not, we can't use the fastmap (since we need to check syntax table values that aren't available there). * regex.c (re_match_2_internal): Check the new flags passed to the charset_mule{,_not} opcode, observe them if appropriate. * regex.h: * regex.h (enum): Expose re_wctype_t here, imported from GNU. tests/ChangeLog addition: 2012-04-21 Aidan Kehoe <kehoea@parhasard.net> * automated/regexp-tests.el: * automated/regexp-tests.el (Assert-char-class): Check that #'string-match errors correctly with an over-long character class name. Add tests for character class functionality that supports non-ASCII characters. These tests expose bugs in GNU Emacs 24.0.94.2, but pass under current XEmacs.
author Aidan Kehoe <kehoea@parhasard.net>
date Sat, 21 Apr 2012 18:58:28 +0100
parents ae97e44a6527
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
636
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
1 alfalfa
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
2 anise
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
3 artichoke
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
4 asparagus
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
5 bamboo
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
6 beets
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
7 bok choi
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
8 broccoflower
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
9 broccoli
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
10 brussels sprouts
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
11 burdock
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
12 cabbage
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
13 carrot
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
14 cauliflower
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
15 cassava
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
16 celery
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
17 celeriac
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
18 chayote
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
19 chestnut
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
20 chives
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
21 cilantro
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
22 corn
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
23 cucumber
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
24 daikon
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
25 dandelion
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
26 eggplant
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
27 endive
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
28 fiddleheads
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
29 fuki
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
30 garbanzo
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
31 garlic
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
32 ginger
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
33 habanero
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
34 horseradish
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
35 kale
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
36 kohlarbi
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
37 leeks
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
38 lettuce
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
39 lima bean
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
40 marjoram
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
41 mushroom
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
42 mustard
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
43 okra
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
44 onion
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
45 parsley
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
46 peanut
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
47 pimento
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
48 potato
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
49 pumpkin
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
50 radish
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
51 rutabaga
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
52 renkon
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
53 satoimo
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
54 shallots
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
55 sorrel
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
56 spinach
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
57 squash
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
58 swisschard
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
59 taro
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
60 tomato
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
61 turnip
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
62 watercress
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
63 yam
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
64 yucca
ae97e44a6527 [xemacs-hg @ 2001-07-26 06:20:44 by stephent]
stephent
parents:
diff changeset
65 zucchini