annotate src/s/sol2.h @ 5648:3f4a234f4672

Support non-ASCII correctly in character classes, test this. src/ChangeLog addition: 2012-04-21 Aidan Kehoe <kehoea@parhasard.net> Support non-ASCII correctly in character classes ([:alnum:] and friends). * regex.c: * regex.c (ISBLANK, ISUNIBYTE): New. Make these and friends independent of the locale, since we want them to be consistent in XEmacs. * regex.c (print_partial_compiled_pattern): Print the flags for charset_mule; don't print non-ASCII as the character values in ranges, this breaks with locales. * regex.c (enum): Define various flags the charset_mule and charset_mule_not opcodes can now take. * regex.c (CHAR_CLASS_MAX_LENGTH): Update this. * regex.c (re_iswctype, re_wctype): New, from GNU. * regex.c (re_wctype_can_match_non_ascii): New; used when deciding on whether to use charset_mule or the ASCII-only regex character set opcode. * regex.c (regex_compile): Error correctly on long, non-existent character class names. Break out the handling of charsets that can match non-ASCII into a separate clause. Use compile_char_class when compiling character classes. * regex.c (compile_char_class): New. Used in regex_compile when compiling character sets that may match non-ASCII. * regex.c (re_compile_fastmap): If there are flags set for charset_mule or charset_mule_not, we can't use the fastmap (since we need to check syntax table values that aren't available there). * regex.c (re_match_2_internal): Check the new flags passed to the charset_mule{,_not} opcode, observe them if appropriate. * regex.h: * regex.h (enum): Expose re_wctype_t here, imported from GNU. tests/ChangeLog addition: 2012-04-21 Aidan Kehoe <kehoea@parhasard.net> * automated/regexp-tests.el: * automated/regexp-tests.el (Assert-char-class): Check that #'string-match errors correctly with an over-long character class name. Add tests for character class functionality that supports non-ASCII characters. These tests expose bugs in GNU Emacs 24.0.94.2, but pass under current XEmacs.
author Aidan Kehoe <kehoea@parhasard.net>
date Sat, 21 Apr 2012 18:58:28 +0100
parents 1f0b15040456
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
5450
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
1 /* Copyright (C) 2000, 2003 Martin Buchholz
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
2
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
3 This file is part of XEmacs.
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
4
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
5 XEmacs is free software: you can redistribute it and/or modify it
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
6 under the terms of the GNU General Public License as published by the
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
7 Free Software Foundation, either version 3 of the License, or (at your
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
8 option) any later version.
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
9
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
10 XEmacs is distributed in the hope that it will be useful, but WITHOUT
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
11 ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
12 FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
13 for more details.
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
14
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
15 You should have received a copy of the GNU General Public License
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
16 along with XEmacs. If not, see <http://www.gnu.org/licenses/>. */
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
17
8c406331e77e Copyright and license to src/s/sol2.h.
Mats Lidell <matsl@xemacs.org>
parents: 4122
diff changeset
18
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
19 /* Synched up with: Completely divergent from FSF. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
20 #define SOLARIS2 1
5494
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 4122
diff changeset
21 /* #define POSIX -- not used in XEmacs */
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
22
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
23 /* Fix understandable GCC lossage on Solaris 2.6 */
4122
8fea628c26fb [xemacs-hg @ 2007-08-17 08:01:13 by crestani]
crestani
parents: 1692
diff changeset
24 #if defined(__GNUC__) && OS_RELEASE >= 506 && OS_RELEASE < 510 && !defined(NOT_C_CODE)
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
25
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
26 /* GCC va_list munging is a little messed up */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
27 #define __GNUC_VA_LIST
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
28 #define _VA_LIST_
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
29 #define _VA_LIST va_list
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
30 typedef void *__gnuc_va_list;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
31 typedef __gnuc_va_list va_list;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
32
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
33 /* Missing prototypes for functions added in Solaris 2.6 */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
34 #include <sys/types.h>
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
35 struct msghdr;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
36 struct sockaddr;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
37 extern int __xnet_bind (int, const struct sockaddr *, size_t);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
38 extern int __xnet_listen (int, int);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
39 extern int __xnet_connect (int, const struct sockaddr *, size_t);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
40 extern ssize_t __xnet_recvmsg (int, struct msghdr *, int);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
41 extern ssize_t __xnet_sendmsg (int, const struct msghdr *, int);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
42 extern ssize_t __xnet_sendto (int, const void *, size_t, int, const struct sockaddr *, size_t);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
43 extern int __xnet_socket (int, int, int);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
44 extern int __xnet_socketpair (int, int, int, int *);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
45 extern int __xnet_getsockopt (int, int, int, void *, size_t *);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
46 #endif /* GCC && >= Solaris 2.6 && C code */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
47
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
48 #include "usg5-4-2.h" /* XEmacs change from 5-4 to 5-4-2 */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
49 #undef PC /* Defined in x86 /usr/include/sys/reg.h */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
50
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
51 /* SIGIO seems to be working under Solaris and it makes ^G work better... */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
52 #undef BROKEN_SIGIO
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
53
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
54 #ifdef NOT_C_CODE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
55 /* XEmacs change -- some Motif packages need -lgen to get regex and regcmp */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
56
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
57 #undef LIBS_SYSTEM
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
58 #define LIBS_SYSTEM "-lsocket -lnsl -lelf -lgen -ldl"
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
59
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
60 /* SYSTEM_MALLOC must be defined if dbx/RTC is going to be used. dbx/RTC does
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
61 not work with a static definition of malloc(). */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
62 /* We want to be able to test out ralloc.c. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
63 /* #define SYSTEM_MALLOC */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
64
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
65 #undef UNEXEC
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
66 #define UNEXEC "unexsol2-6.o"
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
67
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
68 #else /* C_CODE */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
69
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
70 /* 2.5 now has `random' back in libc but we don't want to use it. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
71 #undef HAVE_RANDOM
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
72
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
73 #include <sys/utsname.h> /* warning: macro redefined: SYS_NMLN */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
74
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
75 #endif /* C_CODE */