annotate src/s/README @ 5648:3f4a234f4672

Support non-ASCII correctly in character classes, test this. src/ChangeLog addition: 2012-04-21 Aidan Kehoe <kehoea@parhasard.net> Support non-ASCII correctly in character classes ([:alnum:] and friends). * regex.c: * regex.c (ISBLANK, ISUNIBYTE): New. Make these and friends independent of the locale, since we want them to be consistent in XEmacs. * regex.c (print_partial_compiled_pattern): Print the flags for charset_mule; don't print non-ASCII as the character values in ranges, this breaks with locales. * regex.c (enum): Define various flags the charset_mule and charset_mule_not opcodes can now take. * regex.c (CHAR_CLASS_MAX_LENGTH): Update this. * regex.c (re_iswctype, re_wctype): New, from GNU. * regex.c (re_wctype_can_match_non_ascii): New; used when deciding on whether to use charset_mule or the ASCII-only regex character set opcode. * regex.c (regex_compile): Error correctly on long, non-existent character class names. Break out the handling of charsets that can match non-ASCII into a separate clause. Use compile_char_class when compiling character classes. * regex.c (compile_char_class): New. Used in regex_compile when compiling character sets that may match non-ASCII. * regex.c (re_compile_fastmap): If there are flags set for charset_mule or charset_mule_not, we can't use the fastmap (since we need to check syntax table values that aren't available there). * regex.c (re_match_2_internal): Check the new flags passed to the charset_mule{,_not} opcode, observe them if appropriate. * regex.h: * regex.h (enum): Expose re_wctype_t here, imported from GNU. tests/ChangeLog addition: 2012-04-21 Aidan Kehoe <kehoea@parhasard.net> * automated/regexp-tests.el: * automated/regexp-tests.el (Assert-char-class): Check that #'string-match errors correctly with an over-long character class name. Add tests for character class functionality that supports non-ASCII characters. These tests expose bugs in GNU Emacs 24.0.94.2, but pass under current XEmacs.
author Aidan Kehoe <kehoea@parhasard.net>
date Sat, 21 Apr 2012 18:58:28 +0100
parents 861f2601a38b
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
0
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
1 This directory contains C header files containing
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
2 operating-system-specific definitions. Each file describes a
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
3 particular operating system. The emacs configuration script edits
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
4 ../config.h to include the appropriate one of these files, and then
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
5 each emacs source file includes config.h.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
6
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
7 General XEmacs Changes
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
8 ---------------------------
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
9 The following is a list of those changes made globally across all
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
10 files. They are not marked individually in each header file. All
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
11 other changes should be preceded by a comment /* XEmacs change */.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
12
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
13
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
14 1. Removed all #defines of [read|write|open|close]. This is now
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
15 handled automatically by checking the INTERRUPTIBLE_IO etc. flags.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
16
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
17 2. Removed all instances of #undef SIGIO and replaced them with
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
18 #define BROKEN_SIGIO. Jamie says:
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
19
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
20 /* use BROKEN_SIGIO instead of this kludge -- jwz */
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
21
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
22 3. All instances of HAVE_GETWD, HAVE_DUP2, HAVE_UNISTD_H, NEED_UNISTD_H,
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
23 HAVE_GETTIMEOFDAY and NEED_REALPATH removed. We detect these
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
24 automatically with configure.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
25
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
26 4. All instances of HAVE_X11 replaced with HAVE_X_WINDOWS. We don't
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
27 support X10 or earlier so the HAVE_X11 define was purged.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
28
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
29 5. Most of the signal crap (e.g. redefining sigsetmask, defining
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
30 POSIX_SIGNALS) has been removed. There are four possible
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
31 signal paradigms that all systems fall into, and we auto-detect
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
32 them in configure and handle them in syssignal.h.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
33
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
34 6. Removed references to INTERRUPT_INPUT. XEmacs does not use
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
35 this bizarre way of reading input.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
36
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
37 7. Removed references to BROKEN_FIONREAD. FIONREAD is used only
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
38 in INTERRUPT_INPUT and in the select() emulator, neither of
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
39 which are supported in XEmacs.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
40
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
41 8. Removed references to NOMULTIPLEJOBS. This is unused in XEmacs
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
42 and in FSF Emacs.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
43
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
44 9. Removed references to HAVE_WAIT_HEADER and WAIT_USE_INT.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
45 They are unnecessary with the cleaned up syswait.h in XEmacs.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
46 (We autodetect sys/wait.h). Instead, #define or #undef
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
47 HAVE_UNION_WAIT.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
48
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
49 10. Removed BSTRING. Not used anywhere. (If the header file
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
50 says there are bugs in bcopy() or the like, however, a
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
51 #define BROKEN_BCOPY is added for reference.)
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
52
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
53 11. Removed #defines of bcopy, bzero, bcmp, index, rindex.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
54 XEmacs makes consistent use of the ANSI-equivalent
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
55 functions memcpy, memset, memcmp, strchr, strrchr.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
56
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
57 12. '#define subprocesses' removed. Use '#define NO_SUBPROCESSES'
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
58 if they don't exist.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
59
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
60 13. References to HAVE_VFORK removed. configure detects this.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
61
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
62 14. Removed references to SYSV_SYSTEM_DIR, NONSYSTEM_DIR_LIBRARY,
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
63 HAVE_SOCKETS, HAVE_SYSVIPC. configure detects these.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
64
5494
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
65 15. Removed defines of HAVE_TERMIOS, HAVE_TERMIO, HAVE_TCATTR (when
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
66 HAVE_TERMIOS was also defined), and SIGNALS_VIA_CHARACTERS. configure
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
67 detects these and systty.h automatically defines HAVE_TCATTR when
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
68 HAVE_TERMIOS is defined.
0
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
69
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
70 16. Removed SETPGRP_RELEASES_CTTY. Not necessary any more, with
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
71 fixed definitions of EMACS_SEPARATE_PROCESS_GROUP et al.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
72
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
73 17. Removed defines of NLIST_STRUCT. configure detects this.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
74
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
75 18. Removed defines of _setjmp and _longjmp. configure detects this.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
76
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
77 19. Removed all '#define static' business. Defines NO_REMAP instead.
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
78
376386a54a3c Import from CVS: tag r19-14
cvs
parents:
diff changeset
79 20. Removed defines of HAVE_MACH_MACH_H. configure detects this.
5494
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
80
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
81 21. Removed KERNEL_FILE and LDAV_SYMBOL from most if not all files.
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
82 getloadavg.c has all sorts of conditional defns to define these.
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
83
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
84 22. Got rid of most PTY-related stuff. We try hard to autodetect the
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
85 proper way of allocating PTY's. Removed HAVE_PTYS defn.
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
86
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
87 23. Removed HAVE_SOCKETS, we autodetect this.
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
88
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
89 24. Removed CLASH_DETECTION; this is now a configurable option.
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
90
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
91 25. Removed BSD_PGRPS; this is autodetected.
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
92
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
93 26. Removed NARROWPROTO; this is autodetected.
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
94
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
95 27. Removed LIBS_DEBUG, C_DEBUG_SWITCH, C_OPTIMIZE_SWITCH.
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
96 None of them are used any more. Any such stuff goes into
861f2601a38b Sync s/ files with GNU 23.1.92, delete obsolete stuff, simplify other stuff
Ben Wing <ben@xemacs.org>
parents: 0
diff changeset
97 configure.ac.