annotate tests/mule/match.el @ 4604:e0a8715fdb1f

Support new IGNORE-INVALID-SEQUENCESP argument, #'query-coding-region. lisp/ChangeLog addition: 2009-02-07 Aidan Kehoe <kehoea@parhasard.net> * coding.el (query-coding-clear-highlights): Rename the BUFFER argument to BUFFER-OR-STRING, describe it as possibly being a string in its documentation. (default-query-coding-region): Add a new IGNORE-INVALID-SEQUENCESP argument, document that this function does not support it. Bind case-fold-search to nil, we don't want this to influence what the function thinks is encodable or not. (query-coding-region): Add a new IGNORE-INVALID-SEQUENCESP argument, document what it does; reflect this new argument in the associated compiler macro. (query-coding-string): Add a new IGNORE-INVALID-SEQUENCESP argument, document what it does. Support the HIGHLIGHT argument correctly. * unicode.el (unicode-query-coding-region): Add a new IGNORE-INVALID-SEQUENCESP argument, document what it does, implement this. Document a potential problem. Use #'query-coding-clear-highlights instead of reimplementing it ourselves. Remove some debugging messages. * mule/arabic.el (iso-8859-6): * mule/cyrillic.el (iso-8859-5): * mule/greek.el (iso-8859-7): * mule/hebrew.el (iso-8859-8): * mule/latin.el (iso-8859-2): * mule/latin.el (iso-8859-3): * mule/latin.el (iso-8859-4): * mule/latin.el (iso-8859-14): * mule/latin.el (iso-8859-15): * mule/latin.el (iso-8859-16): * mule/latin.el (iso-8859-9): * mule/latin.el (windows-1252): * mule/mule-coding.el (iso-8859-1): Avoid the assumption that characters not given an explicit mapping in these coding systems map to the ISO 8859-1 characters corresponding to the octets on disk; this makes it much more reasonable to implement the IGNORE-INVALID-SEQUENCESP argument to query-coding-region. * mule/mule-cmds.el (set-language-info): Correct the docstring. * mule/mule-cmds.el (finish-set-language-environment): Treat invalid Unicode sequences produced from invalid-sequence-coding-system and corresponding to control characters the same as control characters in redisplay. * mule/mule-cmds.el: Document that encode-coding-char is available in coding.el * mule/mule-coding.el (make-8-bit-generate-helper): Change to return the both the encode-program generated and the relevant non-ASCII charset; update the docstring to reflect this. * mule/mule-coding.el (make-8-bit-generate-encode-program-and-skip-chars-strings): Rename this function; have it return skip-chars-strings as well as the encode program. Have these skip-chars-strings use ranges for charsets, where possible. * mule/mule-coding.el (make-8-bit-create-decode-encode-tables): Revise this to allow people to specify explicitly characters that should be undefined (= corresponding to keys in unicode-error-default-translation-table), and treating unspecified octets above #x7f as undefined by default. * mule/mule-coding.el (8-bit-fixed-query-coding-region): Add a new IGNORE-INVALID-SEQUENCESP argument, implement support for it using the 8-bit-fixed-invalid-sequences-skip-chars coding system property; remove some debugging messages. * mule/mule-coding.el (make-8-bit-coding-system): This function is dumped, autoloading it makes no sense. Document what happens when characters above #x7f are not specified, implement this. * mule/vietnamese.el: Correct spelling. tests/ChangeLog addition: 2009-02-07 Aidan Kehoe <kehoea@parhasard.net> * automated/query-coding-tests.el: Add FAILING-CASE arguments to the Assert calls, making #'q-c-debug mostly unnecessary. Remove #'q-c-debug. Add new tests that use the IGNORE-INVALID-SEQUENCESP argument to #'query-coding-region; rework the existing ones to respect it.
author Aidan Kehoe <kehoea@parhasard.net>
date Sat, 07 Feb 2009 17:13:37 +0000
parents 131b0175ea99
children 308d34e9f07d
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
70
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
1 ;;; Testsuite for Mule string-matching - used to crash!
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
2
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
3 ;; Copyright (C) 1996 Sun Microsystems.
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
4
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
5 ;; This file is part of XEmacs.
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
6
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
7 ;; XEmacs is free software; you can redistribute it and/or modify it
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
8 ;; under the terms of the GNU General Public License as published by
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
9 ;; the Free Software Foundation; either version 2, or (at your option)
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
10 ;; any later version.
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
11
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
12 ;; XEmacs is distributed in the hope that it will be useful, but
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
13 ;; WITHOUT ANY WARRANTY; without even the implied warranty of
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
14 ;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
15 ;; General Public License for more details.
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
16
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
17 ;; You should have received a copy of the GNU General Public License
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
18 ;; along with XEmacs; see the file COPYING. If not, write to the Free
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
19 ;; Software Foundation,59 Temple Place - Suite 330,
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
20 ;; Boston, MA 02111-1307, USA.
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
21
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
22 ;;; Just load the file to run the test.
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
23
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
24 (defmacro test-match (result regexp string)
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
25 `(save-excursion
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
26 (assert (eq ,result (string-match ,regexp ,string)))
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
27 (let ((buf (get-buffer-create "*testsuite*"))
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
28 (random-text "foo$(BEl5~(B"))
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
29 (set-buffer buf)
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
30 (erase-buffer)
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
31 (insert random-text)
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
32 (insert ,string)
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
33 (goto-char (point-min))
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
34 (forward-char (length random-text))
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
35 (assert (eq (progn (re-search-forward ,regexp) (match-beginning 0))
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
36 (+ 1 ,result (length random-text))))
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
37 )))
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
38
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
39 (when (featurep 'mule)
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
40 (test-match 0 "a" "a")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
41 (test-match 0 "[^a]" "$(B4A;z(B")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
42 (test-match 2 "[^a]$(B;z(B" "ab$(B4A;z(B")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
43 (test-match 1 "[^a]" "ab$(B4A;z(B")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
44 (test-match 0 "[^a]" "$(B4A(Bb$(B4A;z(Bb")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
45 (test-match 6 "[a]" "b$(B4A(Bb$(B4A;z(Bba")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
46 (test-match 2 "[a]" "b$(B4A(Bab$(B4A;z(Bba")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
47 (test-match 1 "[$(B4A(Ba]" "b$(B4A(Bab$(B4A;z(Bba")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
48 (test-match 1 "[a$(B4A(B]" "b$(B4A(Bab$(B4A;z(Bba")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
49 (test-match 0 "[^$(B4A(Ba]" "b$(B4A(Bab$(B4A;z(Bba")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
50 (test-match 5 "$(B4A(B[^$(B4A(Ba]" "a$(B4A(Bab$(B4A4A;z(Bba")
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
51 )
131b0175ea99 Import from CVS: tag r20-0b30
cvs
parents:
diff changeset
52