Move the #'query-coding-region implementation to C. This is necessary because there is no reasonable way to access the corresponding mswindows-multibyte functionality from Lisp, and we need such functionality if we're going to have a reliable and portable #'query-coding-region implementation. However, this change doesn't yet provide #'query-coding-region for the mswindow-multibyte coding systems, there should be no functional differences between an XEmacs with this change and one without it. src/ChangeLog addition: 2009-09-19 Aidan Kehoe <kehoea@parhasard.net> Move the #'query-coding-region implementation to C. This is necessary because there is no reasonable way to access the corresponding mswindows-multibyte functionality from Lisp, and we need such functionality if we're going to have a reliable and portable #'query-coding-region implementation. However, this change doesn't yet provide #'query-coding-region for the mswindow-multibyte coding systems, there should be no functional differences between an XEmacs with this change and one without it. * mule-coding.c (struct fixed_width_coding_system): Add a new coding system type, fixed_width, and implement it. It uses the CCL infrastructure but has a much simpler creation API, and its own query_method, formerly in lisp/mule/mule-coding.el. * unicode.c: Move the Unicode query method implementation here from unicode.el. * lisp.h: Declare Fmake_coding_system_internal, Fcopy_range_table here. * intl-win32.c (complex_vars_of_intl_win32): Use Fmake_coding_system_internal, not Fmake_coding_system. * general-slots.h: Add Qsucceeded, Qunencodable, Qinvalid_sequence here. * file-coding.h (enum coding_system_variant): Add fixed_width_coding_system here. (struct coding_system_methods): Add query_method and query_lstream_method to the coding system methods. Provide flags for the query methods. Declare the default query method; initialise it correctly in INITIALIZE_CODING_SYSTEM_TYPE. * file-coding.c (default_query_method): New function, the default query method for coding systems that do not set it. Moved from coding.el. (make_coding_system_1): Accept new elements in PROPS in #'make-coding-system; aliases, a list of aliases; safe-chars and safe-charsets (these were previously accepted but not saved); and category. (Fmake_coding_system_internal): New function, what used to be #'make-coding-system--on Mule builds, we've now moved some of the functionality of this to Lisp. (Fcoding_system_canonical_name_p): Move this earlier in the file, since it's now called from within make_coding_system_1. (Fquery_coding_region): Move the implementation of this here, from coding.el. (complex_vars_of_file_coding): Call Fmake_coding_system_internal, not Fmake_coding_system; specify safe-charsets properties when we're a mule build. * extents.h (mouse_highlight_priority, Fset_extent_priority, Fset_extent_face, Fmap_extents): Make these available to other C files. lisp/ChangeLog addition: 2009-09-19 Aidan Kehoe <kehoea@parhasard.net> Move the #'query-coding-region implementation to C. * coding.el: Consolidate code that depends on the presence or absence of Mule at the end of this file. (default-query-coding-region, query-coding-region): Move these functions to C. (default-query-coding-region-safe-charset-skip-chars-map): Remove this variable, the corresponding C variable is Vdefault_query_coding_region_chartab_cache in file-coding.c. (query-coding-string): Update docstring to reflect actual multiple values, be more careful about not modifying a range table that we're currently mapping over. (encode-coding-char): Make the implementation of this simpler. (featurep 'mule): Autoload #'make-coding-system from mule/make-coding-system.el if we're a mule build; provide an appropriate compiler macro. Do various non-mule compatibility things if we're not a mule build. * update-elc.el (additional-dump-dependencies): Add mule/make-coding-system as a dump time dependency if we're a mule build. * unicode.el (ccl-encode-to-ucs-2): (decode-char): (encode-char): Move these earlier in the file, for the sake of some byte compile warnings. (unicode-query-coding-region): Move this to unicode.c * mule/make-coding-system.el: New file, not dumped. Contains the functionality to rework the arguments necessary for fixed-width coding systems, and contains the implementation of #'make-coding-system, which now calls #'make-coding-system-internal. * mule/vietnamese.el (viscii): * mule/latin.el (iso-8859-2): (windows-1250): (iso-8859-3): (iso-8859-4): (iso-8859-14): (iso-8859-15): (iso-8859-16): (iso-8859-9): (macintosh): (windows-1252): * mule/hebrew.el (iso-8859-8): * mule/greek.el (iso-8859-7): (windows-1253): * mule/cyrillic.el (iso-8859-5): (koi8-r): (koi8-u): (windows-1251): (alternativnyj): (koi8-ru): (koi8-t): (koi8-c): (koi8-o): * mule/arabic.el (iso-8859-6): (windows-1256): Move all these coding systems to being of type fixed-width, not of type CCL. This allows the distinct query-coding-region for them to be in C, something which will eventually allow us to implement query-coding-region for the mswindows-multibyte coding systems. * mule/general-late.el (posix-charset-to-coding-system-hash): Document why we're pre-emptively persuading the byte compiler that the ELC for this file needs to be written using escape-quoted. Call #'set-unicode-query-skip-chars-args, now the Unicode query-coding-region implementation is in C. * mule/thai-xtis.el (tis-620): Don't bother checking whether we're XEmacs or not here. * mule/mule-coding.el: Move the eight bit fixed-width functionality from this file to make-coding-system.el. tests/ChangeLog addition: 2009-09-19 Aidan Kehoe <kehoea@parhasard.net> * automated/mule-tests.el: Check a coding system's type, not an 8-bit-fixed property, for whether that coding system should be treated as a fixed-width coding system. * automated/query-coding-tests.el: Don't test the query coding functionality for mswindows-multibyte coding systems, it's not yet implemented.

0x22   0x0902  #   Vowel-modifier ANUSWAR
0x23   0x0903  #   Vowel-modifier VISARG
0x24   0x0905  #   Vowel A
0x25   0x0906  #   Vowel AA
0x26   0x0907  #   Vowel I
0x27   0x0908  #   Vowel II
0x28   0x0909  #   Vowel U
0x29   0x090A  #   Vowel UU
0x2a   0x090B  #   Vowel RI
0x2b   0x090E  #   Vowel E (Southern Scripts)
0x2c   0x090F  #   Vowel EY
0x2d   0x0910  #   Vowel AI
0x2e   0x090D  #   Vowel AYE (Devanagari Scripts)
0x2f   0x0912  #   Vowel O (Southern Scripts)
0x30   0x0913  #   Vowel OW
0x31   0x0914  #   Vowel AU
0x32   0x090D  #   Vowel AWE (Devanagari Scripts)
0x33   0x0915  #   Consonant KA
0x34   0x0916  #   Consonant KHA
0x35   0x0917  #   Consonant GA
0x36   0x0918  #   Consonant GHA
0x37   0x0919  #   Consonant NGA
0x38   0x091A  #   Consonant CHA
0x39   0x091B  #   Consonant CHHA
0x3a   0x091C  #   Consonant JA
0x3b   0x091D  #   Consonant JHA
0x3c   0x091E  #   Consonant JNA
0x3d   0x091F  #   Consonant Hard TA
0x3e   0x0920  #   Consonant Hard THA
0x3f   0x0921  #   Consonant Hard DA
0x40   0x0922  #   Consonant Hard DHA
0x41   0x0923  #   Consonant Hard NA
0x42   0x0924  #   Consonant Soft TA
0x43   0x0925  #   Consonant Soft THA
0x44   0x0926  #   Consonant Soft DA
0x45   0x0927  #   Consonant Soft DHA
0x46   0x0928  #   Consonant Soft NA
0x47   0x0929  #   Consonant NA (Tamil)
0x48   0x092A  #   Consonant PA
0x49   0x092B  #   Consonant PHA
0x4a   0x092C  #   Consonant BA
0x4b   0x092D  #   Consonant BHA
0x4c   0x092E  #   Consonant MA
0x4d   0x092F  #   Consonant YA
0x4e   0x095F  #   Consonant JYA (Bengali, Assamese, and Oriya)
0x4f   0x0930  #   Consonant RA
0x50   0x0931  #   Consonant Hard RA (Southern Scripts)
0x51   0x0932  #   Consonant LA
0x52   0x0933  #   Consonant Hard LA
0x53   0x0934  #   Consonant ZHA
0x54   0x0935  #   Consonant VA
0x55   0x0936  #   Consonant SHA
0x56   0x0937  #   Consonant Hard SHA
0x57   0x0938  #   Consonant SA
0x58   0x0939  #   Consonant HA
0x5a   0x093E  #   Vowel Sign AA
0x5b   0x093F  #   Vowel Sign I
0x5c   0x0940  #   Vowel Sign II
0x5d   0x0941  #   Vowel Sign U
0x5e   0x0942  #   Vowel Sign UU
0x5f   0x0943  #   Vowel Sign RI
0x60   0x0946  #   Vowel Sign E (Southern Scripts)
0x61   0x0947  #   Vowel Sign EY
0x62   0x0948  #   Vowel Sign AI
0x63   0x0945  #   Vowel Sign AYE (Devanagari Scripts)
0x64   0x094A  #   Vowel Sign O (Southern Scripts)
0x65   0x094B  #   Vowel Sign OW
0x66   0x094C  #   Vowel Sign AU
0x67   0x0949  #   Vowel Sign AWE (Devanagari Scripts)
0x68   0x094D  #   Vowel Omission Sign (Halant)
0x69   0x093C  #   Diacritic Sign (Nukta)
0x6a   0x0964  #   Full Stop (Viram, Nothern Scripts)
0x71   0x0966  #   DEVANAGARI DIGIT 0
0x72   0x0967  #   DEVANAGARI DIGIT 1
0x73   0x0968  #   DEVANAGARI DIGIT 2
0x74   0x0969  #   DEVANAGARI DIGIT 3
0x75   0x096A  #   DEVANAGARI DIGIT 4
0x76   0x096B  #   DEVANAGARI DIGIT 5
0x77   0x096C  #   DEVANAGARI DIGIT 6
0x78   0x096D  #   DEVANAGARI DIGIT 7
0x79   0x096E  #   DEVANAGARI DIGIT 8
0x7a   0x096F  #   DEVANAGARI DIGIT 9