annotate src/file-coding.h @ 617:af57a77cbc92

[xemacs-hg @ 2001-06-18 07:09:50 by ben] --------------------------------------------------------------- DOCUMENTATION FIXES: --------------------------------------------------------------- eval.c: Correct documentation. elhash.c: Doc correction. --------------------------------------------------------------- LISP OBJECT CLEANUP: --------------------------------------------------------------- bytecode.h, buffer.h, casetab.h, chartab.h, console-msw.h, console.h, database.c, device.h, eldap.h, elhash.h, events.h, extents.h, faces.h, file-coding.h, frame.h, glyphs.h, gui-x.h, gui.h, keymap.h, lisp-disunion.h, lisp-union.h, lisp.h, lrecord.h, lstream.h, mule-charset.h, objects.h, opaque.h, postgresql.h, process.h, rangetab.h, specifier.h, toolbar.h, tooltalk.h, ui-gtk.h: Add wrap_* to all objects (it was already there for a few of them) -- an expression to encapsulate a pointer into a Lisp object, rather than the inconvenient XSET*. "wrap" was chosen because "make" as in make_int(), make_char() is not appropriate. (It implies allocation. The issue does not exist for ints and chars because they are not allocated.) Full error checking has been added to these expressions. When used without error checking, non-union build, use of these expressions will incur no loss of efficiency. (In fact, XSET* is now defined in terms of wrap_* in a non-union build.) In a union build, you will also get no loss of efficiency provided that you have a decent optimizing compiler, and a compiler that either understands inlines or automatically inlines those particular functions. (And since people don't normally do their production builds on union, it doesn't matter.) Update the sample Lisp object definition in lrecord.h accordingly. dumper.c: Fix places in dumper that referenced wrap_object to reference its new name, wrap_pointer_1. buffer.c, bufslots.h, conslots.h, console.c, console.h, devslots.h, device.c, device.h, frame.c, frame.h, frameslots.h, window.c, window.h, winslots.h: -- Extract out the Lisp objects of `struct device' into devslots.h, just like for the other structures. -- Extract out the remaining (not copied into the window config) Lisp objects in `struct window' into winslots.h; use different macros (WINDOW_SLOT vs. WINDOW_SAVED_SLOT) to differentiate them. -- Eliminate the `dead' flag of `struct frame', since it duplicates information already available in `framemeths', and fix FRAME_LIVE_P accordingly. (Devices and consoles already work this way.) -- In *slots.h, switch to system where MARKED_SLOT is automatically undef'd at the end of the file. (Follows what winslots.h already does.) -- Update the comments at the beginning of *slots.h to be accurate. -- When making any of the above objects dead, zero it out entirely and reset all Lisp object slots to Qnil. (We were already doing this somewhat, but not consistently.) This (1) Eliminates the possibility of extra objects hanging around that ought to be GC'd, (2) Causes an immediate crash if anyone tries to access a structure in one of these objects, (3) Ensures consistent behavior wrt dead objects. dialog-msw.c: Use internal_object_printer, since this object should not escape. --------------------------------------------------------------- FIXING A CRASH THAT I HIT ONCE (AND A RELATED BAD BEHAVIOR): --------------------------------------------------------------- eval.c: Fix up some comments about the FSF implementation. Fix two nasty bugs: (1) condition_case_unwind frees the conses sitting in the catch->tag slot too quickly, resulting in a crash that I hit. (2) catches need to be unwound one at a time when calling unwind-protect code, rather than all at once at the end; otherwise, incorrect behavior can result. (A comment shows exactly how.) backtrace.h: Improve comment about FSF differences in the handler stack. --------------------------------------------------------------- FIXING A CRASH THAT I REPEATEDLY HIT WHEN USING THE MOUSE WHEEL UNDER MSWINDOWS: --------------------------------------------------------------- Basic idea: My crash is due either to a dead, non-marked, GC-collected frame inside of a window mirror, or a prematurely freed window mirror. We need to mark the Lisp objects inside of window mirrors. Tracking the lifespan of window mirrors and scrollbar instances is extremely hard, and there may well be lurking bugs where such objects are freed too soon. The only safe way to fix these problems (and it fixes both problems at once) is to make both of these structures Lisp objects. lrecord.h, emacs.c, inline.c, scrollbar-gtk.c, scrollbar-msw.c, scrollbar-x.c, scrollbar.c, scrollbar.h, symsinit.h: Make scrollbar instances actual Lisp objects. Mark the window mirrors in them. inline.c needs to know about scrollbar.h now. Record the new type in lrecord.h. Fix up scrollbar-*.c appropriately. Create a hash table in scrollbar-msw.c so that the scrollbar instances stored in scrollbar HWND's are properly GC-protected. Create complex_vars_of_scrollbar_mswindows() to create the hash table at startup, and call it from emacs.c. Don't store the scrollbar instance as a property of the GTK scrollbar, as it's not used and if we did this, we'd have to separately GC-protect it in a hash table, like in MS Windows. lrecord.h, frame.h, frame.c, frameslots.h, redisplay.c, window.c, window.h: Move mark_window_mirror from redisplay.c to window.c. Make window mirrors actual Lisp objects. Tell lrecord.h about them. Change the window mirror member of struct frame from a pointer to a Lisp object, and add XWINDOW_MIRROR in appropriate places. Mark the scrollbar instances in the window mirror. redisplay.c, redisplay.h, alloc.c: Delete mark_redisplay. Don't call mark_redisplay. We now mark frame-specific structures in mark_frame. NOTE: I also deleted an extremely questionable call to update_frame_window_mirrors(). It was extremely questionable before, and now totally impossible, since it will create Lisp objects during redisplay. frame.c: Mark the scrollbar instances, which are now Lisp objects. Call mark_gutter() here, not in mark_redisplay(). gutter.c: Update comments about correct marking. --------------------------------------------------------------- ISSUES BROUGHT UP BY MARTIN: --------------------------------------------------------------- buffer.h: Put back these macros the way Steve T and I think they ought to be. I already explained in a previous changelog entry why I think these macros should be the way I'd defined them. Once again: We fix these macros so they don't care about the type of their lvalues. The non-C-string equivalents of these already function in the same way, and it's correct because it should be OK to pass in a CBufbyte *, a BufByte *, a Char_Binary *, an UChar_Binary *, etc. The whole reason for these different types is to work around errors caused by signed-vs-unsigned non-matching types. Any possible error that might be caught in a DFC macro would also be caught wherever the argument is used elsewhere. So creating multiple macro versions would add no useful error-checking and just further complicate an already complicated area. As for Martin's "ANSI aliasing" bug, XEmacs is not ANSI-aliasing clean and probably never will be. Unless the board agrees to change XEmacs in this way (and we really don't want to go down that road), this is not a bug. sound.h: Undo Martin's type change. signal.c: Fix problem identified by Martin with Linux and g++ due to non-standard declaration of setitimer(). systime.h: Update the docs for "qxe_" to point out why making the encapsulation explicit is always the right way to go. (setitimer() itself serves as an example.) For 21.4: update-elc-2.el: Correct misplaced parentheses, making lisp/mule not get recompiled.
author ben
date Mon, 18 Jun 2001 07:10:32 +0000
parents ef4d2466a29c
children fdefd0186b75
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
1 /* Header for code conversion stuff
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
2 Copyright (C) 1991, 1995 Free Software Foundation, Inc.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
3 Copyright (C) 1995 Sun Microsystems, Inc.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
4
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
5 This file is part of XEmacs.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
6
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
7 XEmacs is free software; you can redistribute it and/or modify it
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
8 under the terms of the GNU General Public License as published by the
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
9 Free Software Foundation; either version 2, or (at your option) any
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
10 later version.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
11
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
12 XEmacs is distributed in the hope that it will be useful, but WITHOUT
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
13 ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
14 FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
15 for more details.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
16
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
17 You should have received a copy of the GNU General Public License
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
18 along with XEmacs; see the file COPYING. If not, write to
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
19 the Free Software Foundation, Inc., 59 Temple Place - Suite 330,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
20 Boston, MA 02111-1307, USA. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
21
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
22 /* Synched up with: Mule 2.3. Not in FSF. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
23
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
24 /* 91.10.09 written by K.Handa <handa@etl.go.jp> */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
25 /* Rewritten by Ben Wing <ben@xemacs.org>. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
26
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
27 #ifndef INCLUDED_file_coding_h_
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
28 #define INCLUDED_file_coding_h_
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
29
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
30 struct decoding_stream;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
31 struct encoding_stream;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
32
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
33 /* Coding system types. These go into the TYPE field of a
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
34 Lisp_Coding_System. */
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
35
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
36 enum coding_system_type
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
37 {
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
38 CODESYS_AUTODETECT, /* Automatic conversion. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
39 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
40 CODESYS_SHIFT_JIS, /* Shift-JIS; Hankaku (half-width) KANA
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
41 is also supported. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
42 CODESYS_ISO2022, /* Any ISO2022-compliant coding system.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
43 Includes JIS, EUC, CTEXT */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
44 CODESYS_BIG5, /* BIG5 (used for Taiwanese). */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
45 CODESYS_UCS4, /* ISO 10646 UCS-4 */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
46 CODESYS_UTF8, /* ISO 10646 UTF-8 */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
47 CODESYS_CCL, /* Converter written in CCL. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
48 #endif
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
49 CODESYS_NO_CONVERSION /* "No conversion"; used for binary files.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
50 We use quotes because there really
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
51 is some conversion being applied,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
52 but it appears to the user as if
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
53 the text is read in without conversion. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
54 #ifdef DEBUG_XEMACS
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
55 ,CODESYS_INTERNAL /* Raw (internally-formatted) data. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
56 #endif
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
57 };
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
58
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
59 enum eol_type
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
60 {
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
61 EOL_AUTODETECT,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
62 EOL_LF,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
63 EOL_CRLF,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
64 EOL_CR
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
65 };
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
66 typedef enum eol_type eol_type_t;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
67
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
68 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
69 typedef struct charset_conversion_spec charset_conversion_spec;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
70 struct charset_conversion_spec
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
71 {
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
72 Lisp_Object from_charset;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
73 Lisp_Object to_charset;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
74 };
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
75
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
76 typedef struct
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
77 {
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
78 Dynarr_declare (charset_conversion_spec);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
79 } charset_conversion_spec_dynarr;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
80 #endif
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
81
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
82 struct Lisp_Coding_System
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
83 {
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
84 struct lcrecord_header header;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
85
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
86 /* Name and doc string of this coding system. */
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
87 Lisp_Object name;
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
88 Lisp_Object doc_string;
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
89
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
90 /* This is the major type of the coding system -- one of Big5, ISO2022,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
91 Shift-JIS, etc. See the constants above. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
92 enum coding_system_type type;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
93
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
94 /* Mnemonic string displayed in the modeline when this coding
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
95 system is active for a particular buffer. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
96 Lisp_Object mnemonic;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
97
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
98 Lisp_Object post_read_conversion;
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
99 Lisp_Object pre_write_conversion;
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
100
438
84b14dcb0985 Import from CVS: tag r21-2-27
cvs
parents: 428
diff changeset
101 eol_type_t eol_type;
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
102
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
103 /* Subsidiary coding systems that specify a particular type of EOL
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
104 marking, rather than autodetecting it. These will only be non-nil
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
105 if (eol_type == EOL_AUTODETECT). */
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
106 Lisp_Object eol_lf;
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
107 Lisp_Object eol_crlf;
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
108 Lisp_Object eol_cr;
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
109 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
110 struct
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
111 {
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
112 /* What are the charsets to be initially designated to G0, G1,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
113 G2, G3? If t, no charset is initially designated. If nil,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
114 no charset is initially designated and no charset is allowed
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
115 to be designated. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
116 Lisp_Object initial_charset[4];
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
117
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
118 /* If true, a designation escape sequence needs to be sent on output
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
119 for the charset in G[0-3] before that charset is used. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
120 unsigned char force_charset_on_output[4];
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
121
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
122 charset_conversion_spec_dynarr *input_conv;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
123 charset_conversion_spec_dynarr *output_conv;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
124
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
125 unsigned int shoort :1; /* C makes you speak Dutch */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
126 unsigned int no_ascii_eol :1;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
127 unsigned int no_ascii_cntl :1;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
128 unsigned int seven :1;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
129 unsigned int lock_shift :1;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
130 unsigned int no_iso6429 :1;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
131 unsigned int escape_quoted :1;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
132 } iso2022;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
133 struct
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
134 {
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
135 /* For a CCL coding system, these specify the CCL programs used for
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
136 decoding (input) and encoding (output). */
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
137 Lisp_Object decode;
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
138 Lisp_Object encode;
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
139 } ccl;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
140 #endif
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
141 };
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
142 typedef struct Lisp_Coding_System Lisp_Coding_System;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
143
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
144 DECLARE_LRECORD (coding_system, Lisp_Coding_System);
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
145 #define XCODING_SYSTEM(x) XRECORD (x, coding_system, Lisp_Coding_System)
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
146 #define XSETCODING_SYSTEM(x, p) XSETRECORD (x, p, coding_system)
617
af57a77cbc92 [xemacs-hg @ 2001-06-18 07:09:50 by ben]
ben
parents: 528
diff changeset
147 #define wrap_coding_system(p) wrap_record (p, coding_system)
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
148 #define CODING_SYSTEMP(x) RECORDP (x, coding_system)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
149 #define CHECK_CODING_SYSTEM(x) CHECK_RECORD (x, coding_system)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
150 #define CONCHECK_CODING_SYSTEM(x) CONCHECK_RECORD (x, coding_system)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
151
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
152 #define CODING_SYSTEM_NAME(codesys) ((codesys)->name)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
153 #define CODING_SYSTEM_DOC_STRING(codesys) ((codesys)->doc_string)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
154 #define CODING_SYSTEM_TYPE(codesys) ((codesys)->type)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
155 #define CODING_SYSTEM_MNEMONIC(codesys) ((codesys)->mnemonic)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
156 #define CODING_SYSTEM_POST_READ_CONVERSION(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
157 ((codesys)->post_read_conversion)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
158 #define CODING_SYSTEM_PRE_WRITE_CONVERSION(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
159 ((codesys)->pre_write_conversion)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
160 #define CODING_SYSTEM_EOL_TYPE(codesys) ((codesys)->eol_type)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
161 #define CODING_SYSTEM_EOL_LF(codesys) ((codesys)->eol_lf)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
162 #define CODING_SYSTEM_EOL_CRLF(codesys) ((codesys)->eol_crlf)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
163 #define CODING_SYSTEM_EOL_CR(codesys) ((codesys)->eol_cr)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
164
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
165 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
166 #define CODING_SYSTEM_ISO2022_INITIAL_CHARSET(codesys, g) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
167 ((codesys)->iso2022.initial_charset[g])
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
168 #define CODING_SYSTEM_ISO2022_FORCE_CHARSET_ON_OUTPUT(codesys, g) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
169 ((codesys)->iso2022.force_charset_on_output[g])
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
170 #define CODING_SYSTEM_ISO2022_SHORT(codesys) ((codesys)->iso2022.shoort)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
171 #define CODING_SYSTEM_ISO2022_NO_ASCII_EOL(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
172 ((codesys)->iso2022.no_ascii_eol)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
173 #define CODING_SYSTEM_ISO2022_NO_ASCII_CNTL(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
174 ((codesys)->iso2022.no_ascii_cntl)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
175 #define CODING_SYSTEM_ISO2022_SEVEN(codesys) ((codesys)->iso2022.seven)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
176 #define CODING_SYSTEM_ISO2022_LOCK_SHIFT(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
177 ((codesys)->iso2022.lock_shift)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
178 #define CODING_SYSTEM_ISO2022_NO_ISO6429(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
179 ((codesys)->iso2022.no_iso6429)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
180 #define CODING_SYSTEM_ISO2022_ESCAPE_QUOTED(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
181 ((codesys)->iso2022.escape_quoted)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
182 #define CODING_SYSTEM_CCL_DECODE(codesys) ((codesys)->ccl.decode)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
183 #define CODING_SYSTEM_CCL_ENCODE(codesys) ((codesys)->ccl.encode)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
184 #endif /* MULE */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
185
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
186 #define XCODING_SYSTEM_NAME(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
187 CODING_SYSTEM_NAME (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
188 #define XCODING_SYSTEM_DOC_STRING(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
189 CODING_SYSTEM_DOC_STRING (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
190 #define XCODING_SYSTEM_TYPE(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
191 CODING_SYSTEM_TYPE (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
192 #define XCODING_SYSTEM_MNEMONIC(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
193 CODING_SYSTEM_MNEMONIC (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
194 #define XCODING_SYSTEM_POST_READ_CONVERSION(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
195 CODING_SYSTEM_POST_READ_CONVERSION (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
196 #define XCODING_SYSTEM_PRE_WRITE_CONVERSION(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
197 CODING_SYSTEM_PRE_WRITE_CONVERSION (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
198 #define XCODING_SYSTEM_EOL_TYPE(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
199 CODING_SYSTEM_EOL_TYPE (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
200 #define XCODING_SYSTEM_EOL_LF(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
201 CODING_SYSTEM_EOL_LF (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
202 #define XCODING_SYSTEM_EOL_CRLF(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
203 CODING_SYSTEM_EOL_CRLF (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
204 #define XCODING_SYSTEM_EOL_CR(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
205 CODING_SYSTEM_EOL_CR (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
206
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
207 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
208 #define XCODING_SYSTEM_ISO2022_INITIAL_CHARSET(codesys, g) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
209 CODING_SYSTEM_ISO2022_INITIAL_CHARSET (XCODING_SYSTEM (codesys), g)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
210 #define XCODING_SYSTEM_ISO2022_FORCE_CHARSET_ON_OUTPUT(codesys, g) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
211 CODING_SYSTEM_ISO2022_FORCE_CHARSET_ON_OUTPUT (XCODING_SYSTEM (codesys), g)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
212 #define XCODING_SYSTEM_ISO2022_SHORT(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
213 CODING_SYSTEM_ISO2022_SHORT (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
214 #define XCODING_SYSTEM_ISO2022_NO_ASCII_EOL(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
215 CODING_SYSTEM_ISO2022_NO_ASCII_EOL (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
216 #define XCODING_SYSTEM_ISO2022_NO_ASCII_CNTL(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
217 CODING_SYSTEM_ISO2022_NO_ASCII_CNTL (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
218 #define XCODING_SYSTEM_ISO2022_SEVEN(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
219 CODING_SYSTEM_ISO2022_SEVEN (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
220 #define XCODING_SYSTEM_ISO2022_LOCK_SHIFT(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
221 CODING_SYSTEM_ISO2022_LOCK_SHIFT (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
222 #define XCODING_SYSTEM_ISO2022_NO_ISO6429(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
223 CODING_SYSTEM_ISO2022_NO_ISO6429 (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
224 #define XCODING_SYSTEM_ISO2022_ESCAPE_QUOTED(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
225 CODING_SYSTEM_ISO2022_ESCAPE_QUOTED (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
226 #define XCODING_SYSTEM_CCL_DECODE(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
227 CODING_SYSTEM_CCL_DECODE (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
228 #define XCODING_SYSTEM_CCL_ENCODE(codesys) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
229 CODING_SYSTEM_CCL_ENCODE (XCODING_SYSTEM (codesys))
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
230 #endif /* MULE */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
231
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
232 EXFUN (Fcoding_category_list, 0);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
233 EXFUN (Fcoding_category_system, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
234 EXFUN (Fcoding_priority_list, 0);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
235 EXFUN (Fcoding_system_doc_string, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
236 EXFUN (Fcoding_system_list, 0);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
237 EXFUN (Fcoding_system_name, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
238 EXFUN (Fcoding_system_p, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
239 EXFUN (Fcoding_system_property, 2);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
240 EXFUN (Fcoding_system_type, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
241 EXFUN (Fcopy_coding_system, 2);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
242 EXFUN (Fdecode_big5_char, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
243 EXFUN (Fdecode_coding_region, 4);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
244 EXFUN (Fdecode_shift_jis_char, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
245 EXFUN (Fdetect_coding_region, 3);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
246 EXFUN (Fencode_big5_char, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
247 EXFUN (Fencode_coding_region, 4);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
248 EXFUN (Fencode_shift_jis_char, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
249 EXFUN (Ffind_coding_system, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
250 EXFUN (Fget_coding_system, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
251 EXFUN (Fmake_coding_system, 4);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
252 EXFUN (Fset_coding_category_system, 2);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
253 EXFUN (Fset_coding_priority_list, 1);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
254 EXFUN (Fsubsidiary_coding_system, 2);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
255
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
256 extern Lisp_Object Qucs4, Qutf8;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
257 extern Lisp_Object Qbig5, Qccl, Qcharset_g0;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
258 extern Lisp_Object Qcharset_g1, Qcharset_g2, Qcharset_g3, Qcoding_system_error;
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
259 extern Lisp_Object Qcoding_systemp, Qcr, Qcrlf, Qdecode, Qencode;
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
260 extern Lisp_Object Qeol_cr, Qeol_crlf, Qeol_lf, Qeol_type, Qescape_quoted;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
261 extern Lisp_Object Qforce_g0_on_output, Qforce_g1_on_output;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
262 extern Lisp_Object Qforce_g2_on_output, Qforce_g3_on_output;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
263 extern Lisp_Object Qinput_charset_conversion, Qiso2022, Qlf, Qlock_shift;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
264 extern Lisp_Object Qmnemonic, Qno_ascii_cntl, Qno_ascii_eol, Qno_conversion;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
265 extern Lisp_Object Qraw_text;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
266 extern Lisp_Object Qno_iso6429, Qoutput_charset_conversion;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
267 extern Lisp_Object Qpost_read_conversion, Qpre_write_conversion, Qseven;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
268 extern Lisp_Object Qshift_jis, Qshort, Vcoding_system_for_read;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
269 extern Lisp_Object Vcoding_system_for_write, Vcoding_system_hash_table;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
270 extern Lisp_Object Vfile_name_coding_system, Vkeyboard_coding_system;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
271 extern Lisp_Object Vterminal_coding_system;
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
272
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
273 /* Flags indicating current state while converting code. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
274
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
275 /* Used by everyone. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
276
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
277 #define CODING_STATE_END (1 << 0) /* If set, this is the last chunk of
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
278 data being processed. When this
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
279 is finished, output any necessary
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
280 terminating control characters,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
281 escape sequences, etc. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
282 #define CODING_STATE_CR (1 << 1) /* If set, we just saw a CR. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
283
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
284
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
285 /* Used by Big 5 on output. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
286 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
287 #define CODING_STATE_BIG5_1 (1 << 2) /* If set, we just encountered
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
288 LEADING_BYTE_BIG5_1. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
289 #define CODING_STATE_BIG5_2 (1 << 3) /* If set, we just encountered
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
290 LEADING_BYTE_BIG5_2. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
291
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
292
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
293 /* Used by ISO2022 on input and output. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
294
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
295 #define CODING_STATE_R2L (1 << 4) /* If set, the current
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
296 directionality is right-to-left.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
297 Otherwise, it's left-to-right. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
298
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
299
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
300 /* Used by ISO2022 on input. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
301
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
302 #define CODING_STATE_ESCAPE (1 << 5) /* If set, we're currently parsing
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
303 an escape sequence and the upper
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
304 16 bits should be looked at to
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
305 indicate what partial escape
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
306 sequence we've seen so far.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
307 Otherwise, we're running
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
308 through actual text. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
309 #define CODING_STATE_SS2 (1 << 6) /* If set, G2 is invoked into GL, but
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
310 only for the next character. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
311 #define CODING_STATE_SS3 (1 << 7) /* If set, G3 is invoked into GL,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
312 but only for the next character.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
313 If both CODING_STATE_SS2 and
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
314 CODING_STATE_SS3 are set,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
315 CODING_STATE_SS2 overrides; but
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
316 this probably indicates an error
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
317 in the text encoding. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
318 #ifdef ENABLE_COMPOSITE_CHARS
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
319 #define CODING_STATE_COMPOSITE (1 << 8) /* If set, we're currently processing
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
320 a composite character (i.e. a
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
321 character constructed by
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
322 overstriking two or more
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
323 characters). */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
324 #endif /* ENABLE_COMPOSITE_CHARS */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
325
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
326
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
327 /* CODING_STATE_ISO2022_LOCK is the mask of flags that remain on until
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
328 explicitly turned off when in the ISO2022 encoder/decoder. Other flags are
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
329 turned off at the end of processing each character or escape sequence. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
330 #ifdef ENABLE_COMPOSITE_CHARS
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
331 # define CODING_STATE_ISO2022_LOCK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
332 (CODING_STATE_END | CODING_STATE_COMPOSITE | CODING_STATE_R2L)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
333 #else
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
334 # define CODING_STATE_ISO2022_LOCK (CODING_STATE_END | CODING_STATE_R2L)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
335 #endif
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
336
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
337 #define CODING_STATE_BIG5_LOCK CODING_STATE_END
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
338
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
339 /* Flags indicating what we've seen so far when parsing an
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
340 ISO2022 escape sequence. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
341 enum iso_esc_flag
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
342 {
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
343 /* Partial sequences */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
344 ISO_ESC_NOTHING, /* Nothing has been seen. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
345 ISO_ESC, /* We've seen ESC. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
346 ISO_ESC_2_4, /* We've seen ESC $. This indicates
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
347 that we're designating a multi-byte, rather
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
348 than a single-byte, character set. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
349 ISO_ESC_2_8, /* We've seen ESC 0x28, i.e. ESC (.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
350 This means designate a 94-character
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
351 character set into G0. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
352 ISO_ESC_2_9, /* We've seen ESC 0x29 -- designate a
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
353 94-character character set into G1. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
354 ISO_ESC_2_10, /* We've seen ESC 0x2A. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
355 ISO_ESC_2_11, /* We've seen ESC 0x2B. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
356 ISO_ESC_2_12, /* We've seen ESC 0x2C -- designate a
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
357 96-character character set into G0.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
358 (This is not ISO2022-standard.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
359 The following 96-character
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
360 control sequences are standard,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
361 though.) */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
362 ISO_ESC_2_13, /* We've seen ESC 0x2D -- designate a
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
363 96-character character set into G1.
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
364 */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
365 ISO_ESC_2_14, /* We've seen ESC 0x2E. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
366 ISO_ESC_2_15, /* We've seen ESC 0x2F. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
367 ISO_ESC_2_4_8, /* We've seen ESC $ 0x28 -- designate
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
368 a 94^N character set into G0. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
369 ISO_ESC_2_4_9, /* We've seen ESC $ 0x29. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
370 ISO_ESC_2_4_10, /* We've seen ESC $ 0x2A. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
371 ISO_ESC_2_4_11, /* We've seen ESC $ 0x2B. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
372 ISO_ESC_2_4_12, /* We've seen ESC $ 0x2C. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
373 ISO_ESC_2_4_13, /* We've seen ESC $ 0x2D. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
374 ISO_ESC_2_4_14, /* We've seen ESC $ 0x2E. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
375 ISO_ESC_2_4_15, /* We've seen ESC $ 0x2F. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
376 ISO_ESC_5_11, /* We've seen ESC [ or 0x9B. This
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
377 starts a directionality-control
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
378 sequence. The next character
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
379 must be 0, 1, 2, or ]. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
380 ISO_ESC_5_11_0, /* We've seen 0x9B 0. The next character must be ]. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
381 ISO_ESC_5_11_1, /* We've seen 0x9B 1. The next character must be ]. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
382 ISO_ESC_5_11_2, /* We've seen 0x9B 2. The next character must be ]. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
383
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
384 /* Full sequences. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
385 #ifdef ENABLE_COMPOSITE_CHARS
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
386 ISO_ESC_START_COMPOSITE, /* Private usage for START COMPOSING */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
387 ISO_ESC_END_COMPOSITE, /* Private usage for END COMPOSING */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
388 #endif /* ENABLE_COMPOSITE_CHARS */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
389 ISO_ESC_SINGLE_SHIFT, /* We've seen a complete single-shift sequence. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
390 ISO_ESC_LOCKING_SHIFT,/* We've seen a complete locking-shift sequence. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
391 ISO_ESC_DESIGNATE, /* We've seen a complete designation sequence. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
392 ISO_ESC_DIRECTIONALITY,/* We've seen a complete ISO6429 directionality
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
393 sequence. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
394 ISO_ESC_LITERAL /* We've seen a literal character ala
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
395 escape-quoting. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
396 };
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
397
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
398 /* Macros to define code of control characters for ISO2022's functions. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
399 /* code */ /* function */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
400 #define ISO_CODE_LF 0x0A /* line-feed */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
401 #define ISO_CODE_CR 0x0D /* carriage-return */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
402 #define ISO_CODE_SO 0x0E /* shift-out */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
403 #define ISO_CODE_SI 0x0F /* shift-in */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
404 #define ISO_CODE_ESC 0x1B /* escape */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
405 #define ISO_CODE_DEL 0x7F /* delete */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
406 #define ISO_CODE_SS2 0x8E /* single-shift-2 */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
407 #define ISO_CODE_SS3 0x8F /* single-shift-3 */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
408 #define ISO_CODE_CSI 0x9B /* control-sequence-introduce */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
409 #endif /* MULE */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
410
448
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
411 /* Distinguishable categories of encodings.
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
412
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
413 This list determines the initial priority of the categories.
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
414
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
415 For better or worse, currently Mule files are encoded in 7-bit ISO 2022.
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
416 For this reason, under Mule ISO_7 gets highest priority.
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
417
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
418 Putting NO_CONVERSION second prevents "binary corruption" in the
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
419 default case in all but the (presumably) extremely rare case of a
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
420 binary file which contains redundant escape sequences but no 8-bit
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
421 characters.
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
422
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
423 The remaining priorities are based on perceived "internationalization
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
424 political correctness." An exception is UCS-4 at the bottom, since
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
425 basically everything is compatible with UCS-4, but it is likely to
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
426 be very rare as an external encoding. */
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
427
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
428 enum coding_category_type
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
429 {
448
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
430 /* must be a contiguous range of values 0 -- CODING_CATEGORY_LAST - 1 */
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
431 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
432 CODING_CATEGORY_ISO_7, /* ISO2022 system using only seven-bit bytes,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
433 no locking shift */
448
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
434 CODING_CATEGORY_NO_CONVERSION,
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
435 CODING_CATEGORY_UTF8,
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
436 CODING_CATEGORY_ISO_8_1, /* ISO2022 system using eight-bit bytes,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
437 no locking shift, no designation sequences,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
438 one-dimension characters in the upper half. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
439 CODING_CATEGORY_ISO_8_2, /* ISO2022 system using eight-bit bytes,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
440 no locking shift, no designation sequences,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
441 two-dimension characters in the upper half. */
448
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
442 CODING_CATEGORY_ISO_8_DESIGNATE, /* ISO2022 system using eight-bit bytes,
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
443 no locking shift, no single shift,
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
444 using designation to switch charsets */
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
445 CODING_CATEGORY_ISO_LOCK_SHIFT, /* ISO2022 system using locking shift */
448
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
446 CODING_CATEGORY_SHIFT_JIS,
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
447 CODING_CATEGORY_BIG5,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
448 CODING_CATEGORY_UCS4,
448
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
449 #else /* not MULE */
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
450 CODING_CATEGORY_NO_CONVERSION,
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
451 #endif /* MULE */
448
3078fd1074e8 Import from CVS: tag r21-2-39
cvs
parents: 440
diff changeset
452 CODING_CATEGORY_LAST /* not a real coding category */
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
453 };
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
454
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
455 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
456 #define CODING_CATEGORY_SHIFT_JIS_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
457 (1 << CODING_CATEGORY_SHIFT_JIS)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
458 #define CODING_CATEGORY_ISO_7_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
459 (1 << CODING_CATEGORY_ISO_7)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
460 #define CODING_CATEGORY_ISO_8_DESIGNATE_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
461 (1 << CODING_CATEGORY_ISO_8_DESIGNATE)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
462 #define CODING_CATEGORY_ISO_8_1_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
463 (1 << CODING_CATEGORY_ISO_8_1)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
464 #define CODING_CATEGORY_ISO_8_2_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
465 (1 << CODING_CATEGORY_ISO_8_2)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
466 #define CODING_CATEGORY_ISO_LOCK_SHIFT_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
467 (1 << CODING_CATEGORY_ISO_LOCK_SHIFT)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
468 #define CODING_CATEGORY_BIG5_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
469 (1 << CODING_CATEGORY_BIG5)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
470 #define CODING_CATEGORY_UCS4_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
471 (1 << CODING_CATEGORY_UCS4)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
472 #define CODING_CATEGORY_UTF8_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
473 (1 << CODING_CATEGORY_UTF8)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
474 #endif
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
475 #define CODING_CATEGORY_NO_CONVERSION_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
476 (1 << CODING_CATEGORY_NO_CONVERSION)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
477 #define CODING_CATEGORY_NOT_FINISHED_MASK \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
478 (1 << 30)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
479
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
480 #ifdef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
481 /* Convert shift-JIS code (sj1, sj2) into internal string
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
482 representation (c1, c2). (The leading byte is assumed.) */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
483
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
484 #define DECODE_SJIS(sj1, sj2, c1, c2) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
485 do { \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
486 int I1 = sj1, I2 = sj2; \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
487 if (I2 >= 0x9f) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
488 c1 = (I1 << 1) - ((I1 >= 0xe0) ? 0xe0 : 0x60), \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
489 c2 = I2 + 2; \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
490 else \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
491 c1 = (I1 << 1) - ((I1 >= 0xe0) ? 0xe1 : 0x61), \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
492 c2 = I2 + ((I2 >= 0x7f) ? 0x60 : 0x61); \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
493 } while (0)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
494
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
495 /* Convert the internal string representation of a Shift-JIS character
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
496 (c1, c2) into Shift-JIS code (sj1, sj2). The leading byte is
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
497 assumed. */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
498
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
499 #define ENCODE_SJIS(c1, c2, sj1, sj2) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
500 do { \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
501 int I1 = c1, I2 = c2; \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
502 if (I1 & 1) \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
503 sj1 = (I1 >> 1) + ((I1 < 0xdf) ? 0x31 : 0x71), \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
504 sj2 = I2 - ((I2 >= 0xe0) ? 0x60 : 0x61); \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
505 else \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
506 sj1 = (I1 >> 1) + ((I1 < 0xdf) ? 0x30 : 0x70), \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
507 sj2 = I2 - 2; \
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
508 } while (0)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
509 #endif /* MULE */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
510
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
511 Lisp_Object make_decoding_input_stream (Lstream *stream,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
512 Lisp_Object codesys);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
513 Lisp_Object make_encoding_input_stream (Lstream *stream,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
514 Lisp_Object codesys);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
515 Lisp_Object make_decoding_output_stream (Lstream *stream,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
516 Lisp_Object codesys);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
517 Lisp_Object make_encoding_output_stream (Lstream *stream,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
518 Lisp_Object codesys);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
519 Lisp_Object decoding_stream_coding_system (Lstream *stream);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
520 Lisp_Object encoding_stream_coding_system (Lstream *stream);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
521 void set_decoding_stream_coding_system (Lstream *stream,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
522 Lisp_Object codesys);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
523 void set_encoding_stream_coding_system (Lstream *stream,
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
524 Lisp_Object codesys);
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
525 void determine_real_coding_system (Lstream *stream, Lisp_Object *codesys_in_out,
438
84b14dcb0985 Import from CVS: tag r21-2-27
cvs
parents: 428
diff changeset
526 eol_type_t *eol_type_in_out);
428
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
527
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
528
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
529 #ifndef MULE
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
530 #define MIN_LEADING_BYTE 0x80
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
531 /* These need special treatment in a string and/or character */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
532 #ifdef ENABLE_COMPOSITE_CHARS
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
533 #define LEADING_BYTE_COMPOSITE 0x80 /* for a composite character */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
534 #endif
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
535 #define LEADING_BYTE_CONTROL_1 0x8F /* represent normal 80-9F */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
536 #define LEADING_BYTE_LATIN_ISO8859_1 0x81 /* Right half of ISO 8859-1 */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
537 #define BYTE_C1_P(c) ((unsigned int) ((unsigned int) (c) - 0x80) < 0x20)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
538 #define BUFBYTE_FIRST_BYTE_P(c) ((c) < 0xA0)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
539 #define BUFBYTE_LEADING_BYTE_P(c) BYTE_C1_P (c)
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
540 #endif /* not MULE */
3ecd8885ac67 Import from CVS: tag r21-2-22
cvs
parents:
diff changeset
541
440
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
542 #endif /* INCLUDED_file_coding_h_ */
8de8e3f6228a Import from CVS: tag r21-2-28
cvs
parents: 438
diff changeset
543