Mercurial > cpython-lru_cache-weakref

annotate Modules/cjkcodecs/_codecs_hk.c @ 54294:dba767bc3155 legacy-trunk

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
remove mention of old ctypes version
author Benjamin Peterson <benjamin@python.org>
date Sat, 23 May 2009 20:59:09 +0000
parents eca90b8aa7fd
children fd25030223b0
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
1 /*
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
2 * _codecs_hk.c: Codecs collection for encodings from Hong Kong
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
3 *
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
4 * Written by Hye-Shik Chang <perky@FreeBSD.org>
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
5 */
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
6
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
7 #define USING_IMPORTED_MAPS
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
8
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
9 #include "cjkcodecs.h"
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
10 #include "mappings_hk.h"
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
11
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
12 /*
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
13 * BIG5HKSCS codec
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
14 */
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
15
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
16 static const encode_map *big5_encmap = NULL;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
17 static const decode_map *big5_decmap = NULL;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
18
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
19 CODEC_INIT(big5hkscs)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
20 {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
21 static int initialized = 0;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
22
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
23 if (!initialized && IMPORT_MAP(tw, big5, &big5_encmap, &big5_decmap))
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
24 return -1;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
25 initialized = 1;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
26 return 0;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
27 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
28
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
29 /*
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
30 * There are four possible pair unicode -> big5hkscs maps as in HKSCS 2004:
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
31 * U+00CA U+0304 -> 8862 (U+00CA alone is mapped to 8866)
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
32 * U+00CA U+030C -> 8864
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
33 * U+00EA U+0304 -> 88a3 (U+00EA alone is mapped to 88a7)
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
34 * U+00EA U+030C -> 88a5
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
35 * These are handled by not mapping tables but a hand-written code.
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
36 */
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
37 static const DBCHAR big5hkscs_pairenc_table[4] = {0x8862, 0x8864, 0x88a3, 0x88a5};
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
38
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
39 ENCODER(big5hkscs)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
40 {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
41 while (inleft > 0) {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
42 ucs4_t c = **inbuf;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
43 DBCHAR code;
36831
bac6bd343a12 - Modernize code to use Py_ssize_t more intensively.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 33193
diff changeset
44 Py_ssize_t insize;
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
45
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
46 if (c < 0x80) {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
47 REQUIRE_OUTBUF(1)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
48 **outbuf = (unsigned char)c;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
49 NEXT(1, 1)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
50 continue;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
51 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
52
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
53 DECODE_SURROGATE(c)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
54 insize = GET_INSIZE(c);
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
55
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
56 REQUIRE_OUTBUF(2)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
57
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
58 if (c < 0x10000) {
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
59 TRYMAP_ENC(big5hkscs_bmp, code, c) {
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
60 if (code == MULTIC) {
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
61 if (inleft >= 2 &&
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
62 ((c & 0xffdf) == 0x00ca) &&
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
63 (((*inbuf)[1] & 0xfff7) == 0x0304)) {
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
64 code = big5hkscs_pairenc_table[
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
65 ((c >> 4) |
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
66 ((*inbuf)[1] >> 3)) & 3];
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
67 insize = 2;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
68 }
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
69 else if (inleft < 2 &&
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
70 !(flags & MBENC_FLUSH))
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
71 return MBERR_TOOFEW;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
72 else {
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
73 if (c == 0xca)
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
74 code = 0x8866;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
75 else /* c == 0xea */
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
76 code = 0x88a7;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
77 }
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
78 }
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
79 }
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
80 else TRYMAP_ENC(big5, code, c);
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
81 else return 1;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
82 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
83 else if (c < 0x20000)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
84 return insize;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
85 else if (c < 0x30000) {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
86 TRYMAP_ENC(big5hkscs_nonbmp, code, c & 0xffff);
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
87 else return insize;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
88 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
89 else
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
90 return insize;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
91
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
92 OUT1(code >> 8)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
93 OUT2(code & 0xFF)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
94 NEXT(insize, 2)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
95 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
96
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
97 return 0;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
98 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
99
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
100 #define BH2S(c1, c2) (((c1) - 0x87) * (0xfe - 0x40 + 1) + ((c2) - 0x40))
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
101
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
102 DECODER(big5hkscs)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
103 {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
104 while (inleft > 0) {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
105 unsigned char c = IN1;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
106 ucs4_t decoded;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
107
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
108 REQUIRE_OUTBUF(1)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
109
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
110 if (c < 0x80) {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
111 OUT1(c)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
112 NEXT(1, 1)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
113 continue;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
114 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
115
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
116 REQUIRE_INBUF(2)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
117
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
118 if (0xc6 <= c && c <= 0xc8 && (c >= 0xc7 || IN2 >= 0xa1))
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
119 goto hkscsdec;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
120
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
121 TRYMAP_DEC(big5, **outbuf, c, IN2) {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
122 NEXT(2, 1)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
123 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
124 else
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
125 hkscsdec: TRYMAP_DEC(big5hkscs, decoded, c, IN2) {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
126 int s = BH2S(c, IN2);
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
127 const unsigned char *hintbase;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
128
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
129 assert(0x87 <= c && c <= 0xfe);
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
130 assert(0x40 <= IN2 && IN2 <= 0xfe);
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
131
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
132 if (BH2S(0x87, 0x40) <= s && s <= BH2S(0xa0, 0xfe)) {
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
133 hintbase = big5hkscs_phint_0;
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
134 s -= BH2S(0x87, 0x40);
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
135 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
136 else if (BH2S(0xc6,0xa1) <= s && s <= BH2S(0xc8,0xfe)){
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
137 hintbase = big5hkscs_phint_12130;
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
138 s -= BH2S(0xc6, 0xa1);
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
139 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
140 else if (BH2S(0xf9,0xd6) <= s && s <= BH2S(0xfe,0xfe)){
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
141 hintbase = big5hkscs_phint_21924;
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
142 s -= BH2S(0xf9, 0xd6);
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
143 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
144 else
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
145 return MBERR_INTERNAL;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
146
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
147 if (hintbase[s >> 3] & (1 << (s & 7))) {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
148 WRITEUCS4(decoded | 0x20000)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
149 NEXT_IN(2)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
150 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
151 else {
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
152 OUT1(decoded)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
153 NEXT(2, 1)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
154 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
155 }
45235
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
156 else {
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
157 switch ((c << 8) | IN2) {
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
158 case 0x8862: WRITE2(0x00ca, 0x0304); break;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
159 case 0x8864: WRITE2(0x00ca, 0x030c); break;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
160 case 0x88a3: WRITE2(0x00ea, 0x0304); break;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
161 case 0x88a5: WRITE2(0x00ea, 0x030c); break;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
162 default: return 2;
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
163 }
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
164
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
165 NEXT(2, 2) /* all decoded codepoints are pairs, above. */
eca90b8aa7fd Update big5hkscs codec to conform to the HKSCS:2004 revision.
Hye-Shik Chang <hyeshik@gmail.com>
parents: 36831
diff changeset
166 }
32727
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
167 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
168
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
169 return 0;
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
170 }
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
171
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
172
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
173 BEGIN_MAPPINGS_LIST
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
174 MAPPING_DECONLY(big5hkscs)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
175 MAPPING_ENCONLY(big5hkscs_bmp)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
176 MAPPING_ENCONLY(big5hkscs_nonbmp)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
177 END_MAPPINGS_LIST
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
178
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
179 BEGIN_CODECS_LIST
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
180 CODEC_STATELESS_WINIT(big5hkscs)
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
181 END_CODECS_LIST
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
182
69dadc2ca14d Bring CJKCodecs 1.1 into trunk. This completely reorganizes source
Hye-Shik Chang <hyeshik@gmail.com>
parents:
diff changeset
183 I_AM_A_MODULE_FOR(hk)