cpython-lru_cache-weakref: Modules/_codecsmodule.c annotate

annotate Modules/_codecsmodule.c @ 35494:0bcb303b341b legacy-trunk

Explain what file descriptors are; this change has been sitting in my tree for a while

author	Andrew M. Kuchling <amk@amk.ca>
date	Wed, 31 Aug 2005 13:50:17 +0000
parents	6b8c55877755
children	5d93e5ccb31e cc17a582518a

rev	line source
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	1 /* ------------------------------------------------------------------------
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	2
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	3 _codecs -- Provides access to the codec registry and the builtin
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	4 codecs.
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	5
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	6 This module should never be imported directly. The standard library
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	7 module "codecs" wraps this builtin module for use within Python.
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	8
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	9 The codec registry is accessible via:
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	10
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	11 register(search_function) -> None
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	12
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	13 lookup(encoding) -> (encoder, decoder, stream_reader, stream_writer)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	14
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	15 The builtin Unicode codecs use the following interface:
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	16
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	17 <encoding>_encode(Unicode_object[,errors='strict']) ->
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	18 (string object, bytes consumed)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	19
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	20 <encoding>_decode(char_buffer_obj[,errors='strict']) ->
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	21 (Unicode object, bytes consumed)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	22
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	23 <encoding>_encode() interfaces also accept non-Unicode object as
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	24 input. The objects are then converted to Unicode using
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	25 PyUnicode_FromObject() prior to applying the conversion.
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	26
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	27 These <encoding>s are available: utf_8, unicode_escape,
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	28 raw_unicode_escape, unicode_internal, latin_1, ascii (7-bit),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	29 mbcs (on win32).
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	30
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	31
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	32 Written by Marc-Andre Lemburg (mal@lemburg.com).
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	33
13828 254f8b7c4a83 Changing the CNRI copyright notice according to CNRI's instructions. Guido van Rossum <guido@python.org> parents: 13651 diff changeset	34 Copyright (c) Corporation for National Research Initiatives.
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	35
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	36 ------------------------------------------------------------------------ */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	37
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	38 #include "Python.h"
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	39
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	40 /* --- Registry ----------------------------------------------------------- */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	41
25974 040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	42 PyDoc_STRVAR(register__doc__,
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	43 "register(search_function)\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	44 \n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	45 Register a codec search function. Search functions are expected to take\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	46 one argument, the encoding name in all lower case letters, and return\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	47 a tuple of functions (encoder, decoder, stream_reader, stream_writer).");
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	48
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	49 static
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	50 PyObject codec_register(PyObject self, PyObject *args)
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	51 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	52 PyObject *search_function;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	53
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	54 if (!PyArg_ParseTuple(args, "O:register", &search_function))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	55 goto onError;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	56
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	57 if (PyCodec_Register(search_function))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	58 goto onError;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	59
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	60 Py_INCREF(Py_None);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	61 return Py_None;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	62
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	63 onError:
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	64 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	65 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	66
25974 040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	67 PyDoc_STRVAR(lookup__doc__,
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	68 "lookup(encoding) -> (encoder, decoder, stream_reader, stream_writer)\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	69 \n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	70 Looks up a codec tuple in the Python codec registry and returns\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	71 a tuple of functions.");
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	72
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	73 static
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	74 PyObject codec_lookup(PyObject self, PyObject *args)
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	75 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	76 char *encoding;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	77
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	78 if (!PyArg_ParseTuple(args, "s:lookup", &encoding))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	79 goto onError;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	80
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	81 return _PyCodec_Lookup(encoding);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	82
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	83 onError:
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	84 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	85 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	86
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	87 PyDoc_STRVAR(encode__doc__,
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	88 "encode(obj, [encoding[,errors]]) -> object\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	89 \n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	90 Encodes obj using the codec registered for encoding. encoding defaults\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	91 to the default encoding. errors may be given to set a different error\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	92 handling scheme. Default is 'strict' meaning that encoding errors raise\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	93 a ValueError. Other possible values are 'ignore', 'replace' and\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	94 'xmlcharrefreplace' as well as any other name registered with\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	95 codecs.register_error that can handle ValueErrors.");
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	96
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	97 static PyObject *
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	98 codec_encode(PyObject self, PyObject args)
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	99 {
32602 ab979ff8b02a Change some declarations from ``char `` to ``const char ``. Also added Brett Cannon <bcannon@gmail.com> parents: 32572 diff changeset	100 const char *encoding = NULL;
ab979ff8b02a Change some declarations from ``char `` to ``const char ``. Also added Brett Cannon <bcannon@gmail.com> parents: 32572 diff changeset	101 const char *errors = NULL;
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	102 PyObject *v;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	103
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	104 if (!PyArg_ParseTuple(args, "O\|ss:encode", &v, &encoding, &errors))
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	105 return NULL;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	106
34707 0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	107 #ifdef Py_USING_UNICODE
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	108 if (encoding == NULL)
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	109 encoding = PyUnicode_GetDefaultEncoding();
34707 0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	110 #else
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	111 if (encoding == NULL) {
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	112 PyErr_SetString(PyExc_ValueError, "no encoding specified");
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	113 return NULL;
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	114 }
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	115 #endif
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	116
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	117 /* Encode via the codec registry */
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	118 v = PyCodec_Encode(v, encoding, errors);
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	119 if (v == NULL)
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	120 goto onError;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	121 return v;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	122
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	123 onError:
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	124 return NULL;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	125 }
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	126
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	127 PyDoc_STRVAR(decode__doc__,
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	128 "decode(obj, [encoding[,errors]]) -> object\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	129 \n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	130 Decodes obj using the codec registered for encoding. encoding defaults\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	131 to the default encoding. errors may be given to set a different error\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	132 handling scheme. Default is 'strict' meaning that encoding errors raise\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	133 a ValueError. Other possible values are 'ignore' and 'replace'\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	134 as well as any other name registerd with codecs.register_error that is\n\
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	135 able to handle ValueErrors.");
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	136
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	137 static PyObject *
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	138 codec_decode(PyObject self, PyObject args)
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	139 {
32602 ab979ff8b02a Change some declarations from ``char `` to ``const char ``. Also added Brett Cannon <bcannon@gmail.com> parents: 32572 diff changeset	140 const char *encoding = NULL;
ab979ff8b02a Change some declarations from ``char `` to ``const char ``. Also added Brett Cannon <bcannon@gmail.com> parents: 32572 diff changeset	141 const char *errors = NULL;
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	142 PyObject *v;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	143
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	144 if (!PyArg_ParseTuple(args, "O\|ss:decode", &v, &encoding, &errors))
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	145 return NULL;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	146
34707 0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	147 #ifdef Py_USING_UNICODE
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	148 if (encoding == NULL)
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	149 encoding = PyUnicode_GetDefaultEncoding();
34707 0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	150 #else
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	151 if (encoding == NULL) {
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	152 PyErr_SetString(PyExc_ValueError, "no encoding specified");
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	153 return NULL;
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	154 }
0d44d9071e97 Build with --disable-unicode again. Fixes #1158607. Martin v. Löwis <martin@v.loewis.de> parents: 33428 diff changeset	155 #endif
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	156
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	157 /* Decode via the codec registry */
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	158 v = PyCodec_Decode(v, encoding, errors);
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	159 if (v == NULL)
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	160 goto onError;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	161 return v;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	162
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	163 onError:
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	164 return NULL;
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	165 }
8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	166
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	167 /* --- Helpers ------------------------------------------------------------ */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	168
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	169 static
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	170 PyObject codec_tuple(PyObject unicode,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	171 int len)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	172 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	173 PyObject v,w;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	174
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	175 if (unicode == NULL)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	176 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	177 v = PyTuple_New(2);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	178 if (v == NULL) {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	179 Py_DECREF(unicode);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	180 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	181 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	182 PyTuple_SET_ITEM(v,0,unicode);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	183 w = PyInt_FromLong(len);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	184 if (w == NULL) {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	185 Py_DECREF(v);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	186 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	187 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	188 PyTuple_SET_ITEM(v,1,w);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	189 return v;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	190 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	191
24808 ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	192 /* --- String codecs ------------------------------------------------------ */
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	193 static PyObject *
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	194 escape_decode(PyObject *self,
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	195 PyObject *args)
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	196 {
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	197 const char *errors = NULL;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	198 const char *data;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	199 int size;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	200
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	201 if (!PyArg_ParseTuple(args, "s#\|z:escape_decode",
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	202 &data, &size, &errors))
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	203 return NULL;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	204 return codec_tuple(PyString_DecodeEscape(data, size, errors, 0, NULL),
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	205 size);
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	206 }
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	207
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	208 static PyObject *
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	209 escape_encode(PyObject *self,
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	210 PyObject *args)
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	211 {
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	212 PyObject *str;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	213 const char *errors = NULL;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	214 char *buf;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	215 int len;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	216
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	217 if (!PyArg_ParseTuple(args, "O!\|z:escape_encode",
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	218 &PyString_Type, &str, &errors))
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	219 return NULL;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	220
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	221 str = PyString_Repr(str, 0);
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	222 if (!str)
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	223 return NULL;
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	224
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	225 /* The string will be quoted. Unquote, similar to unicode-escape. */
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	226 buf = PyString_AS_STRING (str);
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	227 len = PyString_GET_SIZE (str);
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	228 memmove(buf, buf+1, len-2);
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	229 _PyString_Resize(&str, len-2);
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	230
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	231 return codec_tuple(str, PyString_Size(str));
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	232 }
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	233
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	234 #ifdef Py_USING_UNICODE
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	235 /* --- Decoder ------------------------------------------------------------ */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	236
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	237 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	238 unicode_internal_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	239 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	240 {
14733 814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	241 PyObject *obj;
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	242 const char *errors = NULL;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	243 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	244 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	245
14733 814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	246 if (!PyArg_ParseTuple(args, "O\|z:unicode_internal_decode",
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	247 &obj, &errors))
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	248 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	249
27680 b19aaaeb6d64 Fix for [ 543344 ] Interpreter crashes when recoding; suggested Marc-André Lemburg <mal@egenix.com> parents: 25974 diff changeset	250 if (PyUnicode_Check(obj)) {
b19aaaeb6d64 Fix for [ 543344 ] Interpreter crashes when recoding; suggested Marc-André Lemburg <mal@egenix.com> parents: 25974 diff changeset	251 Py_INCREF(obj);
14733 814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	252 return codec_tuple(obj, PyUnicode_GET_SIZE(obj));
27680 b19aaaeb6d64 Fix for [ 543344 ] Interpreter crashes when recoding; suggested Marc-André Lemburg <mal@egenix.com> parents: 25974 diff changeset	253 }
14733 814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	254 else {
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	255 if (PyObject_AsReadBuffer(obj, (const void **)&data, &size))
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	256 return NULL;
35485 6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34707 diff changeset	257
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34707 diff changeset	258 return codec_tuple(_PyUnicode_DecodeUnicodeInternal(data, size, errors),
14733 814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	259 size);
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	260 }
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	261 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	262
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	263 static PyObject *
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	264 utf_7_decode(PyObject *self,
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	265 PyObject *args)
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	266 {
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	267 const char *data;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	268 int size;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	269 const char *errors = NULL;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	270
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	271 if (!PyArg_ParseTuple(args, "t#\|z:utf_7_decode",
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	272 &data, &size, &errors))
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	273 return NULL;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	274
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	275 return codec_tuple(PyUnicode_DecodeUTF7(data, size, errors),
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	276 size);
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	277 }
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	278
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	279 static PyObject *
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	280 utf_8_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	281 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	282 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	283 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	284 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	285 const char *errors = NULL;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	286 int final = 0;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	287 int consumed;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	288 PyObject *decoded = NULL;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	289
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	290 if (!PyArg_ParseTuple(args, "t#\|zi:utf_8_decode",
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	291 &data, &size, &errors, &final))
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	292 return NULL;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	293 consumed = size;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	294
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	295 decoded = PyUnicode_DecodeUTF8Stateful(data, size, errors,
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	296 final ? NULL : &consumed);
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	297 if (decoded == NULL)
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	298 return NULL;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	299 return codec_tuple(decoded, consumed);
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	300 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	301
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	302 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	303 utf_16_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	304 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	305 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	306 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	307 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	308 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	309 int byteorder = 0;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	310 int final = 0;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	311 int consumed;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	312 PyObject *decoded;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	313
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	314 if (!PyArg_ParseTuple(args, "t#\|zi:utf_16_decode",
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	315 &data, &size, &errors, &final))
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	316 return NULL;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	317 consumed = size;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	318 decoded = PyUnicode_DecodeUTF16Stateful(data, size, errors, &byteorder,
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	319 final ? NULL : &consumed);
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	320 if (decoded == NULL)
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	321 return NULL;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	322 return codec_tuple(decoded, consumed);
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	323 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	324
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	325 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	326 utf_16_le_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	327 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	328 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	329 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	330 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	331 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	332 int byteorder = -1;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	333 int final = 0;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	334 int consumed;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	335 PyObject *decoded = NULL;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	336
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	337 if (!PyArg_ParseTuple(args, "t#\|zi:utf_16_le_decode",
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	338 &data, &size, &errors, &final))
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	339 return NULL;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	340 consumed = size;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	341 decoded = PyUnicode_DecodeUTF16Stateful(data, size, errors,
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	342 &byteorder, final ? NULL : &consumed);
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	343 if (decoded == NULL)
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	344 return NULL;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	345 return codec_tuple(decoded, consumed);
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	346
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	347 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	348
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	349 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	350 utf_16_be_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	351 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	352 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	353 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	354 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	355 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	356 int byteorder = 1;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	357 int final = 0;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	358 int consumed;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	359 PyObject *decoded = NULL;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	360
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	361 if (!PyArg_ParseTuple(args, "t#\|zi:utf_16_be_decode",
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	362 &data, &size, &errors, &final))
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	363 return NULL;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	364 consumed = size;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	365 decoded = PyUnicode_DecodeUTF16Stateful(data, size, errors,
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	366 &byteorder, final ? NULL : &consumed);
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	367 if (decoded == NULL)
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	368 return NULL;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	369 return codec_tuple(decoded, consumed);
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	370 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	371
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	372 /* This non-standard version also provides access to the byteorder
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	373 parameter of the builtin UTF-16 codec.
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	374
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	375 It returns a tuple (unicode, bytesread, byteorder) with byteorder
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	376 being the value in effect at the end of data.
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	377
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	378 */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	379
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	380 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	381 utf_16_ex_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	382 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	383 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	384 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	385 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	386 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	387 int byteorder = 0;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	388 PyObject unicode, tuple;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	389 int final = 0;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	390 int consumed;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	391
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	392 if (!PyArg_ParseTuple(args, "t#\|zii:utf_16_ex_decode",
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	393 &data, &size, &errors, &byteorder, &final))
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	394 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	395
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	396 consumed = size;
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	397 unicode = PyUnicode_DecodeUTF16Stateful(data, size, errors, &byteorder,
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	398 final ? NULL : &consumed);
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	399 if (unicode == NULL)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	400 return NULL;
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32602 diff changeset	401 tuple = Py_BuildValue("Oii", unicode, consumed, byteorder);
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	402 Py_DECREF(unicode);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	403 return tuple;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	404 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	405
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	406 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	407 unicode_escape_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	408 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	409 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	410 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	411 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	412 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	413
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	414 if (!PyArg_ParseTuple(args, "t#\|z:unicode_escape_decode",
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	415 &data, &size, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	416 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	417
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	418 return codec_tuple(PyUnicode_DecodeUnicodeEscape(data, size, errors),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	419 size);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	420 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	421
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	422 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	423 raw_unicode_escape_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	424 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	425 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	426 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	427 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	428 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	429
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	430 if (!PyArg_ParseTuple(args, "t#\|z:raw_unicode_escape_decode",
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	431 &data, &size, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	432 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	433
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	434 return codec_tuple(PyUnicode_DecodeRawUnicodeEscape(data, size, errors),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	435 size);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	436 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	437
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	438 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	439 latin_1_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	440 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	441 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	442 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	443 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	444 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	445
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	446 if (!PyArg_ParseTuple(args, "t#\|z:latin_1_decode",
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	447 &data, &size, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	448 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	449
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	450 return codec_tuple(PyUnicode_DecodeLatin1(data, size, errors),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	451 size);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	452 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	453
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	454 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	455 ascii_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	456 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	457 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	458 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	459 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	460 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	461
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	462 if (!PyArg_ParseTuple(args, "t#\|z:ascii_decode",
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	463 &data, &size, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	464 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	465
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	466 return codec_tuple(PyUnicode_DecodeASCII(data, size, errors),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	467 size);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	468 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	469
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	470 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	471 charmap_decode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	472 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	473 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	474 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	475 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	476 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	477 PyObject *mapping = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	478
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	479 if (!PyArg_ParseTuple(args, "t#\|zO:charmap_decode",
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	480 &data, &size, &errors, &mapping))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	481 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	482 if (mapping == Py_None)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	483 mapping = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	484
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	485 return codec_tuple(PyUnicode_DecodeCharmap(data, size, mapping, errors),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	486 size);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	487 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	488
24071 8142f8d668a0 Patch #569753: Remove support for WIN16. Martin v. Löwis <martin@v.loewis.de> parents: 21757 diff changeset	489 #if defined(MS_WINDOWS) && defined(HAVE_USABLE_WCHAR_T)
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	490
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	491 static PyObject *
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	492 mbcs_decode(PyObject *self,
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	493 PyObject *args)
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	494 {
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	495 const char *data;
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	496 int size;
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	497 const char *errors = NULL;
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	498
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	499 if (!PyArg_ParseTuple(args, "t#\|z:mbcs_decode",
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	500 &data, &size, &errors))
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	501 return NULL;
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	502
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	503 return codec_tuple(PyUnicode_DecodeMBCS(data, size, errors),
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	504 size);
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	505 }
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	506
24071 8142f8d668a0 Patch #569753: Remove support for WIN16. Martin v. Löwis <martin@v.loewis.de> parents: 21757 diff changeset	507 #endif /* MS_WINDOWS */
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	508
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	509 /* --- Encoder ------------------------------------------------------------ */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	510
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	511 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	512 readbuffer_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	513 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	514 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	515 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	516 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	517 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	518
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	519 if (!PyArg_ParseTuple(args, "s#\|z:readbuffer_encode",
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	520 &data, &size, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	521 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	522
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	523 return codec_tuple(PyString_FromStringAndSize(data, size),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	524 size);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	525 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	526
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	527 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	528 charbuffer_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	529 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	530 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	531 const char *data;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	532 int size;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	533 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	534
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	535 if (!PyArg_ParseTuple(args, "t#\|z:charbuffer_encode",
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	536 &data, &size, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	537 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	538
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	539 return codec_tuple(PyString_FromStringAndSize(data, size),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	540 size);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	541 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	542
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	543 static PyObject *
14733 814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	544 unicode_internal_encode(PyObject *self,
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	545 PyObject *args)
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	546 {
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	547 PyObject *obj;
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	548 const char *errors = NULL;
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	549 const char *data;
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	550 int size;
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	551
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	552 if (!PyArg_ParseTuple(args, "O\|z:unicode_internal_encode",
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	553 &obj, &errors))
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	554 return NULL;
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	555
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	556 if (PyUnicode_Check(obj)) {
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	557 data = PyUnicode_AS_DATA(obj);
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	558 size = PyUnicode_GET_DATA_SIZE(obj);
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	559 return codec_tuple(PyString_FromStringAndSize(data, size),
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	560 size);
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	561 }
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	562 else {
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	563 if (PyObject_AsReadBuffer(obj, (const void **)&data, &size))
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	564 return NULL;
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	565 return codec_tuple(PyString_FromStringAndSize(data, size),
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	566 size);
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	567 }
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	568 }
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	569
814f421e0326 Added a true unicode_internal_encode function and fixed the Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	570 static PyObject *
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	571 utf_7_encode(PyObject *self,
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	572 PyObject *args)
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	573 {
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	574 PyObject str, v;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	575 const char *errors = NULL;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	576
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	577 if (!PyArg_ParseTuple(args, "O\|z:utf_7_encode",
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	578 &str, &errors))
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	579 return NULL;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	580
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	581 str = PyUnicode_FromObject(str);
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	582 if (str == NULL)
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	583 return NULL;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	584 v = codec_tuple(PyUnicode_EncodeUTF7(PyUnicode_AS_UNICODE(str),
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	585 PyUnicode_GET_SIZE(str),
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	586 0,
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	587 0,
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	588 errors),
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	589 PyUnicode_GET_SIZE(str));
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	590 Py_DECREF(str);
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	591 return v;
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	592 }
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	593
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19343 diff changeset	594 static PyObject *
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	595 utf_8_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	596 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	597 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	598 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	599 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	600
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	601 if (!PyArg_ParseTuple(args, "O\|z:utf_8_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	602 &str, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	603 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	604
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	605 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	606 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	607 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	608 v = codec_tuple(PyUnicode_EncodeUTF8(PyUnicode_AS_UNICODE(str),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	609 PyUnicode_GET_SIZE(str),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	610 errors),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	611 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	612 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	613 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	614 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	615
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	616 /* This version provides access to the byteorder parameter of the
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	617 builtin UTF-16 codecs as optional third argument. It defaults to 0
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	618 which means: use the native byte order and prepend the data with a
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	619 BOM mark.
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	620
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	621 */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	622
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	623 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	624 utf_16_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	625 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	626 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	627 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	628 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	629 int byteorder = 0;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	630
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	631 if (!PyArg_ParseTuple(args, "O\|zi:utf_16_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	632 &str, &errors, &byteorder))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	633 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	634
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	635 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	636 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	637 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	638 v = codec_tuple(PyUnicode_EncodeUTF16(PyUnicode_AS_UNICODE(str),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	639 PyUnicode_GET_SIZE(str),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	640 errors,
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	641 byteorder),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	642 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	643 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	644 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	645 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	646
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	647 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	648 utf_16_le_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	649 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	650 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	651 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	652 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	653
18139 354a4df09e38 Fix for bug [ #433047 ] missing args to PyArg_ParseTuple Marc-André Lemburg <mal@egenix.com> parents: 14733 diff changeset	654 if (!PyArg_ParseTuple(args, "O\|z:utf_16_le_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	655 &str, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	656 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	657
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	658 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	659 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	660 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	661 v = codec_tuple(PyUnicode_EncodeUTF16(PyUnicode_AS_UNICODE(str),
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	662 PyUnicode_GET_SIZE(str),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	663 errors,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	664 -1),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	665 PyUnicode_GET_SIZE(str));
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	666 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	667 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	668 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	669
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	670 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	671 utf_16_be_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	672 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	673 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	674 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	675 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	676
18139 354a4df09e38 Fix for bug [ #433047 ] missing args to PyArg_ParseTuple Marc-André Lemburg <mal@egenix.com> parents: 14733 diff changeset	677 if (!PyArg_ParseTuple(args, "O\|z:utf_16_be_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	678 &str, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	679 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	680
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	681 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	682 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	683 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	684 v = codec_tuple(PyUnicode_EncodeUTF16(PyUnicode_AS_UNICODE(str),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	685 PyUnicode_GET_SIZE(str),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	686 errors,
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	687 +1),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	688 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	689 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	690 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	691 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	692
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	693 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	694 unicode_escape_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	695 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	696 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	697 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	698 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	699
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	700 if (!PyArg_ParseTuple(args, "O\|z:unicode_escape_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	701 &str, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	702 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	703
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	704 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	705 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	706 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	707 v = codec_tuple(PyUnicode_EncodeUnicodeEscape(PyUnicode_AS_UNICODE(str),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	708 PyUnicode_GET_SIZE(str)),
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	709 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	710 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	711 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	712 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	713
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	714 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	715 raw_unicode_escape_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	716 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	717 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	718 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	719 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	720
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	721 if (!PyArg_ParseTuple(args, "O\|z:raw_unicode_escape_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	722 &str, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	723 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	724
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	725 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	726 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	727 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	728 v = codec_tuple(PyUnicode_EncodeRawUnicodeEscape(
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	729 PyUnicode_AS_UNICODE(str),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	730 PyUnicode_GET_SIZE(str)),
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	731 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	732 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	733 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	734 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	735
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	736 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	737 latin_1_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	738 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	739 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	740 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	741 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	742
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	743 if (!PyArg_ParseTuple(args, "O\|z:latin_1_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	744 &str, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	745 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	746
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	747 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	748 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	749 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	750 v = codec_tuple(PyUnicode_EncodeLatin1(
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	751 PyUnicode_AS_UNICODE(str),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	752 PyUnicode_GET_SIZE(str),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	753 errors),
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	754 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	755 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	756 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	757 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	758
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	759 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	760 ascii_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	761 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	762 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	763 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	764 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	765
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	766 if (!PyArg_ParseTuple(args, "O\|z:ascii_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	767 &str, &errors))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	768 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	769
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	770 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	771 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	772 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	773 v = codec_tuple(PyUnicode_EncodeASCII(
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	774 PyUnicode_AS_UNICODE(str),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	775 PyUnicode_GET_SIZE(str),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	776 errors),
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	777 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	778 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	779 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	780 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	781
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	782 static PyObject *
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	783 charmap_encode(PyObject *self,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	784 PyObject *args)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	785 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	786 PyObject str, v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	787 const char *errors = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	788 PyObject *mapping = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	789
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	790 if (!PyArg_ParseTuple(args, "O\|zO:charmap_encode",
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	791 &str, &errors, &mapping))
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	792 return NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	793 if (mapping == Py_None)
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	794 mapping = NULL;
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	795
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	796 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	797 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	798 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	799 v = codec_tuple(PyUnicode_EncodeCharmap(
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	800 PyUnicode_AS_UNICODE(str),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	801 PyUnicode_GET_SIZE(str),
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	802 mapping,
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	803 errors),
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	804 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	805 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	806 return v;
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	807 }
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	808
24071 8142f8d668a0 Patch #569753: Remove support for WIN16. Martin v. Löwis <martin@v.loewis.de> parents: 21757 diff changeset	809 #if defined(MS_WINDOWS) && defined(HAVE_USABLE_WCHAR_T)
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	810
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	811 static PyObject *
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	812 mbcs_encode(PyObject *self,
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	813 PyObject *args)
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	814 {
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	815 PyObject str, v;
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	816 const char *errors = NULL;
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	817
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	818 if (!PyArg_ParseTuple(args, "O\|z:mbcs_encode",
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	819 &str, &errors))
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	820 return NULL;
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	821
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	822 str = PyUnicode_FromObject(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	823 if (str == NULL)
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	824 return NULL;
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	825 v = codec_tuple(PyUnicode_EncodeMBCS(
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	826 PyUnicode_AS_UNICODE(str),
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	827 PyUnicode_GET_SIZE(str),
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	828 errors),
13358 c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	829 PyUnicode_GET_SIZE(str));
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	830 Py_DECREF(str);
c8706e5a882f Modified the encode interfaces of all builtin codecs to accept Marc-André Lemburg <mal@egenix.com> parents: 12074 diff changeset	831 return v;
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	832 }
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	833
24071 8142f8d668a0 Patch #569753: Remove support for WIN16. Martin v. Löwis <martin@v.loewis.de> parents: 21757 diff changeset	834 #endif /* MS_WINDOWS */
19343 7257e87e0720 Patch #445762: Support --disable-unicode Martin v. Löwis <martin@v.loewis.de> parents: 18278 diff changeset	835 #endif /* Py_USING_UNICODE */
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	836
25091 0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	837 /* --- Error handler registry --------------------------------------------- */
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	838
25974 040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	839 PyDoc_STRVAR(register_error__doc__,
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	840 "register_error(errors, handler)\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	841 \n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	842 Register the specified error handler under the name\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	843 errors. handler must be a callable object, that\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	844 will be called with an exception instance containing\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	845 information about the location of the encoding/decoding\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	846 error and must return a (replacement, new position) tuple.");
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	847
25091 0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	848 static PyObject register_error(PyObject self, PyObject *args)
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	849 {
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	850 const char *name;
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	851 PyObject *handler;
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	852
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	853 if (!PyArg_ParseTuple(args, "sO:register_error",
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	854 &name, &handler))
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	855 return NULL;
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	856 if (PyCodec_RegisterError(name, handler))
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	857 return NULL;
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	858 Py_INCREF(Py_None);
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	859 return Py_None;
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	860 }
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	861
25974 040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	862 PyDoc_STRVAR(lookup_error__doc__,
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	863 "lookup_error(errors) -> handler\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	864 \n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	865 Return the error handler for the specified error handling name\n\
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	866 or raise a LookupError, if no handler exists under this name.");
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	867
25091 0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	868 static PyObject lookup_error(PyObject self, PyObject *args)
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	869 {
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	870 const char *name;
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	871
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	872 if (!PyArg_ParseTuple(args, "s:lookup_error",
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	873 &name))
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	874 return NULL;
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	875 return PyCodec_LookupError(name);
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	876 }
0337dad8403e PEP 293 implemention (from SF patch http://www.python.org/sf/432401) Walter Dörwald <walter@livinglogic.de> parents: 24808 diff changeset	877
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	878 /* --- Module API --------------------------------------------------------- */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	879
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	880 static PyMethodDef _codecs_functions[] = {
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	881 {"register", codec_register, METH_VARARGS,
25974 040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	882 register__doc__},
32572 8ea2cb1ec598 Add generic codecs.encode() and .decode() APIs that don't impose Marc-André Lemburg <mal@egenix.com> parents: 27680 diff changeset	883 {"lookup", codec_lookup, METH_VARARGS,
25974 040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	884 lookup__doc__},
32602 ab979ff8b02a Change some declarations from ``char `` to ``const char ``. Also added Brett Cannon <bcannon@gmail.com> parents: 32572 diff changeset	885 {"encode", codec_encode, METH_VARARGS,
ab979ff8b02a Change some declarations from ``char `` to ``const char ``. Also added Brett Cannon <bcannon@gmail.com> parents: 32572 diff changeset	886 encode__doc__},
ab979ff8b02a Change some declarations from ``char `` to ``const char ``. Also added Brett Cannon <bcannon@gmail.com> parents: 32572 diff changeset	887 {"decode", codec_decode, METH_VARARGS,
ab979ff8b02a Change some declarations from ``char `` to ``const char ``. Also added Brett Cannon <bcannon@gmail.com> parents: 32572 diff changeset	888 decode__doc__},
24808 ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	889 {"escape_encode", escape_encode, METH_VARARGS},
ab63af3ec349 Patch #505705: Remove eval in pickle and cPickle. Martin v. Löwis <martin@v.loewis.de> parents: 24471 diff changeset	890 {"escape_decode", escape_decode, METH_VARARGS},
19343 7257e87e0720 Patch #445762: Support --disable-unicode Martin v. Löwis <martin@v.loewis.de> parents: 18278 diff changeset	891 #ifdef Py_USING_UNICODE
21757 40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	892 {"utf_8_encode", utf_8_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	893 {"utf_8_decode", utf_8_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	894 {"utf_7_encode", utf_7_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	895 {"utf_7_decode", utf_7_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	896 {"utf_16_encode", utf_16_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	897 {"utf_16_le_encode", utf_16_le_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	898 {"utf_16_be_encode", utf_16_be_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	899 {"utf_16_decode", utf_16_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	900 {"utf_16_le_decode", utf_16_le_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	901 {"utf_16_be_decode", utf_16_be_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	902 {"utf_16_ex_decode", utf_16_ex_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	903 {"unicode_escape_encode", unicode_escape_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	904 {"unicode_escape_decode", unicode_escape_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	905 {"unicode_internal_encode", unicode_internal_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	906 {"unicode_internal_decode", unicode_internal_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	907 {"raw_unicode_escape_encode", raw_unicode_escape_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	908 {"raw_unicode_escape_decode", raw_unicode_escape_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	909 {"latin_1_encode", latin_1_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	910 {"latin_1_decode", latin_1_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	911 {"ascii_encode", ascii_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	912 {"ascii_decode", ascii_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	913 {"charmap_encode", charmap_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	914 {"charmap_decode", charmap_decode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	915 {"readbuffer_encode", readbuffer_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	916 {"charbuffer_encode", charbuffer_encode, METH_VARARGS},
24071 8142f8d668a0 Patch #569753: Remove support for WIN16. Martin v. Löwis <martin@v.loewis.de> parents: 21757 diff changeset	917 #if defined(MS_WINDOWS) && defined(HAVE_USABLE_WCHAR_T)
21757 40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	918 {"mbcs_encode", mbcs_encode, METH_VARARGS},
40631ae74b17 Patch #477750: Use METH_ constants in Modules. Martin v. Löwis <martin@v.loewis.de> parents: 19998 diff changeset	919 {"mbcs_decode", mbcs_decode, METH_VARARGS},
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 11980 diff changeset	920 #endif
19343 7257e87e0720 Patch #445762: Support --disable-unicode Martin v. Löwis <martin@v.loewis.de> parents: 18278 diff changeset	921 #endif /* Py_USING_UNICODE */
25974 040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	922 {"register_error", register_error, METH_VARARGS,
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	923 register_error__doc__},
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	924 {"lookup_error", lookup_error, METH_VARARGS,
040af9c736bb Add docstrings to register, lookup, register_error Walter Dörwald <walter@livinglogic.de> parents: 25091 diff changeset	925 lookup_error__doc__},
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	926 {NULL, NULL} /* sentinel */
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	927 };
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	928
24471 f66b3a3509c7 Excise DL_EXPORT/DL_IMPORT from Modules/. Required adding a prototype Mark Hammond <mhammond@skippinet.com.au>* parents: 24071 diff changeset	929 PyMODINIT_FUNC
13651 8a063423e0b7 Bunch of minor ANSIfications: 'void initfunc()' -> 'void initfunc(void)', Thomas Wouters <thomas@python.org> parents: 13358 diff changeset	930 init_codecs(void)
11980 a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	931 {
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	932 Py_InitModule("_codecs", _codecs_functions);
a9b5a31ff8cb Internal module _codecs -- Provides access to the codec registry and Guido van Rossum <guido@python.org> parents: diff changeset	933 }

Mercurial > cpython-lru_cache-weakref

annotate Modules/_codecsmodule.c @ 35494:0bcb303b341b legacy-trunk