cpython-lru_cache-weakref: Include/unicodeobject.h annotate

annotate Include/unicodeobject.h @ 58664:993f703a61ba

Merged revisions 77484,77487,77561,77570,77593,77603,77608,77667,77702-77703,77739,77858,77887,77889 via svnmerge from svn+ssh://pythondev@svn.python.org/python/trunk ........ r77484 | skip.montanaro | 2010-01-13 19:12:34 -0600 (Wed, 13 Jan 2010) | 4 lines Update PyEval_EvalFrame to PyEval_EvalFrameEx. This looks to have been done partially before. Also add a comment describing how this might have to work with different versions of the interpreter. ........ r77487 | ezio.melotti | 2010-01-14 05:34:10 -0600 (Thu, 14 Jan 2010) | 1 line Fixed typo ........ r77561 | georg.brandl | 2010-01-17 02:42:30 -0600 (Sun, 17 Jan 2010) | 1 line #7699: improve datetime docs: straightforward linking to strftime/strptime section, mark classmethods as such. ........ r77570 | georg.brandl | 2010-01-17 06:14:42 -0600 (Sun, 17 Jan 2010) | 1 line Add note about usage of STRINGLIB_EMPTY. ........ r77593 | georg.brandl | 2010-01-17 17:33:53 -0600 (Sun, 17 Jan 2010) | 1 line Fix internal reference. ........ r77603 | benjamin.peterson | 2010-01-18 17:07:56 -0600 (Mon, 18 Jan 2010) | 8 lines data descriptors do not override the class dictionary if __get__ is not defined Adjust documentation and add a test to verify this behavior. See http://mail.python.org/pipermail/python-dev/2010-January/095637.html for discussion. ........ r77608 | gregory.p.smith | 2010-01-19 02:19:03 -0600 (Tue, 19 Jan 2010) | 6 lines Do not compile stubs for the sha2 series hashes in the openssl hashlib module when the openssl version is too old to support them. That leads both compiled code bloat and to unittests attempting to test implementations that don't exist for comparison purposes on such platforms. ........ r77667 | mark.dickinson | 2010-01-21 12:32:27 -0600 (Thu, 21 Jan 2010) | 1 line Add two more test_strtod test values. ........ r77702 | georg.brandl | 2010-01-23 02:43:31 -0600 (Sat, 23 Jan 2010) | 1 line #7762: fix refcount annotation of PyUnicode_Tailmatch(). ........ r77703 | georg.brandl | 2010-01-23 02:47:54 -0600 (Sat, 23 Jan 2010) | 1 line #7725: fix referencing issue. ........ r77739 | benjamin.peterson | 2010-01-24 21:52:52 -0600 (Sun, 24 Jan 2010) | 1 line mention from_float() in error message ........ r77858 | georg.brandl | 2010-01-30 11:57:48 -0600 (Sat, 30 Jan 2010) | 1 line #7802: fix invalid example (heh). ........ r77887 | georg.brandl | 2010-01-31 12:51:49 -0600 (Sun, 31 Jan 2010) | 5 lines Fix-up ftplib documentation: move exception descriptions to toplevel, not inside a class remove attribution in "versionadded" spell and grammar check docstring of FTP_TLS ........ r77889 | michael.foord | 2010-01-31 13:59:26 -0600 (Sun, 31 Jan 2010) | 1 line Minor modification to unittest documentation. ........

author	Benjamin Peterson <benjamin@python.org>
date	Wed, 03 Feb 2010 02:35:45 +0000
parents	ac209f132b17
children	f197407bdba2 dd18cccb55b0

rev	line source
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1 #ifndef Py_UNICODEOBJECT_H
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	2 #define Py_UNICODEOBJECT_H
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	3
44999 7c02182e2979 Merged revisions 60284-60349 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44586 diff changeset	4 #include <stdarg.h>
7c02182e2979 Merged revisions 60284-60349 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44586 diff changeset	5
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	6 /*
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	7
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	8 Unicode implementation based on original code by Fredrik Lundh,
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	9 modified by Marc-Andre Lemburg (mal@lemburg.com) according to the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	10 Unicode Integration Proposal (see file Misc/unicode.txt).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	11
13828 254f8b7c4a83 Changing the CNRI copyright notice according to CNRI's instructions. Guido van Rossum <guido@python.org> parents: 13661 diff changeset	12 Copyright (c) Corporation for National Research Initiatives.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	13
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	14
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	15 Original header:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	16 --------------------------------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	17
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	18 * Yet another Unicode string type for Python. This type supports the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	19 * 16-bit Basic Multilingual Plane (BMP) only.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	20 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	21 * Written by Fredrik Lundh, January 1999.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	22 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	23 * Copyright (c) 1999 by Secret Labs AB.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	24 * Copyright (c) 1999 by Fredrik Lundh.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	25 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	26 * fredrik@pythonware.com
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	27 * http://www.pythonware.com
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	28 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	29 * --------------------------------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	30 * This Unicode String Type is
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	31 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	32 * Copyright (c) 1999 by Secret Labs AB
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	33 * Copyright (c) 1999 by Fredrik Lundh
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	34 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	35 * By obtaining, using, and/or copying this software and/or its
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	36 * associated documentation, you agree that you have read, understood,
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	37 * and will comply with the following terms and conditions:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	38 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	39 * Permission to use, copy, modify, and distribute this software and its
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	40 * associated documentation for any purpose and without fee is hereby
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	41 * granted, provided that the above copyright notice appears in all
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	42 * copies, and that both that copyright notice and this permission notice
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	43 * appear in supporting documentation, and that the name of Secret Labs
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	44 * AB or the author not be used in advertising or publicity pertaining to
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	45 * distribution of the software without specific, written prior
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	46 * permission.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	47 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	48 * SECRET LABS AB AND THE AUTHOR DISCLAIMS ALL WARRANTIES WITH REGARD TO
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	49 * THIS SOFTWARE, INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	50 * FITNESS. IN NO EVENT SHALL SECRET LABS AB OR THE AUTHOR BE LIABLE FOR
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	51 * ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	52 * WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	53 * ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	54 * OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	55 * -------------------------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	56
19980 9ab6af6815af Fix for bug #462737. Marc-André Lemburg <mal@egenix.com> parents: 19849 diff changeset	57 #include <ctype.h>
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	58
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	59 /* === Internal API ======================================================= */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	60
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	61 /* --- Internal Unicode Format -------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	62
44586 a2938c55200c Always define Py_USING_UNICODE, 3rd party software may depend on it. A missing declaration can lead to strange bugs as I had to learn the hard way in the upcoming merge Christian Heimes <christian@cheimes.de> parents: 44351 diff changeset	63 /* Python 3.x requires unicode */
a2938c55200c Always define Py_USING_UNICODE, 3rd party software may depend on it. A missing declaration can lead to strange bugs as I had to learn the hard way in the upcoming merge Christian Heimes <christian@cheimes.de> parents: 44351 diff changeset	64 #define Py_USING_UNICODE
a2938c55200c Always define Py_USING_UNICODE, 3rd party software may depend on it. A missing declaration can lead to strange bugs as I had to learn the hard way in the upcoming merge Christian Heimes <christian@cheimes.de> parents: 44351 diff changeset	65
18296 22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	66 /* FIXME: MvL's new implementation assumes that Py_UNICODE_SIZE is
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	67 properly set, but the default rules below doesn't set it. I'll
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	68 sort this out some other day -- fredrik@pythonware.com */
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	69
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	70 #ifndef Py_UNICODE_SIZE
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	71 #error Must define Py_UNICODE_SIZE
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	72 #endif
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	73
18324 3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	74 /* Setting Py_UNICODE_WIDE enables UCS-4 storage. Otherwise, Unicode
3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	75 strings are stored as UCS-2 (with limited support for UTF-16) */
3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	76
3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	77 #if Py_UNICODE_SIZE >= 4
3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	78 #define Py_UNICODE_WIDE
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	79 #endif
18280 0632dcd69ea3 experimental UCS-4 support: added USE_UCS4_STORAGE define to Fredrik Lundh <fredrik@pythonware.com> parents: 17887 diff changeset	80
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	81 /* Set these flags if the platform has "wchar.h", "wctype.h" and the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	82 wchar_t type is a 16-bit unsigned type */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	83 /* #define HAVE_WCHAR_H */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	84 /* #define HAVE_USABLE_WCHAR_T */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	85
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	86 /* Defaults for various platforms */
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	87 #ifndef PY_UNICODE_TYPE
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	88
18280 0632dcd69ea3 experimental UCS-4 support: added USE_UCS4_STORAGE define to Fredrik Lundh <fredrik@pythonware.com> parents: 17887 diff changeset	89 /* Windows has a usable wchar_t type (unless we're using UCS-4) */
18324 3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	90 # if defined(MS_WIN32) && Py_UNICODE_SIZE == 2
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	91 # define HAVE_USABLE_WCHAR_T
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	92 # define PY_UNICODE_TYPE wchar_t
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	93 # endif
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	94
18324 3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	95 # if defined(Py_UNICODE_WIDE)
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	96 # define PY_UNICODE_TYPE Py_UCS4
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	97 # endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	98
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	99 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	100
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	101 /* If the compiler provides a wchar_t type we try to support it
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	102 through the interface functions PyUnicode_FromWideChar() and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	103 PyUnicode_AsWideChar(). */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	104
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	105 #ifdef HAVE_USABLE_WCHAR_T
13917 03fa40528d17 Added #fndef's to avoid compiler errors. Marc-André Lemburg <mal@egenix.com> parents: 13837 diff changeset	106 # ifndef HAVE_WCHAR_H
03fa40528d17 Added #fndef's to avoid compiler errors. Marc-André Lemburg <mal@egenix.com> parents: 13837 diff changeset	107 # define HAVE_WCHAR_H
03fa40528d17 Added #fndef's to avoid compiler errors. Marc-André Lemburg <mal@egenix.com> parents: 13837 diff changeset	108 # endif
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	109 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	110
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	111 #ifdef HAVE_WCHAR_H
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	112 /* Work around a cosmetic bug in BSDI 4.x wchar.h; thanks to Thomas Wouters */
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	113 # ifdef _HAVE_BSDI
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	114 # include <time.h>
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	115 # endif
19980 9ab6af6815af Fix for bug #462737. Marc-André Lemburg <mal@egenix.com> parents: 19849 diff changeset	116 # include <wchar.h>
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	117 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	118
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	119 /*
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	120 * Use this typedef when you need to represent a UTF-16 surrogate pair
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	121 * as single unsigned integer.
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	122 */
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	123 #if SIZEOF_INT >= 4
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	124 typedef unsigned int Py_UCS4;
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	125 #elif SIZEOF_LONG >= 4
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	126 typedef unsigned long Py_UCS4;
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	127 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	128
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	129 /* Py_UNICODE is the native Unicode storage format (code unit) used by
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	130 Python and represents a single Unicode element in the Unicode
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	131 type. */
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	132
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	133 typedef PY_UNICODE_TYPE Py_UNICODE;
13393 bcb14627b8f4 Bill Tutt: Added Py_UCS4 typedef to hold UCS4 values (these need Marc-André Lemburg <mal@egenix.com> parents: 13352 diff changeset	134
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	135 /* --- UCS-2/UCS-4 Name Mangling ------------------------------------------ */
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	136
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	137 /* Unicode API names are mangled to assure that UCS-2 and UCS-4 builds
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	138 produce different external names and thus cause import errors in
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	139 case Python interpreters and extensions with mixed compiled in
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	140 Unicode width assumptions are combined. */
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	141
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	142 #ifndef Py_UNICODE_WIDE
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	143
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	144 # define PyUnicode_AsASCIIString PyUnicodeUCS2_AsASCIIString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	145 # define PyUnicode_AsCharmapString PyUnicodeUCS2_AsCharmapString
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	146 # define PyUnicode_AsDecodedObject PyUnicodeUCS2_AsDecodedObject
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	147 # define PyUnicode_AsDecodedUnicode PyUnicodeUCS2_AsDecodedUnicode
32551 f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	148 # define PyUnicode_AsEncodedObject PyUnicodeUCS2_AsEncodedObject
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	149 # define PyUnicode_AsEncodedString PyUnicodeUCS2_AsEncodedString
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	150 # define PyUnicode_AsEncodedUnicode PyUnicodeUCS2_AsEncodedUnicode
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	151 # define PyUnicode_AsLatin1String PyUnicodeUCS2_AsLatin1String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	152 # define PyUnicode_AsRawUnicodeEscapeString PyUnicodeUCS2_AsRawUnicodeEscapeString
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	153 # define PyUnicode_AsUTF32String PyUnicodeUCS2_AsUTF32String
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	154 # define PyUnicode_AsUTF16String PyUnicodeUCS2_AsUTF16String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	155 # define PyUnicode_AsUTF8String PyUnicodeUCS2_AsUTF8String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	156 # define PyUnicode_AsUnicode PyUnicodeUCS2_AsUnicode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	157 # define PyUnicode_AsUnicodeEscapeString PyUnicodeUCS2_AsUnicodeEscapeString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	158 # define PyUnicode_AsWideChar PyUnicodeUCS2_AsWideChar
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	159 # define PyUnicode_ClearFreeList PyUnicodeUCS2_ClearFreelist
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	160 # define PyUnicode_Compare PyUnicodeUCS2_Compare
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	161 # define PyUnicode_Concat PyUnicodeUCS2_Concat
41769 b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	162 # define PyUnicode_Append PyUnicodeUCS2_Append
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	163 # define PyUnicode_AppendAndDel PyUnicodeUCS2_AppendAndDel
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	164 # define PyUnicode_Contains PyUnicodeUCS2_Contains
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	165 # define PyUnicode_Count PyUnicodeUCS2_Count
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	166 # define PyUnicode_Decode PyUnicodeUCS2_Decode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	167 # define PyUnicode_DecodeASCII PyUnicodeUCS2_DecodeASCII
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	168 # define PyUnicode_DecodeCharmap PyUnicodeUCS2_DecodeCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	169 # define PyUnicode_DecodeLatin1 PyUnicodeUCS2_DecodeLatin1
43569 19319e70fc3e Patch #1272, by Christian Heimes and Alexandre Vassalotti. Guido van Rossum <guido@python.org> parents: 42984 diff changeset	170 # define PyUnicode_DecodeFSDefault PyUnicodeUCS2_DecodeFSDefault
43761 658cd34a8c5d Fixed a bug in PyUnicode_DecodeFSDefault. strcmp() returns 0 on success. Christian Heimes <christian@cheimes.de> parents: 43569 diff changeset	171 # define PyUnicode_DecodeFSDefaultAndSize PyUnicodeUCS2_DecodeFSDefaultAndSize
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	172 # define PyUnicode_DecodeRawUnicodeEscape PyUnicodeUCS2_DecodeRawUnicodeEscape
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	173 # define PyUnicode_DecodeUTF32 PyUnicodeUCS2_DecodeUTF32
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	174 # define PyUnicode_DecodeUTF32Stateful PyUnicodeUCS2_DecodeUTF32Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	175 # define PyUnicode_DecodeUTF16 PyUnicodeUCS2_DecodeUTF16
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	176 # define PyUnicode_DecodeUTF16Stateful PyUnicodeUCS2_DecodeUTF16Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	177 # define PyUnicode_DecodeUTF8 PyUnicodeUCS2_DecodeUTF8
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	178 # define PyUnicode_DecodeUTF8Stateful PyUnicodeUCS2_DecodeUTF8Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	179 # define PyUnicode_DecodeUnicodeEscape PyUnicodeUCS2_DecodeUnicodeEscape
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	180 # define PyUnicode_Encode PyUnicodeUCS2_Encode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	181 # define PyUnicode_EncodeASCII PyUnicodeUCS2_EncodeASCII
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	182 # define PyUnicode_EncodeCharmap PyUnicodeUCS2_EncodeCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	183 # define PyUnicode_EncodeDecimal PyUnicodeUCS2_EncodeDecimal
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	184 # define PyUnicode_EncodeLatin1 PyUnicodeUCS2_EncodeLatin1
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	185 # define PyUnicode_EncodeRawUnicodeEscape PyUnicodeUCS2_EncodeRawUnicodeEscape
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	186 # define PyUnicode_EncodeUTF32 PyUnicodeUCS2_EncodeUTF32
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	187 # define PyUnicode_EncodeUTF16 PyUnicodeUCS2_EncodeUTF16
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	188 # define PyUnicode_EncodeUTF8 PyUnicodeUCS2_EncodeUTF8
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	189 # define PyUnicode_EncodeUnicodeEscape PyUnicodeUCS2_EncodeUnicodeEscape
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	190 # define PyUnicode_Find PyUnicodeUCS2_Find
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	191 # define PyUnicode_Format PyUnicodeUCS2_Format
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	192 # define PyUnicode_FromEncodedObject PyUnicodeUCS2_FromEncodedObject
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	193 # define PyUnicode_FromFormat PyUnicodeUCS2_FromFormat
db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	194 # define PyUnicode_FromFormatV PyUnicodeUCS2_FromFormatV
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	195 # define PyUnicode_FromObject PyUnicodeUCS2_FromObject
24753 27ae978bee58 Add name mangling for new PyUnicode_FromOrdinal() and fix declaration Marc-André Lemburg <mal@egenix.com> parents: 24752 diff changeset	196 # define PyUnicode_FromOrdinal PyUnicodeUCS2_FromOrdinal
41619 61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	197 # define PyUnicode_FromString PyUnicodeUCS2_FromString
41766 d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	198 # define PyUnicode_FromStringAndSize PyUnicodeUCS2_FromStringAndSize
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	199 # define PyUnicode_FromUnicode PyUnicodeUCS2_FromUnicode
41768 b592985a953f Add missing #define. Walter Dörwald <walter@livinglogic.de> parents: 41766 diff changeset	200 # define PyUnicode_FromWideChar PyUnicodeUCS2_FromWideChar
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	201 # define PyUnicode_FSConverter PyUnicodeUCS2_FSConverter
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	202 # define PyUnicode_GetDefaultEncoding PyUnicodeUCS2_GetDefaultEncoding
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	203 # define PyUnicode_GetMax PyUnicodeUCS2_GetMax
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	204 # define PyUnicode_GetSize PyUnicodeUCS2_GetSize
42597 20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	205 # define PyUnicode_IsIdentifier PyUnicodeUCS2_IsIdentifier
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	206 # define PyUnicode_Join PyUnicodeUCS2_Join
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	207 # define PyUnicode_Partition PyUnicodeUCS2_Partition
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	208 # define PyUnicode_RPartition PyUnicodeUCS2_RPartition
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	209 # define PyUnicode_RSplit PyUnicodeUCS2_RSplit
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	210 # define PyUnicode_Replace PyUnicodeUCS2_Replace
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	211 # define PyUnicode_Resize PyUnicodeUCS2_Resize
39610 3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	212 # define PyUnicode_RichCompare PyUnicodeUCS2_RichCompare
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	213 # define PyUnicode_SetDefaultEncoding PyUnicodeUCS2_SetDefaultEncoding
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	214 # define PyUnicode_Split PyUnicodeUCS2_Split
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	215 # define PyUnicode_Splitlines PyUnicodeUCS2_Splitlines
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	216 # define PyUnicode_Tailmatch PyUnicodeUCS2_Tailmatch
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	217 # define PyUnicode_Translate PyUnicodeUCS2_Translate
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	218 # define PyUnicode_TranslateCharmap PyUnicodeUCS2_TranslateCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	219 # define _PyUnicode_AsDefaultEncodedString _PyUnicodeUCS2_AsDefaultEncodedString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	220 # define _PyUnicode_Fini _PyUnicodeUCS2_Fini
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	221 # define _PyUnicode_Init _PyUnicodeUCS2_Init
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	222 # define _PyUnicode_IsAlpha _PyUnicodeUCS2_IsAlpha
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	223 # define _PyUnicode_IsDecimalDigit _PyUnicodeUCS2_IsDecimalDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	224 # define _PyUnicode_IsDigit _PyUnicodeUCS2_IsDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	225 # define _PyUnicode_IsLinebreak _PyUnicodeUCS2_IsLinebreak
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	226 # define _PyUnicode_IsLowercase _PyUnicodeUCS2_IsLowercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	227 # define _PyUnicode_IsNumeric _PyUnicodeUCS2_IsNumeric
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	228 # define _PyUnicode_IsPrintable _PyUnicodeUCS2_IsPrintable
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	229 # define _PyUnicode_IsTitlecase _PyUnicodeUCS2_IsTitlecase
42595 f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	230 # define _PyUnicode_IsXidStart _PyUnicodeUCS2_IsXidStart
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	231 # define _PyUnicode_IsXidContinue _PyUnicodeUCS2_IsXidContinue
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	232 # define _PyUnicode_IsUppercase _PyUnicodeUCS2_IsUppercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	233 # define _PyUnicode_IsWhitespace _PyUnicodeUCS2_IsWhitespace
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	234 # define _PyUnicode_ToDecimalDigit _PyUnicodeUCS2_ToDecimalDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	235 # define _PyUnicode_ToDigit _PyUnicodeUCS2_ToDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	236 # define _PyUnicode_ToLowercase _PyUnicodeUCS2_ToLowercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	237 # define _PyUnicode_ToNumeric _PyUnicodeUCS2_ToNumeric
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	238 # define _PyUnicode_ToTitlecase _PyUnicodeUCS2_ToTitlecase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	239 # define _PyUnicode_ToUppercase _PyUnicodeUCS2_ToUppercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	240
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	241 #else
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	242
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	243 # define PyUnicode_AsASCIIString PyUnicodeUCS4_AsASCIIString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	244 # define PyUnicode_AsCharmapString PyUnicodeUCS4_AsCharmapString
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	245 # define PyUnicode_AsDecodedObject PyUnicodeUCS4_AsDecodedObject
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	246 # define PyUnicode_AsDecodedUnicode PyUnicodeUCS4_AsDecodedUnicode
32551 f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	247 # define PyUnicode_AsEncodedObject PyUnicodeUCS4_AsEncodedObject
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	248 # define PyUnicode_AsEncodedString PyUnicodeUCS4_AsEncodedString
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	249 # define PyUnicode_AsEncodedUnicode PyUnicodeUCS4_AsEncodedUnicode
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	250 # define PyUnicode_AsLatin1String PyUnicodeUCS4_AsLatin1String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	251 # define PyUnicode_AsRawUnicodeEscapeString PyUnicodeUCS4_AsRawUnicodeEscapeString
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	252 # define PyUnicode_AsUTF32String PyUnicodeUCS4_AsUTF32String
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	253 # define PyUnicode_AsUTF16String PyUnicodeUCS4_AsUTF16String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	254 # define PyUnicode_AsUTF8String PyUnicodeUCS4_AsUTF8String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	255 # define PyUnicode_AsUnicode PyUnicodeUCS4_AsUnicode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	256 # define PyUnicode_AsUnicodeEscapeString PyUnicodeUCS4_AsUnicodeEscapeString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	257 # define PyUnicode_AsWideChar PyUnicodeUCS4_AsWideChar
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	258 # define PyUnicode_ClearFreeList PyUnicodeUCS4_ClearFreelist
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	259 # define PyUnicode_Compare PyUnicodeUCS4_Compare
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	260 # define PyUnicode_Concat PyUnicodeUCS4_Concat
41769 b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	261 # define PyUnicode_Append PyUnicodeUCS4_Append
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	262 # define PyUnicode_AppendAndDel PyUnicodeUCS4_AppendAndDel
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	263 # define PyUnicode_Contains PyUnicodeUCS4_Contains
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	264 # define PyUnicode_Count PyUnicodeUCS4_Count
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	265 # define PyUnicode_Decode PyUnicodeUCS4_Decode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	266 # define PyUnicode_DecodeASCII PyUnicodeUCS4_DecodeASCII
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	267 # define PyUnicode_DecodeCharmap PyUnicodeUCS4_DecodeCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	268 # define PyUnicode_DecodeLatin1 PyUnicodeUCS4_DecodeLatin1
43569 19319e70fc3e Patch #1272, by Christian Heimes and Alexandre Vassalotti. Guido van Rossum <guido@python.org> parents: 42984 diff changeset	269 # define PyUnicode_DecodeFSDefault PyUnicodeUCS4_DecodeFSDefault
43761 658cd34a8c5d Fixed a bug in PyUnicode_DecodeFSDefault. strcmp() returns 0 on success. Christian Heimes <christian@cheimes.de> parents: 43569 diff changeset	270 # define PyUnicode_DecodeFSDefaultAndSize PyUnicodeUCS4_DecodeFSDefaultAndSize
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	271 # define PyUnicode_DecodeRawUnicodeEscape PyUnicodeUCS4_DecodeRawUnicodeEscape
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	272 # define PyUnicode_DecodeUTF32 PyUnicodeUCS4_DecodeUTF32
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	273 # define PyUnicode_DecodeUTF32Stateful PyUnicodeUCS4_DecodeUTF32Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	274 # define PyUnicode_DecodeUTF16 PyUnicodeUCS4_DecodeUTF16
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	275 # define PyUnicode_DecodeUTF16Stateful PyUnicodeUCS4_DecodeUTF16Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	276 # define PyUnicode_DecodeUTF8 PyUnicodeUCS4_DecodeUTF8
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	277 # define PyUnicode_DecodeUTF8Stateful PyUnicodeUCS4_DecodeUTF8Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	278 # define PyUnicode_DecodeUnicodeEscape PyUnicodeUCS4_DecodeUnicodeEscape
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	279 # define PyUnicode_Encode PyUnicodeUCS4_Encode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	280 # define PyUnicode_EncodeASCII PyUnicodeUCS4_EncodeASCII
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	281 # define PyUnicode_EncodeCharmap PyUnicodeUCS4_EncodeCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	282 # define PyUnicode_EncodeDecimal PyUnicodeUCS4_EncodeDecimal
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	283 # define PyUnicode_EncodeLatin1 PyUnicodeUCS4_EncodeLatin1
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	284 # define PyUnicode_EncodeRawUnicodeEscape PyUnicodeUCS4_EncodeRawUnicodeEscape
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	285 # define PyUnicode_EncodeUTF32 PyUnicodeUCS4_EncodeUTF32
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	286 # define PyUnicode_EncodeUTF16 PyUnicodeUCS4_EncodeUTF16
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	287 # define PyUnicode_EncodeUTF8 PyUnicodeUCS4_EncodeUTF8
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	288 # define PyUnicode_EncodeUnicodeEscape PyUnicodeUCS4_EncodeUnicodeEscape
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	289 # define PyUnicode_Find PyUnicodeUCS4_Find
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	290 # define PyUnicode_Format PyUnicodeUCS4_Format
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	291 # define PyUnicode_FromEncodedObject PyUnicodeUCS4_FromEncodedObject
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	292 # define PyUnicode_FromFormat PyUnicodeUCS4_FromFormat
db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	293 # define PyUnicode_FromFormatV PyUnicodeUCS4_FromFormatV
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	294 # define PyUnicode_FromObject PyUnicodeUCS4_FromObject
24753 27ae978bee58 Add name mangling for new PyUnicode_FromOrdinal() and fix declaration Marc-André Lemburg <mal@egenix.com> parents: 24752 diff changeset	295 # define PyUnicode_FromOrdinal PyUnicodeUCS4_FromOrdinal
41619 61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	296 # define PyUnicode_FromString PyUnicodeUCS4_FromString
41766 d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	297 # define PyUnicode_FromStringAndSize PyUnicodeUCS4_FromStringAndSize
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	298 # define PyUnicode_FromUnicode PyUnicodeUCS4_FromUnicode
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	299 # define PyUnicode_FromWideChar PyUnicodeUCS4_FromWideChar
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	300 # define PyUnicode_FSConverter PyUnicodeUCS4_FSConverter
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	301 # define PyUnicode_GetDefaultEncoding PyUnicodeUCS4_GetDefaultEncoding
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	302 # define PyUnicode_GetMax PyUnicodeUCS4_GetMax
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	303 # define PyUnicode_GetSize PyUnicodeUCS4_GetSize
42597 20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	304 # define PyUnicode_IsIdentifier PyUnicodeUCS4_IsIdentifier
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	305 # define PyUnicode_Join PyUnicodeUCS4_Join
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	306 # define PyUnicode_Partition PyUnicodeUCS4_Partition
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	307 # define PyUnicode_RPartition PyUnicodeUCS4_RPartition
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	308 # define PyUnicode_RSplit PyUnicodeUCS4_RSplit
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	309 # define PyUnicode_Replace PyUnicodeUCS4_Replace
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	310 # define PyUnicode_Resize PyUnicodeUCS4_Resize
39610 3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	311 # define PyUnicode_RichCompare PyUnicodeUCS4_RichCompare
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	312 # define PyUnicode_SetDefaultEncoding PyUnicodeUCS4_SetDefaultEncoding
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	313 # define PyUnicode_Split PyUnicodeUCS4_Split
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	314 # define PyUnicode_Splitlines PyUnicodeUCS4_Splitlines
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	315 # define PyUnicode_Tailmatch PyUnicodeUCS4_Tailmatch
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	316 # define PyUnicode_Translate PyUnicodeUCS4_Translate
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	317 # define PyUnicode_TranslateCharmap PyUnicodeUCS4_TranslateCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	318 # define _PyUnicode_AsDefaultEncodedString _PyUnicodeUCS4_AsDefaultEncodedString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	319 # define _PyUnicode_Fini _PyUnicodeUCS4_Fini
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	320 # define _PyUnicode_Init _PyUnicodeUCS4_Init
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	321 # define _PyUnicode_IsAlpha _PyUnicodeUCS4_IsAlpha
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	322 # define _PyUnicode_IsDecimalDigit _PyUnicodeUCS4_IsDecimalDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	323 # define _PyUnicode_IsDigit _PyUnicodeUCS4_IsDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	324 # define _PyUnicode_IsLinebreak _PyUnicodeUCS4_IsLinebreak
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	325 # define _PyUnicode_IsLowercase _PyUnicodeUCS4_IsLowercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	326 # define _PyUnicode_IsNumeric _PyUnicodeUCS4_IsNumeric
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	327 # define _PyUnicode_IsPrintable _PyUnicodeUCS4_IsPrintable
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	328 # define _PyUnicode_IsTitlecase _PyUnicodeUCS4_IsTitlecase
42595 f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	329 # define _PyUnicode_IsXidStart _PyUnicodeUCS4_IsXidStart
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	330 # define _PyUnicode_IsXidContinue _PyUnicodeUCS4_IsXidContinue
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	331 # define _PyUnicode_IsUppercase _PyUnicodeUCS4_IsUppercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	332 # define _PyUnicode_IsWhitespace _PyUnicodeUCS4_IsWhitespace
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	333 # define _PyUnicode_ToDecimalDigit _PyUnicodeUCS4_ToDecimalDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	334 # define _PyUnicode_ToDigit _PyUnicodeUCS4_ToDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	335 # define _PyUnicode_ToLowercase _PyUnicodeUCS4_ToLowercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	336 # define _PyUnicode_ToNumeric _PyUnicodeUCS4_ToNumeric
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	337 # define _PyUnicode_ToTitlecase _PyUnicodeUCS4_ToTitlecase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	338 # define _PyUnicode_ToUppercase _PyUnicodeUCS4_ToUppercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	339
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	340
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	341 #endif
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	342
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	343 /* --- Internal Unicode Operations ---------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	344
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	345 /* If you want Python to use the compiler's wctype.h functions instead
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	346 of the ones supplied with Python, define WANT_WCTYPE_FUNCTIONS or
33864 6b61af083493 SF patch #1056231: typo in comment (unicodeobject.h) Raymond Hettinger <python@rcn.com> parents: 33428 diff changeset	347 configure Python using --with-wctype-functions. This reduces the
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	348 interpreter's code size. */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	349
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	350 #if defined(HAVE_USABLE_WCHAR_T) && defined(WANT_WCTYPE_FUNCTIONS)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	351
19980 9ab6af6815af Fix for bug #462737. Marc-André Lemburg <mal@egenix.com> parents: 19849 diff changeset	352 #include <wctype.h>
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	353
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	354 #define Py_UNICODE_ISSPACE(ch) iswspace(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	355
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	356 #define Py_UNICODE_ISLOWER(ch) iswlower(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	357 #define Py_UNICODE_ISUPPER(ch) iswupper(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	358 #define Py_UNICODE_ISTITLE(ch) _PyUnicode_IsTitlecase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	359 #define Py_UNICODE_ISLINEBREAK(ch) _PyUnicode_IsLinebreak(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	360
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	361 #define Py_UNICODE_TOLOWER(ch) towlower(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	362 #define Py_UNICODE_TOUPPER(ch) towupper(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	363 #define Py_UNICODE_TOTITLE(ch) _PyUnicode_ToTitlecase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	364
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	365 #define Py_UNICODE_ISDECIMAL(ch) _PyUnicode_IsDecimalDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	366 #define Py_UNICODE_ISDIGIT(ch) _PyUnicode_IsDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	367 #define Py_UNICODE_ISNUMERIC(ch) _PyUnicode_IsNumeric(ch)
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	368 #define Py_UNICODE_ISPRINTABLE(ch) _PyUnicode_IsPrintable(ch)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	369
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	370 #define Py_UNICODE_TODECIMAL(ch) _PyUnicode_ToDecimalDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	371 #define Py_UNICODE_TODIGIT(ch) _PyUnicode_ToDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	372 #define Py_UNICODE_TONUMERIC(ch) _PyUnicode_ToNumeric(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	373
13352 d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	374 #define Py_UNICODE_ISALPHA(ch) iswalpha(ch)
d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	375
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	376 #else
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	377
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	378 /* Since splitting on whitespace is an important use case, and
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	379 whitespace in most situations is solely ASCII whitespace, we
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	380 optimize for the common case by using a quick look-up table
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	381 _Py_ascii_whitespace (see below) with an inlined check.
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	382
45056 c8fca9b5cd3c Merged revisions 60408-60440 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44999 diff changeset	383 */
c8fca9b5cd3c Merged revisions 60408-60440 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44999 diff changeset	384 #define Py_UNICODE_ISSPACE(ch) \
c8fca9b5cd3c Merged revisions 60408-60440 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44999 diff changeset	385 ((ch) < 128U ? _Py_ascii_whitespace[(ch)] : _PyUnicode_IsWhitespace(ch))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	386
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	387 #define Py_UNICODE_ISLOWER(ch) _PyUnicode_IsLowercase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	388 #define Py_UNICODE_ISUPPER(ch) _PyUnicode_IsUppercase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	389 #define Py_UNICODE_ISTITLE(ch) _PyUnicode_IsTitlecase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	390 #define Py_UNICODE_ISLINEBREAK(ch) _PyUnicode_IsLinebreak(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	391
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	392 #define Py_UNICODE_TOLOWER(ch) _PyUnicode_ToLowercase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	393 #define Py_UNICODE_TOUPPER(ch) _PyUnicode_ToUppercase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	394 #define Py_UNICODE_TOTITLE(ch) _PyUnicode_ToTitlecase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	395
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	396 #define Py_UNICODE_ISDECIMAL(ch) _PyUnicode_IsDecimalDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	397 #define Py_UNICODE_ISDIGIT(ch) _PyUnicode_IsDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	398 #define Py_UNICODE_ISNUMERIC(ch) _PyUnicode_IsNumeric(ch)
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	399 #define Py_UNICODE_ISPRINTABLE(ch) _PyUnicode_IsPrintable(ch)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	400
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	401 #define Py_UNICODE_TODECIMAL(ch) _PyUnicode_ToDecimalDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	402 #define Py_UNICODE_TODIGIT(ch) _PyUnicode_ToDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	403 #define Py_UNICODE_TONUMERIC(ch) _PyUnicode_ToNumeric(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	404
13352 d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	405 #define Py_UNICODE_ISALPHA(ch) _PyUnicode_IsAlpha(ch)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	406
13352 d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	407 #endif
13320 67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	408
67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	409 #define Py_UNICODE_ISALNUM(ch) \
67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	410 (Py_UNICODE_ISALPHA(ch) \|\| \
67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	411 Py_UNICODE_ISDECIMAL(ch) \|\| \
67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	412 Py_UNICODE_ISDIGIT(ch) \|\| \
67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	413 Py_UNICODE_ISNUMERIC(ch))
67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	414
38669 19fd6141940d Partially merge trunk into p3yk. The removal of Mac/Tools is confusing svn Thomas Wouters <thomas@python.org> parents: 38453 diff changeset	415 #define Py_UNICODE_COPY(target, source, length) \
19fd6141940d Partially merge trunk into p3yk. The removal of Mac/Tools is confusing svn Thomas Wouters <thomas@python.org> parents: 38453 diff changeset	416 Py_MEMCPY((target), (source), (length)*sizeof(Py_UNICODE))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	417
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	418 #define Py_UNICODE_FILL(target, value, length) \
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	419 do {Py_ssize_t i_; Py_UNICODE *t_ = (target); Py_UNICODE v_ = (value);\
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	420 for (i_ = 0; i_ < (length); i_++) t_[i_] = v_;\
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	421 } while (0)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	422
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	423 /* Check if substring matches at given offset. the offset must be
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	424 valid, and the substring must not be empty */
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	425
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	426 #define Py_UNICODE_MATCH(string, offset, substring) \
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	427 ((((string)->str + (offset)) == ((substring)->str)) && \
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	428 ((((string)->str + (offset) + (substring)->length-1) == ((substring)->str + (substring)->length-1))) && \
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	429 !memcmp((string)->str + (offset), (substring)->str, (substring)->length*sizeof(Py_UNICODE)))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	430
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	431 #ifdef __cplusplus
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	432 extern "C" {
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	433 #endif
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	434
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	435 /* --- Unicode Type ------------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	436
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	437 typedef struct {
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	438 PyObject_HEAD
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	439 Py_ssize_t length; /* Length of raw Unicode data in buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	440 Py_UNICODE str; / Raw Unicode buffer */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	441 long hash; /* Hash value; -1 if not set */
41876 dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	442 int state; /* != 0 if interned. In this case the two
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	443 * references from the dictionary to this object
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	444 * are not counted in ob_refcnt. */
13837 2badb322355f This patch finalizes the move from UTF-8 to a default encoding in Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	445 PyObject defenc; / (Default) Encoded version as Python
2badb322355f This patch finalizes the move from UTF-8 to a default encoding in Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	446 string, or NULL; this is used for
2badb322355f This patch finalizes the move from UTF-8 to a default encoding in Marc-André Lemburg <mal@egenix.com> parents: 13828 diff changeset	447 implementing the buffer protocol */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	448 } PyUnicodeObject;
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	449
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	450 PyAPI_DATA(PyTypeObject) PyUnicode_Type;
44061 0cc552ab76bd Added all PyTypeObjects to the appropriate header files. Christian Heimes <christian@cheimes.de> parents: 43933 diff changeset	451 PyAPI_DATA(PyTypeObject) PyUnicodeIter_Type;
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	452
41876 dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	453 #define SSTATE_NOT_INTERNED 0
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	454 #define SSTATE_INTERNED_MORTAL 1
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	455 #define SSTATE_INTERNED_IMMORTAL 2
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	456
40909 f2f0b41f270d Merged revisions 53875-53911 via svnmerge from Thomas Wouters <thomas@python.org> parents: 39610 diff changeset	457 #define PyUnicode_Check(op) \
44351 86a2679dca46 #1629: Renamed Py_Size, Py_Type and Py_Refcnt to Py_SIZE, Py_TYPE and Py_REFCNT. Christian Heimes <christian@cheimes.de> parents: 44061 diff changeset	458 PyType_FastSubclass(Py_TYPE(op), Py_TPFLAGS_UNICODE_SUBCLASS)
86a2679dca46 #1629: Renamed Py_Size, Py_Type and Py_Refcnt to Py_SIZE, Py_TYPE and Py_REFCNT. Christian Heimes <christian@cheimes.de> parents: 44061 diff changeset	459 #define PyUnicode_CheckExact(op) (Py_TYPE(op) == &PyUnicode_Type)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	460
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	461 /* Fast access macros */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	462 #define PyUnicode_GET_SIZE(op) \
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	463 (assert(PyUnicode_Check(op)),(((PyUnicodeObject *)(op))->length))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	464 #define PyUnicode_GET_DATA_SIZE(op) \
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	465 (assert(PyUnicode_Check(op)),(((PyUnicodeObject )(op))->length sizeof(Py_UNICODE)))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	466 #define PyUnicode_AS_UNICODE(op) \
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	467 (assert(PyUnicode_Check(op)),(((PyUnicodeObject *)(op))->str))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	468 #define PyUnicode_AS_DATA(op) \
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	469 (assert(PyUnicode_Check(op)),((const char )((PyUnicodeObject )(op))->str))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	470
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	471 /* --- Constants ---------------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	472
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	473 /* This Unicode character will be used as replacement character during
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	474 decoding if the errors argument is set to "replace". Note: the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	475 Unicode character U+FFFD is the official REPLACEMENT CHARACTER in
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	476 Unicode 3.0. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	477
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	478 #define Py_UNICODE_REPLACEMENT_CHARACTER ((Py_UNICODE) 0xFFFD)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	479
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	480 /* === Public API ========================================================= */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	481
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	482 /* --- Plain Py_UNICODE --------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	483
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	484 /* Create a Unicode Object from the Py_UNICODE buffer u of the given
17618 b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	485 size.
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	486
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	487 u may be NULL which causes the contents to be undefined. It is the
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	488 user's responsibility to fill in the needed data afterwards. Note
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	489 that modifying the Unicode object contents after construction is
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	490 only allowed if u was set to NULL.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	491
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	492 The buffer is copied into the new object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	493
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	494 PyAPI_FUNC(PyObject*) PyUnicode_FromUnicode(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	495 const Py_UNICODE u, / Unicode buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	496 Py_ssize_t size /* size of buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	497 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	498
41766 d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	499 /* Similar to PyUnicode_FromUnicode(), but u points to Latin-1 encoded bytes */
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	500 PyAPI_FUNC(PyObject*) PyUnicode_FromStringAndSize(
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	501 const char u, / char buffer */
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	502 Py_ssize_t size /* size of buffer */
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	503 );
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	504
41619 61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	505 /* Similar to PyUnicode_FromUnicode(), but u points to null-terminated
61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	506 Latin-1 encoded bytes */
61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	507 PyAPI_FUNC(PyObject*) PyUnicode_FromString(
61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	508 const char u / string */
61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	509 );
61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	510
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	511 /* Return a read-only pointer to the Unicode object's internal
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	512 Py_UNICODE buffer. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	513
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	514 PyAPI_FUNC(Py_UNICODE *) PyUnicode_AsUnicode(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	515 PyObject unicode / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	516 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	517
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	518 /* Get the length of the Unicode object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	519
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	520 PyAPI_FUNC(Py_ssize_t) PyUnicode_GetSize(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	521 PyObject unicode / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	522 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	523
18298 982163c4e9d2 Encode surrogates in UTF-8 even for a wide Py_UNICODE. Martin v. Löwis <martin@v.loewis.de> parents: 18296 diff changeset	524 /* Get the maximum ordinal for a Unicode character. */
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	525 PyAPI_FUNC(Py_UNICODE) PyUnicode_GetMax(void);
18298 982163c4e9d2 Encode surrogates in UTF-8 even for a wide Py_UNICODE. Martin v. Löwis <martin@v.loewis.de> parents: 18296 diff changeset	526
12326 9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	527 /* Resize an already allocated Unicode object to the new size length.
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	528
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	529 *unicode is modified to point to the new (resized) object and 0
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	530 returned on success.
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	531
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	532 This API may only be called by the function which also called the
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	533 Unicode constructor. The refcount on the object must be 1. Otherwise,
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	534 an error is returned.
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	535
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	536 Error handling is implemented as follows: an exception is set, -1
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	537 is returned and *unicode left untouched.
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	538
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	539 */
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	540
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	541 PyAPI_FUNC(int) PyUnicode_Resize(
12326 9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	542 PyObject *unicode, / Pointer to the Unicode object */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	543 Py_ssize_t length /* New length */
12326 9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	544 );
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	545
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	546 /* Coerce obj to an Unicode object and return a reference with
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	547 incremented refcount.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	548
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	549 Coercion is done in the following way:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	550
20554 0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	551 1. String and other char buffer compatible objects are decoded
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	552 under the assumptions that they contain data using the current
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	553 default encoding. Decoding is done in "strict" mode.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	554
20554 0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	555 2. All other objects (including Unicode objects) raise an
0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	556 exception.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	557
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	558 The API returns NULL in case of an error. The caller is responsible
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	559 for decref'ing the returned objects.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	560
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	561 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	562
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	563 PyAPI_FUNC(PyObject*) PyUnicode_FromEncodedObject(
13401 8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	564 register PyObject obj, / Object */
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	565 const char encoding, / encoding */
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	566 const char errors / error handling */
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	567 );
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	568
20554 0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	569 /* Coerce obj to an Unicode object and return a reference with
13401 8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	570 incremented refcount.
20554 0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	571
0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	572 Unicode objects are passed back as-is (subclasses are converted to
0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	573 true Unicode objects), all other objects are delegated to
0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	574 PyUnicode_FromEncodedObject(obj, NULL, "strict") which results in
0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	575 using the default encoding as basis for decoding the object.
13401 8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	576
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	577 The API returns NULL in case of an error. The caller is responsible
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	578 for decref'ing the returned objects.
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	579
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	580 */
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	581
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	582 PyAPI_FUNC(PyObject*) PyUnicode_FromObject(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	583 register PyObject obj / Object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	584 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	585
41766 d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	586 PyAPI_FUNC(PyObject ) PyUnicode_FromFormatV(const char, va_list);
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	587 PyAPI_FUNC(PyObject ) PyUnicode_FromFormat(const char, ...);
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	588
47393 0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	589 /* Format the object based on the format_spec, as defined in PEP 3101
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	590 (Advanced String Formatting). */
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	591 PyAPI_FUNC(PyObject ) _PyUnicode_FormatAdvanced(PyObject obj,
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	592 Py_UNICODE *format_spec,
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	593 Py_ssize_t format_spec_len);
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	594
41876 dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	595 PyAPI_FUNC(void) PyUnicode_InternInPlace(PyObject **);
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	596 PyAPI_FUNC(void) PyUnicode_InternImmortal(PyObject **);
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	597 PyAPI_FUNC(PyObject ) PyUnicode_InternFromString(const char );
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	598 PyAPI_FUNC(void) _Py_ReleaseInternedUnicodeStrings(void);
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	599
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	600 /* Use only if you know it's a string */
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	601 #define PyUnicode_CHECK_INTERNED(op) (((PyUnicodeObject *)(op))->state)
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	602
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	603 /* --- wchar_t support for platforms which support it --------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	604
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	605 #ifdef HAVE_WCHAR_H
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	606
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	607 /* Create a Unicode Object from the whcar_t buffer w of the given
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	608 size.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	609
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	610 The buffer is copied into the new object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	611
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	612 PyAPI_FUNC(PyObject*) PyUnicode_FromWideChar(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	613 register const wchar_t w, / wchar_t buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	614 Py_ssize_t size /* size of buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	615 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	616
34016 264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	617 /* Copies the Unicode Object contents into the wchar_t buffer w. At
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	618 most size wchar_t characters are copied.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	619
34016 264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	620 Note that the resulting wchar_t string may or may not be
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	621 0-terminated. It is the responsibility of the caller to make sure
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	622 that the wchar_t string is 0-terminated in case this is required by
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	623 the application.
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	624
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	625 Returns the number of wchar_t characters copied (excluding a
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	626 possibly trailing 0-termination character) or -1 in case of an
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	627 error. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	628
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	629 PyAPI_FUNC(Py_ssize_t) PyUnicode_AsWideChar(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	630 PyUnicodeObject unicode, / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	631 register wchar_t w, / wchar_t buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	632 Py_ssize_t size /* size of buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	633 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	634
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	635 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	636
24737 eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	637 /* --- Unicode ordinals --------------------------------------------------- */
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	638
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	639 /* Create a Unicode Object from the given Unicode code point ordinal.
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	640
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	641 The ordinal must be in range(0x10000) on narrow Python builds
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	642 (UCS2), and range(0x110000) on wide builds (UCS4). A ValueError is
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	643 raised in case it is not.
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	644
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	645 */
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	646
24753 27ae978bee58 Add name mangling for new PyUnicode_FromOrdinal() and fix declaration Marc-André Lemburg <mal@egenix.com> parents: 24752 diff changeset	647 PyAPI_FUNC(PyObject*) PyUnicode_FromOrdinal(int ordinal);
24737 eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	648
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	649 /* --- Free-list management ----------------------------------------------- */
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	650
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	651 /* Clear the free list used by the Unicode implementation.
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	652
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	653 This can be used to release memory used for objects on the free
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	654 list back to the Python memory allocator.
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	655
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	656 */
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	657
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	658 PyAPI_FUNC(int) PyUnicode_ClearFreeList(void);
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	659
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	660 /* === Builtin Codecs =====================================================
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	661
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	662 Many of these APIs take two arguments encoding and errors. These
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	663 parameters encoding and errors have the same semantics as the ones
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	664 of the builtin unicode() API.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	665
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	666 Setting encoding to NULL causes the default encoding to be used.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	667
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	668 Error handling is set by errors which may also be set to NULL
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	669 meaning to use the default handling defined for the codec. Default
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	670 error handling for all builtin codecs is "strict" (ValueErrors are
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	671 raised).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	672
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	673 The codecs all use a similar interface. Only deviation from the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	674 generic ones are documented.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	675
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	676 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	677
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	678 /* --- Manage the default encoding ---------------------------------------- */
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	679
18887 9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	680 /* Return a Python string holding the default encoded value of the
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	681 Unicode object.
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	682
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	683 The resulting string is cached in the Unicode object for subsequent
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	684 usage by this function. The cached version is needed to implement
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	685 the character buffer interface and will live (at least) as long as
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	686 the Unicode object itself.
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	687
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	688 The refcount of the string is not incremented.
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	689
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	690 * Exported for internal use by the interpreter only !!! *
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	691
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	692 */
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	693
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	694 PyAPI_FUNC(PyObject *) _PyUnicode_AsDefaultEncodedString(
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	695 PyObject *unicode,
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	696 const char *errors);
18887 9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	697
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	698 /* Returns a pointer to the default encoding (normally, UTF-8) of the
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	699 Unicode object unicode and the size of the encoded representation
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	700 in bytes stored in *size.
43761 658cd34a8c5d Fixed a bug in PyUnicode_DecodeFSDefault. strcmp() returns 0 on success. Christian Heimes <christian@cheimes.de> parents: 43569 diff changeset	701
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	702 In case of an error, no *size is set.
42984 3a56e73ae919 Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() but Guido van Rossum <guido@python.org> parents: 42896 diff changeset	703
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	704 *** This API is for interpreter INTERNAL USE ONLY and will likely
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	705 *** be removed or changed for Python 3.1.
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	706
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	707 *** If you need to access the Unicode object as UTF-8 bytes string,
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	708 *** please use PyUnicode_AsUTF8String() instead.
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	709
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	710 */
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	711
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	712 PyAPI_FUNC(char *) _PyUnicode_AsStringAndSize(
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	713 PyObject *unicode,
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	714 Py_ssize_t *size);
42984 3a56e73ae919 Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() but Guido van Rossum <guido@python.org> parents: 42896 diff changeset	715
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	716 /* Returns a pointer to the default encoding (normally, UTf-8) of the
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	717 Unicode object unicode.
42984 3a56e73ae919 Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() but Guido van Rossum <guido@python.org> parents: 42896 diff changeset	718
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	719 Use of this API is DEPRECATED since no size information can be
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	720 extracted from the returned data.
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	721
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	722 *** This API is for interpreter INTERNAL USE ONLY and will likely
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	723 *** be removed or changed for Python 3.1.
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	724
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	725 *** If you need to access the Unicode object as UTF-8 bytes string,
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	726 *** please use PyUnicode_AsUTF8String() instead.
42984 3a56e73ae919 Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() but Guido van Rossum <guido@python.org> parents: 42896 diff changeset	727
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	728 */
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	729
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	730 PyAPI_FUNC(char ) _PyUnicode_AsString(PyObject unicode);
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	731
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	732 /* Returns the currently active default encoding.
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	733
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	734 The default encoding is currently implemented as run-time settable
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	735 process global. This may change in future versions of the
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	736 interpreter to become a parameter which is managed on a per-thread
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	737 basis.
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	738
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	739 */
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	740
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	741 PyAPI_FUNC(const char*) PyUnicode_GetDefaultEncoding(void);
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	742
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	743 /* Sets the currently active default encoding.
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	744
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	745 Returns 0 on success, -1 in case of an error.
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	746
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	747 */
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	748
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	749 PyAPI_FUNC(int) PyUnicode_SetDefaultEncoding(
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	750 const char encoding / Encoding name in standard form */
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	751 );
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	752
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	753 /* --- Generic Codecs ----------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	754
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	755 /* Create a Unicode object by decoding the encoded string s of the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	756 given size. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	757
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	758 PyAPI_FUNC(PyObject*) PyUnicode_Decode(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	759 const char s, / encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	760 Py_ssize_t size, /* size of buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	761 const char encoding, / encoding */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	762 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	763 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	764
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	765 /* Decode a Unicode object unicode and return the result as Python
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	766 object. */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	767
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	768 PyAPI_FUNC(PyObject*) PyUnicode_AsDecodedObject(
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	769 PyObject unicode, / Unicode object */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	770 const char encoding, / encoding */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	771 const char errors / error handling */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	772 );
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	773
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	774 /* Decode a Unicode object unicode and return the result as Unicode
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	775 object. */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	776
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	777 PyAPI_FUNC(PyObject*) PyUnicode_AsDecodedUnicode(
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	778 PyObject unicode, / Unicode object */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	779 const char encoding, / encoding */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	780 const char errors / error handling */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	781 );
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	782
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	783 /* Encodes a Py_UNICODE buffer of the given size and returns a
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	784 Python string object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	785
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	786 PyAPI_FUNC(PyObject*) PyUnicode_Encode(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	787 const Py_UNICODE s, / Unicode char buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	788 Py_ssize_t size, /* number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	789 const char encoding, / encoding */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	790 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	791 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	792
32551 f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	793 /* Encodes a Unicode object and returns the result as Python
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	794 object. */
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	795
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	796 PyAPI_FUNC(PyObject*) PyUnicode_AsEncodedObject(
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	797 PyObject unicode, / Unicode object */
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	798 const char encoding, / encoding */
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	799 const char errors / error handling */
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	800 );
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	801
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	802 /* Encodes a Unicode object and returns the result as Python string
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	803 object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	804
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	805 PyAPI_FUNC(PyObject*) PyUnicode_AsEncodedString(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	806 PyObject unicode, / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	807 const char encoding, / encoding */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	808 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	809 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	810
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	811 /* Encodes a Unicode object and returns the result as Unicode
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	812 object. */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	813
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	814 PyAPI_FUNC(PyObject*) PyUnicode_AsEncodedUnicode(
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	815 PyObject unicode, / Unicode object */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	816 const char encoding, / encoding */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	817 const char errors / error handling */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	818 );
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	819
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	820 /* Build an encoding map. */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	821
38673 a19c20c5e5c7 Merge the rest of the trunk. Thomas Wouters <thomas@python.org> parents: 38669 diff changeset	822 PyAPI_FUNC(PyObject*) PyUnicode_BuildEncodingMap(
a19c20c5e5c7 Merge the rest of the trunk. Thomas Wouters <thomas@python.org> parents: 38669 diff changeset	823 PyObject* string /* 256 character map */
a19c20c5e5c7 Merge the rest of the trunk. Thomas Wouters <thomas@python.org> parents: 38669 diff changeset	824 );
a19c20c5e5c7 Merge the rest of the trunk. Thomas Wouters <thomas@python.org> parents: 38669 diff changeset	825
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	826 /* --- UTF-7 Codecs ------------------------------------------------------- */
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	827
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	828 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF7(
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	829 const char string, / UTF-7 encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	830 Py_ssize_t length, /* size of string */
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	831 const char errors / error handling */
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	832 );
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	833
43933 9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	834 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF7Stateful(
9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	835 const char string, / UTF-7 encoded string */
9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	836 Py_ssize_t length, /* size of string */
9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	837 const char errors, / error handling */
9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	838 Py_ssize_t consumed / bytes consumed */
9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	839 );
9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	840
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	841 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUTF7(
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	842 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	843 Py_ssize_t length, /* number of Py_UNICODE chars to encode */
53742 9b9590007e82 Merged revisions 72283-72284 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53187 diff changeset	844 int base64SetO, /* Encode RFC2152 Set O characters in base64 */
9b9590007e82 Merged revisions 72283-72284 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53187 diff changeset	845 int base64WhiteSpace, /* Encode whitespace (sp, ht, nl, cr) in base64 */
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	846 const char errors / error handling */
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	847 );
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	848
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	849 /* --- UTF-8 Codecs ------------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	850
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	851 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF8(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	852 const char string, / UTF-8 encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	853 Py_ssize_t length, /* size of string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	854 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	855 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	856
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	857 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF8Stateful(
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	858 const char string, / UTF-8 encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	859 Py_ssize_t length, /* size of string */
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	860 const char errors, / error handling */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	861 Py_ssize_t consumed / bytes consumed */
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	862 );
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	863
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	864 PyAPI_FUNC(PyObject*) PyUnicode_AsUTF8String(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	865 PyObject unicode / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	866 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	867
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	868 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUTF8(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	869 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	870 Py_ssize_t length, /* number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	871 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	872 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	873
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	874 /* --- UTF-32 Codecs ------------------------------------------------------ */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	875
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	876 /* Decodes length bytes from a UTF-32 encoded buffer string and returns
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	877 the corresponding Unicode object.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	878
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	879 errors (if non-NULL) defines the error handling. It defaults
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	880 to "strict".
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	881
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	882 If byteorder is non-NULL, the decoder starts decoding using the
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	883 given byte order:
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	884
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	885 *byteorder == -1: little endian
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	886 *byteorder == 0: native order
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	887 *byteorder == 1: big endian
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	888
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	889 In native mode, the first four bytes of the stream are checked for a
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	890 BOM mark. If found, the BOM mark is analysed, the byte order
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	891 adjusted and the BOM skipped. In the other modes, no BOM mark
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	892 interpretation is done. After completion, *byteorder is set to the
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	893 current byte order at the end of input data.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	894
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	895 If byteorder is NULL, the codec starts in native order mode.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	896
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	897 */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	898
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	899 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF32(
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	900 const char string, / UTF-32 encoded string */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	901 Py_ssize_t length, /* size of string */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	902 const char errors, / error handling */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	903 int byteorder / pointer to byteorder to use
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	904 0=native;-1=LE,1=BE; updated on
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	905 exit */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	906 );
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	907
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	908 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF32Stateful(
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	909 const char string, / UTF-32 encoded string */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	910 Py_ssize_t length, /* size of string */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	911 const char errors, / error handling */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	912 int byteorder, / pointer to byteorder to use
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	913 0=native;-1=LE,1=BE; updated on
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	914 exit */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	915 Py_ssize_t consumed / bytes consumed */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	916 );
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	917
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	918 /* Returns a Python string using the UTF-32 encoding in native byte
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	919 order. The string always starts with a BOM mark. */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	920
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	921 PyAPI_FUNC(PyObject*) PyUnicode_AsUTF32String(
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	922 PyObject unicode / Unicode object */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	923 );
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	924
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	925 /* Returns a Python string object holding the UTF-32 encoded value of
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	926 the Unicode data.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	927
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	928 If byteorder is not 0, output is written according to the following
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	929 byte order:
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	930
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	931 byteorder == -1: little endian
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	932 byteorder == 0: native byte order (writes a BOM mark)
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	933 byteorder == 1: big endian
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	934
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	935 If byteorder is 0, the output string will always start with the
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	936 Unicode BOM mark (U+FEFF). In the other two modes, no BOM mark is
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	937 prepended.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	938
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	939 */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	940
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	941 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUTF32(
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	942 const Py_UNICODE data, / Unicode char buffer */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	943 Py_ssize_t length, /* number of Py_UNICODE chars to encode */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	944 const char errors, / error handling */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	945 int byteorder /* byteorder to use 0=BOM+native;-1=LE,1=BE */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	946 );
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	947
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	948 /* --- UTF-16 Codecs ------------------------------------------------------ */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	949
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	950 /* Decodes length bytes from a UTF-16 encoded buffer string and returns
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	951 the corresponding Unicode object.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	952
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	953 errors (if non-NULL) defines the error handling. It defaults
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	954 to "strict".
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	955
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	956 If byteorder is non-NULL, the decoder starts decoding using the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	957 given byte order:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	958
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	959 *byteorder == -1: little endian
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	960 *byteorder == 0: native order
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	961 *byteorder == 1: big endian
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	962
17887 fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	963 In native mode, the first two bytes of the stream are checked for a
fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	964 BOM mark. If found, the BOM mark is analysed, the byte order
fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	965 adjusted and the BOM skipped. In the other modes, no BOM mark
fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	966 interpretation is done. After completion, *byteorder is set to the
fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	967 current byte order at the end of input data.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	968
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	969 If byteorder is NULL, the codec starts in native order mode.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	970
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	971 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	972
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	973 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF16(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	974 const char string, / UTF-16 encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	975 Py_ssize_t length, /* size of string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	976 const char errors, / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	977 int byteorder / pointer to byteorder to use
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	978 0=native;-1=LE,1=BE; updated on
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	979 exit */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	980 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	981
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	982 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF16Stateful(
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	983 const char string, / UTF-16 encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	984 Py_ssize_t length, /* size of string */
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	985 const char errors, / error handling */
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	986 int byteorder, / pointer to byteorder to use
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	987 0=native;-1=LE,1=BE; updated on
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	988 exit */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	989 Py_ssize_t consumed / bytes consumed */
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	990 );
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	991
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	992 /* Returns a Python string using the UTF-16 encoding in native byte
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	993 order. The string always starts with a BOM mark. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	994
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	995 PyAPI_FUNC(PyObject*) PyUnicode_AsUTF16String(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	996 PyObject unicode / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	997 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	998
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	999 /* Returns a Python string object holding the UTF-16 encoded value of
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1000 the Unicode data.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1001
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1002 If byteorder is not 0, output is written according to the following
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1003 byte order:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1004
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1005 byteorder == -1: little endian
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1006 byteorder == 0: native byte order (writes a BOM mark)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1007 byteorder == 1: big endian
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1008
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1009 If byteorder is 0, the output string will always start with the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1010 Unicode BOM mark (U+FEFF). In the other two modes, no BOM mark is
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1011 prepended.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1012
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1013 Note that Py_UNICODE data is being interpreted as UTF-16 reduced to
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1014 UCS-2. This trick makes it possible to add full UTF-16 capabilities
13620 5b727ab37092 Spelling fixes supplied by Rob W. W. Hooft. All these are fixes in either Thomas Wouters <thomas@python.org> parents: 13401 diff changeset	1015 at a later point without compromising the APIs.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1016
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1017 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1018
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1019 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUTF16(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1020 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1021 Py_ssize_t length, /* number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1022 const char errors, / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1023 int byteorder /* byteorder to use 0=BOM+native;-1=LE,1=BE */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1024 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1025
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1026 /* --- Unicode-Escape Codecs ---------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1027
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1028 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUnicodeEscape(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1029 const char string, / Unicode-Escape encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1030 Py_ssize_t length, /* size of string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1031 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1032 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1033
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1034 PyAPI_FUNC(PyObject*) PyUnicode_AsUnicodeEscapeString(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1035 PyObject unicode / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1036 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1037
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1038 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUnicodeEscape(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1039 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1040 Py_ssize_t length /* Number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1041 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1042
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1043 /* --- Raw-Unicode-Escape Codecs ------------------------------------------ */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1044
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1045 PyAPI_FUNC(PyObject*) PyUnicode_DecodeRawUnicodeEscape(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1046 const char string, / Raw-Unicode-Escape encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1047 Py_ssize_t length, /* size of string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1048 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1049 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1050
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1051 PyAPI_FUNC(PyObject*) PyUnicode_AsRawUnicodeEscapeString(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1052 PyObject unicode / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1053 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1054
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1055 PyAPI_FUNC(PyObject*) PyUnicode_EncodeRawUnicodeEscape(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1056 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1057 Py_ssize_t length /* Number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1058 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1059
35485 6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1060 /* --- Unicode Internal Codec ---------------------------------------------
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1061
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1062 Only for internal use in _codecsmodule.c */
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1063
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1064 PyObject *_PyUnicode_DecodeUnicodeInternal(
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1065 const char *string,
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1066 Py_ssize_t length,
35485 6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1067 const char *errors
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1068 );
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1069
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1070 /* --- Latin-1 Codecs -----------------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1071
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1072 Note: Latin-1 corresponds to the first 256 Unicode ordinals.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1073
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1074 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1075
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1076 PyAPI_FUNC(PyObject*) PyUnicode_DecodeLatin1(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1077 const char string, / Latin-1 encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1078 Py_ssize_t length, /* size of string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1079 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1080 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1081
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1082 PyAPI_FUNC(PyObject*) PyUnicode_AsLatin1String(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1083 PyObject unicode / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1084 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1085
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1086 PyAPI_FUNC(PyObject*) PyUnicode_EncodeLatin1(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1087 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1088 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1089 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1090 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1091
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1092 /* --- ASCII Codecs -------------------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1093
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1094 Only 7-bit ASCII data is excepted. All other codes generate errors.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1095
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1096 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1097
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1098 PyAPI_FUNC(PyObject*) PyUnicode_DecodeASCII(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1099 const char string, / ASCII encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1100 Py_ssize_t length, /* size of string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1101 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1102 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1103
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1104 PyAPI_FUNC(PyObject*) PyUnicode_AsASCIIString(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1105 PyObject unicode / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1106 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1107
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1108 PyAPI_FUNC(PyObject*) PyUnicode_EncodeASCII(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1109 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1110 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1111 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1112 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1113
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1114 /* --- Character Map Codecs -----------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1115
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1116 This codec uses mappings to encode and decode characters.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1117
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1118 Decoding mappings must map single string characters to single
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1119 Unicode characters, integers (which are then interpreted as Unicode
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1120 ordinals) or None (meaning "undefined mapping" and causing an
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1121 error).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1122
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1123 Encoding mappings must map single Unicode characters to single
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1124 string characters, integers (which are then interpreted as Latin-1
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1125 ordinals) or None (meaning "undefined mapping" and causing an
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1126 error).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1127
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1128 If a character lookup fails with a LookupError, the character is
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1129 copied as-is meaning that its ordinal value will be interpreted as
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1130 Unicode or Latin-1 ordinal resp. Because of this mappings only need
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1131 to contain those mappings which map characters to different code
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1132 points.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1133
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1134 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1135
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1136 PyAPI_FUNC(PyObject*) PyUnicode_DecodeCharmap(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1137 const char string, / Encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1138 Py_ssize_t length, /* size of string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1139 PyObject mapping, / character mapping
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1140 (char ordinal -> unicode ordinal) */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1141 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1142 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1143
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1144 PyAPI_FUNC(PyObject*) PyUnicode_AsCharmapString(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1145 PyObject unicode, / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1146 PyObject mapping / character mapping
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1147 (unicode ordinal -> char ordinal) */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1148 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1149
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1150 PyAPI_FUNC(PyObject*) PyUnicode_EncodeCharmap(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1151 const Py_UNICODE data, / Unicode char buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1152 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1153 PyObject mapping, / character mapping
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1154 (unicode ordinal -> char ordinal) */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1155 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1156 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1157
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1158 /* Translate a Py_UNICODE buffer of the given length by applying a
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1159 character mapping table to it and return the resulting Unicode
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1160 object.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1161
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1162 The mapping table must map Unicode ordinal integers to Unicode
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1163 ordinal integers or None (causing deletion of the character).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1164
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1165 Mapping tables may be dictionaries or sequences. Unmapped character
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1166 ordinals (ones which cause a LookupError) are left untouched and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1167 are copied as-is.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1168
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1169 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1170
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1171 PyAPI_FUNC(PyObject *) PyUnicode_TranslateCharmap(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1172 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1173 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1174 PyObject table, / Translate table */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1175 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1176 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1177
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1178 #ifdef MS_WIN32
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	1179
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1180 /* --- MBCS codecs for Windows -------------------------------------------- */
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	1181
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1182 PyAPI_FUNC(PyObject*) PyUnicode_DecodeMBCS(
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1183 const char string, / MBCS encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1184 Py_ssize_t length, /* size of string */
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1185 const char errors / error handling */
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1186 );
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1187
39442 654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1188 PyAPI_FUNC(PyObject*) PyUnicode_DecodeMBCSStateful(
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1189 const char string, / MBCS encoded string */
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1190 Py_ssize_t length, /* size of string */
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1191 const char errors, / error handling */
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1192 Py_ssize_t consumed / bytes consumed */
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1193 );
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1194
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1195 PyAPI_FUNC(PyObject*) PyUnicode_AsMBCSString(
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1196 PyObject unicode / Unicode object */
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1197 );
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1198
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1199 PyAPI_FUNC(PyObject*) PyUnicode_EncodeMBCS(
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1200 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1201 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1202 const char errors / error handling */
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1203 );
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1204
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	1205 #endif /* MS_WIN32 */
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1206
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1207 /* --- Decimal Encoder ---------------------------------------------------- */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1208
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1209 /* Takes a Unicode string holding a decimal value and writes it into
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1210 an output buffer using standard ASCII digit codes.
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1211
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1212 The output buffer has to provide at least length+1 bytes of storage
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1213 area. The output string is 0-terminated.
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1214
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1215 The encoder converts whitespace to ' ', decimal characters to their
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1216 corresponding ASCII digit and all other Latin-1 characters except
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1217 \0 as-is. Characters outside this range (Unicode ordinals 1-256)
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1218 are treated as errors. This includes embedded NULL bytes.
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1219
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1220 Error handling is defined by the errors argument:
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1221
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1222 NULL or "strict": raise a ValueError
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1223 "ignore": ignore the wrong characters (these are not copied to the
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1224 output buffer)
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1225 "replace": replaces illegal characters with '?'
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1226
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1227 Returns 0 on success, -1 on failure.
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1228
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1229 */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1230
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1231 PyAPI_FUNC(int) PyUnicode_EncodeDecimal(
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1232 Py_UNICODE s, / Unicode buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1233 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1234 char output, / Output buffer; must have size >= length */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1235 const char errors / error handling */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1236 );
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1237
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1238 /* --- File system encoding ---------------------------------------------- */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1239
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1240 /* ParseTuple converter which converts a Unicode object into the file
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1241 system encoding, using the PEP 383 error handler; bytes objects are
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1242 output as-is. */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1243
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1244 PyAPI_FUNC(int) PyUnicode_FSConverter(PyObject, void);
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1245
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1246 /* Decode a null-terminated string using Py_FileSystemDefaultEncoding.
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1247
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1248 If the encoding is supported by one of the built-in codecs (i.e., UTF-8,
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1249 UTF-16, UTF-32, Latin-1 or MBCS), otherwise fallback to UTF-8 and replace
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1250 invalid characters with '?'.
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1251
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1252 The function is intended to be used for paths and file names only
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1253 during bootstrapping process where the codecs are not set up.
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1254 */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1255
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1256 PyAPI_FUNC(PyObject*) PyUnicode_DecodeFSDefault(
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1257 const char s / encoded string */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1258 );
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1259
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1260 PyAPI_FUNC(PyObject*) PyUnicode_DecodeFSDefaultAndSize(
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1261 const char s, / encoded string */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1262 Py_ssize_t size /* size */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1263 );
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1264
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1265 /* --- Methods & Slots ----------------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1266
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1267 These are capable of handling Unicode objects and strings on input
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1268 (we refer to them as strings in the descriptions) and return
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1269 Unicode objects or integers as apporpriate. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1270
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1271 /* Concat two strings giving a new Unicode string. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1272
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1273 PyAPI_FUNC(PyObject*) PyUnicode_Concat(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1274 PyObject left, / Left string */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1275 PyObject right / Right string */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1276 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1277
41769 b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1278 /* Concat two strings and put the result in *pleft
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1279 (sets pleft to NULL on error) /
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1280
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1281 PyAPI_FUNC(void) PyUnicode_Append(
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1282 PyObject *pleft, / Pointer to left string */
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1283 PyObject right / Right string */
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1284 );
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1285
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1286 /* Concat two strings, put the result in *pleft and drop the right object
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1287 (sets pleft to NULL on error) /
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1288
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1289 PyAPI_FUNC(void) PyUnicode_AppendAndDel(
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1290 PyObject *pleft, / Pointer to left string */
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1291 PyObject right / Right string */
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1292 );
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1293
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1294 /* Split a string giving a list of Unicode strings.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1295
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1296 If sep is NULL, splitting will be done at all whitespace
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1297 substrings. Otherwise, splits occur at the given separator.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1298
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1299 At most maxsplit splits will be done. If negative, no limit is set.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1300
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1301 Separators are not included in the resulting list.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1302
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1303 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1304
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1305 PyAPI_FUNC(PyObject*) PyUnicode_Split(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1306 PyObject s, / String to split */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1307 PyObject sep, / String separator */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1308 Py_ssize_t maxsplit /* Maxsplit count */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1309 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1310
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1311 /* Dito, but split at line breaks.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1312
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1313 CRLF is considered to be one line break. Line breaks are not
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1314 included in the resulting list. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1315
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1316 PyAPI_FUNC(PyObject*) PyUnicode_Splitlines(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1317 PyObject s, / String to split */
12372 214303d32f76 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12326 diff changeset	1318 int keepends /* If true, line end markers are included */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1319 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1320
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1321 /* Partition a string using a given separator. */
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1322
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1323 PyAPI_FUNC(PyObject*) PyUnicode_Partition(
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1324 PyObject s, / String to partition */
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1325 PyObject sep / String separator */
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1326 );
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1327
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1328 /* Partition a string using a given separator, searching from the end of the
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1329 string. */
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1330
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1331 PyAPI_FUNC(PyObject*) PyUnicode_RPartition(
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1332 PyObject s, / String to partition */
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1333 PyObject sep / String separator */
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1334 );
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1335
31199 504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1336 /* Split a string giving a list of Unicode strings.
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1337
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1338 If sep is NULL, splitting will be done at all whitespace
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1339 substrings. Otherwise, splits occur at the given separator.
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1340
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1341 At most maxsplit splits will be done. But unlike PyUnicode_Split
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1342 PyUnicode_RSplit splits from the end of the string. If negative,
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1343 no limit is set.
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1344
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1345 Separators are not included in the resulting list.
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1346
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1347 */
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1348
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1349 PyAPI_FUNC(PyObject*) PyUnicode_RSplit(
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1350 PyObject s, / String to split */
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1351 PyObject sep, / String separator */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1352 Py_ssize_t maxsplit /* Maxsplit count */
31199 504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1353 );
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1354
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1355 /* Translate a string by applying a character mapping table to it and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1356 return the resulting Unicode object.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1357
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1358 The mapping table must map Unicode ordinal integers to Unicode
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1359 ordinal integers or None (causing deletion of the character).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1360
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1361 Mapping tables may be dictionaries or sequences. Unmapped character
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1362 ordinals (ones which cause a LookupError) are left untouched and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1363 are copied as-is.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1364
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1365 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1366
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1367 PyAPI_FUNC(PyObject *) PyUnicode_Translate(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1368 PyObject str, / String */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1369 PyObject table, / Translate table */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1370 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1371 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1372
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1373 /* Join a sequence of strings using the given separator and return
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1374 the resulting Unicode string. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1375
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1376 PyAPI_FUNC(PyObject*) PyUnicode_Join(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1377 PyObject separator, / Separator string */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1378 PyObject seq / Sequence object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1379 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1380
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1381 /* Return 1 if substr matches str[start:end] at the given tail end, 0
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1382 otherwise. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1383
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1384 PyAPI_FUNC(Py_ssize_t) PyUnicode_Tailmatch(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1385 PyObject str, / String */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1386 PyObject substr, / Prefix or Suffix string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1387 Py_ssize_t start, /* Start index */
7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1388 Py_ssize_t end, /* Stop index */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1389 int direction /* Tail end: -1 prefix, +1 suffix */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1390 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1391
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1392 /* Return the first position of substr in str[start:end] using the
23561 c5e8f89fd358 Fix for bug [ 561796 ] string.find causes lazy error Marc-André Lemburg <mal@egenix.com> parents: 23225 diff changeset	1393 given search direction or -1 if not found. -2 is returned in case
c5e8f89fd358 Fix for bug [ 561796 ] string.find causes lazy error Marc-André Lemburg <mal@egenix.com> parents: 23225 diff changeset	1394 an error occurred and an exception is set. */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1395
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1396 PyAPI_FUNC(Py_ssize_t) PyUnicode_Find(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1397 PyObject str, / String */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1398 PyObject substr, / Substring to find */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1399 Py_ssize_t start, /* Start index */
7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1400 Py_ssize_t end, /* Stop index */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1401 int direction /* Find direction: +1 forward, -1 backward */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1402 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1403
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	1404 /* Count the number of occurrences of substr in str[start:end]. */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1405
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1406 PyAPI_FUNC(Py_ssize_t) PyUnicode_Count(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1407 PyObject str, / String */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1408 PyObject substr, / Substring to count */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1409 Py_ssize_t start, /* Start index */
7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1410 Py_ssize_t end /* Stop index */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1411 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1412
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	1413 /* Replace at most maxcount occurrences of substr in str with replstr
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1414 and return the resulting Unicode object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1415
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1416 PyAPI_FUNC(PyObject *) PyUnicode_Replace(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1417 PyObject str, / String */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1418 PyObject substr, / Substring to find */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1419 PyObject replstr, / Substring to replace */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1420 Py_ssize_t maxcount /* Max. number of replacements to apply;
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1421 -1 = all */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1422 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1423
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1424 /* Compare two strings and return -1, 0, 1 for less than, equal,
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1425 greater than resp. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1426
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1427 PyAPI_FUNC(int) PyUnicode_Compare(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1428 PyObject left, / Left string */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1429 PyObject right / Right string */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1430 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1431
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1432 PyAPI_FUNC(int) PyUnicode_CompareWithASCIIString(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1433 PyObject *left,
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1434 const char *right
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1435 );
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1436
39610 3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1437 /* Rich compare two strings and return one of the following:
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1438
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1439 - NULL in case an exception was raised
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1440 - Py_True or Py_False for successfuly comparisons
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1441 - Py_NotImplemented in case the type combination is unknown
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1442
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1443 Note that Py_EQ and Py_NE comparisons can cause a UnicodeWarning in
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1444 case the conversion of the arguments to Unicode fails with a
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1445 UnicodeDecodeError.
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1446
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1447 Possible values for op:
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1448
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1449 Py_GT, Py_GE, Py_EQ, Py_NE, Py_LT, Py_LE
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1450
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1451 */
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1452
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1453 PyAPI_FUNC(PyObject *) PyUnicode_RichCompare(
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1454 PyObject left, / Left string */
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1455 PyObject right, / Right string */
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1456 int op /* Operation: Py_EQ, Py_NE, Py_GT, etc. */
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1457 );
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1458
13620 5b727ab37092 Spelling fixes supplied by Rob W. W. Hooft. All these are fixes in either Thomas Wouters <thomas@python.org> parents: 13401 diff changeset	1459 /* Apply a argument tuple or dictionary to a format string and return
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1460 the resulting Unicode string. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1461
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1462 PyAPI_FUNC(PyObject *) PyUnicode_Format(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1463 PyObject format, / Format string */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1464 PyObject args / Argument tuple or dictionary */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1465 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1466
12002 d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1467 /* Checks whether element is contained in container and return 1/0
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1468 accordingly.
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1469
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1470 element has to coerce to an one element Unicode string. -1 is
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1471 returned in case of an error. */
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1472
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1473 PyAPI_FUNC(int) PyUnicode_Contains(
12002 d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1474 PyObject container, / Container string */
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1475 PyObject element / Element string */
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1476 );
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1477
42597 20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	1478 /* Checks whether argument is a valid identifier. */
20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	1479
20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	1480 PyAPI_FUNC(int) PyUnicode_IsIdentifier(PyObject *s);
20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	1481
23225 e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1482 /* Externally visible for str.strip(unicode) */
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1483 PyAPI_FUNC(PyObject *) _PyUnicode_XStrip(
23225 e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1484 PyUnicodeObject *self,
e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1485 int striptype,
e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1486 PyObject *sepobj
e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1487 );
e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1488
46909 ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1489 /* Using the current locale, insert the thousands grouping
ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1490 into the string pointed to by buffer. For the argument descriptions,
ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1491 see Objects/stringlib/localeutil.h */
ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1492
53187 b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1493 PyAPI_FUNC(Py_ssize_t) _PyUnicode_InsertThousandsGroupingLocale(Py_UNICODE *buffer,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1494 Py_ssize_t n_buffer,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1495 Py_UNICODE *digits,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1496 Py_ssize_t n_digits,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1497 Py_ssize_t min_width);
46909 ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1498
52773 28096ed73153 Added ',' thousands grouping to int.__format__. See PEP 378. Eric Smith <eric@trueblade.com> parents: 50660 diff changeset	1499 /* Using explicit passed-in values, insert the thousands grouping
28096ed73153 Added ',' thousands grouping to int.__format__. See PEP 378. Eric Smith <eric@trueblade.com> parents: 50660 diff changeset	1500 into the string pointed to by buffer. For the argument descriptions,
28096ed73153 Added ',' thousands grouping to int.__format__. See PEP 378. Eric Smith <eric@trueblade.com> parents: 50660 diff changeset	1501 see Objects/stringlib/localeutil.h */
53187 b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1502 PyAPI_FUNC(Py_ssize_t) _PyUnicode_InsertThousandsGrouping(Py_UNICODE *buffer,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1503 Py_ssize_t n_buffer,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1504 Py_UNICODE *digits,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1505 Py_ssize_t n_digits,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1506 Py_ssize_t min_width,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1507 const char *grouping,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1508 const char *thousands_sep);
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1509 /* === Characters Type APIs =============================================== */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1510
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	1511 /* Helper array used by Py_UNICODE_ISSPACE(). */
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	1512
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	1513 PyAPI_DATA(const unsigned char) _Py_ascii_whitespace[];
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	1514
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1515 /* These should not be used directly. Use the Py_UNICODE_IS* and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1516 Py_UNICODE_TO* macros instead.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1517
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1518 These APIs are implemented in Objects/unicodectype.c.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1519
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1520 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1521
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1522 PyAPI_FUNC(int) _PyUnicode_IsLowercase(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1523 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1524 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1525
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1526 PyAPI_FUNC(int) _PyUnicode_IsUppercase(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1527 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1528 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1529
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1530 PyAPI_FUNC(int) _PyUnicode_IsTitlecase(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1531 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1532 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1533
42595 f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1534 PyAPI_FUNC(int) _PyUnicode_IsXidStart(
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1535 Py_UNICODE ch /* Unicode character */
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1536 );
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1537
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1538 PyAPI_FUNC(int) _PyUnicode_IsXidContinue(
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1539 Py_UNICODE ch /* Unicode character */
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1540 );
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1541
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1542 PyAPI_FUNC(int) _PyUnicode_IsWhitespace(
35808 c2a98ba371c8 _PyUnicode_IsWhitespace(), Tim Peters <tim.peters@gmail.com> parents: 35485 diff changeset	1543 const Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1544 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1545
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1546 PyAPI_FUNC(int) _PyUnicode_IsLinebreak(
35808 c2a98ba371c8 _PyUnicode_IsWhitespace(), Tim Peters <tim.peters@gmail.com> parents: 35485 diff changeset	1547 const Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1548 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1549
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1550 PyAPI_FUNC(Py_UNICODE) _PyUnicode_ToLowercase(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1551 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1552 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1553
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1554 PyAPI_FUNC(Py_UNICODE) _PyUnicode_ToUppercase(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1555 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1556 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1557
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1558 PyAPI_FUNC(Py_UNICODE) _PyUnicode_ToTitlecase(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1559 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1560 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1561
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1562 PyAPI_FUNC(int) _PyUnicode_ToDecimalDigit(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1563 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1564 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1565
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1566 PyAPI_FUNC(int) _PyUnicode_ToDigit(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1567 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1568 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1569
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1570 PyAPI_FUNC(double) _PyUnicode_ToNumeric(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1571 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1572 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1573
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1574 PyAPI_FUNC(int) _PyUnicode_IsDecimalDigit(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1575 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1576 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1577
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1578 PyAPI_FUNC(int) _PyUnicode_IsDigit(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1579 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1580 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1581
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1582 PyAPI_FUNC(int) _PyUnicode_IsNumeric(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1583 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1584 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1585
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	1586 PyAPI_FUNC(int) _PyUnicode_IsPrintable(
da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	1587 Py_UNICODE ch /* Unicode character */
da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	1588 );
da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	1589
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1590 PyAPI_FUNC(int) _PyUnicode_IsAlpha(
18332 49acc8ac60c2 removed "register const" from scalar arguments to the unicode Fredrik Lundh <fredrik@pythonware.com> parents: 18324 diff changeset	1591 Py_UNICODE ch /* Unicode character */
13352 d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	1592 );
d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	1593
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1594 PyAPI_FUNC(size_t) Py_UNICODE_strlen(const Py_UNICODE *u);
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1595
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1596 PyAPI_FUNC(Py_UNICODE*) Py_UNICODE_strcpy(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1597 Py_UNICODE s1, const Py_UNICODE s2);
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1598
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1599 PyAPI_FUNC(Py_UNICODE*) Py_UNICODE_strncpy(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1600 Py_UNICODE s1, const Py_UNICODE s2, size_t n);
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1601
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1602 PyAPI_FUNC(int) Py_UNICODE_strcmp(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1603 const Py_UNICODE s1, const Py_UNICODE s2);
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1604
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1605 PyAPI_FUNC(Py_UNICODE*) Py_UNICODE_strchr(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1606 const Py_UNICODE *s, Py_UNICODE c
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1607 );
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1608
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1609 #ifdef __cplusplus
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1610 }
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1611 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1612 #endif /* !Py_UNICODEOBJECT_H */

Mercurial > cpython-lru_cache-weakref

annotate Include/unicodeobject.h @ 58664:993f703a61ba