cpython-lru_cache-weakref: Include/unicodeobject.h annotate

annotate Include/unicodeobject.h @ 67467:abe201dfd3dc 3.1

Merged revisions 87861,87863 via svnmerge from svn+ssh://pythondev@svn.python.org/python/branches/py3k ........ r87861 | antoine.pitrou | 2011-01-08 11:23:29 +0100 (sam., 08 janv. 2011) | 3 lines Fix test_ssl after r87849 ........ r87863 | antoine.pitrou | 2011-01-08 11:28:11 +0100 (sam., 08 janv. 2011) | 3 lines Add EHOSTUNREACH ('No route to host') to the errnos trapped by transient_internet(). ........

author	Antoine Pitrou <solipsis@pitrou.net>
date	Sat, 08 Jan 2011 10:31:09 +0000
parents	52fe60216e89
children	3c9232a684ae

rev	line source
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1 #ifndef Py_UNICODEOBJECT_H
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	2 #define Py_UNICODEOBJECT_H
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	3
44999 7c02182e2979 Merged revisions 60284-60349 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44586 diff changeset	4 #include <stdarg.h>
7c02182e2979 Merged revisions 60284-60349 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44586 diff changeset	5
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	6 /*
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	7
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	8 Unicode implementation based on original code by Fredrik Lundh,
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	9 modified by Marc-Andre Lemburg (mal@lemburg.com) according to the
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	10 Unicode Integration Proposal. (See
52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	11 http://www.egenix.com/files/python/unicode-proposal.txt).
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	12
13828 254f8b7c4a83 Changing the CNRI copyright notice according to CNRI's instructions. Guido van Rossum <guido@python.org> parents: 13661 diff changeset	13 Copyright (c) Corporation for National Research Initiatives.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	14
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	15
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	16 Original header:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	17 --------------------------------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	18
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	19 * Yet another Unicode string type for Python. This type supports the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	20 * 16-bit Basic Multilingual Plane (BMP) only.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	21 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	22 * Written by Fredrik Lundh, January 1999.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	23 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	24 * Copyright (c) 1999 by Secret Labs AB.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	25 * Copyright (c) 1999 by Fredrik Lundh.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	26 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	27 * fredrik@pythonware.com
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	28 * http://www.pythonware.com
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	29 *
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	30 * --------------------------------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	31 * This Unicode String Type is
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	32 *
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	33 * Copyright (c) 1999 by Secret Labs AB
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	34 * Copyright (c) 1999 by Fredrik Lundh
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	35 *
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	36 * By obtaining, using, and/or copying this software and/or its
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	37 * associated documentation, you agree that you have read, understood,
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	38 * and will comply with the following terms and conditions:
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	39 *
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	40 * Permission to use, copy, modify, and distribute this software and its
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	41 * associated documentation for any purpose and without fee is hereby
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	42 * granted, provided that the above copyright notice appears in all
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	43 * copies, and that both that copyright notice and this permission notice
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	44 * appear in supporting documentation, and that the name of Secret Labs
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	45 * AB or the author not be used in advertising or publicity pertaining to
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	46 * distribution of the software without specific, written prior
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	47 * permission.
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	48 *
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	49 * SECRET LABS AB AND THE AUTHOR DISCLAIMS ALL WARRANTIES WITH REGARD TO
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	50 * THIS SOFTWARE, INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	51 * FITNESS. IN NO EVENT SHALL SECRET LABS AB OR THE AUTHOR BE LIABLE FOR
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	52 * ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	53 * WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	54 * ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	55 * OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	56 * -------------------------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	57
19980 9ab6af6815af Fix for bug #462737. Marc-André Lemburg <mal@egenix.com> parents: 19849 diff changeset	58 #include <ctype.h>
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	59
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	60 /* === Internal API ======================================================= */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	61
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	62 /* --- Internal Unicode Format -------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	63
44586 a2938c55200c Always define Py_USING_UNICODE, 3rd party software may depend on it. A missing declaration can lead to strange bugs as I had to learn the hard way in the upcoming merge Christian Heimes <christian@cheimes.de> parents: 44351 diff changeset	64 /* Python 3.x requires unicode */
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	65 #define Py_USING_UNICODE
44586 a2938c55200c Always define Py_USING_UNICODE, 3rd party software may depend on it. A missing declaration can lead to strange bugs as I had to learn the hard way in the upcoming merge Christian Heimes <christian@cheimes.de> parents: 44351 diff changeset	66
18296 22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	67 /* FIXME: MvL's new implementation assumes that Py_UNICODE_SIZE is
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	68 properly set, but the default rules below doesn't set it. I'll
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	69 sort this out some other day -- fredrik@pythonware.com */
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	70
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	71 #ifndef Py_UNICODE_SIZE
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	72 #error Must define Py_UNICODE_SIZE
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	73 #endif
22f85c6a6520 Make Unicode work a bit better on Windows... Fredrik Lundh <fredrik@pythonware.com> parents: 18292 diff changeset	74
18324 3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	75 /* Setting Py_UNICODE_WIDE enables UCS-4 storage. Otherwise, Unicode
3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	76 strings are stored as UCS-2 (with limited support for UTF-16) */
3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	77
3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	78 #if Py_UNICODE_SIZE >= 4
3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	79 #define Py_UNICODE_WIDE
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	80 #endif
18280 0632dcd69ea3 experimental UCS-4 support: added USE_UCS4_STORAGE define to Fredrik Lundh <fredrik@pythonware.com> parents: 17887 diff changeset	81
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	82 /* Set these flags if the platform has "wchar.h", "wctype.h" and the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	83 wchar_t type is a 16-bit unsigned type */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	84 /* #define HAVE_WCHAR_H */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	85 /* #define HAVE_USABLE_WCHAR_T */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	86
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	87 /* Defaults for various platforms */
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	88 #ifndef PY_UNICODE_TYPE
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	89
18280 0632dcd69ea3 experimental UCS-4 support: added USE_UCS4_STORAGE define to Fredrik Lundh <fredrik@pythonware.com> parents: 17887 diff changeset	90 /* Windows has a usable wchar_t type (unless we're using UCS-4) */
18324 3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	91 # if defined(MS_WIN32) && Py_UNICODE_SIZE == 2
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	92 # define HAVE_USABLE_WCHAR_T
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	93 # define PY_UNICODE_TYPE wchar_t
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	94 # endif
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	95
18324 3ba7a358ce02 use Py_UNICODE_WIDE instead of USE_UCS4_STORAGE and Py_UNICODE_SIZE Fredrik Lundh <fredrik@pythonware.com> parents: 18298 diff changeset	96 # if defined(Py_UNICODE_WIDE)
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	97 # define PY_UNICODE_TYPE Py_UCS4
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	98 # endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	99
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	100 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	101
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	102 /* If the compiler provides a wchar_t type we try to support it
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	103 through the interface functions PyUnicode_FromWideChar() and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	104 PyUnicode_AsWideChar(). */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	105
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	106 #ifdef HAVE_USABLE_WCHAR_T
13917 03fa40528d17 Added #fndef's to avoid compiler errors. Marc-André Lemburg <mal@egenix.com> parents: 13837 diff changeset	107 # ifndef HAVE_WCHAR_H
03fa40528d17 Added #fndef's to avoid compiler errors. Marc-André Lemburg <mal@egenix.com> parents: 13837 diff changeset	108 # define HAVE_WCHAR_H
03fa40528d17 Added #fndef's to avoid compiler errors. Marc-André Lemburg <mal@egenix.com> parents: 13837 diff changeset	109 # endif
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	110 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	111
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	112 #ifdef HAVE_WCHAR_H
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	113 /* Work around a cosmetic bug in BSDI 4.x wchar.h; thanks to Thomas Wouters */
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	114 # ifdef _HAVE_BSDI
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	115 # include <time.h>
65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	116 # endif
19980 9ab6af6815af Fix for bug #462737. Marc-André Lemburg <mal@egenix.com> parents: 19849 diff changeset	117 # include <wchar.h>
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	118 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	119
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	120 /*
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	121 * Use this typedef when you need to represent a UTF-16 surrogate pair
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	122 * as single unsigned integer.
ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	123 */
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	124 #if SIZEOF_INT >= 4
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	125 typedef unsigned int Py_UCS4;
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	126 #elif SIZEOF_LONG >= 4
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	127 typedef unsigned long Py_UCS4;
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	128 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	129
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	130 /* Py_UNICODE is the native Unicode storage format (code unit) used by
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	131 Python and represents a single Unicode element in the Unicode
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	132 type. */
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	133
18292 ffbb9c918ac0 Support using UCS-4 as the Py_UNICODE type: Martin v. Löwis <martin@v.loewis.de> parents: 18280 diff changeset	134 typedef PY_UNICODE_TYPE Py_UNICODE;
13393 bcb14627b8f4 Bill Tutt: Added Py_UCS4 typedef to hold UCS4 values (these need Marc-André Lemburg <mal@egenix.com> parents: 13352 diff changeset	135
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	136 /* --- UCS-2/UCS-4 Name Mangling ------------------------------------------ */
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	137
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	138 /* Unicode API names are mangled to assure that UCS-2 and UCS-4 builds
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	139 produce different external names and thus cause import errors in
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	140 case Python interpreters and extensions with mixed compiled in
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	141 Unicode width assumptions are combined. */
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	142
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	143 #ifndef Py_UNICODE_WIDE
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	144
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	145 # define PyUnicode_AsASCIIString PyUnicodeUCS2_AsASCIIString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	146 # define PyUnicode_AsCharmapString PyUnicodeUCS2_AsCharmapString
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	147 # define PyUnicode_AsDecodedObject PyUnicodeUCS2_AsDecodedObject
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	148 # define PyUnicode_AsDecodedUnicode PyUnicodeUCS2_AsDecodedUnicode
32551 f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	149 # define PyUnicode_AsEncodedObject PyUnicodeUCS2_AsEncodedObject
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	150 # define PyUnicode_AsEncodedString PyUnicodeUCS2_AsEncodedString
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	151 # define PyUnicode_AsEncodedUnicode PyUnicodeUCS2_AsEncodedUnicode
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	152 # define PyUnicode_AsLatin1String PyUnicodeUCS2_AsLatin1String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	153 # define PyUnicode_AsRawUnicodeEscapeString PyUnicodeUCS2_AsRawUnicodeEscapeString
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	154 # define PyUnicode_AsUTF32String PyUnicodeUCS2_AsUTF32String
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	155 # define PyUnicode_AsUTF16String PyUnicodeUCS2_AsUTF16String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	156 # define PyUnicode_AsUTF8String PyUnicodeUCS2_AsUTF8String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	157 # define PyUnicode_AsUnicode PyUnicodeUCS2_AsUnicode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	158 # define PyUnicode_AsUnicodeEscapeString PyUnicodeUCS2_AsUnicodeEscapeString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	159 # define PyUnicode_AsWideChar PyUnicodeUCS2_AsWideChar
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	160 # define PyUnicode_ClearFreeList PyUnicodeUCS2_ClearFreelist
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	161 # define PyUnicode_Compare PyUnicodeUCS2_Compare
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	162 # define PyUnicode_Concat PyUnicodeUCS2_Concat
41769 b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	163 # define PyUnicode_Append PyUnicodeUCS2_Append
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	164 # define PyUnicode_AppendAndDel PyUnicodeUCS2_AppendAndDel
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	165 # define PyUnicode_Contains PyUnicodeUCS2_Contains
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	166 # define PyUnicode_Count PyUnicodeUCS2_Count
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	167 # define PyUnicode_Decode PyUnicodeUCS2_Decode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	168 # define PyUnicode_DecodeASCII PyUnicodeUCS2_DecodeASCII
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	169 # define PyUnicode_DecodeCharmap PyUnicodeUCS2_DecodeCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	170 # define PyUnicode_DecodeLatin1 PyUnicodeUCS2_DecodeLatin1
43569 19319e70fc3e Patch #1272, by Christian Heimes and Alexandre Vassalotti. Guido van Rossum <guido@python.org> parents: 42984 diff changeset	171 # define PyUnicode_DecodeFSDefault PyUnicodeUCS2_DecodeFSDefault
43761 658cd34a8c5d Fixed a bug in PyUnicode_DecodeFSDefault. strcmp() returns 0 on success. Christian Heimes <christian@cheimes.de> parents: 43569 diff changeset	172 # define PyUnicode_DecodeFSDefaultAndSize PyUnicodeUCS2_DecodeFSDefaultAndSize
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	173 # define PyUnicode_DecodeRawUnicodeEscape PyUnicodeUCS2_DecodeRawUnicodeEscape
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	174 # define PyUnicode_DecodeUTF32 PyUnicodeUCS2_DecodeUTF32
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	175 # define PyUnicode_DecodeUTF32Stateful PyUnicodeUCS2_DecodeUTF32Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	176 # define PyUnicode_DecodeUTF16 PyUnicodeUCS2_DecodeUTF16
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	177 # define PyUnicode_DecodeUTF16Stateful PyUnicodeUCS2_DecodeUTF16Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	178 # define PyUnicode_DecodeUTF8 PyUnicodeUCS2_DecodeUTF8
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	179 # define PyUnicode_DecodeUTF8Stateful PyUnicodeUCS2_DecodeUTF8Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	180 # define PyUnicode_DecodeUnicodeEscape PyUnicodeUCS2_DecodeUnicodeEscape
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	181 # define PyUnicode_Encode PyUnicodeUCS2_Encode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	182 # define PyUnicode_EncodeASCII PyUnicodeUCS2_EncodeASCII
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	183 # define PyUnicode_EncodeCharmap PyUnicodeUCS2_EncodeCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	184 # define PyUnicode_EncodeDecimal PyUnicodeUCS2_EncodeDecimal
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	185 # define PyUnicode_EncodeLatin1 PyUnicodeUCS2_EncodeLatin1
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	186 # define PyUnicode_EncodeRawUnicodeEscape PyUnicodeUCS2_EncodeRawUnicodeEscape
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	187 # define PyUnicode_EncodeUTF32 PyUnicodeUCS2_EncodeUTF32
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	188 # define PyUnicode_EncodeUTF16 PyUnicodeUCS2_EncodeUTF16
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	189 # define PyUnicode_EncodeUTF8 PyUnicodeUCS2_EncodeUTF8
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	190 # define PyUnicode_EncodeUnicodeEscape PyUnicodeUCS2_EncodeUnicodeEscape
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	191 # define PyUnicode_Find PyUnicodeUCS2_Find
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	192 # define PyUnicode_Format PyUnicodeUCS2_Format
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	193 # define PyUnicode_FromEncodedObject PyUnicodeUCS2_FromEncodedObject
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	194 # define PyUnicode_FromFormat PyUnicodeUCS2_FromFormat
db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	195 # define PyUnicode_FromFormatV PyUnicodeUCS2_FromFormatV
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	196 # define PyUnicode_FromObject PyUnicodeUCS2_FromObject
24753 27ae978bee58 Add name mangling for new PyUnicode_FromOrdinal() and fix declaration Marc-André Lemburg <mal@egenix.com> parents: 24752 diff changeset	197 # define PyUnicode_FromOrdinal PyUnicodeUCS2_FromOrdinal
41619 61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	198 # define PyUnicode_FromString PyUnicodeUCS2_FromString
41766 d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	199 # define PyUnicode_FromStringAndSize PyUnicodeUCS2_FromStringAndSize
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	200 # define PyUnicode_FromUnicode PyUnicodeUCS2_FromUnicode
41768 b592985a953f Add missing #define. Walter Dörwald <walter@livinglogic.de> parents: 41766 diff changeset	201 # define PyUnicode_FromWideChar PyUnicodeUCS2_FromWideChar
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	202 # define PyUnicode_FSConverter PyUnicodeUCS2_FSConverter
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	203 # define PyUnicode_GetDefaultEncoding PyUnicodeUCS2_GetDefaultEncoding
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	204 # define PyUnicode_GetMax PyUnicodeUCS2_GetMax
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	205 # define PyUnicode_GetSize PyUnicodeUCS2_GetSize
42597 20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	206 # define PyUnicode_IsIdentifier PyUnicodeUCS2_IsIdentifier
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	207 # define PyUnicode_Join PyUnicodeUCS2_Join
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	208 # define PyUnicode_Partition PyUnicodeUCS2_Partition
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	209 # define PyUnicode_RPartition PyUnicodeUCS2_RPartition
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	210 # define PyUnicode_RSplit PyUnicodeUCS2_RSplit
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	211 # define PyUnicode_Replace PyUnicodeUCS2_Replace
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	212 # define PyUnicode_Resize PyUnicodeUCS2_Resize
39610 3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	213 # define PyUnicode_RichCompare PyUnicodeUCS2_RichCompare
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	214 # define PyUnicode_SetDefaultEncoding PyUnicodeUCS2_SetDefaultEncoding
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	215 # define PyUnicode_Split PyUnicodeUCS2_Split
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	216 # define PyUnicode_Splitlines PyUnicodeUCS2_Splitlines
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	217 # define PyUnicode_Tailmatch PyUnicodeUCS2_Tailmatch
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	218 # define PyUnicode_Translate PyUnicodeUCS2_Translate
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	219 # define PyUnicode_TranslateCharmap PyUnicodeUCS2_TranslateCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	220 # define _PyUnicode_AsDefaultEncodedString _PyUnicodeUCS2_AsDefaultEncodedString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	221 # define _PyUnicode_Fini _PyUnicodeUCS2_Fini
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	222 # define _PyUnicode_Init _PyUnicodeUCS2_Init
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	223 # define _PyUnicode_IsAlpha _PyUnicodeUCS2_IsAlpha
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	224 # define _PyUnicode_IsDecimalDigit _PyUnicodeUCS2_IsDecimalDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	225 # define _PyUnicode_IsDigit _PyUnicodeUCS2_IsDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	226 # define _PyUnicode_IsLinebreak _PyUnicodeUCS2_IsLinebreak
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	227 # define _PyUnicode_IsLowercase _PyUnicodeUCS2_IsLowercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	228 # define _PyUnicode_IsNumeric _PyUnicodeUCS2_IsNumeric
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	229 # define _PyUnicode_IsPrintable _PyUnicodeUCS2_IsPrintable
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	230 # define _PyUnicode_IsTitlecase _PyUnicodeUCS2_IsTitlecase
42595 f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	231 # define _PyUnicode_IsXidStart _PyUnicodeUCS2_IsXidStart
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	232 # define _PyUnicode_IsXidContinue _PyUnicodeUCS2_IsXidContinue
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	233 # define _PyUnicode_IsUppercase _PyUnicodeUCS2_IsUppercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	234 # define _PyUnicode_IsWhitespace _PyUnicodeUCS2_IsWhitespace
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	235 # define _PyUnicode_ToDecimalDigit _PyUnicodeUCS2_ToDecimalDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	236 # define _PyUnicode_ToDigit _PyUnicodeUCS2_ToDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	237 # define _PyUnicode_ToLowercase _PyUnicodeUCS2_ToLowercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	238 # define _PyUnicode_ToNumeric _PyUnicodeUCS2_ToNumeric
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	239 # define _PyUnicode_ToTitlecase _PyUnicodeUCS2_ToTitlecase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	240 # define _PyUnicode_ToUppercase _PyUnicodeUCS2_ToUppercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	241
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	242 #else
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	243
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	244 # define PyUnicode_AsASCIIString PyUnicodeUCS4_AsASCIIString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	245 # define PyUnicode_AsCharmapString PyUnicodeUCS4_AsCharmapString
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	246 # define PyUnicode_AsDecodedObject PyUnicodeUCS4_AsDecodedObject
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	247 # define PyUnicode_AsDecodedUnicode PyUnicodeUCS4_AsDecodedUnicode
32551 f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	248 # define PyUnicode_AsEncodedObject PyUnicodeUCS4_AsEncodedObject
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	249 # define PyUnicode_AsEncodedString PyUnicodeUCS4_AsEncodedString
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	250 # define PyUnicode_AsEncodedUnicode PyUnicodeUCS4_AsEncodedUnicode
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	251 # define PyUnicode_AsLatin1String PyUnicodeUCS4_AsLatin1String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	252 # define PyUnicode_AsRawUnicodeEscapeString PyUnicodeUCS4_AsRawUnicodeEscapeString
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	253 # define PyUnicode_AsUTF32String PyUnicodeUCS4_AsUTF32String
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	254 # define PyUnicode_AsUTF16String PyUnicodeUCS4_AsUTF16String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	255 # define PyUnicode_AsUTF8String PyUnicodeUCS4_AsUTF8String
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	256 # define PyUnicode_AsUnicode PyUnicodeUCS4_AsUnicode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	257 # define PyUnicode_AsUnicodeEscapeString PyUnicodeUCS4_AsUnicodeEscapeString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	258 # define PyUnicode_AsWideChar PyUnicodeUCS4_AsWideChar
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	259 # define PyUnicode_ClearFreeList PyUnicodeUCS4_ClearFreelist
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	260 # define PyUnicode_Compare PyUnicodeUCS4_Compare
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	261 # define PyUnicode_Concat PyUnicodeUCS4_Concat
41769 b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	262 # define PyUnicode_Append PyUnicodeUCS4_Append
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	263 # define PyUnicode_AppendAndDel PyUnicodeUCS4_AppendAndDel
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	264 # define PyUnicode_Contains PyUnicodeUCS4_Contains
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	265 # define PyUnicode_Count PyUnicodeUCS4_Count
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	266 # define PyUnicode_Decode PyUnicodeUCS4_Decode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	267 # define PyUnicode_DecodeASCII PyUnicodeUCS4_DecodeASCII
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	268 # define PyUnicode_DecodeCharmap PyUnicodeUCS4_DecodeCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	269 # define PyUnicode_DecodeLatin1 PyUnicodeUCS4_DecodeLatin1
43569 19319e70fc3e Patch #1272, by Christian Heimes and Alexandre Vassalotti. Guido van Rossum <guido@python.org> parents: 42984 diff changeset	270 # define PyUnicode_DecodeFSDefault PyUnicodeUCS4_DecodeFSDefault
43761 658cd34a8c5d Fixed a bug in PyUnicode_DecodeFSDefault. strcmp() returns 0 on success. Christian Heimes <christian@cheimes.de> parents: 43569 diff changeset	271 # define PyUnicode_DecodeFSDefaultAndSize PyUnicodeUCS4_DecodeFSDefaultAndSize
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	272 # define PyUnicode_DecodeRawUnicodeEscape PyUnicodeUCS4_DecodeRawUnicodeEscape
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	273 # define PyUnicode_DecodeUTF32 PyUnicodeUCS4_DecodeUTF32
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	274 # define PyUnicode_DecodeUTF32Stateful PyUnicodeUCS4_DecodeUTF32Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	275 # define PyUnicode_DecodeUTF16 PyUnicodeUCS4_DecodeUTF16
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	276 # define PyUnicode_DecodeUTF16Stateful PyUnicodeUCS4_DecodeUTF16Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	277 # define PyUnicode_DecodeUTF8 PyUnicodeUCS4_DecodeUTF8
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	278 # define PyUnicode_DecodeUTF8Stateful PyUnicodeUCS4_DecodeUTF8Stateful
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	279 # define PyUnicode_DecodeUnicodeEscape PyUnicodeUCS4_DecodeUnicodeEscape
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	280 # define PyUnicode_Encode PyUnicodeUCS4_Encode
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	281 # define PyUnicode_EncodeASCII PyUnicodeUCS4_EncodeASCII
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	282 # define PyUnicode_EncodeCharmap PyUnicodeUCS4_EncodeCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	283 # define PyUnicode_EncodeDecimal PyUnicodeUCS4_EncodeDecimal
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	284 # define PyUnicode_EncodeLatin1 PyUnicodeUCS4_EncodeLatin1
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	285 # define PyUnicode_EncodeRawUnicodeEscape PyUnicodeUCS4_EncodeRawUnicodeEscape
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	286 # define PyUnicode_EncodeUTF32 PyUnicodeUCS4_EncodeUTF32
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	287 # define PyUnicode_EncodeUTF16 PyUnicodeUCS4_EncodeUTF16
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	288 # define PyUnicode_EncodeUTF8 PyUnicodeUCS4_EncodeUTF8
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	289 # define PyUnicode_EncodeUnicodeEscape PyUnicodeUCS4_EncodeUnicodeEscape
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	290 # define PyUnicode_Find PyUnicodeUCS4_Find
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	291 # define PyUnicode_Format PyUnicodeUCS4_Format
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	292 # define PyUnicode_FromEncodedObject PyUnicodeUCS4_FromEncodedObject
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	293 # define PyUnicode_FromFormat PyUnicodeUCS4_FromFormat
db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	294 # define PyUnicode_FromFormatV PyUnicodeUCS4_FromFormatV
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	295 # define PyUnicode_FromObject PyUnicodeUCS4_FromObject
24753 27ae978bee58 Add name mangling for new PyUnicode_FromOrdinal() and fix declaration Marc-André Lemburg <mal@egenix.com> parents: 24752 diff changeset	296 # define PyUnicode_FromOrdinal PyUnicodeUCS4_FromOrdinal
41619 61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	297 # define PyUnicode_FromString PyUnicodeUCS4_FromString
41766 d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	298 # define PyUnicode_FromStringAndSize PyUnicodeUCS4_FromStringAndSize
50550 db464426a365 Merged revisions 67972 via svnmerge from Georg Brandl <georg@python.org> parents: 49553 diff changeset	299 # define PyUnicode_FromUnicode PyUnicodeUCS4_FromUnicode
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	300 # define PyUnicode_FromWideChar PyUnicodeUCS4_FromWideChar
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	301 # define PyUnicode_FSConverter PyUnicodeUCS4_FSConverter
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	302 # define PyUnicode_GetDefaultEncoding PyUnicodeUCS4_GetDefaultEncoding
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	303 # define PyUnicode_GetMax PyUnicodeUCS4_GetMax
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	304 # define PyUnicode_GetSize PyUnicodeUCS4_GetSize
42597 20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	305 # define PyUnicode_IsIdentifier PyUnicodeUCS4_IsIdentifier
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	306 # define PyUnicode_Join PyUnicodeUCS4_Join
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	307 # define PyUnicode_Partition PyUnicodeUCS4_Partition
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	308 # define PyUnicode_RPartition PyUnicodeUCS4_RPartition
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	309 # define PyUnicode_RSplit PyUnicodeUCS4_RSplit
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	310 # define PyUnicode_Replace PyUnicodeUCS4_Replace
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	311 # define PyUnicode_Resize PyUnicodeUCS4_Resize
39610 3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	312 # define PyUnicode_RichCompare PyUnicodeUCS4_RichCompare
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	313 # define PyUnicode_SetDefaultEncoding PyUnicodeUCS4_SetDefaultEncoding
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	314 # define PyUnicode_Split PyUnicodeUCS4_Split
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	315 # define PyUnicode_Splitlines PyUnicodeUCS4_Splitlines
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	316 # define PyUnicode_Tailmatch PyUnicodeUCS4_Tailmatch
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	317 # define PyUnicode_Translate PyUnicodeUCS4_Translate
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	318 # define PyUnicode_TranslateCharmap PyUnicodeUCS4_TranslateCharmap
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	319 # define _PyUnicode_AsDefaultEncodedString _PyUnicodeUCS4_AsDefaultEncodedString
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	320 # define _PyUnicode_Fini _PyUnicodeUCS4_Fini
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	321 # define _PyUnicode_Init _PyUnicodeUCS4_Init
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	322 # define _PyUnicode_IsAlpha _PyUnicodeUCS4_IsAlpha
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	323 # define _PyUnicode_IsDecimalDigit _PyUnicodeUCS4_IsDecimalDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	324 # define _PyUnicode_IsDigit _PyUnicodeUCS4_IsDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	325 # define _PyUnicode_IsLinebreak _PyUnicodeUCS4_IsLinebreak
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	326 # define _PyUnicode_IsLowercase _PyUnicodeUCS4_IsLowercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	327 # define _PyUnicode_IsNumeric _PyUnicodeUCS4_IsNumeric
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	328 # define _PyUnicode_IsPrintable _PyUnicodeUCS4_IsPrintable
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	329 # define _PyUnicode_IsTitlecase _PyUnicodeUCS4_IsTitlecase
42595 f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	330 # define _PyUnicode_IsXidStart _PyUnicodeUCS4_IsXidStart
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	331 # define _PyUnicode_IsXidContinue _PyUnicodeUCS4_IsXidContinue
18911 55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	332 # define _PyUnicode_IsUppercase _PyUnicodeUCS4_IsUppercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	333 # define _PyUnicode_IsWhitespace _PyUnicodeUCS4_IsWhitespace
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	334 # define _PyUnicode_ToDecimalDigit _PyUnicodeUCS4_ToDecimalDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	335 # define _PyUnicode_ToDigit _PyUnicodeUCS4_ToDigit
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	336 # define _PyUnicode_ToLowercase _PyUnicodeUCS4_ToLowercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	337 # define _PyUnicode_ToNumeric _PyUnicodeUCS4_ToNumeric
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	338 # define _PyUnicode_ToTitlecase _PyUnicodeUCS4_ToTitlecase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	339 # define _PyUnicode_ToUppercase _PyUnicodeUCS4_ToUppercase
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	340
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	341
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	342 #endif
55b45b47fc48 As discussed on python-dev: this patch adds name mangling to Marc-André Lemburg <mal@egenix.com> parents: 18887 diff changeset	343
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	344 /* --- Internal Unicode Operations ---------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	345
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	346 /* If you want Python to use the compiler's wctype.h functions instead
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	347 of the ones supplied with Python, define WANT_WCTYPE_FUNCTIONS or
33864 6b61af083493 SF patch #1056231: typo in comment (unicodeobject.h) Raymond Hettinger <python@rcn.com> parents: 33428 diff changeset	348 configure Python using --with-wctype-functions. This reduces the
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	349 interpreter's code size. */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	350
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	351 #if defined(HAVE_USABLE_WCHAR_T) && defined(WANT_WCTYPE_FUNCTIONS)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	352
19980 9ab6af6815af Fix for bug #462737. Marc-André Lemburg <mal@egenix.com> parents: 19849 diff changeset	353 #include <wctype.h>
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	354
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	355 #define Py_UNICODE_ISSPACE(ch) iswspace(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	356
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	357 #define Py_UNICODE_ISLOWER(ch) iswlower(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	358 #define Py_UNICODE_ISUPPER(ch) iswupper(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	359 #define Py_UNICODE_ISTITLE(ch) _PyUnicode_IsTitlecase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	360 #define Py_UNICODE_ISLINEBREAK(ch) _PyUnicode_IsLinebreak(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	361
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	362 #define Py_UNICODE_TOLOWER(ch) towlower(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	363 #define Py_UNICODE_TOUPPER(ch) towupper(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	364 #define Py_UNICODE_TOTITLE(ch) _PyUnicode_ToTitlecase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	365
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	366 #define Py_UNICODE_ISDECIMAL(ch) _PyUnicode_IsDecimalDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	367 #define Py_UNICODE_ISDIGIT(ch) _PyUnicode_IsDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	368 #define Py_UNICODE_ISNUMERIC(ch) _PyUnicode_IsNumeric(ch)
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	369 #define Py_UNICODE_ISPRINTABLE(ch) _PyUnicode_IsPrintable(ch)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	370
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	371 #define Py_UNICODE_TODECIMAL(ch) _PyUnicode_ToDecimalDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	372 #define Py_UNICODE_TODIGIT(ch) _PyUnicode_ToDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	373 #define Py_UNICODE_TONUMERIC(ch) _PyUnicode_ToNumeric(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	374
13352 d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	375 #define Py_UNICODE_ISALPHA(ch) iswalpha(ch)
d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	376
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	377 #else
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	378
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	379 /* Since splitting on whitespace is an important use case, and
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	380 whitespace in most situations is solely ASCII whitespace, we
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	381 optimize for the common case by using a quick look-up table
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	382 _Py_ascii_whitespace (see below) with an inlined check.
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	383
45056 c8fca9b5cd3c Merged revisions 60408-60440 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44999 diff changeset	384 */
c8fca9b5cd3c Merged revisions 60408-60440 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 44999 diff changeset	385 #define Py_UNICODE_ISSPACE(ch) \
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	386 ((ch) < 128U ? _Py_ascii_whitespace[(ch)] : _PyUnicode_IsWhitespace(ch))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	387
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	388 #define Py_UNICODE_ISLOWER(ch) _PyUnicode_IsLowercase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	389 #define Py_UNICODE_ISUPPER(ch) _PyUnicode_IsUppercase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	390 #define Py_UNICODE_ISTITLE(ch) _PyUnicode_IsTitlecase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	391 #define Py_UNICODE_ISLINEBREAK(ch) _PyUnicode_IsLinebreak(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	392
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	393 #define Py_UNICODE_TOLOWER(ch) _PyUnicode_ToLowercase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	394 #define Py_UNICODE_TOUPPER(ch) _PyUnicode_ToUppercase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	395 #define Py_UNICODE_TOTITLE(ch) _PyUnicode_ToTitlecase(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	396
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	397 #define Py_UNICODE_ISDECIMAL(ch) _PyUnicode_IsDecimalDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	398 #define Py_UNICODE_ISDIGIT(ch) _PyUnicode_IsDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	399 #define Py_UNICODE_ISNUMERIC(ch) _PyUnicode_IsNumeric(ch)
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	400 #define Py_UNICODE_ISPRINTABLE(ch) _PyUnicode_IsPrintable(ch)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	401
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	402 #define Py_UNICODE_TODECIMAL(ch) _PyUnicode_ToDecimalDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	403 #define Py_UNICODE_TODIGIT(ch) _PyUnicode_ToDigit(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	404 #define Py_UNICODE_TONUMERIC(ch) _PyUnicode_ToNumeric(ch)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	405
13352 d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	406 #define Py_UNICODE_ISALPHA(ch) _PyUnicode_IsAlpha(ch)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	407
13352 d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	408 #endif
13320 67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	409
67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	410 #define Py_UNICODE_ISALNUM(ch) \
67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	411 (Py_UNICODE_ISALPHA(ch) \|\| \
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	412 Py_UNICODE_ISDECIMAL(ch) \|\| \
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	413 Py_UNICODE_ISDIGIT(ch) \|\| \
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	414 Py_UNICODE_ISNUMERIC(ch))
13320 67a04816ea50 Added new Py_UNICODE_ISALPHA() and Py_UNICODE_ISALNUM() macros Marc-André Lemburg <mal@egenix.com> parents: 12956 diff changeset	415
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	416 #define Py_UNICODE_COPY(target, source, length) \
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	417 Py_MEMCPY((target), (source), (length)*sizeof(Py_UNICODE))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	418
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	419 #define Py_UNICODE_FILL(target, value, length) \
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	420 do {Py_ssize_t i_; Py_UNICODE *t_ = (target); Py_UNICODE v_ = (value);\
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	421 for (i_ = 0; i_ < (length); i_++) t_[i_] = v_;\
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	422 } while (0)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	423
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	424 /* Check if substring matches at given offset. The offset must be
52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	425 valid, and the substring must not be empty. */
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	426
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	427 #define Py_UNICODE_MATCH(string, offset, substring) \
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	428 ((((string)->str + (offset)) == ((substring)->str)) && \
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	429 ((((string)->str + (offset) + (substring)->length-1) == ((substring)->str + (substring)->length-1))) && \
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	430 !memcmp((string)->str + (offset), (substring)->str, (substring)->length*sizeof(Py_UNICODE)))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	431
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	432 #ifdef __cplusplus
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	433 extern "C" {
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	434 #endif
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	435
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	436 /* --- Unicode Type ------------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	437
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	438 typedef struct {
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	439 PyObject_HEAD
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	440 Py_ssize_t length; /* Length of raw Unicode data in buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	441 Py_UNICODE str; / Raw Unicode buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	442 long hash; /* Hash value; -1 if not set */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	443 int state; /* != 0 if interned. In this case the two
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	444 * references from the dictionary to this object
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	445 * are not counted in ob_refcnt. */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	446 PyObject defenc; / (Default) Encoded version as Python
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	447 string, or NULL; this is used for
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	448 implementing the buffer protocol */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	449 } PyUnicodeObject;
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	450
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	451 PyAPI_DATA(PyTypeObject) PyUnicode_Type;
44061 0cc552ab76bd Added all PyTypeObjects to the appropriate header files. Christian Heimes <christian@cheimes.de> parents: 43933 diff changeset	452 PyAPI_DATA(PyTypeObject) PyUnicodeIter_Type;
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	453
41876 dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	454 #define SSTATE_NOT_INTERNED 0
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	455 #define SSTATE_INTERNED_MORTAL 1
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	456 #define SSTATE_INTERNED_IMMORTAL 2
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	457
40909 f2f0b41f270d Merged revisions 53875-53911 via svnmerge from Thomas Wouters <thomas@python.org> parents: 39610 diff changeset	458 #define PyUnicode_Check(op) \
44351 86a2679dca46 #1629: Renamed Py_Size, Py_Type and Py_Refcnt to Py_SIZE, Py_TYPE and Py_REFCNT. Christian Heimes <christian@cheimes.de> parents: 44061 diff changeset	459 PyType_FastSubclass(Py_TYPE(op), Py_TPFLAGS_UNICODE_SUBCLASS)
86a2679dca46 #1629: Renamed Py_Size, Py_Type and Py_Refcnt to Py_SIZE, Py_TYPE and Py_REFCNT. Christian Heimes <christian@cheimes.de> parents: 44061 diff changeset	460 #define PyUnicode_CheckExact(op) (Py_TYPE(op) == &PyUnicode_Type)
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	461
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	462 /* Fast access macros */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	463 #define PyUnicode_GET_SIZE(op) \
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	464 (assert(PyUnicode_Check(op)),(((PyUnicodeObject *)(op))->length))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	465 #define PyUnicode_GET_DATA_SIZE(op) \
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	466 (assert(PyUnicode_Check(op)),(((PyUnicodeObject )(op))->length sizeof(Py_UNICODE)))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	467 #define PyUnicode_AS_UNICODE(op) \
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	468 (assert(PyUnicode_Check(op)),(((PyUnicodeObject *)(op))->str))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	469 #define PyUnicode_AS_DATA(op) \
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	470 (assert(PyUnicode_Check(op)),((const char )((PyUnicodeObject )(op))->str))
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	471
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	472 /* --- Constants ---------------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	473
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	474 /* This Unicode character will be used as replacement character during
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	475 decoding if the errors argument is set to "replace". Note: the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	476 Unicode character U+FFFD is the official REPLACEMENT CHARACTER in
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	477 Unicode 3.0. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	478
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	479 #define Py_UNICODE_REPLACEMENT_CHARACTER ((Py_UNICODE) 0xFFFD)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	480
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	481 /* === Public API ========================================================= */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	482
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	483 /* --- Plain Py_UNICODE --------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	484
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	485 /* Create a Unicode Object from the Py_UNICODE buffer u of the given
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	486 size.
17618 b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	487
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	488 u may be NULL which causes the contents to be undefined. It is the
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	489 user's responsibility to fill in the needed data afterwards. Note
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	490 that modifying the Unicode object contents after construction is
b44ba7c01217 This patch originated from an idea by Martin v. Loewis who submitted a Marc-André Lemburg <mal@egenix.com> parents: 13917 diff changeset	491 only allowed if u was set to NULL.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	492
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	493 The buffer is copied into the new object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	494
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	495 PyAPI_FUNC(PyObject*) PyUnicode_FromUnicode(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	496 const Py_UNICODE u, / Unicode buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	497 Py_ssize_t size /* size of buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	498 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	499
65113 c9879b3402e4 Merged revisions 82262,82269,82434,82480-82481,82484-82485,82487-82488,82594,82599,82615 via svnmerge from Georg Brandl <georg@python.org> parents: 61577 diff changeset	500 /* Similar to PyUnicode_FromUnicode(), but u points to UTF-8 encoded bytes */
41766 d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	501 PyAPI_FUNC(PyObject*) PyUnicode_FromStringAndSize(
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	502 const char u, / char buffer */
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	503 Py_ssize_t size /* size of buffer */
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	504 );
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	505
41619 61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	506 /* Similar to PyUnicode_FromUnicode(), but u points to null-terminated
65113 c9879b3402e4 Merged revisions 82262,82269,82434,82480-82481,82484-82485,82487-82488,82594,82599,82615 via svnmerge from Georg Brandl <georg@python.org> parents: 61577 diff changeset	507 UTF-8 encoded bytes */
41619 61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	508 PyAPI_FUNC(PyObject*) PyUnicode_FromString(
61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	509 const char u / string */
61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	510 );
61acfb831633 Add PyUnicode_FromString(), which create a unicode object from a Walter Dörwald <walter@livinglogic.de> parents: 41587 diff changeset	511
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	512 /* Return a read-only pointer to the Unicode object's internal
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	513 Py_UNICODE buffer. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	514
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	515 PyAPI_FUNC(Py_UNICODE *) PyUnicode_AsUnicode(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	516 PyObject unicode / Unicode object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	517 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	518
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	519 /* Get the length of the Unicode object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	520
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	521 PyAPI_FUNC(Py_ssize_t) PyUnicode_GetSize(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	522 PyObject unicode / Unicode object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	523 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	524
18298 982163c4e9d2 Encode surrogates in UTF-8 even for a wide Py_UNICODE. Martin v. Löwis <martin@v.loewis.de> parents: 18296 diff changeset	525 /* Get the maximum ordinal for a Unicode character. */
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	526 PyAPI_FUNC(Py_UNICODE) PyUnicode_GetMax(void);
18298 982163c4e9d2 Encode surrogates in UTF-8 even for a wide Py_UNICODE. Martin v. Löwis <martin@v.loewis.de> parents: 18296 diff changeset	527
12326 9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	528 /* Resize an already allocated Unicode object to the new size length.
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	529
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	530 *unicode is modified to point to the new (resized) object and 0
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	531 returned on success.
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	532
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	533 This API may only be called by the function which also called the
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	534 Unicode constructor. The refcount on the object must be 1. Otherwise,
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	535 an error is returned.
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	536
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	537 Error handling is implemented as follows: an exception is set, -1
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	538 is returned and *unicode left untouched.
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	539
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	540 */
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	541
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	542 PyAPI_FUNC(int) PyUnicode_Resize(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	543 PyObject *unicode, / Pointer to the Unicode object */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	544 Py_ssize_t length /* New length */
12326 9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	545 );
9488e4fdafe4 Marc-Andre Lemburg: New exported API PyUnicode_Resize(). Guido van Rossum <guido@python.org> parents: 12248 diff changeset	546
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	547 /* Coerce obj to an Unicode object and return a reference with
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	548 incremented refcount.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	549
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	550 Coercion is done in the following way:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	551
65113 c9879b3402e4 Merged revisions 82262,82269,82434,82480-82481,82484-82485,82487-82488,82594,82599,82615 via svnmerge from Georg Brandl <georg@python.org> parents: 61577 diff changeset	552 1. bytes, bytearray and other char buffer compatible objects are decoded
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	553 under the assumptions that they contain data using the UTF-8
52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	554 encoding. Decoding is done in "strict" mode.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	555
20554 0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	556 2. All other objects (including Unicode objects) raise an
0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	557 exception.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	558
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	559 The API returns NULL in case of an error. The caller is responsible
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	560 for decref'ing the returned objects.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	561
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	562 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	563
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	564 PyAPI_FUNC(PyObject*) PyUnicode_FromEncodedObject(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	565 register PyObject obj, / Object */
13401 8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	566 const char encoding, / encoding */
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	567 const char errors / error handling */
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	568 );
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	569
20554 0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	570 /* Coerce obj to an Unicode object and return a reference with
13401 8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	571 incremented refcount.
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	572
20554 0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	573 Unicode objects are passed back as-is (subclasses are converted to
0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	574 true Unicode objects), all other objects are delegated to
0336ee5b46d4 SF patch #470578: Fixes to synchronize unicode() and str() Guido van Rossum <guido@python.org> parents: 19998 diff changeset	575 PyUnicode_FromEncodedObject(obj, NULL, "strict") which results in
65113 c9879b3402e4 Merged revisions 82262,82269,82434,82480-82481,82484-82485,82487-82488,82594,82599,82615 via svnmerge from Georg Brandl <georg@python.org> parents: 61577 diff changeset	576 using UTF-8 encoding as basis for decoding the object.
13401 8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	577
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	578 The API returns NULL in case of an error. The caller is responsible
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	579 for decref'ing the returned objects.
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	580
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	581 */
8f1a2deeb9b0 Added new API PyUnicode_FromEncodedObject() which supports decoding Marc-André Lemburg <mal@egenix.com> parents: 13393 diff changeset	582
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	583 PyAPI_FUNC(PyObject*) PyUnicode_FromObject(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	584 register PyObject obj / Object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	585 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	586
41766 d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	587 PyAPI_FUNC(PyObject ) PyUnicode_FromFormatV(const char, va_list);
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	588 PyAPI_FUNC(PyObject ) PyUnicode_FromFormat(const char, ...);
d6aa7edf217a Add 'U'/'U#' format characters to Py_BuildValue (and thus Walter Dörwald <walter@livinglogic.de> parents: 41619 diff changeset	589
47393 0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	590 /* Format the object based on the format_spec, as defined in PEP 3101
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	591 (Advanced String Formatting). */
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	592 PyAPI_FUNC(PyObject ) _PyUnicode_FormatAdvanced(PyObject obj,
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	593 Py_UNICODE *format_spec,
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	594 Py_ssize_t format_spec_len);
0da27fdf0192 Refactor and clean up str.format() code (and helpers) in advance of optimizations. Eric Smith <eric@trueblade.com> parents: 46909 diff changeset	595
41876 dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	596 PyAPI_FUNC(void) PyUnicode_InternInPlace(PyObject **);
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	597 PyAPI_FUNC(void) PyUnicode_InternImmortal(PyObject **);
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	598 PyAPI_FUNC(PyObject ) PyUnicode_InternFromString(const char );
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	599 PyAPI_FUNC(void) _Py_ReleaseInternedUnicodeStrings(void);
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	600
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	601 /* Use only if you know it's a string */
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	602 #define PyUnicode_CHECK_INTERNED(op) (((PyUnicodeObject *)(op))->state)
dcb43f40390b Add interning of unicode strings by copying the functionality from Walter Dörwald <walter@livinglogic.de> parents: 41769 diff changeset	603
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	604 /* --- wchar_t support for platforms which support it --------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	605
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	606 #ifdef HAVE_WCHAR_H
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	607
65113 c9879b3402e4 Merged revisions 82262,82269,82434,82480-82481,82484-82485,82487-82488,82594,82599,82615 via svnmerge from Georg Brandl <georg@python.org> parents: 61577 diff changeset	608 /* Create a Unicode Object from the wchar_t buffer w of the given
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	609 size.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	610
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	611 The buffer is copied into the new object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	612
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	613 PyAPI_FUNC(PyObject*) PyUnicode_FromWideChar(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	614 register const wchar_t w, / wchar_t buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	615 Py_ssize_t size /* size of buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	616 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	617
34016 264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	618 /* Copies the Unicode Object contents into the wchar_t buffer w. At
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	619 most size wchar_t characters are copied.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	620
34016 264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	621 Note that the resulting wchar_t string may or may not be
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	622 0-terminated. It is the responsibility of the caller to make sure
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	623 that the wchar_t string is 0-terminated in case this is required by
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	624 the application.
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	625
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	626 Returns the number of wchar_t characters copied (excluding a
264e45baacd5 Correct the handling of 0-termination of PyUnicode_AsWideChar() Marc-André Lemburg <mal@egenix.com> parents: 33864 diff changeset	627 possibly trailing 0-termination character) or -1 in case of an
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	628 error. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	629
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	630 PyAPI_FUNC(Py_ssize_t) PyUnicode_AsWideChar(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	631 PyUnicodeObject unicode, / Unicode object */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	632 register wchar_t w, / wchar_t buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	633 Py_ssize_t size /* size of buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	634 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	635
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	636 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	637
24737 eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	638 /* --- Unicode ordinals --------------------------------------------------- */
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	639
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	640 /* Create a Unicode Object from the given Unicode code point ordinal.
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	641
24737 eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	642 The ordinal must be in range(0x10000) on narrow Python builds
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	643 (UCS2), and range(0x110000) on wide builds (UCS4). A ValueError is
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	644 raised in case it is not.
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	645
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	646 */
eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	647
24753 27ae978bee58 Add name mangling for new PyUnicode_FromOrdinal() and fix declaration Marc-André Lemburg <mal@egenix.com> parents: 24752 diff changeset	648 PyAPI_FUNC(PyObject*) PyUnicode_FromOrdinal(int ordinal);
24737 eaa87632b1e8 Add C API PyUnicode_FromOrdinal() which exposes unichr() at C level. Marc-André Lemburg <mal@egenix.com> parents: 23561 diff changeset	649
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	650 /* --- Free-list management ----------------------------------------------- */
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	651
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	652 /* Clear the free list used by the Unicode implementation.
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	653
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	654 This can be used to release memory used for objects on the free
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	655 list back to the Python memory allocator.
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	656
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	657 */
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	658
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	659 PyAPI_FUNC(int) PyUnicode_ClearFreeList(void);
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	660
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	661 /* === Builtin Codecs =====================================================
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	662
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	663 Many of these APIs take two arguments encoding and errors. These
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	664 parameters encoding and errors have the same semantics as the ones
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	665 of the builtin str() API.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	666
65113 c9879b3402e4 Merged revisions 82262,82269,82434,82480-82481,82484-82485,82487-82488,82594,82599,82615 via svnmerge from Georg Brandl <georg@python.org> parents: 61577 diff changeset	667 Setting encoding to NULL causes the default encoding (UTF-8) to be used.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	668
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	669 Error handling is set by errors which may also be set to NULL
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	670 meaning to use the default handling defined for the codec. Default
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	671 error handling for all builtin codecs is "strict" (ValueErrors are
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	672 raised).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	673
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	674 The codecs all use a similar interface. Only deviation from the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	675 generic ones are documented.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	676
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	677 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	678
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	679 /* --- Manage the default encoding ---------------------------------------- */
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	680
18887 9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	681 /* Return a Python string holding the default encoded value of the
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	682 Unicode object.
18887 9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	683
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	684 Same as PyUnicode_AsUTF8String() except
52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	685 the resulting string is cached in the Unicode object for subsequent
18887 9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	686 usage by this function. The cached version is needed to implement
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	687 the character buffer interface and will live (at least) as long as
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	688 the Unicode object itself.
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	689
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	690 The refcount of the string is not incremented.
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	691
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	692 * Exported for internal use by the interpreter only !!! *
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	693
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	694 */
9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	695
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	696 PyAPI_FUNC(PyObject *) _PyUnicode_AsDefaultEncodedString(
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	697 PyObject *unicode,
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	698 const char *errors);
18887 9b291ca6546c Add _PyUnicode_AsDefaultEncodedString to unicodeobject.h. Jeremy Hylton <jeremy@alum.mit.edu> parents: 18332 diff changeset	699
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	700 /* Returns a pointer to the default encoding (UTF-8) of the
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	701 Unicode object unicode and the size of the encoded representation
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	702 in bytes stored in *size.
43761 658cd34a8c5d Fixed a bug in PyUnicode_DecodeFSDefault. strcmp() returns 0 on success. Christian Heimes <christian@cheimes.de> parents: 43569 diff changeset	703
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	704 In case of an error, no *size is set.
42984 3a56e73ae919 Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() but Guido van Rossum <guido@python.org> parents: 42896 diff changeset	705
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	706 *** This API is for interpreter INTERNAL USE ONLY and will likely
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	707 *** be removed or changed in the future.
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	708
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	709 *** If you need to access the Unicode object as UTF-8 bytes string,
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	710 *** please use PyUnicode_AsUTF8String() instead.
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	711
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	712 */
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	713
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	714 PyAPI_FUNC(char *) _PyUnicode_AsStringAndSize(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	715 PyObject *unicode,
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	716 Py_ssize_t *size);
42984 3a56e73ae919 Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() but Guido van Rossum <guido@python.org> parents: 42896 diff changeset	717
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	718 /* Returns a pointer to the default encoding (UTF-8) of the
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	719 Unicode object unicode.
42984 3a56e73ae919 Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() but Guido van Rossum <guido@python.org> parents: 42896 diff changeset	720
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	721 Use of this API is DEPRECATED since no size information can be
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	722 extracted from the returned data.
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	723
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	724 *** This API is for interpreter INTERNAL USE ONLY and will likely
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	725 *** be removed or changed for Python 3.1.
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	726
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	727 *** If you need to access the Unicode object as UTF-8 bytes string,
85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	728 *** please use PyUnicode_AsUTF8String() instead.
42984 3a56e73ae919 Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() but Guido van Rossum <guido@python.org> parents: 42896 diff changeset	729
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	730 */
0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	731
48660 85b67fb5672b Rename PyUnicode_AsString -> _PyUnicode_AsString and Marc-André Lemburg <mal@egenix.com> parents: 48358 diff changeset	732 PyAPI_FUNC(char ) _PyUnicode_AsString(PyObject unicode);
46598 0154df250ef6 Cleanup the Unicode header documentation and formatting a bit. Marc-André Lemburg <mal@egenix.com> parents: 45371 diff changeset	733
66206 52fe60216e89 Merged revisions 86478 via svnmerge from Alexander Belopolsky <alexander.belopolsky@gmail.com> parents: 65113 diff changeset	734 /* Returns "utf-8". */
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	735
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	736 PyAPI_FUNC(const char*) PyUnicode_GetDefaultEncoding(void);
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	737
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	738 /* Sets the currently active default encoding.
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	739
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	740 Returns 0 on success, -1 in case of an error.
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	741
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	742 */
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	743
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	744 PyAPI_FUNC(int) PyUnicode_SetDefaultEncoding(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	745 const char encoding / Encoding name in standard form */
12643 06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	746 );
06ff966f69d5 M.-A. Lemburg <mal@lemburg.com>: Fred Drake <fdrake@acm.org> parents: 12372 diff changeset	747
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	748 /* --- Generic Codecs ----------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	749
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	750 /* Create a Unicode object by decoding the encoded string s of the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	751 given size. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	752
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	753 PyAPI_FUNC(PyObject*) PyUnicode_Decode(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	754 const char s, / encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	755 Py_ssize_t size, /* size of buffer */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	756 const char encoding, / encoding */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	757 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	758 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	759
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	760 /* Decode a Unicode object unicode and return the result as Python
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	761 object. */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	762
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	763 PyAPI_FUNC(PyObject*) PyUnicode_AsDecodedObject(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	764 PyObject unicode, / Unicode object */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	765 const char encoding, / encoding */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	766 const char errors / error handling */
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	767 );
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	768
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	769 /* Decode a Unicode object unicode and return the result as Unicode
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	770 object. */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	771
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	772 PyAPI_FUNC(PyObject*) PyUnicode_AsDecodedUnicode(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	773 PyObject unicode, / Unicode object */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	774 const char encoding, / encoding */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	775 const char errors / error handling */
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	776 );
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	777
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	778 /* Encodes a Py_UNICODE buffer of the given size and returns a
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	779 Python string object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	780
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	781 PyAPI_FUNC(PyObject*) PyUnicode_Encode(
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	782 const Py_UNICODE s, / Unicode char buffer */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	783 Py_ssize_t size, /* number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	784 const char encoding, / encoding */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	785 const char errors / error handling */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	786 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	787
32551 f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	788 /* Encodes a Unicode object and returns the result as Python
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	789 object. */
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	790
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	791 PyAPI_FUNC(PyObject*) PyUnicode_AsEncodedObject(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	792 PyObject unicode, / Unicode object */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	793 const char encoding, / encoding */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	794 const char errors / error handling */
32551 f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	795 );
f46d49e2e0f0 Allow string and unicode return types from .encode()/.decode() Marc-André Lemburg <mal@egenix.com> parents: 32197 diff changeset	796
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	797 /* Encodes a Unicode object and returns the result as Python string
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	798 object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	799
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	800 PyAPI_FUNC(PyObject*) PyUnicode_AsEncodedString(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	801 PyObject unicode, / Unicode object */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	802 const char encoding, / encoding */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	803 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	804 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	805
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	806 /* Encodes a Unicode object and returns the result as Unicode
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	807 object. */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	808
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	809 PyAPI_FUNC(PyObject*) PyUnicode_AsEncodedUnicode(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	810 PyObject unicode, / Unicode object */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	811 const char encoding, / encoding */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	812 const char errors / error handling */
47496 2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	813 );
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	814
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	815 /* Build an encoding map. */
2284fa89ab08 Move the codec decode type checks to bytes/bytearray.decode(). Marc-André Lemburg <mal@egenix.com> parents: 47463 diff changeset	816
38673 a19c20c5e5c7 Merge the rest of the trunk. Thomas Wouters <thomas@python.org> parents: 38669 diff changeset	817 PyAPI_FUNC(PyObject*) PyUnicode_BuildEncodingMap(
a19c20c5e5c7 Merge the rest of the trunk. Thomas Wouters <thomas@python.org> parents: 38669 diff changeset	818 PyObject* string /* 256 character map */
a19c20c5e5c7 Merge the rest of the trunk. Thomas Wouters <thomas@python.org> parents: 38669 diff changeset	819 );
a19c20c5e5c7 Merge the rest of the trunk. Thomas Wouters <thomas@python.org> parents: 38669 diff changeset	820
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	821 /* --- UTF-7 Codecs ------------------------------------------------------- */
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	822
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	823 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF7(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	824 const char string, / UTF-7 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	825 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	826 const char errors / error handling */
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	827 );
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	828
43933 9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	829 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF7Stateful(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	830 const char string, / UTF-7 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	831 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	832 const char errors, / error handling */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	833 Py_ssize_t consumed / bytes consumed */
43933 9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	834 );
9c4bf18e5d30 Merged revisions 59056-59076 via svnmerge from Christian Heimes <christian@cheimes.de> parents: 43761 diff changeset	835
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	836 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUTF7(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	837 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	838 Py_ssize_t length, /* number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	839 int base64SetO, /* Encode RFC2152 Set O characters in base64 */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	840 int base64WhiteSpace, /* Encode whitespace (sp, ht, nl, cr) in base64 */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	841 const char errors / error handling */
19998 8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	842 );
8a0c97453df4 Patch #435971: UTF-7 codec by Brian Quinlan. Marc-André Lemburg <mal@egenix.com> parents: 19980 diff changeset	843
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	844 /* --- UTF-8 Codecs ------------------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	845
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	846 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF8(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	847 const char string, / UTF-8 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	848 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	849 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	850 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	851
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	852 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF8Stateful(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	853 const char string, / UTF-8 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	854 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	855 const char errors, / error handling */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	856 Py_ssize_t consumed / bytes consumed */
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	857 );
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	858
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	859 PyAPI_FUNC(PyObject*) PyUnicode_AsUTF8String(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	860 PyObject unicode / Unicode object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	861 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	862
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	863 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUTF8(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	864 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	865 Py_ssize_t length, /* number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	866 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	867 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	868
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	869 /* --- UTF-32 Codecs ------------------------------------------------------ */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	870
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	871 /* Decodes length bytes from a UTF-32 encoded buffer string and returns
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	872 the corresponding Unicode object.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	873
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	874 errors (if non-NULL) defines the error handling. It defaults
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	875 to "strict".
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	876
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	877 If byteorder is non-NULL, the decoder starts decoding using the
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	878 given byte order:
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	879
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	880 *byteorder == -1: little endian
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	881 *byteorder == 0: native order
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	882 *byteorder == 1: big endian
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	883
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	884 In native mode, the first four bytes of the stream are checked for a
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	885 BOM mark. If found, the BOM mark is analysed, the byte order
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	886 adjusted and the BOM skipped. In the other modes, no BOM mark
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	887 interpretation is done. After completion, *byteorder is set to the
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	888 current byte order at the end of input data.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	889
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	890 If byteorder is NULL, the codec starts in native order mode.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	891
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	892 */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	893
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	894 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF32(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	895 const char string, / UTF-32 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	896 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	897 const char errors, / error handling */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	898 int byteorder / pointer to byteorder to use
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	899 0=native;-1=LE,1=BE; updated on
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	900 exit */
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	901 );
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	902
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	903 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF32Stateful(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	904 const char string, / UTF-32 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	905 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	906 const char errors, / error handling */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	907 int byteorder, / pointer to byteorder to use
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	908 0=native;-1=LE,1=BE; updated on
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	909 exit */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	910 Py_ssize_t consumed / bytes consumed */
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	911 );
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	912
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	913 /* Returns a Python string using the UTF-32 encoding in native byte
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	914 order. The string always starts with a BOM mark. */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	915
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	916 PyAPI_FUNC(PyObject*) PyUnicode_AsUTF32String(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	917 PyObject unicode / Unicode object */
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	918 );
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	919
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	920 /* Returns a Python string object holding the UTF-32 encoded value of
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	921 the Unicode data.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	922
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	923 If byteorder is not 0, output is written according to the following
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	924 byte order:
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	925
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	926 byteorder == -1: little endian
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	927 byteorder == 0: native byte order (writes a BOM mark)
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	928 byteorder == 1: big endian
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	929
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	930 If byteorder is 0, the output string will always start with the
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	931 Unicode BOM mark (U+FEFF). In the other two modes, no BOM mark is
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	932 prepended.
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	933
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	934 */
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	935
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	936 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUTF32(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	937 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	938 Py_ssize_t length, /* number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	939 const char errors, / error handling */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	940 int byteorder /* byteorder to use 0=BOM+native;-1=LE,1=BE */
42626 f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	941 );
f1a2d51f1cab Apply SF patch #1775604: This adds three new codecs (utf-32, utf-32-le and Walter Dörwald <walter@livinglogic.de> parents: 42597 diff changeset	942
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	943 /* --- UTF-16 Codecs ------------------------------------------------------ */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	944
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	945 /* Decodes length bytes from a UTF-16 encoded buffer string and returns
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	946 the corresponding Unicode object.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	947
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	948 errors (if non-NULL) defines the error handling. It defaults
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	949 to "strict".
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	950
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	951 If byteorder is non-NULL, the decoder starts decoding using the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	952 given byte order:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	953
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	954 *byteorder == -1: little endian
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	955 *byteorder == 0: native order
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	956 *byteorder == 1: big endian
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	957
17887 fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	958 In native mode, the first two bytes of the stream are checked for a
fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	959 BOM mark. If found, the BOM mark is analysed, the byte order
fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	960 adjusted and the BOM skipped. In the other modes, no BOM mark
fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	961 interpretation is done. After completion, *byteorder is set to the
fd5f83188778 This patch changes the behaviour of the UTF-16 codec family. Only the Marc-André Lemburg <mal@egenix.com> parents: 17618 diff changeset	962 current byte order at the end of input data.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	963
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	964 If byteorder is NULL, the codec starts in native order mode.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	965
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	966 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	967
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	968 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF16(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	969 const char string, / UTF-16 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	970 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	971 const char errors, / error handling */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	972 int byteorder / pointer to byteorder to use
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	973 0=native;-1=LE,1=BE; updated on
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	974 exit */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	975 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	976
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	977 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUTF16Stateful(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	978 const char string, / UTF-16 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	979 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	980 const char errors, / error handling */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	981 int byteorder, / pointer to byteorder to use
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	982 0=native;-1=LE,1=BE; updated on
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	983 exit */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	984 Py_ssize_t consumed / bytes consumed */
33428 57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	985 );
57478a13fbf6 SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now support Walter Dörwald <walter@livinglogic.de> parents: 32951 diff changeset	986
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	987 /* Returns a Python string using the UTF-16 encoding in native byte
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	988 order. The string always starts with a BOM mark. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	989
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	990 PyAPI_FUNC(PyObject*) PyUnicode_AsUTF16String(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	991 PyObject unicode / Unicode object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	992 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	993
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	994 /* Returns a Python string object holding the UTF-16 encoded value of
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	995 the Unicode data.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	996
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	997 If byteorder is not 0, output is written according to the following
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	998 byte order:
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	999
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1000 byteorder == -1: little endian
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1001 byteorder == 0: native byte order (writes a BOM mark)
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1002 byteorder == 1: big endian
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1003
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1004 If byteorder is 0, the output string will always start with the
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1005 Unicode BOM mark (U+FEFF). In the other two modes, no BOM mark is
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1006 prepended.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1007
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1008 Note that Py_UNICODE data is being interpreted as UTF-16 reduced to
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1009 UCS-2. This trick makes it possible to add full UTF-16 capabilities
13620 5b727ab37092 Spelling fixes supplied by Rob W. W. Hooft. All these are fixes in either Thomas Wouters <thomas@python.org> parents: 13401 diff changeset	1010 at a later point without compromising the APIs.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1011
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1012 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1013
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1014 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUTF16(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1015 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1016 Py_ssize_t length, /* number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1017 const char errors, / error handling */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1018 int byteorder /* byteorder to use 0=BOM+native;-1=LE,1=BE */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1019 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1020
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1021 /* --- Unicode-Escape Codecs ---------------------------------------------- */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1022
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1023 PyAPI_FUNC(PyObject*) PyUnicode_DecodeUnicodeEscape(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1024 const char string, / Unicode-Escape encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1025 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1026 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1027 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1028
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1029 PyAPI_FUNC(PyObject*) PyUnicode_AsUnicodeEscapeString(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1030 PyObject unicode / Unicode object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1031 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1032
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1033 PyAPI_FUNC(PyObject*) PyUnicode_EncodeUnicodeEscape(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1034 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1035 Py_ssize_t length /* Number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1036 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1037
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1038 /* --- Raw-Unicode-Escape Codecs ------------------------------------------ */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1039
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1040 PyAPI_FUNC(PyObject*) PyUnicode_DecodeRawUnicodeEscape(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1041 const char string, / Raw-Unicode-Escape encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1042 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1043 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1044 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1045
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1046 PyAPI_FUNC(PyObject*) PyUnicode_AsRawUnicodeEscapeString(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1047 PyObject unicode / Unicode object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1048 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1049
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1050 PyAPI_FUNC(PyObject*) PyUnicode_EncodeRawUnicodeEscape(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1051 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1052 Py_ssize_t length /* Number of Py_UNICODE chars to encode */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1053 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1054
35485 6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1055 /* --- Unicode Internal Codec ---------------------------------------------
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1056
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1057 Only for internal use in _codecsmodule.c */
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1058
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1059 PyObject *_PyUnicode_DecodeUnicodeInternal(
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1060 const char *string,
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1061 Py_ssize_t length,
35485 6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1062 const char *errors
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1063 );
6b8c55877755 Backport checkin: Walter Dörwald <walter@livinglogic.de> parents: 34016 diff changeset	1064
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1065 /* --- Latin-1 Codecs -----------------------------------------------------
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1066
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1067 Note: Latin-1 corresponds to the first 256 Unicode ordinals.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1068
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1069 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1070
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1071 PyAPI_FUNC(PyObject*) PyUnicode_DecodeLatin1(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1072 const char string, / Latin-1 encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1073 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1074 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1075 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1076
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1077 PyAPI_FUNC(PyObject*) PyUnicode_AsLatin1String(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1078 PyObject unicode / Unicode object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1079 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1080
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1081 PyAPI_FUNC(PyObject*) PyUnicode_EncodeLatin1(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1082 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1083 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1084 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1085 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1086
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1087 /* --- ASCII Codecs -------------------------------------------------------
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1088
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1089 Only 7-bit ASCII data is excepted. All other codes generate errors.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1090
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1091 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1092
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1093 PyAPI_FUNC(PyObject*) PyUnicode_DecodeASCII(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1094 const char string, / ASCII encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1095 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1096 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1097 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1098
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1099 PyAPI_FUNC(PyObject*) PyUnicode_AsASCIIString(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1100 PyObject unicode / Unicode object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1101 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1102
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1103 PyAPI_FUNC(PyObject*) PyUnicode_EncodeASCII(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1104 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1105 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1106 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1107 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1108
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1109 /* --- Character Map Codecs -----------------------------------------------
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1110
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1111 This codec uses mappings to encode and decode characters.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1112
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1113 Decoding mappings must map single string characters to single
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1114 Unicode characters, integers (which are then interpreted as Unicode
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1115 ordinals) or None (meaning "undefined mapping" and causing an
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1116 error).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1117
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1118 Encoding mappings must map single Unicode characters to single
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1119 string characters, integers (which are then interpreted as Latin-1
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1120 ordinals) or None (meaning "undefined mapping" and causing an
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1121 error).
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1122
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1123 If a character lookup fails with a LookupError, the character is
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1124 copied as-is meaning that its ordinal value will be interpreted as
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1125 Unicode or Latin-1 ordinal resp. Because of this mappings only need
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1126 to contain those mappings which map characters to different code
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1127 points.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1128
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1129 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1130
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1131 PyAPI_FUNC(PyObject*) PyUnicode_DecodeCharmap(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1132 const char string, / Encoded string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1133 Py_ssize_t length, /* size of string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1134 PyObject mapping, / character mapping
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1135 (char ordinal -> unicode ordinal) */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1136 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1137 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1138
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1139 PyAPI_FUNC(PyObject*) PyUnicode_AsCharmapString(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1140 PyObject unicode, / Unicode object */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1141 PyObject mapping / character mapping
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1142 (unicode ordinal -> char ordinal) */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1143 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1144
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1145 PyAPI_FUNC(PyObject*) PyUnicode_EncodeCharmap(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1146 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1147 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1148 PyObject mapping, / character mapping
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1149 (unicode ordinal -> char ordinal) */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1150 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1151 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1152
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1153 /* Translate a Py_UNICODE buffer of the given length by applying a
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1154 character mapping table to it and return the resulting Unicode
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1155 object.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1156
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1157 The mapping table must map Unicode ordinal integers to Unicode
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1158 ordinal integers or None (causing deletion of the character).
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1159
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1160 Mapping tables may be dictionaries or sequences. Unmapped character
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1161 ordinals (ones which cause a LookupError) are left untouched and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1162 are copied as-is.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1163
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1164 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1165
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1166 PyAPI_FUNC(PyObject *) PyUnicode_TranslateCharmap(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1167 const Py_UNICODE data, / Unicode char buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1168 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1169 PyObject table, / Translate table */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1170 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1171 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1172
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1173 #ifdef MS_WIN32
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	1174
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1175 /* --- MBCS codecs for Windows -------------------------------------------- */
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	1176
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1177 PyAPI_FUNC(PyObject*) PyUnicode_DecodeMBCS(
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1178 const char string, / MBCS encoded string */
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1179 Py_ssize_t length, /* size of string */
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1180 const char errors / error handling */
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1181 );
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1182
39442 654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1183 PyAPI_FUNC(PyObject*) PyUnicode_DecodeMBCSStateful(
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1184 const char string, / MBCS encoded string */
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1185 Py_ssize_t length, /* size of string */
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1186 const char errors, / error handling */
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1187 Py_ssize_t consumed / bytes consumed */
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1188 );
654c380cf8b9 Merged revisions 46753-51188 via svnmerge from Thomas Wouters <thomas@python.org> parents: 38673 diff changeset	1189
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1190 PyAPI_FUNC(PyObject*) PyUnicode_AsMBCSString(
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1191 PyObject unicode / Unicode object */
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1192 );
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1193
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1194 PyAPI_FUNC(PyObject*) PyUnicode_EncodeMBCS(
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1195 const Py_UNICODE data, / Unicode char buffer */
42490 b56a8d822f21 Whitespace normalization. Neal Norwitz <nnorwitz@gmail.com> parents: 42334 diff changeset	1196 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1197 const char errors / error handling */
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1198 );
86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1199
12074 65f35b73e350 Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12066 diff changeset	1200 #endif /* MS_WIN32 */
12066 86cffe50fb17 Prototypes added for MBCS codecs. (Win32 only.) Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1201
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1202 /* --- Decimal Encoder ---------------------------------------------------- */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1203
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1204 /* Takes a Unicode string holding a decimal value and writes it into
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1205 an output buffer using standard ASCII digit codes.
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1206
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1207 The output buffer has to provide at least length+1 bytes of storage
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1208 area. The output string is 0-terminated.
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1209
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1210 The encoder converts whitespace to ' ', decimal characters to their
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1211 corresponding ASCII digit and all other Latin-1 characters except
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1212 \0 as-is. Characters outside this range (Unicode ordinals 1-256)
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1213 are treated as errors. This includes embedded NULL bytes.
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1214
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1215 Error handling is defined by the errors argument:
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1216
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1217 NULL or "strict": raise a ValueError
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1218 "ignore": ignore the wrong characters (these are not copied to the
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1219 output buffer)
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1220 "replace": replaces illegal characters with '?'
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1221
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1222 Returns 0 on success, -1 on failure.
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1223
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1224 */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1225
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1226 PyAPI_FUNC(int) PyUnicode_EncodeDecimal(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1227 Py_UNICODE s, / Unicode buffer */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1228 Py_ssize_t length, /* Number of Py_UNICODE chars to encode */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1229 char output, / Output buffer; must have size >= length */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1230 const char errors / error handling */
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1231 );
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12074 diff changeset	1232
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1233 /* --- File system encoding ---------------------------------------------- */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1234
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1235 /* ParseTuple converter which converts a Unicode object into the file
61577 2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1236 system encoding as a bytes object, using the "surrogateescape" error
2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1237 handler; bytes objects are output as-is. */
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1238
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1239 PyAPI_FUNC(int) PyUnicode_FSConverter(PyObject, void);
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1240
61577 2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1241 /* Decode a null-terminated string using Py_FileSystemDefaultEncoding
2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1242 and the "surrogateescape" error handler.
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1243
61577 2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1244 If Py_FileSystemDefaultEncoding is not set, fall back to UTF-8.
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1245
61577 2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1246 Use PyUnicode_DecodeFSDefaultAndSize() if you have the string length.
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1247 */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1248
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1249 PyAPI_FUNC(PyObject*) PyUnicode_DecodeFSDefault(
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1250 const char s / encoded string */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1251 );
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1252
61577 2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1253 /* Decode a string using Py_FileSystemDefaultEncoding
2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1254 and the "surrogateescape" error handler.
2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1255
2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1256 If Py_FileSystemDefaultEncoding is not set, fall back to UTF-8.
2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1257 */
2b0af69aef97 Merged revisions 81168 via svnmerge from Victor Stinner <victor.stinner@haypocalc.com> parents: 61467 diff changeset	1258
53767 ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1259 PyAPI_FUNC(PyObject*) PyUnicode_DecodeFSDefaultAndSize(
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1260 const char s, / encoded string */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1261 Py_ssize_t size /* size */
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1262 );
ac209f132b17 Issue #5915: Implement PEP 383, Non-decodable Bytes in Martin v. Löwis <martin@v.loewis.de> parents: 53742 diff changeset	1263
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1264 /* --- Methods & Slots ----------------------------------------------------
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1265
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1266 These are capable of handling Unicode objects and strings on input
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1267 (we refer to them as strings in the descriptions) and return
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1268 Unicode objects or integers as apporpriate. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1269
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1270 /* Concat two strings giving a new Unicode string. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1271
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1272 PyAPI_FUNC(PyObject*) PyUnicode_Concat(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1273 PyObject left, / Left string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1274 PyObject right / Right string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1275 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1276
41769 b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1277 /* Concat two strings and put the result in *pleft
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1278 (sets pleft to NULL on error) /
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1279
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1280 PyAPI_FUNC(void) PyUnicode_Append(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1281 PyObject *pleft, / Pointer to left string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1282 PyObject right / Right string */
41769 b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1283 );
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1284
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1285 /* Concat two strings, put the result in *pleft and drop the right object
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1286 (sets pleft to NULL on error) /
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1287
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1288 PyAPI_FUNC(void) PyUnicode_AppendAndDel(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1289 PyObject *pleft, / Pointer to left string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1290 PyObject right / Right string */
41769 b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1291 );
b29d71d43c80 Add functions PyUnicode_Append() and PyUnicode_AppendAndDel() that mirror Walter Dörwald <walter@livinglogic.de> parents: 41768 diff changeset	1292
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1293 /* Split a string giving a list of Unicode strings.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1294
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1295 If sep is NULL, splitting will be done at all whitespace
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1296 substrings. Otherwise, splits occur at the given separator.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1297
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1298 At most maxsplit splits will be done. If negative, no limit is set.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1299
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1300 Separators are not included in the resulting list.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1301
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1302 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1303
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1304 PyAPI_FUNC(PyObject*) PyUnicode_Split(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1305 PyObject s, / String to split */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1306 PyObject sep, / String separator */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1307 Py_ssize_t maxsplit /* Maxsplit count */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1308 );
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1309
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1310 /* Dito, but split at line breaks.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1311
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1312 CRLF is considered to be one line break. Line breaks are not
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1313 included in the resulting list. */
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1314
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1315 PyAPI_FUNC(PyObject*) PyUnicode_Splitlines(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1316 PyObject s, / String to split */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1317 int keepends /* If true, line end markers are included */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1318 );
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1319
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1320 /* Partition a string using a given separator. */
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1321
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1322 PyAPI_FUNC(PyObject*) PyUnicode_Partition(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1323 PyObject s, / String to partition */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1324 PyObject sep / String separator */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1325 );
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1326
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1327 /* Partition a string using a given separator, searching from the end of the
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1328 string. */
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1329
29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1330 PyAPI_FUNC(PyObject*) PyUnicode_RPartition(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1331 PyObject s, / String to partition */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1332 PyObject sep / String separator */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1333 );
38453 29ae5e0fc348 Much-needed merge (using svnmerge.py this time) of trunk changes into p3yk. Thomas Wouters <thomas@python.org> parents: 36501 diff changeset	1334
31199 504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1335 /* Split a string giving a list of Unicode strings.
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1336
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1337 If sep is NULL, splitting will be done at all whitespace
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1338 substrings. Otherwise, splits occur at the given separator.
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1339
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1340 At most maxsplit splits will be done. But unlike PyUnicode_Split
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1341 PyUnicode_RSplit splits from the end of the string. If negative,
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1342 no limit is set.
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1343
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1344 Separators are not included in the resulting list.
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1345
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1346 */
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1347
504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1348 PyAPI_FUNC(PyObject*) PyUnicode_RSplit(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1349 PyObject s, / String to split */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1350 PyObject sep, / String separator */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1351 Py_ssize_t maxsplit /* Maxsplit count */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1352 );
31199 504943c89193 Add rsplit method for str and unicode builtin types. Hye-Shik Chang <hyeshik@gmail.com> parents: 24753 diff changeset	1353
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1354 /* Translate a string by applying a character mapping table to it and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1355 return the resulting Unicode object.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1356
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1357 The mapping table must map Unicode ordinal integers to Unicode
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1358 ordinal integers or None (causing deletion of the character).
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1359
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1360 Mapping tables may be dictionaries or sequences. Unmapped character
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1361 ordinals (ones which cause a LookupError) are left untouched and
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1362 are copied as-is.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1363
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1364 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1365
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1366 PyAPI_FUNC(PyObject *) PyUnicode_Translate(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1367 PyObject str, / String */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1368 PyObject table, / Translate table */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1369 const char errors / error handling */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1370 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1371
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1372 /* Join a sequence of strings using the given separator and return
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1373 the resulting Unicode string. */
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1374
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1375 PyAPI_FUNC(PyObject*) PyUnicode_Join(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1376 PyObject separator, / Separator string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1377 PyObject seq / Sequence object */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1378 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1379
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1380 /* Return 1 if substr matches str[start:end] at the given tail end, 0
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1381 otherwise. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1382
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1383 PyAPI_FUNC(Py_ssize_t) PyUnicode_Tailmatch(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1384 PyObject str, / String */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1385 PyObject substr, / Prefix or Suffix string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1386 Py_ssize_t start, /* Start index */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1387 Py_ssize_t end, /* Stop index */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1388 int direction /* Tail end: -1 prefix, +1 suffix */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1389 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1390
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1391 /* Return the first position of substr in str[start:end] using the
23561 c5e8f89fd358 Fix for bug [ 561796 ] string.find causes lazy error Marc-André Lemburg <mal@egenix.com> parents: 23225 diff changeset	1392 given search direction or -1 if not found. -2 is returned in case
c5e8f89fd358 Fix for bug [ 561796 ] string.find causes lazy error Marc-André Lemburg <mal@egenix.com> parents: 23225 diff changeset	1393 an error occurred and an exception is set. */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1394
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1395 PyAPI_FUNC(Py_ssize_t) PyUnicode_Find(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1396 PyObject str, / String */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1397 PyObject substr, / Substring to find */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1398 Py_ssize_t start, /* Start index */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1399 Py_ssize_t end, /* Stop index */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1400 int direction /* Find direction: +1 forward, -1 backward */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1401 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1402
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	1403 /* Count the number of occurrences of substr in str[start:end]. */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1404
36501 7fdc639bc5b4 Merge ssize_t branch. Martin v. Löwis <martin@v.loewis.de> parents: 35808 diff changeset	1405 PyAPI_FUNC(Py_ssize_t) PyUnicode_Count(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1406 PyObject str, / String */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1407 PyObject substr, / Substring to count */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1408 Py_ssize_t start, /* Start index */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1409 Py_ssize_t end /* Stop index */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1410 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1411
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 12002 diff changeset	1412 /* Replace at most maxcount occurrences of substr in str with replstr
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1413 and return the resulting Unicode object. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1414
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1415 PyAPI_FUNC(PyObject *) PyUnicode_Replace(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1416 PyObject str, / String */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1417 PyObject substr, / Substring to find */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1418 PyObject replstr, / Substring to replace */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1419 Py_ssize_t maxcount /* Max. number of replacements to apply;
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1420 -1 = all */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1421 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1422
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1423 /* Compare two strings and return -1, 0, 1 for less than, equal,
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1424 greater than resp. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1425
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1426 PyAPI_FUNC(int) PyUnicode_Compare(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1427 PyObject left, / Left string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1428 PyObject right / Right string */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1429 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1430
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1431 PyAPI_FUNC(int) PyUnicode_CompareWithASCIIString(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1432 PyObject *left,
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1433 const char *right
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1434 );
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1435
39610 3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1436 /* Rich compare two strings and return one of the following:
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1437
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1438 - NULL in case an exception was raised
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1439 - Py_True or Py_False for successfuly comparisons
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1440 - Py_NotImplemented in case the type combination is unknown
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1441
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1442 Note that Py_EQ and Py_NE comparisons can cause a UnicodeWarning in
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1443 case the conversion of the arguments to Unicode fails with a
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1444 UnicodeDecodeError.
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1445
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1446 Possible values for op:
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1447
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1448 Py_GT, Py_GE, Py_EQ, Py_NE, Py_LT, Py_LE
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1449
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1450 */
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1451
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1452 PyAPI_FUNC(PyObject *) PyUnicode_RichCompare(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1453 PyObject left, / Left string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1454 PyObject right, / Right string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1455 int op /* Operation: Py_EQ, Py_NE, Py_GT, etc. */
39610 3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1456 );
3674f20ac781 Merge current trunk into p3yk. This includes the PyNumber_Index API change, Thomas Wouters <thomas@python.org> parents: 39442 diff changeset	1457
13620 5b727ab37092 Spelling fixes supplied by Rob W. W. Hooft. All these are fixes in either Thomas Wouters <thomas@python.org> parents: 13401 diff changeset	1458 /* Apply a argument tuple or dictionary to a format string and return
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1459 the resulting Unicode string. */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1460
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1461 PyAPI_FUNC(PyObject *) PyUnicode_Format(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1462 PyObject format, / Format string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1463 PyObject args / Argument tuple or dictionary */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1464 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1465
12002 d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1466 /* Checks whether element is contained in container and return 1/0
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1467 accordingly.
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1468
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1469 element has to coerce to an one element Unicode string. -1 is
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1470 returned in case of an error. */
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1471
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1472 PyAPI_FUNC(int) PyUnicode_Contains(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1473 PyObject container, / Container string */
f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1474 PyObject element / Element string */
12002 d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1475 );
d50fa3670b66 Marc-Andre Lemburg: add declaration for PyUnicode_Contains(). Guido van Rossum <guido@python.org> parents: 11962 diff changeset	1476
42597 20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	1477 /* Checks whether argument is a valid identifier. */
20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	1478
20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	1479 PyAPI_FUNC(int) PyUnicode_IsIdentifier(PyObject *s);
20477cbfd996 Implement PEP 3131. Add isidentifier to str. Martin v. Löwis <martin@v.loewis.de> parents: 42595 diff changeset	1480
23225 e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1481 /* Externally visible for str.strip(unicode) */
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1482 PyAPI_FUNC(PyObject *) _PyUnicode_XStrip(
23225 e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1483 PyUnicodeObject *self,
e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1484 int striptype,
e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1485 PyObject *sepobj
e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1486 );
e639e34ef901 Apply patch diff.txt from SF feature request Walter Dörwald <walter@livinglogic.de> parents: 20554 diff changeset	1487
46909 ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1488 /* Using the current locale, insert the thousands grouping
ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1489 into the string pointed to by buffer. For the argument descriptions,
ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1490 see Objects/stringlib/localeutil.h */
ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1491
53187 b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1492 PyAPI_FUNC(Py_ssize_t) _PyUnicode_InsertThousandsGroupingLocale(Py_UNICODE *buffer,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1493 Py_ssize_t n_buffer,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1494 Py_UNICODE *digits,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1495 Py_ssize_t n_digits,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1496 Py_ssize_t min_width);
46909 ef4ec968fdb6 Merged revisions 63078 via svnmerge from Eric Smith <eric@trueblade.com> parents: 46598 diff changeset	1497
52773 28096ed73153 Added ',' thousands grouping to int.__format__. See PEP 378. Eric Smith <eric@trueblade.com> parents: 50660 diff changeset	1498 /* Using explicit passed-in values, insert the thousands grouping
28096ed73153 Added ',' thousands grouping to int.__format__. See PEP 378. Eric Smith <eric@trueblade.com> parents: 50660 diff changeset	1499 into the string pointed to by buffer. For the argument descriptions,
28096ed73153 Added ',' thousands grouping to int.__format__. See PEP 378. Eric Smith <eric@trueblade.com> parents: 50660 diff changeset	1500 see Objects/stringlib/localeutil.h */
53187 b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1501 PyAPI_FUNC(Py_ssize_t) _PyUnicode_InsertThousandsGrouping(Py_UNICODE *buffer,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1502 Py_ssize_t n_buffer,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1503 Py_UNICODE *digits,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1504 Py_ssize_t n_digits,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1505 Py_ssize_t min_width,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1506 const char *grouping,
b653eab13b73 The other half of Issue #1580: use short float repr where possible. Eric Smith <eric@trueblade.com> parents: 52773 diff changeset	1507 const char *thousands_sep);
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1508 /* === Characters Type APIs =============================================== */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1509
50660 9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	1510 /* Helper array used by Py_UNICODE_ISSPACE(). */
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	1511
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	1512 PyAPI_DATA(const unsigned char) _Py_ascii_whitespace[];
9d093ef89c56 Merged revisions 68440 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50550 diff changeset	1513
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1514 /* These should not be used directly. Use the Py_UNICODE_IS* and
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1515 Py_UNICODE_TO* macros instead.
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1516
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1517 These APIs are implemented in Objects/unicodectype.c.
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1518
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1519 */
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1520
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1521 PyAPI_FUNC(int) _PyUnicode_IsLowercase(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1522 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1523 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1524
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1525 PyAPI_FUNC(int) _PyUnicode_IsUppercase(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1526 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1527 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1528
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1529 PyAPI_FUNC(int) _PyUnicode_IsTitlecase(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1530 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1531 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1532
42595 f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1533 PyAPI_FUNC(int) _PyUnicode_IsXidStart(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1534 Py_UNICODE ch /* Unicode character */
42595 f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1535 );
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1536
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1537 PyAPI_FUNC(int) _PyUnicode_IsXidContinue(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1538 Py_UNICODE ch /* Unicode character */
42595 f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1539 );
f6af0b2598ca Add XID_Start and XID_Continue properties to unicodectype. Martin v. Löwis <martin@v.loewis.de> parents: 42490 diff changeset	1540
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1541 PyAPI_FUNC(int) _PyUnicode_IsWhitespace(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1542 const Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1543 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1544
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1545 PyAPI_FUNC(int) _PyUnicode_IsLinebreak(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1546 const Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1547 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1548
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1549 PyAPI_FUNC(Py_UNICODE) _PyUnicode_ToLowercase(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1550 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1551 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1552
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1553 PyAPI_FUNC(Py_UNICODE) _PyUnicode_ToUppercase(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1554 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1555 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1556
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1557 PyAPI_FUNC(Py_UNICODE) _PyUnicode_ToTitlecase(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1558 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1559 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1560
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1561 PyAPI_FUNC(int) _PyUnicode_ToDecimalDigit(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1562 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1563 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1564
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1565 PyAPI_FUNC(int) _PyUnicode_ToDigit(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1566 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1567 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1568
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1569 PyAPI_FUNC(double) _PyUnicode_ToNumeric(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1570 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1571 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1572
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1573 PyAPI_FUNC(int) _PyUnicode_IsDecimalDigit(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1574 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1575 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1576
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1577 PyAPI_FUNC(int) _PyUnicode_IsDigit(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1578 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1579 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1580
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1581 PyAPI_FUNC(int) _PyUnicode_IsNumeric(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1582 Py_UNICODE ch /* Unicode character */
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1583 );
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1584
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	1585 PyAPI_FUNC(int) _PyUnicode_IsPrintable(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1586 Py_UNICODE ch /* Unicode character */
47611 da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	1587 );
da47e7e135ae #2630: Implement PEP 3138. Georg Brandl <georg@python.org> parents: 47496 diff changeset	1588
24752 c1eb668525e1 Excise DL_EXPORT from Include. Mark Hammond <mhammond@skippinet.com.au> parents: 24737 diff changeset	1589 PyAPI_FUNC(int) _PyUnicode_IsAlpha(
61467 f197407bdba2 Recorded merge of revisions 81032 via svnmerge from Antoine Pitrou <solipsis@pitrou.net> parents: 53767 diff changeset	1590 Py_UNICODE ch /* Unicode character */
13352 d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	1591 );
d88535ccaee5 Modified the ISALPHA and ISALNUM macros to use the new lookup APIs Marc-André Lemburg <mal@egenix.com> parents: 13320 diff changeset	1592
42013 cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1593 PyAPI_FUNC(size_t) Py_UNICODE_strlen(const Py_UNICODE *u);
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1594
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1595 PyAPI_FUNC(Py_UNICODE*) Py_UNICODE_strcpy(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1596 Py_UNICODE s1, const Py_UNICODE s2);
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1597
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1598 PyAPI_FUNC(Py_UNICODE*) Py_UNICODE_strncpy(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1599 Py_UNICODE s1, const Py_UNICODE s2, size_t n);
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1600
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1601 PyAPI_FUNC(int) Py_UNICODE_strcmp(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1602 const Py_UNICODE s1, const Py_UNICODE s2);
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1603
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1604 PyAPI_FUNC(Py_UNICODE*) Py_UNICODE_strchr(
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1605 const Py_UNICODE *s, Py_UNICODE c
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1606 );
cd125fe83051 Make identifiers str (not str8) objects throughout. Martin v. Löwis <martin@v.loewis.de> parents: 41876 diff changeset	1607
11962 be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1608 #ifdef __cplusplus
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1609 }
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1610 #endif
be98e055e39d Unicode implementation by Marc-Andre Lemburg based on original code by Fredrik Lundh. Guido van Rossum <guido@python.org> parents: diff changeset	1611 #endif /* !Py_UNICODEOBJECT_H */

Mercurial > cpython-lru_cache-weakref

annotate Include/unicodeobject.h @ 67467:abe201dfd3dc 3.1