cpython-lru_cache-weakref: Objects/unicodeobject.c annotate

annotate Objects/unicodeobject.c @ 12357:5b59ea41db4e legacy-trunk

Install the docs (with fewer rules). Add descriptions for the system variables.

author	Guido van Rossum <guido@python.org>
date	Mon, 10 Apr 2000 19:36:27 +0000
parents	3cc77848a62a
children	68e48bb94071

rev	line source
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1 /*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3 Unicode implementation based on original code by Fredrik Lundh,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4 modified by Marc-Andre Lemburg (mal@lemburg.com) according to the
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	5 Unicode Integration Proposal (see file Misc/unicode.txt).
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	6
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	7 (c) Copyright CNRI, All Rights Reserved. NO WARRANTY.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	8
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	9
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	10 Original header:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	11 --------------------------------------------------------------------
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	12
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	13 * Yet another Unicode string type for Python. This type supports the
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	14 * 16-bit Basic Multilingual Plane (BMP) only.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	15 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	16 * Note that this string class supports embedded NULL characters. End
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	17 * of string is given by the length attribute. However, the internal
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	18 * representation always stores a trailing NULL to make it easier to
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	19 * use unicode strings with standard APIs.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	20 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	21 * History:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	22 * 1999-01-23 fl Created
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	23 * 1999-01-24 fl Added split, join, capwords; basic UTF-8 support
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	24 * 1999-01-24 fl Basic UCS-2 support, buffer interface, etc.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	25 * 1999-03-06 fl Moved declarations to separate file, etc.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	26 * 1999-06-13 fl Changed join method semantics according to Tim's proposal
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	27 * 1999-08-10 fl Some minor tweaks
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	28 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	29 * Written by Fredrik Lundh, January 1999.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	30 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	31 * Copyright (c) 1999 by Secret Labs AB.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	32 * Copyright (c) 1999 by Fredrik Lundh.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	33 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	34 * fredrik@pythonware.com
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	35 * http://www.pythonware.com
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	36 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	37 * --------------------------------------------------------------------
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	38 * This Unicode String Type is
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	39 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	40 * Copyright (c) 1999 by Secret Labs AB
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	41 * Copyright (c) 1999 by Fredrik Lundh
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	42 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	43 * By obtaining, using, and/or copying this software and/or its
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	44 * associated documentation, you agree that you have read, understood,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	45 * and will comply with the following terms and conditions:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	46 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	47 * Permission to use, copy, modify, and distribute this software and its
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	48 * associated documentation for any purpose and without fee is hereby
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	49 * granted, provided that the above copyright notice appears in all
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	50 * copies, and that both that copyright notice and this permission notice
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	51 * appear in supporting documentation, and that the name of Secret Labs
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	52 * AB or the author not be used in advertising or publicity pertaining to
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	53 * distribution of the software without specific, written prior
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	54 * permission.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	55 *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	56 * SECRET LABS AB AND THE AUTHOR DISCLAIMS ALL WARRANTIES WITH REGARD TO
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	57 * THIS SOFTWARE, INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	58 * FITNESS. IN NO EVENT SHALL SECRET LABS AB OR THE AUTHOR BE LIABLE FOR
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	59 * ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	60 * WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	61 * ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	62 * OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	63 * -------------------------------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	64
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	65 #include "Python.h"
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	66
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	67 #include "mymath.h"
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	68 #include "unicodeobject.h"
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	69
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	70 #if defined(HAVE_LIMITS_H)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	71 #include <limits.h>
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	72 #else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	73 #define INT_MAX 2147483647
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	74 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	75
12067 bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	76 #ifdef MS_WIN32
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	77 #include <windows.h>
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	78 #endif
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	79
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	80 /* Limit for the Unicode object free list */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	81
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	82 #define MAX_UNICODE_FREELIST_SIZE 1024
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	83
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	84 /* Limit for the Unicode object free list stay alive optimization.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	85
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	86 The implementation will keep allocated Unicode memory intact for
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	87 all objects on the free list having a size less than this
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	88 limit. This reduces malloc() overhead for small Unicode objects.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	89
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	90 At worst this will result in MAX_UNICODE_FREELIST_SIZE *
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	91 (sizeof(PyUnicodeObject) + KEEPALIVE_SIZE_LIMIT +
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	92 malloc()-overhead) bytes of unused garbage.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	93
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	94 Setting the limit to 0 effectively turns the feature off.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	95
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	96 Note: This is an experimental feature ! If you get core dumps when
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	97 using Unicode objects, turn this feature off.
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	98
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	99 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	100
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	101 #define KEEPALIVE_SIZE_LIMIT 9
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	102
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	103 /* Endianness switches; defaults to little endian */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	104
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	105 #ifdef WORDS_BIGENDIAN
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	106 # define BYTEORDER_IS_BIG_ENDIAN
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	107 #else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	108 # define BYTEORDER_IS_LITTLE_ENDIAN
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	109 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	110
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	111 /* --- Globals ------------------------------------------------------------ */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	112
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	113 /* The empty Unicode object */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	114 static PyUnicodeObject *unicode_empty = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	115
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	116 /* Free list for Unicode objects */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	117 static PyUnicodeObject *unicode_freelist = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	118 static int unicode_freelist_size = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	119
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	120 /* --- Unicode Object ----------------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	121
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	122 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	123 int _PyUnicode_Resize(register PyUnicodeObject *unicode,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	124 int length)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	125 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	126 void *oldstr;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	127
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	128 /* Shortcut if there's nothing much to do. */
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	129 if (unicode->length == length)
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	130 goto reset;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	131
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	132 /* Resizing unicode_empty is not allowed. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	133 if (unicode == unicode_empty) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	134 PyErr_SetString(PyExc_SystemError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	135 "can't resize empty unicode object");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	136 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	137 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	138
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	139 /* We allocate one more byte to make sure the string is
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	140 Ux0000 terminated -- XXX is this needed ? */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	141 oldstr = unicode->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	142 PyMem_RESIZE(unicode->str, Py_UNICODE, length + 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	143 if (!unicode->str) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	144 unicode->str = oldstr;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	145 PyErr_NoMemory();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	146 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	147 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	148 unicode->str[length] = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	149 unicode->length = length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	150
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	151 reset:
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	152 /* Reset the object caches */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	153 if (unicode->utf8str) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	154 Py_DECREF(unicode->utf8str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	155 unicode->utf8str = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	156 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	157 unicode->hash = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	158
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	159 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	160 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	161
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	162 int PyUnicode_Resize(PyObject **unicode,
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	163 int length)
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	164 {
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	165 PyUnicodeObject *v;
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	166
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	167 if (unicode == NULL) {
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	168 PyErr_BadInternalCall();
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	169 return -1;
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	170 }
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	171 v = (PyUnicodeObject )unicode;
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	172 if (v == NULL \|\| !PyUnicode_Check(v) \|\| v->ob_refcnt != 1) {
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	173 PyErr_BadInternalCall();
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	174 return -1;
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	175 }
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	176 return _PyUnicode_Resize(v, length);
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	177 }
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	178
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	179 /* We allocate one more byte to make sure the string is
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	180 Ux0000 terminated -- XXX is this needed ?
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	181
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	182 XXX This allocator could further be enhanced by assuring that the
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	183 free list never reduces its size below 1.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	184
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	185 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	186
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	187 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	188 PyUnicodeObject *_PyUnicode_New(int length)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	189 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	190 register PyUnicodeObject *unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	191
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	192 /* Optimization for empty strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	193 if (length == 0 && unicode_empty != NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	194 Py_INCREF(unicode_empty);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	195 return unicode_empty;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	196 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	197
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	198 /* Unicode freelist & memory allocation */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	199 if (unicode_freelist) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	200 unicode = unicode_freelist;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	201 unicode_freelist = (PyUnicodeObject *)unicode_freelist;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	202 unicode_freelist_size--;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	203 unicode->ob_type = &PyUnicode_Type;
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	204 _Py_NewReference((PyObject *)unicode);
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	205 if (unicode->str) {
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	206 /* Keep-Alive optimization: we only upsize the buffer,
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	207 never downsize it. */
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	208 if ((unicode->length < length) &&
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	209 _PyUnicode_Resize(unicode, length)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	210 free(unicode->str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	211 PyMem_DEL(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	212 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	213 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	214 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	215 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	216 unicode->str = PyMem_NEW(Py_UNICODE, length + 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	217 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	218 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	219 unicode = PyObject_NEW(PyUnicodeObject, &PyUnicode_Type);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	220 if (unicode == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	221 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	222 unicode->str = PyMem_NEW(Py_UNICODE, length + 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	223 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	224
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	225 if (!unicode->str)
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	226 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	227 unicode->str[length] = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	228 unicode->length = length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	229 unicode->hash = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	230 unicode->utf8str = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	231 return unicode;
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	232
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	233 onError:
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	234 _Py_ForgetReference((PyObject *)unicode);
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	235 PyMem_DEL(unicode);
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	236 PyErr_NoMemory();
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	237 return NULL;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	238 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	239
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	240 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	241 void _PyUnicode_Free(register PyUnicodeObject *unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	242 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	243 if (unicode_freelist_size < MAX_UNICODE_FREELIST_SIZE) {
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	244 /* Keep-Alive optimization */
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	245 if (unicode->length >= KEEPALIVE_SIZE_LIMIT) {
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	246 free(unicode->str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	247 unicode->str = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	248 unicode->length = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	249 }
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	250 if (unicode->utf8str) {
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	251 Py_DECREF(unicode->utf8str);
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	252 unicode->utf8str = NULL;
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	253 }
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	254 /* Add to free list */
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	255 (PyUnicodeObject *)unicode = unicode_freelist;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	256 unicode_freelist = unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	257 unicode_freelist_size++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	258 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	259 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	260 free(unicode->str);
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	261 Py_XDECREF(unicode->utf8str);
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	262 PyMem_DEL(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	263 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	264 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	265
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	266 PyObject PyUnicode_FromUnicode(const Py_UNICODE u,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	267 int size)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	268 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	269 PyUnicodeObject *unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	270
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	271 unicode = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	272 if (!unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	273 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	274
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	275 /* Copy the Unicode data into the new object */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	276 if (u != NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	277 memcpy(unicode->str, u, size * sizeof(Py_UNICODE));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	278
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	279 return (PyObject *)unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	280 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	281
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	282 #ifdef HAVE_WCHAR_H
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	283
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	284 PyObject PyUnicode_FromWideChar(register const wchar_t w,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	285 int size)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	286 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	287 PyUnicodeObject *unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	288
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	289 if (w == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	290 PyErr_BadInternalCall();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	291 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	292 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	293
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	294 unicode = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	295 if (!unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	296 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	297
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	298 /* Copy the wchar_t data into the new object */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	299 #ifdef HAVE_USABLE_WCHAR_T
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	300 memcpy(unicode->str, w, size * sizeof(wchar_t));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	301 #else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	302 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	303 register Py_UNICODE *u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	304 register int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	305 u = PyUnicode_AS_UNICODE(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	306 for (i = size; i >= 0; i--)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	307 u++ = w++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	308 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	309 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	310
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	311 return (PyObject *)unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	312 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	313
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	314 int PyUnicode_AsWideChar(PyUnicodeObject *unicode,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	315 register wchar_t *w,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	316 int size)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	317 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	318 if (unicode == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	319 PyErr_BadInternalCall();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	320 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	321 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	322 if (size > PyUnicode_GET_SIZE(unicode))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	323 size = PyUnicode_GET_SIZE(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	324 #ifdef HAVE_USABLE_WCHAR_T
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	325 memcpy(w, unicode->str, size * sizeof(wchar_t));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	326 #else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	327 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	328 register Py_UNICODE *u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	329 register int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	330 u = PyUnicode_AS_UNICODE(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	331 for (i = size; i >= 0; i--)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	332 w++ = u++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	333 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	334 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	335
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	336 return size;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	337 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	338
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	339 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	340
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	341 PyObject PyUnicode_FromObject(register PyObject obj)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	342 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	343 const char *s;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	344 int len;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	345
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	346 if (obj == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	347 PyErr_BadInternalCall();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	348 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	349 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	350 else if (PyUnicode_Check(obj)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	351 Py_INCREF(obj);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	352 return obj;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	353 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	354 else if (PyString_Check(obj)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	355 s = PyString_AS_STRING(obj);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	356 len = PyString_GET_SIZE(obj);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	357 }
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	358 else if (PyObject_AsCharBuffer(obj, &s, &len)) {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	359 /* Overwrite the error message with something more useful in
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	360 case of a TypeError. */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	361 if (PyErr_ExceptionMatches(PyExc_TypeError))
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	362 PyErr_SetString(PyExc_TypeError,
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	363 "coercing to Unicode: need string or charbuffer");
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	364 return NULL;
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	365 }
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	366 if (len == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	367 Py_INCREF(unicode_empty);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	368 return (PyObject *)unicode_empty;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	369 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	370 return PyUnicode_DecodeUTF8(s, len, "strict");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	371 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	372
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	373 PyObject PyUnicode_Decode(const char s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	374 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	375 const char *encoding,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	376 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	377 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	378 PyObject buffer = NULL, unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	379
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	380 /* Shortcut for the default encoding UTF-8 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	381 if (encoding == NULL \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	382 (strcmp(encoding, "utf-8") == 0))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	383 return PyUnicode_DecodeUTF8(s, size, errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	384
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	385 /* Decode via the codec registry */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	386 buffer = PyBuffer_FromMemory((void *)s, size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	387 if (buffer == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	388 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	389 unicode = PyCodec_Decode(buffer, encoding, errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	390 if (unicode == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	391 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	392 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	393 PyErr_Format(PyExc_TypeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	394 "decoder did not return an unicode object (type=%.400s)",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	395 unicode->ob_type->tp_name);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	396 Py_DECREF(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	397 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	398 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	399 Py_DECREF(buffer);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	400 return unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	401
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	402 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	403 Py_XDECREF(buffer);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	404 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	405 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	406
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	407 PyObject PyUnicode_Encode(const Py_UNICODE s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	408 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	409 const char *encoding,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	410 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	411 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	412 PyObject v, unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	413
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	414 unicode = PyUnicode_FromUnicode(s, size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	415 if (unicode == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	416 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	417 v = PyUnicode_AsEncodedString(unicode, encoding, errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	418 Py_DECREF(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	419 return v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	420 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	421
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	422 PyObject PyUnicode_AsEncodedString(PyObject unicode,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	423 const char *encoding,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	424 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	425 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	426 PyObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	427
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	428 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	429 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	430 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	431 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	432 /* Shortcut for the default encoding UTF-8 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	433 if ((encoding == NULL \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	434 (strcmp(encoding, "utf-8") == 0)) &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	435 errors == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	436 return PyUnicode_AsUTF8String(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	437
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	438 /* Encode via the codec registry */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	439 v = PyCodec_Encode(unicode, encoding, errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	440 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	441 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	442 /* XXX Should we really enforce this ? */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	443 if (!PyString_Check(v)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	444 PyErr_Format(PyExc_TypeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	445 "encoder did not return a string object (type=%.400s)",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	446 v->ob_type->tp_name);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	447 Py_DECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	448 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	449 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	450 return v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	451
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	452 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	453 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	454 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	455
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	456 Py_UNICODE PyUnicode_AsUnicode(PyObject unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	457 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	458 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	459 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	460 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	461 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	462 return PyUnicode_AS_UNICODE(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	463
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	464 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	465 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	466 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	467
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	468 int PyUnicode_GetSize(PyObject *unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	469 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	470 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	471 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	472 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	473 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	474 return PyUnicode_GET_SIZE(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	475
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	476 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	477 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	478 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	479
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	480 /* --- UTF-8 Codec -------------------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	481
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	482 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	483 char utf8_code_length[256] = {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	484 /* Map UTF-8 encoded prefix byte to sequence length. zero means
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	485 illegal prefix. see RFC 2279 for details */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	486 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	487 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	488 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	489 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	490 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	491 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	492 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	493 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	494 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	495 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	496 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	497 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	498 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	499 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	500 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	501 4, 4, 4, 4, 4, 4, 4, 4, 5, 5, 5, 5, 6, 6, 0, 0
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	502 };
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	503
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	504 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	505 int utf8_decoding_error(const char **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	506 Py_UNICODE **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	507 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	508 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	509 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	510 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	511 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	512 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	513 "UTF-8 decoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	514 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	515 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	516 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	517 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	518 (*source)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	519 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	520 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	521 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	522 (*source)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	523 **dest = Py_UNICODE_REPLACEMENT_CHARACTER;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	524 (*dest)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	525 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	526 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	527 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	528 PyErr_Format(PyExc_ValueError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	529 "UTF-8 decoding error; unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	530 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	531 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	532 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	533 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	534
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	535 #define UTF8_ERROR(details) do { \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	536 if (utf8_decoding_error(&s, &p, errors, details)) \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	537 goto onError; \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	538 continue; \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	539 } while (0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	540
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	541 PyObject PyUnicode_DecodeUTF8(const char s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	542 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	543 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	544 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	545 int n;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	546 const char *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	547 PyUnicodeObject *unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	548 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	549
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	550 /* Note: size will always be longer than the resulting Unicode
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	551 character count */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	552 unicode = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	553 if (!unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	554 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	555 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	556 return (PyObject *)unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	557
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	558 /* Unpack UTF-8 encoded data */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	559 p = unicode->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	560 e = s + size;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	561
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	562 while (s < e) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	563 register Py_UNICODE ch = (unsigned char)*s;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	564
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	565 if (ch < 0x80) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	566 *p++ = ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	567 s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	568 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	569 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	570
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	571 n = utf8_code_length[ch];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	572
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	573 if (s + n > e)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	574 UTF8_ERROR("unexpected end of data");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	575
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	576 switch (n) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	577
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	578 case 0:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	579 UTF8_ERROR("unexpected code byte");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	580 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	581
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	582 case 1:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	583 UTF8_ERROR("internal error");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	584 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	585
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	586 case 2:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	587 if ((s[1] & 0xc0) != 0x80)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	588 UTF8_ERROR("invalid data");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	589 ch = ((s[0] & 0x1f) << 6) + (s[1] & 0x3f);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	590 if (ch < 0x80)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	591 UTF8_ERROR("illegal encoding");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	592 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	593 *p++ = ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	594 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	595
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	596 case 3:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	597 if ((s[1] & 0xc0) != 0x80 \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	598 (s[2] & 0xc0) != 0x80)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	599 UTF8_ERROR("invalid data");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	600 ch = ((s[0] & 0x0f) << 12) + ((s[1] & 0x3f) << 6) + (s[2] & 0x3f);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	601 if (ch < 0x800 \|\| (ch >= 0xd800 && ch < 0xe000))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	602 UTF8_ERROR("illegal encoding");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	603 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	604 *p++ = ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	605 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	606
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	607 default:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	608 /* Other sizes are only needed for UCS-4 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	609 UTF8_ERROR("unsupported Unicode code range");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	610 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	611 s += n;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	612 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	613
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	614 /* Adjust length */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	615 if (_PyUnicode_Resize(unicode, p - unicode->str))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	616 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	617
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	618 return (PyObject *)unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	619
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	620 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	621 Py_DECREF(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	622 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	623 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	624
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	625 #undef UTF8_ERROR
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	626
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	627 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	628 int utf8_encoding_error(const Py_UNICODE **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	629 char **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	630 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	631 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	632 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	633 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	634 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	635 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	636 "UTF-8 encoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	637 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	638 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	639 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	640 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	641 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	642 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	643 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	644 **dest = '?';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	645 (*dest)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	646 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	647 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	648 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	649 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	650 "UTF-8 encoding error; "
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	651 "unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	652 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	653 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	654 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	655 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	656
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	657 PyObject PyUnicode_EncodeUTF8(const Py_UNICODE s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	658 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	659 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	660 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	661 PyObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	662 char *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	663 char *q;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	664
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	665 v = PyString_FromStringAndSize(NULL, 3 * size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	666 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	667 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	668 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	669 goto done;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	670
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	671 p = q = PyString_AS_STRING(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	672 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	673 Py_UNICODE ch = *s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	674 if (ch < 0x80)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	675 *p++ = (char) ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	676 else if (ch < 0x0800) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	677 *p++ = 0xc0 \| (ch >> 6);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	678 *p++ = 0x80 \| (ch & 0x3f);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	679 } else if (0xD800 <= ch && ch <= 0xDFFF) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	680 /* These byte ranges are reserved for UTF-16 surrogate
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	681 bytes which the Python implementation currently does
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	682 not support. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	683 printf("code range problem: U+%04x\n", ch);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	684 if (utf8_encoding_error(&s, &p, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	685 "unsupported code range"))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	686 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	687 } else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	688 *p++ = 0xe0 \| (ch >> 12);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	689 *p++ = 0x80 \| ((ch >> 6) & 0x3f);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	690 *p++ = 0x80 \| (ch & 0x3f);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	691 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	692 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	693 *p = '\0';
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	694 if (_PyString_Resize(&v, p - q))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	695 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	696
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	697 done:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	698 return v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	699
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	700 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	701 Py_DECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	702 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	703 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	704
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	705 /* Return a Python string holding the UTF-8 encoded value of the
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	706 Unicode object.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	707
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	708 The resulting string is cached in the Unicode object for subsequent
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	709 usage by this function. The cached version is needed to implement
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	710 the character buffer interface.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	711
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	712 The refcount of the string is not incremented.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	713
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	714 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	715
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	716 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	717 PyObject utf8_string(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	718 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	719 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	720 PyObject *v = self->utf8str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	721
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	722 if (v)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	723 return v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	724 v = PyUnicode_EncodeUTF8(PyUnicode_AS_UNICODE(self),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	725 PyUnicode_GET_SIZE(self),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	726 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	727 if (v && errors == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	728 self->utf8str = v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	729 return v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	730 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	731
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	732 PyObject PyUnicode_AsUTF8String(PyObject unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	733 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	734 PyObject *str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	735
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	736 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	737 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	738 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	739 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	740 str = utf8_string((PyUnicodeObject *)unicode, NULL);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	741 if (str == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	742 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	743 Py_INCREF(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	744 return str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	745 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	746
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	747 /* --- UTF-16 Codec ------------------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	748
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	749 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	750 int utf16_decoding_error(const Py_UNICODE **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	751 Py_UNICODE **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	752 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	753 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	754 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	755 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	756 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	757 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	758 "UTF-16 decoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	759 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	760 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	761 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	762 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	763 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	764 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	765 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	766 if (dest) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	767 **dest = Py_UNICODE_REPLACEMENT_CHARACTER;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	768 (*dest)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	769 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	770 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	771 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	772 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	773 PyErr_Format(PyExc_ValueError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	774 "UTF-16 decoding error; unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	775 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	776 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	777 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	778 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	779
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	780 #define UTF16_ERROR(details) do { \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	781 if (utf16_decoding_error(&q, &p, errors, details)) \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	782 goto onError; \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	783 continue; \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	784 } while(0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	785
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	786 PyObject PyUnicode_DecodeUTF16(const char s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	787 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	788 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	789 int *byteorder)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	790 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	791 PyUnicodeObject *unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	792 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	793 const Py_UNICODE q, e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	794 int bo = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	795
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	796 /* size should be an even number */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	797 if (size % sizeof(Py_UNICODE) != 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	798 if (utf16_decoding_error(NULL, NULL, errors, "truncated data"))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	799 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	800 /* The remaining input chars are ignored if we fall through
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	801 here... */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	802 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	803
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	804 /* Note: size will always be longer than the resulting Unicode
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	805 character count */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	806 unicode = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	807 if (!unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	808 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	809 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	810 return (PyObject *)unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	811
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	812 /* Unpack UTF-16 encoded data */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	813 p = unicode->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	814 q = (Py_UNICODE *)s;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	815 e = q + (size / sizeof(Py_UNICODE));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	816
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	817 if (byteorder)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	818 bo = *byteorder;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	819
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	820 while (q < e) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	821 register Py_UNICODE ch = *q++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	822
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	823 /* Check for BOM marks (U+FEFF) in the input and adjust
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	824 current byte order setting accordingly. Swap input
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	825 bytes if needed. (This assumes sizeof(Py_UNICODE) == 2
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	826 !) */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	827 #ifdef BYTEORDER_IS_LITTLE_ENDIAN
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	828 if (ch == 0xFEFF) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	829 bo = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	830 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	831 } else if (ch == 0xFFFE) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	832 bo = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	833 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	834 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	835 if (bo == 1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	836 ch = (ch >> 8) \| (ch << 8);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	837 #else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	838 if (ch == 0xFEFF) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	839 bo = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	840 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	841 } else if (ch == 0xFFFE) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	842 bo = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	843 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	844 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	845 if (bo == -1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	846 ch = (ch >> 8) \| (ch << 8);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	847 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	848 if (ch < 0xD800 \|\| ch > 0xDFFF) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	849 *p++ = ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	850 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	851 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	852
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	853 /* UTF-16 code pair: */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	854 if (q >= e)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	855 UTF16_ERROR("unexpected end of data");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	856 if (0xDC00 <= q && q <= 0xDFFF) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	857 q++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	858 if (0xD800 <= q && q <= 0xDBFF)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	859 /* This is valid data (a UTF-16 surrogate pair), but
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	860 we are not able to store this information since our
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	861 Py_UNICODE type only has 16 bits... this might
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	862 change someday, even though it's unlikely. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	863 UTF16_ERROR("code pairs are not supported");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	864 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	865 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	866 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	867 UTF16_ERROR("illegal encoding");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	868 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	869
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	870 if (byteorder)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	871 *byteorder = bo;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	872
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	873 /* Adjust length */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	874 if (_PyUnicode_Resize(unicode, p - unicode->str))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	875 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	876
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	877 return (PyObject *)unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	878
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	879 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	880 Py_DECREF(unicode);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	881 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	882 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	883
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	884 #undef UTF16_ERROR
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	885
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	886 PyObject PyUnicode_EncodeUTF16(const Py_UNICODE s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	887 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	888 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	889 int byteorder)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	890 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	891 PyObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	892 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	893 char *q;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	894
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	895 /* We don't create UTF-16 pairs... */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	896 v = PyString_FromStringAndSize(NULL,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	897 sizeof(Py_UNICODE) * (size + (byteorder == 0)));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	898 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	899 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	900 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	901 goto done;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	902
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	903 q = PyString_AS_STRING(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	904 p = (Py_UNICODE *)q;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	905
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	906 if (byteorder == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	907 *p++ = 0xFEFF;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	908 if (byteorder == 0 \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	909 #ifdef BYTEORDER_IS_LITTLE_ENDIAN
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	910 byteorder == -1
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	911 #else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	912 byteorder == 1
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	913 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	914 )
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	915 memcpy(p, s, size * sizeof(Py_UNICODE));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	916 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	917 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	918 Py_UNICODE ch = *s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	919 *p++ = (ch >> 8) \| (ch << 8);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	920 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	921 done:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	922 return v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	923 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	924
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	925 PyObject PyUnicode_AsUTF16String(PyObject unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	926 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	927 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	928 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	929 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	930 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	931 return PyUnicode_EncodeUTF16(PyUnicode_AS_UNICODE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	932 PyUnicode_GET_SIZE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	933 NULL,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	934 0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	935 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	936
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	937 /* --- Unicode Escape Codec ----------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	938
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	939 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	940 int unicodeescape_decoding_error(const char **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	941 unsigned int *x,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	942 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	943 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	944 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	945 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	946 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	947 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	948 "Unicode-Escape decoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	949 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	950 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	951 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	952 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	953 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	954 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	955 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	956 *x = (unsigned int)Py_UNICODE_REPLACEMENT_CHARACTER;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	957 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	958 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	959 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	960 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	961 "Unicode-Escape decoding error; "
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	962 "unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	963 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	964 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	965 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	966 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	967
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	968 PyObject PyUnicode_DecodeUnicodeEscape(const char s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	969 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	970 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	971 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	972 PyUnicodeObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	973 Py_UNICODE p = NULL, buf = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	974 const char *end;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	975
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	976 /* Escaped strings will always be longer than the resulting
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	977 Unicode string, so we start with size here and then reduce the
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	978 length after conversion to the true value. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	979 v = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	980 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	981 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	982 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	983 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	984 p = buf = PyUnicode_AS_UNICODE(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	985 end = s + size;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	986 while (s < end) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	987 unsigned char c;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	988 unsigned int x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	989 int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	990
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	991 /* Non-escape characters are interpreted as Unicode ordinals */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	992 if (*s != '\\') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	993 p++ = (unsigned char)s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	994 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	995 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	996
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	997 /* \ - Escapes */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	998 s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	999 switch (*s++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1000
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1001 /* \x escapes */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1002 case '\n': break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1003 case '\\': *p++ = '\\'; break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1004 case '\'': *p++ = '\''; break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1005 case '\"': *p++ = '\"'; break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1006 case 'b': *p++ = '\b'; break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1007 case 'f': p++ = '\014'; break; / FF */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1008 case 't': *p++ = '\t'; break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1009 case 'n': *p++ = '\n'; break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1010 case 'r': *p++ = '\r'; break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1011 case 'v': p++ = '\013'; break; / VT */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1012 case 'a': p++ = '\007'; break; / BEL, not classic C */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1013
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1014 /* \OOO (octal) escapes */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1015 case '0': case '1': case '2': case '3':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1016 case '4': case '5': case '6': case '7':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1017 c = s[-1] - '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1018 if ('0' <= s && s <= '7') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1019 c = (c<<3) + *s++ - '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1020 if ('0' <= s && s <= '7')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1021 c = (c<<3) + *s++ - '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1022 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1023 *p++ = c;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1024 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1025
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1026 /* \xXXXX escape with 0-4 hex digits */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1027 case 'x':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1028 x = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1029 c = (unsigned char)*s;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1030 if (isxdigit(c)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1031 do {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1032 x = (x<<4) & ~0xF;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1033 if ('0' <= c && c <= '9')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1034 x += c - '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1035 else if ('a' <= c && c <= 'f')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1036 x += 10 + c - 'a';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1037 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1038 x += 10 + c - 'A';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1039 c = (unsigned char)*++s;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1040 } while (isxdigit(c));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1041 *p++ = x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1042 } else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1043 *p++ = '\\';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1044 *p++ = (unsigned char)s[-1];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1045 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1046 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1047
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1048 /* \uXXXX with 4 hex digits */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1049 case 'u':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1050 for (x = 0, i = 0; i < 4; i++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1051 c = (unsigned char)s[i];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1052 if (!isxdigit(c)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1053 if (unicodeescape_decoding_error(&s, &x, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1054 "truncated \\uXXXX"))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1055 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1056 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1057 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1058 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1059 x = (x<<4) & ~0xF;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1060 if (c >= '0' && c <= '9')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1061 x += c - '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1062 else if (c >= 'a' && c <= 'f')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1063 x += 10 + c - 'a';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1064 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1065 x += 10 + c - 'A';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1066 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1067 s += i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1068 *p++ = x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1069 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1070
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1071 default:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1072 *p++ = '\\';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1073 *p++ = (unsigned char)s[-1];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1074 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1075 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1076 }
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1077 if (_PyUnicode_Resize(v, (int)(p - buf)))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1078 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1079 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1080
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1081 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1082 Py_XDECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1083 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1084 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1085
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1086 /* Return a Unicode-Escape string version of the Unicode object.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1087
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1088 If quotes is true, the string is enclosed in u"" or u'' quotes as
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1089 appropriate.
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1090
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1091 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1092
12025 7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	1093 static const Py_UNICODE findchar(const Py_UNICODE s,
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	1094 int size,
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	1095 Py_UNICODE ch);
7994d9db7f4d On 17-Mar-2000, Marc-Andre Lemburg said: Barry Warsaw <barry@python.org> parents: 11997 diff changeset	1096
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1097 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1098 PyObject unicodeescape_string(const Py_UNICODE s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1099 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1100 int quotes)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1101 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1102 PyObject *repr;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1103 char *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1104 char *q;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1105
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1106 static const char *hexdigit = "0123456789ABCDEF";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1107
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1108 repr = PyString_FromStringAndSize(NULL, 2 + 6*size + 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1109 if (repr == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1110 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1111
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1112 p = q = PyString_AS_STRING(repr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1113
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1114 if (quotes) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1115 *p++ = 'u';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1116 *p++ = (findchar(s, size, '\'') &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1117 !findchar(s, size, '"')) ? '"' : '\'';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1118 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1119 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1120 Py_UNICODE ch = *s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1121 /* Escape quotes */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1122 if (quotes && (ch == q[1] \|\| ch == '\\')) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1123 *p++ = '\\';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1124 *p++ = (char) ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1125 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1126 /* Map 16-bit characters to '\uxxxx' */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1127 else if (ch >= 256) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1128 *p++ = '\\';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1129 *p++ = 'u';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1130 *p++ = hexdigit[(ch >> 12) & 0xf];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1131 *p++ = hexdigit[(ch >> 8) & 0xf];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1132 *p++ = hexdigit[(ch >> 4) & 0xf];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1133 *p++ = hexdigit[ch & 15];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1134 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1135 /* Map non-printable US ASCII to '\ooo' */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1136 else if (ch < ' ' \|\| ch >= 128) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1137 *p++ = '\\';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1138 *p++ = hexdigit[(ch >> 6) & 7];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1139 *p++ = hexdigit[(ch >> 3) & 7];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1140 *p++ = hexdigit[ch & 7];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1141 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1142 /* Copy everything else as-is */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1143 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1144 *p++ = (char) ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1145 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1146 if (quotes)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1147 *p++ = q[1];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1148
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1149 *p = '\0';
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1150 if (_PyString_Resize(&repr, p - q))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1151 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1152
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1153 return repr;
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1154
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1155 onError:
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1156 Py_DECREF(repr);
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1157 return NULL;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1158 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1159
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1160 PyObject PyUnicode_EncodeUnicodeEscape(const Py_UNICODE s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1161 int size)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1162 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1163 return unicodeescape_string(s, size, 0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1164 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1165
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1166 PyObject PyUnicode_AsUnicodeEscapeString(PyObject unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1167 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1168 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1169 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1170 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1171 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1172 return PyUnicode_EncodeUnicodeEscape(PyUnicode_AS_UNICODE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1173 PyUnicode_GET_SIZE(unicode));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1174 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1175
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1176 /* --- Raw Unicode Escape Codec ------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1177
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1178 PyObject PyUnicode_DecodeRawUnicodeEscape(const char s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1179 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1180 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1181 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1182 PyUnicodeObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1183 Py_UNICODE p, buf;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1184 const char *end;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1185 const char *bs;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1186
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1187 /* Escaped strings will always be longer than the resulting
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1188 Unicode string, so we start with size here and then reduce the
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1189 length after conversion to the true value. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1190 v = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1191 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1192 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1193 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1194 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1195 p = buf = PyUnicode_AS_UNICODE(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1196 end = s + size;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1197 while (s < end) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1198 unsigned char c;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1199 unsigned int x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1200 int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1201
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1202 /* Non-escape characters are interpreted as Unicode ordinals */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1203 if (*s != '\\') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1204 p++ = (unsigned char)s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1205 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1206 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1207
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1208 /* \u-escapes are only interpreted iff the number of leading
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1209 backslashes if odd */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1210 bs = s;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1211 for (;s < end;) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1212 if (*s != '\\')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1213 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1214 p++ = (unsigned char)s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1215 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1216 if (((s - bs) & 1) == 0 \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1217 s >= end \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1218 *s != 'u') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1219 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1220 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1221 p--;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1222 s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1223
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1224 /* \uXXXX with 4 hex digits */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1225 for (x = 0, i = 0; i < 4; i++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1226 c = (unsigned char)s[i];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1227 if (!isxdigit(c)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1228 if (unicodeescape_decoding_error(&s, &x, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1229 "truncated \\uXXXX"))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1230 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1231 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1232 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1233 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1234 x = (x<<4) & ~0xF;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1235 if (c >= '0' && c <= '9')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1236 x += c - '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1237 else if (c >= 'a' && c <= 'f')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1238 x += 10 + c - 'a';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1239 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1240 x += 10 + c - 'A';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1241 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1242 s += i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1243 *p++ = x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1244 }
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1245 if (_PyUnicode_Resize(v, (int)(p - buf)))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1246 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1247 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1248
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1249 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1250 Py_XDECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1251 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1252 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1253
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1254 PyObject PyUnicode_EncodeRawUnicodeEscape(const Py_UNICODE s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1255 int size)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1256 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1257 PyObject *repr;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1258 char *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1259 char *q;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1260
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1261 static const char *hexdigit = "0123456789ABCDEF";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1262
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1263 repr = PyString_FromStringAndSize(NULL, 6 * size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1264 if (repr == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1265 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1266
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1267 p = q = PyString_AS_STRING(repr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1268 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1269 Py_UNICODE ch = *s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1270 /* Map 16-bit characters to '\uxxxx' */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1271 if (ch >= 256) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1272 *p++ = '\\';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1273 *p++ = 'u';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1274 *p++ = hexdigit[(ch >> 12) & 0xf];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1275 *p++ = hexdigit[(ch >> 8) & 0xf];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1276 *p++ = hexdigit[(ch >> 4) & 0xf];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1277 *p++ = hexdigit[ch & 15];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1278 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1279 /* Copy everything else as-is */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1280 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1281 *p++ = (char) ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1282 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1283 *p = '\0';
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1284 if (_PyString_Resize(&repr, p - q))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1285 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1286
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1287 return repr;
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1288
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1289 onError:
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1290 Py_DECREF(repr);
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1291 return NULL;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1292 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1293
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1294 PyObject PyUnicode_AsRawUnicodeEscapeString(PyObject unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1295 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1296 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1297 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1298 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1299 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1300 return PyUnicode_EncodeRawUnicodeEscape(PyUnicode_AS_UNICODE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1301 PyUnicode_GET_SIZE(unicode));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1302 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1303
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1304 /* --- Latin-1 Codec ------------------------------------------------------ */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1305
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1306 PyObject PyUnicode_DecodeLatin1(const char s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1307 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1308 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1309 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1310 PyUnicodeObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1311 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1312
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1313 /* Latin-1 is equivalent to the first 256 ordinals in Unicode. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1314 v = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1315 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1316 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1317 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1318 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1319 p = PyUnicode_AS_UNICODE(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1320 while (size-- > 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1321 p++ = (unsigned char)s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1322 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1323
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1324 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1325 Py_XDECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1326 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1327 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1328
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1329 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1330 int latin1_encoding_error(const Py_UNICODE **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1331 char **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1332 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1333 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1334 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1335 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1336 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1337 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1338 "Latin-1 encoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1339 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1340 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1341 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1342 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1343 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1344 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1345 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1346 **dest = '?';
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1347 (*dest)++;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1348 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1349 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1350 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1351 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1352 "Latin-1 encoding error; "
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1353 "unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1354 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1355 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1356 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1357 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1358
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1359 PyObject PyUnicode_EncodeLatin1(const Py_UNICODE p,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1360 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1361 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1362 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1363 PyObject *repr;
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1364 char s, start;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1365 repr = PyString_FromStringAndSize(NULL, size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1366 if (repr == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1367 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1368
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1369 s = PyString_AS_STRING(repr);
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1370 start = s;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1371 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1372 Py_UNICODE ch = *p++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1373 if (ch >= 256) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1374 if (latin1_encoding_error(&p, &s, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1375 "ordinal not in range(256)"))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1376 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1377 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1378 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1379 *s++ = (char)ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1380 }
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1381 /* Resize if error handling skipped some characters */
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1382 if (s - start < PyString_GET_SIZE(repr))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1383 if (_PyString_Resize(&repr, s - start))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1384 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1385 return repr;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1386
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1387 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1388 Py_DECREF(repr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1389 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1390 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1391
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1392 PyObject PyUnicode_AsLatin1String(PyObject unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1393 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1394 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1395 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1396 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1397 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1398 return PyUnicode_EncodeLatin1(PyUnicode_AS_UNICODE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1399 PyUnicode_GET_SIZE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1400 NULL);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1401 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1402
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1403 /* --- 7-bit ASCII Codec -------------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1404
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1405 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1406 int ascii_decoding_error(const char **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1407 Py_UNICODE **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1408 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1409 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1410 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1411 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1412 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1413 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1414 "ASCII decoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1415 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1416 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1417 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1418 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1419 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1420 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1421 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1422 **dest = Py_UNICODE_REPLACEMENT_CHARACTER;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1423 (*dest)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1424 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1425 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1426 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1427 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1428 "ASCII decoding error; "
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1429 "unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1430 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1431 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1432 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1433 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1434
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1435 PyObject PyUnicode_DecodeASCII(const char s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1436 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1437 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1438 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1439 PyUnicodeObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1440 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1441
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1442 /* ASCII is equivalent to the first 128 ordinals in Unicode. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1443 v = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1444 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1445 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1446 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1447 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1448 p = PyUnicode_AS_UNICODE(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1449 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1450 register unsigned char c;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1451
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1452 c = (unsigned char)*s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1453 if (c < 128)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1454 *p++ = c;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1455 else if (ascii_decoding_error(&s, &p, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1456 "ordinal not in range(128)"))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1457 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1458 }
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1459 if (p - PyUnicode_AS_UNICODE(v) < PyString_GET_SIZE(v))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1460 if (_PyUnicode_Resize(v, (int)(p - PyUnicode_AS_UNICODE(v))))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1461 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1462 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1463
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1464 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1465 Py_XDECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1466 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1467 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1468
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1469 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1470 int ascii_encoding_error(const Py_UNICODE **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1471 char **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1472 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1473 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1474 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1475 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1476 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1477 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1478 "ASCII encoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1479 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1480 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1481 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1482 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1483 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1484 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1485 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1486 **dest = '?';
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1487 (*dest)++;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1488 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1489 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1490 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1491 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1492 "ASCII encoding error; "
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1493 "unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1494 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1495 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1496 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1497 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1498
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1499 PyObject PyUnicode_EncodeASCII(const Py_UNICODE p,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1500 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1501 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1502 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1503 PyObject *repr;
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1504 char s, start;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1505 repr = PyString_FromStringAndSize(NULL, size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1506 if (repr == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1507 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1508
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1509 s = PyString_AS_STRING(repr);
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1510 start = s;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1511 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1512 Py_UNICODE ch = *p++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1513 if (ch >= 128) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1514 if (ascii_encoding_error(&p, &s, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1515 "ordinal not in range(128)"))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1516 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1517 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1518 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1519 *s++ = (char)ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1520 }
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1521 /* Resize if error handling skipped some characters */
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1522 if (s - start < PyString_GET_SIZE(repr))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1523 if (_PyString_Resize(&repr, s - start))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1524 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1525 return repr;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1526
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1527 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1528 Py_DECREF(repr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1529 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1530 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1531
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1532 PyObject PyUnicode_AsASCIIString(PyObject unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1533 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1534 if (!PyUnicode_Check(unicode)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1535 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1536 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1537 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1538 return PyUnicode_EncodeASCII(PyUnicode_AS_UNICODE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1539 PyUnicode_GET_SIZE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1540 NULL);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1541 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1542
12067 bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1543 #ifdef MS_WIN32
12193 c3fc2b4617fc Some blank lines. Guido van Rossum <guido@python.org> parents: 12067 diff changeset	1544
12067 bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1545 /* --- MBCS codecs for Windows -------------------------------------------- */
12193 c3fc2b4617fc Some blank lines. Guido van Rossum <guido@python.org> parents: 12067 diff changeset	1546
12067 bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1547 PyObject PyUnicode_DecodeMBCS(const char s,
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1548 int size,
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1549 const char *errors)
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1550 {
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1551 PyUnicodeObject *v;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1552 Py_UNICODE *p;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1553
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1554 /* First get the size of the result */
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1555 DWORD usize = MultiByteToWideChar(CP_ACP, 0, s, size, NULL, 0);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1556 if (usize==0)
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1557 return PyErr_SetFromWindowsErrWithFilename(0, NULL);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1558
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1559 v = _PyUnicode_New(usize);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1560 if (v == NULL)
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1561 return NULL;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1562 if (usize == 0)
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1563 return (PyObject *)v;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1564 p = PyUnicode_AS_UNICODE(v);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1565 if (0 == MultiByteToWideChar(CP_ACP, 0, s, size, p, usize)) {
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1566 Py_DECREF(v);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1567 return PyErr_SetFromWindowsErrWithFilename(0, NULL);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1568 }
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1569
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1570 return (PyObject *)v;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1571 }
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1572
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1573 PyObject PyUnicode_EncodeMBCS(const Py_UNICODE p,
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1574 int size,
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1575 const char *errors)
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1576 {
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1577 PyObject *repr;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1578 char *s;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1579
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1580 /* First get the size of the result */
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1581 DWORD mbcssize = WideCharToMultiByte(CP_ACP, 0, p, size, NULL, 0, NULL, NULL);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1582 if (mbcssize==0)
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1583 return PyErr_SetFromWindowsErrWithFilename(0, NULL);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1584
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1585 repr = PyString_FromStringAndSize(NULL, mbcssize);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1586 if (repr == NULL)
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1587 return NULL;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1588 if (mbcssize==0)
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1589 return repr;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1590
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1591 /* Do the conversion */
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1592 s = PyString_AS_STRING(repr);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1593 if (0 == WideCharToMultiByte(CP_ACP, 0, p, size, s, mbcssize, NULL, NULL)) {
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1594 Py_DECREF(repr);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1595 return PyErr_SetFromWindowsErrWithFilename(0, NULL);
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1596 }
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1597 return repr;
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1598 }
12193 c3fc2b4617fc Some blank lines. Guido van Rossum <guido@python.org> parents: 12067 diff changeset	1599
12067 bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1600 #endif /* MS_WIN32 */
bcab189ddf86 MBCS codecs. (Win32 only.) By Mark Hammond. Guido van Rossum <guido@python.org> parents: 12025 diff changeset	1601
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1602 /* --- Character Mapping Codec -------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1603
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1604 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1605 int charmap_decoding_error(const char **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1606 Py_UNICODE **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1607 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1608 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1609 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1610 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1611 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1612 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1613 "charmap decoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1614 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1615 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1616 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1617 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1618 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1619 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1620 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1621 **dest = Py_UNICODE_REPLACEMENT_CHARACTER;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1622 (*dest)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1623 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1624 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1625 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1626 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1627 "charmap decoding error; "
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1628 "unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1629 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1630 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1631 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1632 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1633
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1634 PyObject PyUnicode_DecodeCharmap(const char s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1635 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1636 PyObject *mapping,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1637 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1638 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1639 PyUnicodeObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1640 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1641
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1642 /* Default to Latin-1 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1643 if (mapping == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1644 return PyUnicode_DecodeLatin1(s, size, errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1645
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1646 v = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1647 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1648 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1649 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1650 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1651 p = PyUnicode_AS_UNICODE(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1652 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1653 unsigned char ch = *s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1654 PyObject w, x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1655
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1656 /* Get mapping (char ordinal -> integer, Unicode char or None) */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1657 w = PyInt_FromLong((long)ch);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1658 if (w == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1659 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1660 x = PyObject_GetItem(mapping, w);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1661 Py_DECREF(w);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1662 if (x == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1663 if (PyErr_ExceptionMatches(PyExc_LookupError)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1664 /* No mapping found: default to Latin-1 mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1665 PyErr_Clear();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1666 *p++ = (Py_UNICODE)ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1667 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1668 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1669 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1670 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1671
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1672 /* Apply mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1673 if (PyInt_Check(x)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1674 int value = PyInt_AS_LONG(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1675 if (value < 0 \|\| value > 65535) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1676 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1677 "character mapping must be in range(65336)");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1678 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1679 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1680 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1681 *p++ = (Py_UNICODE)value;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1682 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1683 else if (x == Py_None) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1684 /* undefined mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1685 if (charmap_decoding_error(&s, &p, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1686 "character maps to <undefined>")) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1687 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1688 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1689 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1690 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1691 else if (PyUnicode_Check(x)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1692 if (PyUnicode_GET_SIZE(x) != 1) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1693 /* 1-n mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1694 PyErr_SetString(PyExc_NotImplementedError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1695 "1-n mappings are currently not implemented");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1696 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1697 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1698 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1699 p++ = PyUnicode_AS_UNICODE(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1700 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1701 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1702 /* wrong return value */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1703 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1704 "character mapping must return integer, None or unicode");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1705 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1706 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1707 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1708 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1709 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1710 if (p - PyUnicode_AS_UNICODE(v) < PyUnicode_GET_SIZE(v))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1711 if (_PyUnicode_Resize(v, (int)(p - PyUnicode_AS_UNICODE(v))))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1712 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1713 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1714
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1715 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1716 Py_XDECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1717 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1718 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1719
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1720 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1721 int charmap_encoding_error(const Py_UNICODE **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1722 char **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1723 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1724 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1725 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1726 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1727 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1728 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1729 "charmap encoding error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1730 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1731 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1732 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1733 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1734 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1735 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1736 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1737 **dest = '?';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1738 (*dest)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1739 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1740 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1741 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1742 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1743 "charmap encoding error; "
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1744 "unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1745 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1746 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1747 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1748 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1749
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1750 PyObject PyUnicode_EncodeCharmap(const Py_UNICODE p,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1751 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1752 PyObject *mapping,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1753 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1754 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1755 PyObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1756 char *s;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1757
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1758 /* Default to Latin-1 */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1759 if (mapping == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1760 return PyUnicode_EncodeLatin1(p, size, errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1761
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1762 v = PyString_FromStringAndSize(NULL, size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1763 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1764 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1765 s = PyString_AS_STRING(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1766 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1767 Py_UNICODE ch = *p++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1768 PyObject w, x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1769
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1770 /* Get mapping (Unicode ordinal -> string char, integer or None) */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1771 w = PyInt_FromLong((long)ch);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1772 if (w == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1773 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1774 x = PyObject_GetItem(mapping, w);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1775 Py_DECREF(w);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1776 if (x == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1777 if (PyErr_ExceptionMatches(PyExc_LookupError)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1778 /* No mapping found: default to Latin-1 mapping if possible */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1779 PyErr_Clear();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1780 if (ch < 256) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1781 *s++ = (char)ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1782 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1783 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1784 else if (!charmap_encoding_error(&p, &s, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1785 "missing character mapping"))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1786 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1787 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1788 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1789 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1790
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1791 /* Apply mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1792 if (PyInt_Check(x)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1793 int value = PyInt_AS_LONG(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1794 if (value < 0 \|\| value > 255) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1795 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1796 "character mapping must be in range(256)");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1797 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1798 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1799 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1800 *s++ = (char)value;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1801 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1802 else if (x == Py_None) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1803 /* undefined mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1804 if (charmap_encoding_error(&p, &s, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1805 "character maps to <undefined>")) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1806 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1807 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1808 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1809 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1810 else if (PyString_Check(x)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1811 if (PyString_GET_SIZE(x) != 1) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1812 /* 1-n mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1813 PyErr_SetString(PyExc_NotImplementedError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1814 "1-n mappings are currently not implemented");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1815 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1816 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1817 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1818 s++ = PyString_AS_STRING(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1819 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1820 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1821 /* wrong return value */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1822 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1823 "character mapping must return integer, None or unicode");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1824 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1825 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1826 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1827 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1828 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1829 if (s - PyString_AS_STRING(v) < PyString_GET_SIZE(v))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1830 if (_PyString_Resize(&v, (int)(s - PyString_AS_STRING(v))))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1831 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1832 return v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1833
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1834 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1835 Py_DECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1836 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1837 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1838
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1839 PyObject PyUnicode_AsCharmapString(PyObject unicode,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1840 PyObject *mapping)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1841 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1842 if (!PyUnicode_Check(unicode) \|\| mapping == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1843 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1844 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1845 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1846 return PyUnicode_EncodeCharmap(PyUnicode_AS_UNICODE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1847 PyUnicode_GET_SIZE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1848 mapping,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1849 NULL);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1850 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1851
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1852 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1853 int translate_error(const Py_UNICODE **source,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1854 Py_UNICODE **dest,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1855 const char *errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1856 const char *details)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1857 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1858 if ((errors == NULL) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1859 (strcmp(errors,"strict") == 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1860 PyErr_Format(PyExc_UnicodeError,
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1861 "translate error: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1862 details);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1863 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1864 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1865 else if (strcmp(errors,"ignore") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1866 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1867 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1868 else if (strcmp(errors,"replace") == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1869 **dest = '?';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1870 (*dest)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1871 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1872 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1873 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1874 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1875 "translate error; "
12320 5de0b939fe61 Skip Montanaro: add string precisions to calls to PyErr_Format Guido van Rossum <guido@python.org> parents: 12275 diff changeset	1876 "unknown error handling code: %.400s",
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1877 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1878 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1879 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1880 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1881
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1882 PyObject PyUnicode_TranslateCharmap(const Py_UNICODE s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1883 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1884 PyObject *mapping,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1885 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1886 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1887 PyUnicodeObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1888 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1889
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1890 if (mapping == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1891 PyErr_BadArgument();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1892 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1893 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1894
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1895 /* Output will never be longer than input */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1896 v = _PyUnicode_New(size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1897 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1898 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1899 if (size == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1900 goto done;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1901 p = PyUnicode_AS_UNICODE(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1902 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1903 Py_UNICODE ch = *s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1904 PyObject w, x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1905
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1906 /* Get mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1907 w = PyInt_FromLong(ch);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1908 if (w == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1909 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1910 x = PyObject_GetItem(mapping, w);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1911 Py_DECREF(w);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1912 if (x == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1913 if (PyErr_ExceptionMatches(PyExc_LookupError)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1914 /* No mapping found: default to 1-1 mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1915 PyErr_Clear();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1916 *p++ = ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1917 continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1918 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1919 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1920 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1921
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1922 /* Apply mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1923 if (PyInt_Check(x))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1924 *p++ = (Py_UNICODE)PyInt_AS_LONG(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1925 else if (x == Py_None) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1926 /* undefined mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1927 if (translate_error(&s, &p, errors,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1928 "character maps to <undefined>")) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1929 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1930 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1931 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1932 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1933 else if (PyUnicode_Check(x)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1934 if (PyUnicode_GET_SIZE(x) != 1) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1935 /* 1-n mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1936 PyErr_SetString(PyExc_NotImplementedError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1937 "1-n mappings are currently not implemented");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1938 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1939 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1940 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1941 p++ = PyUnicode_AS_UNICODE(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1942 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1943 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1944 /* wrong return value */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1945 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1946 "translate mapping must return integer, None or unicode");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1947 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1948 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1949 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1950 Py_DECREF(x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1951 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1952 if (p - PyUnicode_AS_UNICODE(v) < PyUnicode_GET_SIZE(v))
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1953 if (_PyUnicode_Resize(v, (int)(p - PyUnicode_AS_UNICODE(v))))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	1954 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1955
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1956 done:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1957 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1958
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1959 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1960 Py_XDECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1961 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1962 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1963
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1964 PyObject PyUnicode_Translate(PyObject str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1965 PyObject *mapping,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1966 const char *errors)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1967 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1968 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1969
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1970 str = PyUnicode_FromObject(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1971 if (str == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1972 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1973 result = PyUnicode_TranslateCharmap(PyUnicode_AS_UNICODE(str),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1974 PyUnicode_GET_SIZE(str),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1975 mapping,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1976 errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1977 Py_DECREF(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1978 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1979
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1980 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1981 Py_XDECREF(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1982 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1983 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	1984
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1985 /* --- Decimal Encoder ---------------------------------------------------- */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1986
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1987 int PyUnicode_EncodeDecimal(Py_UNICODE *s,
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1988 int length,
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1989 char *output,
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1990 const char *errors)
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1991 {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1992 Py_UNICODE p, end;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1993
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1994 if (output == NULL) {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1995 PyErr_BadArgument();
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1996 return -1;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1997 }
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1998
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	1999 p = s;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2000 end = s + length;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2001 while (p < end) {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2002 register Py_UNICODE ch = *p++;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2003 int decimal;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2004
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2005 if (Py_UNICODE_ISSPACE(ch)) {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2006 *output++ = ' ';
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2007 continue;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2008 }
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2009 decimal = Py_UNICODE_TODECIMAL(ch);
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2010 if (decimal >= 0) {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2011 *output++ = '0' + decimal;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2012 continue;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2013 }
12275 cbfa95a6a03e Conrad Huang points out that "if (0 < ch < 256)", while legal C, Guido van Rossum <guido@python.org> parents: 12249 diff changeset	2014 if (0 < ch && ch < 256) {
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	2015 *output++ = ch;
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2016 continue;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2017 }
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2018 /* All other characters are considered invalid */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2019 if (errors == NULL \|\| strcmp(errors, "strict") == 0) {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2020 PyErr_SetString(PyExc_ValueError,
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2021 "invalid decimal Unicode string");
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2022 goto onError;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2023 }
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2024 else if (strcmp(errors, "ignore") == 0)
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2025 continue;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2026 else if (strcmp(errors, "replace") == 0) {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2027 *output++ = '?';
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2028 continue;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2029 }
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2030 }
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2031 /* 0-terminate the output string */
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2032 *output++ = '\0';
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2033 return 0;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2034
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2035 onError:
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2036 return -1;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2037 }
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2038
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2039 /* --- Helpers ------------------------------------------------------------ */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2040
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2041 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2042 int count(PyUnicodeObject *self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2043 int start,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2044 int end,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2045 PyUnicodeObject *substring)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2046 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2047 int count = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2048
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2049 end -= substring->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2050
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2051 while (start <= end)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2052 if (Py_UNICODE_MATCH(self, start, substring)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2053 count++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2054 start += substring->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2055 } else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2056 start++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2057
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2058 return count;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2059 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2060
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2061 int PyUnicode_Count(PyObject *str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2062 PyObject *substr,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2063 int start,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2064 int end)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2065 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2066 int result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2067
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2068 str = PyUnicode_FromObject(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2069 if (str == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2070 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2071 substr = PyUnicode_FromObject(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2072 if (substr == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2073 Py_DECREF(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2074 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2075 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2076
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2077 result = count((PyUnicodeObject *)str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2078 start, end,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2079 (PyUnicodeObject *)substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2080
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2081 Py_DECREF(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2082 Py_DECREF(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2083 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2084 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2085
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2086 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2087 int findstring(PyUnicodeObject *self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2088 PyUnicodeObject *substring,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2089 int start,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2090 int end,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2091 int direction)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2092 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2093 if (start < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2094 start += self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2095 if (start < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2096 start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2097
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2098 if (substring->length == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2099 return start;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2100
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2101 if (end > self->length)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2102 end = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2103 if (end < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2104 end += self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2105 if (end < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2106 end = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2107
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2108 end -= substring->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2109
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2110 if (direction < 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2111 for (; end >= start; end--)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2112 if (Py_UNICODE_MATCH(self, end, substring))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2113 return end;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2114 } else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2115 for (; start <= end; start++)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2116 if (Py_UNICODE_MATCH(self, start, substring))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2117 return start;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2118 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2119
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2120 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2121 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2122
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2123 int PyUnicode_Find(PyObject *str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2124 PyObject *substr,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2125 int start,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2126 int end,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2127 int direction)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2128 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2129 int result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2130
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2131 str = PyUnicode_FromObject(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2132 if (str == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2133 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2134 substr = PyUnicode_FromObject(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2135 if (substr == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2136 Py_DECREF(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2137 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2138 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2139
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2140 result = findstring((PyUnicodeObject *)str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2141 (PyUnicodeObject *)substr,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2142 start, end, direction);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2143 Py_DECREF(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2144 Py_DECREF(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2145 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2146 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2147
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2148 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2149 int tailmatch(PyUnicodeObject *self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2150 PyUnicodeObject *substring,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2151 int start,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2152 int end,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2153 int direction)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2154 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2155 if (start < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2156 start += self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2157 if (start < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2158 start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2159
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2160 if (substring->length == 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2161 return 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2162
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2163 if (end > self->length)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2164 end = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2165 if (end < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2166 end += self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2167 if (end < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2168 end = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2169
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2170 end -= substring->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2171 if (end < start)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2172 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2173
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2174 if (direction > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2175 if (Py_UNICODE_MATCH(self, end, substring))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2176 return 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2177 } else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2178 if (Py_UNICODE_MATCH(self, start, substring))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2179 return 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2180 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2181
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2182 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2183 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2184
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2185 int PyUnicode_Tailmatch(PyObject *str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2186 PyObject *substr,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2187 int start,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2188 int end,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2189 int direction)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2190 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2191 int result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2192
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2193 str = PyUnicode_FromObject(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2194 if (str == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2195 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2196 substr = PyUnicode_FromObject(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2197 if (substr == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2198 Py_DECREF(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2199 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2200 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2201
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2202 result = tailmatch((PyUnicodeObject *)str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2203 (PyUnicodeObject *)substr,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2204 start, end, direction);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2205 Py_DECREF(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2206 Py_DECREF(substr);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2207 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2208 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2209
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2210 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2211 const Py_UNICODE findchar(const Py_UNICODE s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2212 int size,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2213 Py_UNICODE ch)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2214 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2215 /* like wcschr, but doesn't stop at NULL characters */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2216
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2217 while (size-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2218 if (*s == ch)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2219 return s;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2220 s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2221 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2222
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2223 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2224 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2225
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2226 /* Apply fixfct filter to the Unicode object self and return a
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2227 reference to the modified object */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2228
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2229 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2230 PyObject fixup(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2231 int (fixfct)(PyUnicodeObject s))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2232 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2233
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2234 PyUnicodeObject *u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2235
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2236 u = (PyUnicodeObject*) PyUnicode_FromUnicode(self->str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2237 self->length);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2238 if (u == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2239 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2240 if (!fixfct(u)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2241 /* fixfct should return TRUE if it modified the buffer. If
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2242 FALSE, return a reference to the original buffer instead
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2243 (to save space, not time) */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2244 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2245 Py_DECREF(u);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2246 return (PyObject*) self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2247 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2248 return (PyObject*) u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2249 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2250
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2251 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2252 int fixupper(PyUnicodeObject *self)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2253 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2254 int len = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2255 Py_UNICODE *s = self->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2256 int status = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2257
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2258 while (len-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2259 register Py_UNICODE ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2260
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2261 ch = Py_UNICODE_TOUPPER(*s);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2262 if (ch != *s) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2263 status = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2264 *s = ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2265 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2266 s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2267 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2268
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2269 return status;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2270 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2271
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2272 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2273 int fixlower(PyUnicodeObject *self)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2274 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2275 int len = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2276 Py_UNICODE *s = self->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2277 int status = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2278
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2279 while (len-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2280 register Py_UNICODE ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2281
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2282 ch = Py_UNICODE_TOLOWER(*s);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2283 if (ch != *s) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2284 status = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2285 *s = ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2286 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2287 s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2288 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2289
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2290 return status;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2291 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2292
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2293 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2294 int fixswapcase(PyUnicodeObject *self)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2295 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2296 int len = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2297 Py_UNICODE *s = self->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2298 int status = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2299
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2300 while (len-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2301 if (Py_UNICODE_ISUPPER(*s)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2302 s = Py_UNICODE_TOLOWER(s);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2303 status = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2304 } else if (Py_UNICODE_ISLOWER(*s)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2305 s = Py_UNICODE_TOUPPER(s);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2306 status = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2307 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2308 s++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2309 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2310
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2311 return status;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2312 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2313
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2314 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2315 int fixcapitalize(PyUnicodeObject *self)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2316 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2317 if (self->length > 0 && Py_UNICODE_ISLOWER(self->str[0])) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2318 self->str[0] = Py_UNICODE_TOUPPER(self->str[0]);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2319 return 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2320 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2321 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2322 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2323
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2324 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2325 int fixtitle(PyUnicodeObject *self)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2326 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2327 register Py_UNICODE *p = PyUnicode_AS_UNICODE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2328 register Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2329 int previous_is_cased;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2330
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2331 /* Shortcut for single character strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2332 if (PyUnicode_GET_SIZE(self) == 1) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2333 Py_UNICODE ch = Py_UNICODE_TOTITLE(*p);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2334 if (*p != ch) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2335 *p = ch;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2336 return 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2337 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2338 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2339 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2340 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2341
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2342 e = p + PyUnicode_GET_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2343 previous_is_cased = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2344 for (; p < e; p++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2345 register const Py_UNICODE ch = *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2346
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2347 if (previous_is_cased)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2348 *p = Py_UNICODE_TOLOWER(ch);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2349 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2350 *p = Py_UNICODE_TOTITLE(ch);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2351
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2352 if (Py_UNICODE_ISLOWER(ch) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2353 Py_UNICODE_ISUPPER(ch) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2354 Py_UNICODE_ISTITLE(ch))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2355 previous_is_cased = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2356 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2357 previous_is_cased = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2358 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2359 return 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2360 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2361
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2362 PyObject PyUnicode_Join(PyObject separator,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2363 PyObject *seq)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2364 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2365 Py_UNICODE *sep;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2366 int seplen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2367 PyUnicodeObject *res = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2368 int reslen = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2369 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2370 int seqlen = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2371 int sz = 100;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2372 int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2373
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2374 seqlen = PySequence_Length(seq);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2375 if (seqlen < 0 && PyErr_Occurred())
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2376 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2377
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2378 if (separator == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2379 Py_UNICODE blank = ' ';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2380 sep = &blank;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2381 seplen = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2382 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2383 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2384 separator = PyUnicode_FromObject(separator);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2385 if (separator == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2386 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2387 sep = PyUnicode_AS_UNICODE(separator);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2388 seplen = PyUnicode_GET_SIZE(separator);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2389 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2390
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2391 res = _PyUnicode_New(sz);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2392 if (res == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2393 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2394 p = PyUnicode_AS_UNICODE(res);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2395 reslen = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2396
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2397 for (i = 0; i < seqlen; i++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2398 int itemlen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2399 PyObject *item;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2400
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2401 item = PySequence_GetItem(seq, i);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2402 if (item == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2403 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2404 if (!PyUnicode_Check(item)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2405 PyObject *v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2406 v = PyUnicode_FromObject(item);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2407 Py_DECREF(item);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2408 item = v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2409 if (item == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2410 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2411 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2412 itemlen = PyUnicode_GET_SIZE(item);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2413 while (reslen + itemlen + seplen >= sz) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2414 if (_PyUnicode_Resize(res, sz*2))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2415 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2416 sz *= 2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2417 p = PyUnicode_AS_UNICODE(res) + reslen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2418 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2419 if (i > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2420 memcpy(p, sep, seplen * sizeof(Py_UNICODE));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2421 p += seplen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2422 reslen += seplen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2423 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2424 memcpy(p, PyUnicode_AS_UNICODE(item), itemlen * sizeof(Py_UNICODE));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2425 p += itemlen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2426 reslen += itemlen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2427 Py_DECREF(item);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2428 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2429 if (_PyUnicode_Resize(res, reslen))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2430 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2431
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2432 Py_XDECREF(separator);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2433 return (PyObject *)res;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2434
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2435 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2436 Py_XDECREF(separator);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2437 Py_DECREF(res);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2438 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2439 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2440
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2441 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2442 PyUnicodeObject pad(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2443 int left,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2444 int right,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2445 Py_UNICODE fill)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2446 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2447 PyUnicodeObject *u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2448
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2449 if (left < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2450 left = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2451 if (right < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2452 right = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2453
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2454 if (left == 0 && right == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2455 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2456 return self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2457 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2458
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2459 u = _PyUnicode_New(left + self->length + right);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2460 if (u) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2461 if (left)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2462 Py_UNICODE_FILL(u->str, fill, left);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2463 Py_UNICODE_COPY(u->str + left, self->str, self->length);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2464 if (right)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2465 Py_UNICODE_FILL(u->str + left + self->length, fill, right);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2466 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2467
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2468 return u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2469 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2470
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2471 #define SPLIT_APPEND(data, left, right) \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2472 str = PyUnicode_FromUnicode(data + left, right - left); \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2473 if (!str) \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2474 goto onError; \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2475 if (PyList_Append(list, str)) { \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2476 Py_DECREF(str); \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2477 goto onError; \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2478 } \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2479 else \
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2480 Py_DECREF(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2481
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2482 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2483 PyObject split_whitespace(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2484 PyObject *list,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2485 int maxcount)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2486 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2487 register int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2488 register int j;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2489 int len = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2490 PyObject *str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2491
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2492 for (i = j = 0; i < len; ) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2493 /* find a token */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2494 while (i < len && Py_UNICODE_ISSPACE(self->str[i]))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2495 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2496 j = i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2497 while (i < len && !Py_UNICODE_ISSPACE(self->str[i]))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2498 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2499 if (j < i) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2500 if (maxcount-- <= 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2501 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2502 SPLIT_APPEND(self->str, j, i);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2503 while (i < len && Py_UNICODE_ISSPACE(self->str[i]))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2504 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2505 j = i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2506 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2507 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2508 if (j < len) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2509 SPLIT_APPEND(self->str, j, len);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2510 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2511 return list;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2512
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2513 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2514 Py_DECREF(list);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2515 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2516 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2517
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2518 PyObject PyUnicode_Splitlines(PyObject string,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2519 int maxcount)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2520 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2521 register int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2522 register int j;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2523 int len;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2524 PyObject *list;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2525 PyObject *str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2526 Py_UNICODE *data;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2527
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2528 string = PyUnicode_FromObject(string);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2529 if (string == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2530 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2531 data = PyUnicode_AS_UNICODE(string);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2532 len = PyUnicode_GET_SIZE(string);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2533
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2534 if (maxcount < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2535 maxcount = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2536
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2537 list = PyList_New(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2538 if (!list)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2539 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2540
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2541 for (i = j = 0; i < len; ) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2542 /* Find a line and append it */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2543 while (i < len && !Py_UNICODE_ISLINEBREAK(data[i]))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2544 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2545 if (maxcount-- <= 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2546 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2547 SPLIT_APPEND(data, j, i);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2548
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2549 /* Skip the line break reading CRLF as one line break */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2550 if (i < len) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2551 if (data[i] == '\r' && i + 1 < len &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2552 data[i+1] == '\n')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2553 i += 2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2554 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2555 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2556 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2557 j = i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2558 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2559 if (j < len) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2560 SPLIT_APPEND(data, j, len);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2561 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2562
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2563 Py_DECREF(string);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2564 return list;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2565
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2566 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2567 Py_DECREF(list);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2568 Py_DECREF(string);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2569 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2570 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2571
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2572 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2573 PyObject split_char(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2574 PyObject *list,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2575 Py_UNICODE ch,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2576 int maxcount)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2577 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2578 register int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2579 register int j;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2580 int len = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2581 PyObject *str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2582
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2583 for (i = j = 0; i < len; ) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2584 if (self->str[i] == ch) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2585 if (maxcount-- <= 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2586 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2587 SPLIT_APPEND(self->str, j, i);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2588 i = j = i + 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2589 } else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2590 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2591 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2592 if (j <= len) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2593 SPLIT_APPEND(self->str, j, len);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2594 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2595 return list;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2596
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2597 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2598 Py_DECREF(list);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2599 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2600 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2601
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2602 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2603 PyObject split_substring(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2604 PyObject *list,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2605 PyUnicodeObject *substring,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2606 int maxcount)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2607 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2608 register int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2609 register int j;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2610 int len = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2611 int sublen = substring->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2612 PyObject *str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2613
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2614 for (i = j = 0; i < len - sublen; ) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2615 if (Py_UNICODE_MATCH(self, i, substring)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2616 if (maxcount-- <= 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2617 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2618 SPLIT_APPEND(self->str, j, i);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2619 i = j = i + sublen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2620 } else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2621 i++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2622 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2623 if (j <= len) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2624 SPLIT_APPEND(self->str, j, len);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2625 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2626 return list;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2627
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2628 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2629 Py_DECREF(list);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2630 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2631 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2632
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2633 #undef SPLIT_APPEND
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2634
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2635 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2636 PyObject split(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2637 PyUnicodeObject *substring,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2638 int maxcount)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2639 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2640 PyObject *list;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2641
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2642 if (maxcount < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2643 maxcount = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2644
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2645 list = PyList_New(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2646 if (!list)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2647 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2648
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2649 if (substring == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2650 return split_whitespace(self,list,maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2651
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2652 else if (substring->length == 1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2653 return split_char(self,list,substring->str[0],maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2654
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2655 else if (substring->length == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2656 Py_DECREF(list);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2657 PyErr_SetString(PyExc_ValueError, "empty separator");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2658 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2659 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2660 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2661 return split_substring(self,list,substring,maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2662 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2663
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2664 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2665 PyObject strip(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2666 int left,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2667 int right)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2668 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2669 Py_UNICODE *p = self->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2670 int start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2671 int end = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2672
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2673 if (left)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2674 while (start < end && Py_UNICODE_ISSPACE(p[start]))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2675 start++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2676
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2677 if (right)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2678 while (end > start && Py_UNICODE_ISSPACE(p[end-1]))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2679 end--;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2680
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2681 if (start == 0 && end == self->length) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2682 /* couldn't strip anything off, return original string */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2683 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2684 return (PyObject*) self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2685 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2686
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2687 return (PyObject*) PyUnicode_FromUnicode(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2688 self->str + start,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2689 end - start
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2690 );
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2691 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2692
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2693 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2694 PyObject replace(PyUnicodeObject self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2695 PyUnicodeObject *str1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2696 PyUnicodeObject *str2,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2697 int maxcount)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2698 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2699 PyUnicodeObject *u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2700
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2701 if (maxcount < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2702 maxcount = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2703
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2704 if (str1->length == 1 && str2->length == 1) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2705 int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2706
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2707 /* replace characters */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2708 if (!findchar(self->str, self->length, str1->str[0])) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2709 /* nothing to replace, return original string */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2710 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2711 u = self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2712 } else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2713 Py_UNICODE u1 = str1->str[0];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2714 Py_UNICODE u2 = str2->str[0];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2715
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2716 u = (PyUnicodeObject*) PyUnicode_FromUnicode(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2717 self->str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2718 self->length
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2719 );
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2720 if (u)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2721 for (i = 0; i < u->length; i++)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2722 if (u->str[i] == u1) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2723 if (--maxcount < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2724 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2725 u->str[i] = u2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2726 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2727 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2728
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2729 } else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2730 int n, i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2731 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2732
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2733 /* replace strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2734 n = count(self, 0, self->length, str1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2735 if (n > maxcount)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2736 n = maxcount;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2737 if (n == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2738 /* nothing to replace, return original string */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2739 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2740 u = self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2741 } else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2742 u = _PyUnicode_New(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2743 self->length + n * (str2->length - str1->length));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2744 if (u) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2745 i = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2746 p = u->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2747 while (i <= self->length - str1->length)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2748 if (Py_UNICODE_MATCH(self, i, str1)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2749 /* replace string segment */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2750 Py_UNICODE_COPY(p, str2->str, str2->length);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2751 p += str2->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2752 i += str1->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2753 if (--n <= 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2754 /* copy remaining part */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2755 Py_UNICODE_COPY(p, self->str+i, self->length-i);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2756 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2757 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2758 } else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2759 *p++ = self->str[i++];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2760 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2761 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2762 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2763
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2764 return (PyObject *) u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2765 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2766
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2767 /* --- Unicode Object Methods --------------------------------------------- */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2768
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2769 static char title__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2770 "S.title() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2771 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2772 Return a titlecased version of S, i.e. words start with title case\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2773 characters, all remaining cased characters have lower case.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2774
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2775 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2776 unicode_title(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2777 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2778 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2779 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2780 return fixup(self, fixtitle);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2781 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2782
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2783 static char capitalize__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2784 "S.capitalize() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2785 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2786 Return a capitalized version of S, i.e. make the first character\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2787 have upper case.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2788
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2789 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2790 unicode_capitalize(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2791 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2792 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2793 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2794 return fixup(self, fixcapitalize);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2795 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2796
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2797 #if 0
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2798 static char capwords__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2799 "S.capwords() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2800 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2801 Apply .capitalize() to all words in S and return the result with\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2802 normalized whitespace (all whitespace strings are replaced by ' ').";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2803
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2804 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2805 unicode_capwords(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2806 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2807 PyObject *list;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2808 PyObject *item;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2809 int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2810
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2811 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2812 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2813
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2814 /* Split into words */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2815 list = split(self, NULL, -1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2816 if (!list)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2817 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2818
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2819 /* Capitalize each word */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2820 for (i = 0; i < PyList_GET_SIZE(list); i++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2821 item = fixup((PyUnicodeObject *)PyList_GET_ITEM(list, i),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2822 fixcapitalize);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2823 if (item == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2824 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2825 Py_DECREF(PyList_GET_ITEM(list, i));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2826 PyList_SET_ITEM(list, i, item);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2827 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2828
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2829 /* Join the words to form a new string */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2830 item = PyUnicode_Join(NULL, list);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2831
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2832 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2833 Py_DECREF(list);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2834 return (PyObject *)item;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2835 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2836 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2837
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2838 static char center__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2839 "S.center(width) -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2840 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2841 Return S centered in a Unicode string of length width. Padding is done\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2842 using spaces.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2843
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2844 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2845 unicode_center(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2846 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2847 int marg, left;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2848 int width;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2849
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2850 if (!PyArg_ParseTuple(args, "i:center", &width))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2851 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2852
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2853 if (self->length >= width) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2854 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2855 return (PyObject*) self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2856 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2857
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2858 marg = width - self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2859 left = marg / 2 + (marg & width & 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2860
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2861 return (PyObject*) pad(self, left, marg - left, ' ');
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2862 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2863
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2864 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2865 unicode_compare(PyUnicodeObject str1, PyUnicodeObject str2)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2866 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2867 int len1, len2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2868 Py_UNICODE *s1 = str1->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2869 Py_UNICODE *s2 = str2->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2870
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2871 len1 = str1->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2872 len2 = str2->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2873
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2874 while (len1 > 0 && len2 > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2875 int cmp = (s1++) - (s2++);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2876 if (cmp)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2877 /* This should make Christian happy! */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2878 return (cmp < 0) ? -1 : (cmp != 0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2879 len1--, len2--;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2880 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2881
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2882 return (len1 < len2) ? -1 : (len1 != len2);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2883 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2884
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2885 int PyUnicode_Compare(PyObject *left,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2886 PyObject *right)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2887 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2888 PyUnicodeObject u = NULL, v = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2889 int result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2890
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2891 /* Coerce the two arguments */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2892 u = (PyUnicodeObject *)PyUnicode_FromObject(left);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2893 if (u == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2894 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2895 v = (PyUnicodeObject *)PyUnicode_FromObject(right);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2896 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2897 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2898
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2899 /* Shortcut for emtpy or interned objects */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2900 if (v == u) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2901 Py_DECREF(u);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2902 Py_DECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2903 return 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2904 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2905
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2906 result = unicode_compare(u, v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2907
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2908 Py_DECREF(u);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2909 Py_DECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2910 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2911
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2912 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2913 Py_XDECREF(u);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2914 Py_XDECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2915 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2916 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2917
11997 38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2918 int PyUnicode_Contains(PyObject *container,
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2919 PyObject *element)
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2920 {
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2921 PyUnicodeObject u = NULL, v = NULL;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2922 int result;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2923 register const Py_UNICODE p, e;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2924 register Py_UNICODE ch;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2925
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2926 /* Coerce the two arguments */
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2927 v = (PyUnicodeObject *)PyUnicode_FromObject(element);
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2928 if (v == NULL)
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2929 goto onError;
12248 70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2930 u = (PyUnicodeObject *)PyUnicode_FromObject(container);
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2931 if (u == NULL) {
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2932 Py_DECREF(v);
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2933 goto onError;
70154e2e9c89 Marc-Andre's third try at this bulk patch seems to work (except that Guido van Rossum <guido@python.org> parents: 12193 diff changeset	2934 }
11997 38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2935
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2936 /* Check v in u */
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2937 if (PyUnicode_GET_SIZE(v) != 1) {
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2938 PyErr_SetString(PyExc_TypeError,
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2939 "string member test needs char left operand");
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2940 goto onError;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2941 }
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2942 ch = *PyUnicode_AS_UNICODE(v);
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2943 p = PyUnicode_AS_UNICODE(u);
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2944 e = p + PyUnicode_GET_SIZE(u);
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2945 result = 0;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2946 while (p < e) {
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2947 if (*p++ == ch) {
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2948 result = 1;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2949 break;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2950 }
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2951 }
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2952
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2953 Py_DECREF(u);
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2954 Py_DECREF(v);
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2955 return result;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2956
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2957 onError:
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2958 Py_XDECREF(u);
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2959 Py_XDECREF(v);
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2960 return -1;
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2961 }
38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	2962
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2963 /* Concat to string or Unicode object giving a new Unicode object. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2964
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2965 PyObject PyUnicode_Concat(PyObject left,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2966 PyObject *right)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2967 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2968 PyUnicodeObject u = NULL, v = NULL, *w;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2969
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2970 /* Coerce the two arguments */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2971 u = (PyUnicodeObject *)PyUnicode_FromObject(left);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2972 if (u == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2973 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2974 v = (PyUnicodeObject *)PyUnicode_FromObject(right);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2975 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2976 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2977
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2978 /* Shortcuts */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2979 if (v == unicode_empty) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2980 Py_DECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2981 return (PyObject *)u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2982 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2983 if (u == unicode_empty) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2984 Py_DECREF(u);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2985 return (PyObject *)v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2986 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2987
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2988 /* Concat the two Unicode strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2989 w = _PyUnicode_New(u->length + v->length);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2990 if (w == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2991 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2992 Py_UNICODE_COPY(w->str, u->str, u->length);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2993 Py_UNICODE_COPY(w->str + u->length, v->str, v->length);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2994
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2995 Py_DECREF(u);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2996 Py_DECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2997 return (PyObject *)w;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2998
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	2999 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3000 Py_XDECREF(u);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3001 Py_XDECREF(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3002 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3003 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3004
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3005 static char count__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3006 "S.count(sub[, start[, end]]) -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3007 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3008 Return the number of occurrences of substring sub in Unicode string\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3009 S[start:end]. Optional arguments start and end are\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3010 interpreted as in slice notation.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3011
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3012 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3013 unicode_count(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3014 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3015 PyUnicodeObject *substring;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3016 int start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3017 int end = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3018 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3019
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3020 if (!PyArg_ParseTuple(args, "O\|ii:count", &substring, &start, &end))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3021 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3022
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3023 substring = (PyUnicodeObject *)PyUnicode_FromObject(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3024 (PyObject *)substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3025 if (substring == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3026 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3027
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3028 if (substring->length == 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3029 Py_DECREF(substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3030 return PyInt_FromLong((long) 0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3031 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3032
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3033 if (start < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3034 start += self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3035 if (start < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3036 start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3037 if (end > self->length)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3038 end = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3039 if (end < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3040 end += self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3041 if (end < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3042 end = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3043
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3044 result = PyInt_FromLong((long) count(self, start, end, substring));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3045
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3046 Py_DECREF(substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3047 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3048 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3049
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3050 static char encode__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3051 "S.encode([encoding[,errors]]) -> string\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3052 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3053 Return an encoded string version of S. Default encoding is 'UTF-8'.\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3054 errors may be given to set a different error handling scheme. Default\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3055 is 'strict' meaning that encoding errors raise a ValueError. Other\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3056 possible values are 'ignore' and 'replace'.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3057
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3058 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3059 unicode_encode(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3060 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3061 char *encoding = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3062 char *errors = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3063 if (!PyArg_ParseTuple(args, "\|ss:encode", &encoding, &errors))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3064 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3065 return PyUnicode_AsEncodedString((PyObject *)self, encoding, errors);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3066 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3067
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3068 static char expandtabs__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3069 "S.expandtabs([tabsize]) -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3070 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3071 Return a copy of S where all tab characters are expanded using spaces.\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3072 If tabsize is not given, a tab size of 8 characters is assumed.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3073
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3074 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3075 unicode_expandtabs(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3076 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3077 Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3078 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3079 Py_UNICODE *q;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3080 int i, j;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3081 PyUnicodeObject *u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3082 int tabsize = 8;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3083
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3084 if (!PyArg_ParseTuple(args, "\|i:expandtabs", &tabsize))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3085 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3086
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3087 /* First pass: determine size of ouput string */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3088 i = j = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3089 e = self->str + self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3090 for (p = self->str; p < e; p++)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3091 if (*p == '\t') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3092 if (tabsize > 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3093 j += tabsize - (j % tabsize);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3094 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3095 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3096 j++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3097 if (p == '\n' \|\| p == '\r') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3098 i += j;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3099 j = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3100 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3101 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3102
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3103 /* Second pass: create output string and fill it */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3104 u = _PyUnicode_New(i + j);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3105 if (!u)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3106 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3107
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3108 j = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3109 q = u->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3110
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3111 for (p = self->str; p < e; p++)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3112 if (*p == '\t') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3113 if (tabsize > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3114 i = tabsize - (j % tabsize);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3115 j += i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3116 while (i--)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3117 *q++ = ' ';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3118 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3119 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3120 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3121 j++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3122 q++ = p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3123 if (p == '\n' \|\| p == '\r')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3124 j = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3125 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3126
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3127 return (PyObject*) u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3128 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3129
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3130 static char find__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3131 "S.find(sub [,start [,end]]) -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3132 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3133 Return the lowest index in S where substring sub is found,\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3134 such that sub is contained within s[start,end]. Optional\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3135 arguments start and end are interpreted as in slice notation.\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3136 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3137 Return -1 on failure.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3138
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3139 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3140 unicode_find(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3141 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3142 PyUnicodeObject *substring;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3143 int start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3144 int end = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3145 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3146
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3147 if (!PyArg_ParseTuple(args, "O\|ii:find", &substring, &start, &end))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3148 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3149 substring = (PyUnicodeObject *)PyUnicode_FromObject(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3150 (PyObject *)substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3151 if (substring == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3152 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3153
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3154 result = PyInt_FromLong(findstring(self, substring, start, end, 1));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3155
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3156 Py_DECREF(substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3157 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3158 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3159
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3160 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3161 unicode_getitem(PyUnicodeObject *self, int index)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3162 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3163 if (index < 0 \|\| index >= self->length) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3164 PyErr_SetString(PyExc_IndexError, "string index out of range");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3165 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3166 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3167
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3168 return (PyObject*) PyUnicode_FromUnicode(&self->str[index], 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3169 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3170
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3171 static long
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3172 unicode_hash(PyUnicodeObject *self)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3173 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3174 long hash;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3175 PyObject *utf8;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3176
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3177 /* Since Unicode objects compare equal to their UTF-8 string
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3178 counterparts, they should also use the UTF-8 strings as basis
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3179 for their hash value. This is needed to assure that strings and
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3180 Unicode objects behave in the same way as dictionary
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3181 keys. Unfortunately, this costs some performance and also some
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3182 memory if the cached UTF-8 representation is not used later
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3183 on. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3184 if (self->hash != -1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3185 return self->hash;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3186 utf8 = utf8_string(self, NULL);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3187 if (utf8 == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3188 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3189 hash = PyObject_Hash(utf8);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3190 if (hash == -1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3191 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3192 self->hash = hash;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3193 return hash;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3194 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3195
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3196 static char index__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3197 "S.index(sub [,start [,end]]) -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3198 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3199 Like S.find() but raise ValueError when the substring is not found.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3200
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3201 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3202 unicode_index(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3203 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3204 int result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3205 PyUnicodeObject *substring;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3206 int start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3207 int end = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3208
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3209 if (!PyArg_ParseTuple(args, "O\|ii:index", &substring, &start, &end))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3210 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3211
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3212 substring = (PyUnicodeObject *)PyUnicode_FromObject(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3213 (PyObject *)substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3214 if (substring == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3215 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3216
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3217 result = findstring(self, substring, start, end, 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3218
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3219 Py_DECREF(substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3220 if (result < 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3221 PyErr_SetString(PyExc_ValueError, "substring not found");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3222 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3223 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3224 return PyInt_FromLong(result);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3225 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3226
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3227 static char islower__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3228 "S.islower() -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3229 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3230 Return 1 if all cased characters in S are lowercase and there is\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3231 at least one cased character in S, 0 otherwise.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3232
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3233 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3234 unicode_islower(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3235 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3236 register const Py_UNICODE *p = PyUnicode_AS_UNICODE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3237 register const Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3238 int cased;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3239
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3240 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3241 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3242
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3243 /* Shortcut for single character strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3244 if (PyUnicode_GET_SIZE(self) == 1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3245 return PyInt_FromLong(Py_UNICODE_ISLOWER(*p) != 0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3246
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3247 e = p + PyUnicode_GET_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3248 cased = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3249 for (; p < e; p++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3250 register const Py_UNICODE ch = *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3251
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3252 if (Py_UNICODE_ISUPPER(ch) \|\| Py_UNICODE_ISTITLE(ch))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3253 return PyInt_FromLong(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3254 else if (!cased && Py_UNICODE_ISLOWER(ch))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3255 cased = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3256 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3257 return PyInt_FromLong(cased);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3258 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3259
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3260 static char isupper__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3261 "S.isupper() -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3262 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3263 Return 1 if all cased characters in S are uppercase and there is\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3264 at least one cased character in S, 0 otherwise.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3265
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3266 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3267 unicode_isupper(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3268 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3269 register const Py_UNICODE *p = PyUnicode_AS_UNICODE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3270 register const Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3271 int cased;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3272
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3273 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3274 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3275
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3276 /* Shortcut for single character strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3277 if (PyUnicode_GET_SIZE(self) == 1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3278 return PyInt_FromLong(Py_UNICODE_ISUPPER(*p) != 0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3279
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3280 e = p + PyUnicode_GET_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3281 cased = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3282 for (; p < e; p++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3283 register const Py_UNICODE ch = *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3284
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3285 if (Py_UNICODE_ISLOWER(ch) \|\| Py_UNICODE_ISTITLE(ch))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3286 return PyInt_FromLong(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3287 else if (!cased && Py_UNICODE_ISUPPER(ch))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3288 cased = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3289 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3290 return PyInt_FromLong(cased);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3291 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3292
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3293 static char istitle__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3294 "S.istitle() -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3295 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3296 Return 1 if S is a titlecased string, i.e. upper- and titlecase characters\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3297 may only follow uncased characters and lowercase characters only cased\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3298 ones. Return 0 otherwise.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3299
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3300 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3301 unicode_istitle(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3302 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3303 register const Py_UNICODE *p = PyUnicode_AS_UNICODE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3304 register const Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3305 int cased, previous_is_cased;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3306
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3307 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3308 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3309
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3310 /* Shortcut for single character strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3311 if (PyUnicode_GET_SIZE(self) == 1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3312 return PyInt_FromLong((Py_UNICODE_ISTITLE(*p) != 0) \|\|
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3313 (Py_UNICODE_ISUPPER(*p) != 0));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3314
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3315 e = p + PyUnicode_GET_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3316 cased = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3317 previous_is_cased = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3318 for (; p < e; p++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3319 register const Py_UNICODE ch = *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3320
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3321 if (Py_UNICODE_ISUPPER(ch) \|\| Py_UNICODE_ISTITLE(ch)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3322 if (previous_is_cased)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3323 return PyInt_FromLong(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3324 previous_is_cased = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3325 cased = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3326 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3327 else if (Py_UNICODE_ISLOWER(ch)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3328 if (!previous_is_cased)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3329 return PyInt_FromLong(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3330 previous_is_cased = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3331 cased = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3332 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3333 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3334 previous_is_cased = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3335 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3336 return PyInt_FromLong(cased);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3337 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3338
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3339 static char isspace__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3340 "S.isspace() -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3341 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3342 Return 1 if there are only whitespace characters in S,\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3343 0 otherwise.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3344
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3345 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3346 unicode_isspace(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3347 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3348 register const Py_UNICODE *p = PyUnicode_AS_UNICODE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3349 register const Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3350
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3351 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3352 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3353
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3354 /* Shortcut for single character strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3355 if (PyUnicode_GET_SIZE(self) == 1 &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3356 Py_UNICODE_ISSPACE(*p))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3357 return PyInt_FromLong(1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3358
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3359 e = p + PyUnicode_GET_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3360 for (; p < e; p++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3361 if (!Py_UNICODE_ISSPACE(*p))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3362 return PyInt_FromLong(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3363 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3364 return PyInt_FromLong(1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3365 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3366
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3367 static char isdecimal__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3368 "S.isdecimal() -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3369 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3370 Return 1 if there are only decimal characters in S,\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3371 0 otherwise.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3372
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3373 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3374 unicode_isdecimal(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3375 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3376 register const Py_UNICODE *p = PyUnicode_AS_UNICODE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3377 register const Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3378
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3379 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3380 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3381
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3382 /* Shortcut for single character strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3383 if (PyUnicode_GET_SIZE(self) == 1 &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3384 Py_UNICODE_ISDECIMAL(*p))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3385 return PyInt_FromLong(1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3386
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3387 e = p + PyUnicode_GET_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3388 for (; p < e; p++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3389 if (!Py_UNICODE_ISDECIMAL(*p))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3390 return PyInt_FromLong(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3391 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3392 return PyInt_FromLong(1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3393 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3394
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3395 static char isdigit__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3396 "S.isdigit() -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3397 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3398 Return 1 if there are only digit characters in S,\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3399 0 otherwise.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3400
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3401 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3402 unicode_isdigit(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3403 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3404 register const Py_UNICODE *p = PyUnicode_AS_UNICODE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3405 register const Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3406
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3407 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3408 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3409
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3410 /* Shortcut for single character strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3411 if (PyUnicode_GET_SIZE(self) == 1 &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3412 Py_UNICODE_ISDIGIT(*p))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3413 return PyInt_FromLong(1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3414
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3415 e = p + PyUnicode_GET_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3416 for (; p < e; p++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3417 if (!Py_UNICODE_ISDIGIT(*p))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3418 return PyInt_FromLong(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3419 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3420 return PyInt_FromLong(1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3421 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3422
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3423 static char isnumeric__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3424 "S.isnumeric() -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3425 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3426 Return 1 if there are only numeric characters in S,\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3427 0 otherwise.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3428
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3429 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3430 unicode_isnumeric(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3431 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3432 register const Py_UNICODE *p = PyUnicode_AS_UNICODE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3433 register const Py_UNICODE *e;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3434
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3435 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3436 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3437
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3438 /* Shortcut for single character strings */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3439 if (PyUnicode_GET_SIZE(self) == 1 &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3440 Py_UNICODE_ISNUMERIC(*p))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3441 return PyInt_FromLong(1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3442
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3443 e = p + PyUnicode_GET_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3444 for (; p < e; p++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3445 if (!Py_UNICODE_ISNUMERIC(*p))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3446 return PyInt_FromLong(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3447 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3448 return PyInt_FromLong(1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3449 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3450
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3451 static char join__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3452 "S.join(sequence) -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3453 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3454 Return a string which is the concatenation of the strings in the\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3455 sequence. The separator between elements is S.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3456
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3457 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3458 unicode_join(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3459 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3460 PyObject *data;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3461 if (!PyArg_ParseTuple(args, "O:join", &data))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3462 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3463
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3464 return PyUnicode_Join((PyObject *)self, data);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3465 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3466
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3467 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3468 unicode_length(PyUnicodeObject *self)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3469 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3470 return self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3471 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3472
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3473 static char ljust__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3474 "S.ljust(width) -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3475 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3476 Return S left justified in a Unicode string of length width. Padding is\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3477 done using spaces.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3478
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3479 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3480 unicode_ljust(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3481 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3482 int width;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3483 if (!PyArg_ParseTuple(args, "i:ljust", &width))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3484 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3485
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3486 if (self->length >= width) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3487 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3488 return (PyObject*) self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3489 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3490
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3491 return (PyObject*) pad(self, 0, width - self->length, ' ');
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3492 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3493
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3494 static char lower__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3495 "S.lower() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3496 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3497 Return a copy of the string S converted to lowercase.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3498
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3499 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3500 unicode_lower(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3501 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3502 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3503 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3504 return fixup(self, fixlower);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3505 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3506
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3507 static char lstrip__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3508 "S.lstrip() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3509 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3510 Return a copy of the string S with leading whitespace removed.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3511
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3512 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3513 unicode_lstrip(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3514 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3515 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3516 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3517 return strip(self, 1, 0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3518 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3519
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3520 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3521 unicode_repeat(PyUnicodeObject *str, int len)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3522 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3523 PyUnicodeObject *u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3524 Py_UNICODE *p;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3525
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3526 if (len < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3527 len = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3528
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3529 if (len == 1) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3530 /* no repeat, return original string */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3531 Py_INCREF(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3532 return (PyObject*) str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3533 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3534
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3535 u = _PyUnicode_New(len * str->length);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3536 if (!u)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3537 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3538
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3539 p = u->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3540
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3541 while (len-- > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3542 Py_UNICODE_COPY(p, str->str, str->length);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3543 p += str->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3544 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3545
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3546 return (PyObject*) u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3547 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3548
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3549 PyObject PyUnicode_Replace(PyObject obj,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3550 PyObject *subobj,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3551 PyObject *replobj,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3552 int maxcount)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3553 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3554 PyObject *self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3555 PyObject *str1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3556 PyObject *str2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3557 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3558
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3559 self = PyUnicode_FromObject(obj);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3560 if (self == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3561 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3562 str1 = PyUnicode_FromObject(subobj);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3563 if (str1 == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3564 Py_DECREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3565 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3566 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3567 str2 = PyUnicode_FromObject(replobj);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3568 if (str2 == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3569 Py_DECREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3570 Py_DECREF(str1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3571 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3572 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3573 result = replace((PyUnicodeObject *)self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3574 (PyUnicodeObject *)str1,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3575 (PyUnicodeObject *)str2,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3576 maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3577 Py_DECREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3578 Py_DECREF(str1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3579 Py_DECREF(str2);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3580 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3581 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3582
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3583 static char replace__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3584 "S.replace (old, new[, maxsplit]) -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3585 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3586 Return a copy of S with all occurrences of substring\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3587 old replaced by new. If the optional argument maxsplit is\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3588 given, only the first maxsplit occurrences are replaced.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3589
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3590 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3591 unicode_replace(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3592 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3593 PyUnicodeObject *str1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3594 PyUnicodeObject *str2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3595 int maxcount = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3596 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3597
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3598 if (!PyArg_ParseTuple(args, "OO\|i:replace", &str1, &str2, &maxcount))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3599 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3600 str1 = (PyUnicodeObject )PyUnicode_FromObject((PyObject )str1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3601 if (str1 == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3602 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3603 str2 = (PyUnicodeObject )PyUnicode_FromObject((PyObject )str2);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3604 if (str2 == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3605 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3606
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3607 result = replace(self, str1, str2, maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3608
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3609 Py_DECREF(str1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3610 Py_DECREF(str2);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3611 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3612 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3613
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3614 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3615 PyObject unicode_repr(PyObject unicode)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3616 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3617 return unicodeescape_string(PyUnicode_AS_UNICODE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3618 PyUnicode_GET_SIZE(unicode),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3619 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3620 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3621
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3622 static char rfind__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3623 "S.rfind(sub [,start [,end]]) -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3624 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3625 Return the highest index in S where substring sub is found,\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3626 such that sub is contained within s[start,end]. Optional\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3627 arguments start and end are interpreted as in slice notation.\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3628 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3629 Return -1 on failure.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3630
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3631 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3632 unicode_rfind(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3633 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3634 PyUnicodeObject *substring;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3635 int start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3636 int end = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3637 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3638
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3639 if (!PyArg_ParseTuple(args, "O\|ii:rfind", &substring, &start, &end))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3640 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3641 substring = (PyUnicodeObject *)PyUnicode_FromObject(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3642 (PyObject *)substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3643 if (substring == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3644 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3645
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3646 result = PyInt_FromLong(findstring(self, substring, start, end, -1));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3647
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3648 Py_DECREF(substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3649 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3650 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3651
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3652 static char rindex__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3653 "S.rindex(sub [,start [,end]]) -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3654 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3655 Like S.rfind() but raise ValueError when the substring is not found.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3656
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3657 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3658 unicode_rindex(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3659 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3660 int result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3661 PyUnicodeObject *substring;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3662 int start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3663 int end = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3664
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3665 if (!PyArg_ParseTuple(args, "O\|ii:rindex", &substring, &start, &end))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3666 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3667 substring = (PyUnicodeObject *)PyUnicode_FromObject(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3668 (PyObject *)substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3669 if (substring == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3670 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3671
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3672 result = findstring(self, substring, start, end, -1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3673
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3674 Py_DECREF(substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3675 if (result < 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3676 PyErr_SetString(PyExc_ValueError, "substring not found");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3677 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3678 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3679 return PyInt_FromLong(result);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3680 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3681
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3682 static char rjust__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3683 "S.rjust(width) -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3684 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3685 Return S right justified in a Unicode string of length width. Padding is\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3686 done using spaces.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3687
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3688 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3689 unicode_rjust(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3690 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3691 int width;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3692 if (!PyArg_ParseTuple(args, "i:rjust", &width))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3693 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3694
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3695 if (self->length >= width) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3696 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3697 return (PyObject*) self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3698 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3699
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3700 return (PyObject*) pad(self, width - self->length, 0, ' ');
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3701 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3702
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3703 static char rstrip__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3704 "S.rstrip() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3705 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3706 Return a copy of the string S with trailing whitespace removed.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3707
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3708 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3709 unicode_rstrip(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3710 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3711 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3712 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3713 return strip(self, 0, 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3714 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3715
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3716 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3717 unicode_slice(PyUnicodeObject *self, int start, int end)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3718 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3719 /* standard clamping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3720 if (start < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3721 start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3722 if (end < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3723 end = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3724 if (end > self->length)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3725 end = self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3726 if (start == 0 && end == self->length) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3727 /* full slice, return original string */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3728 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3729 return (PyObject*) self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3730 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3731 if (start > end)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3732 start = end;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3733 /* copy slice */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3734 return (PyObject*) PyUnicode_FromUnicode(self->str + start,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3735 end - start);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3736 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3737
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3738 PyObject PyUnicode_Split(PyObject s,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3739 PyObject *sep,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3740 int maxsplit)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3741 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3742 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3743
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3744 s = PyUnicode_FromObject(s);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3745 if (s == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3746 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3747 if (sep != NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3748 sep = PyUnicode_FromObject(sep);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3749 if (sep == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3750 Py_DECREF(s);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3751 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3752 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3753 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3754
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3755 result = split((PyUnicodeObject )s, (PyUnicodeObject )sep, maxsplit);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3756
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3757 Py_DECREF(s);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3758 Py_XDECREF(sep);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3759 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3760 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3761
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3762 static char split__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3763 "S.split([sep [,maxsplit]]) -> list of strings\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3764 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3765 Return a list of the words in S, using sep as the\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3766 delimiter string. If maxsplit is given, at most maxsplit\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3767 splits are done. If sep is not specified, any whitespace string\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3768 is a separator.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3769
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3770 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3771 unicode_split(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3772 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3773 PyObject *substring = Py_None;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3774 int maxcount = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3775
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3776 if (!PyArg_ParseTuple(args, "\|Oi:split", &substring, &maxcount))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3777 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3778
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3779 if (substring == Py_None)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3780 return split(self, NULL, maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3781 else if (PyUnicode_Check(substring))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3782 return split(self, (PyUnicodeObject *)substring, maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3783 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3784 return PyUnicode_Split((PyObject *)self, substring, maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3785 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3786
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3787 static char splitlines__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3788 "S.splitlines([maxsplit]]) -> list of strings\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3789 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3790 Return a list of the lines in S, breaking at line boundaries.\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3791 If maxsplit is given, at most maxsplit are done. Line breaks are not\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3792 included in the resulting list.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3793
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3794 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3795 unicode_splitlines(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3796 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3797 int maxcount = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3798
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3799 if (!PyArg_ParseTuple(args, "\|i:splitlines", &maxcount))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3800 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3801
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3802 return PyUnicode_Splitlines((PyObject *)self, maxcount);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3803 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3804
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3805 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3806 PyObject unicode_str(PyUnicodeObject self)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3807 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3808 return PyUnicode_AsUTF8String((PyObject *)self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3809 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3810
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3811 static char strip__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3812 "S.strip() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3813 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3814 Return a copy of S with leading and trailing whitespace removed.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3815
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3816 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3817 unicode_strip(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3818 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3819 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3820 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3821 return strip(self, 1, 1);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3822 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3823
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3824 static char swapcase__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3825 "S.swapcase() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3826 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3827 Return a copy of S with uppercase characters converted to lowercase\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3828 and vice versa.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3829
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3830 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3831 unicode_swapcase(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3832 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3833 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3834 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3835 return fixup(self, fixswapcase);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3836 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3837
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3838 static char translate__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3839 "S.translate(table) -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3840 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3841 Return a copy of the string S, where all characters have been mapped\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3842 through the given translation table, which must be a mapping of\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3843 Unicode ordinals to Unicode ordinals or None. Unmapped characters\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3844 are left untouched. Characters mapped to None are deleted.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3845
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3846 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3847 unicode_translate(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3848 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3849 PyObject *table;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3850
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3851 if (!PyArg_ParseTuple(args, "O:translate", &table))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3852 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3853 return PyUnicode_TranslateCharmap(self->str,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3854 self->length,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3855 table,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3856 "ignore");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3857 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3858
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3859 static char upper__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3860 "S.upper() -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3861 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3862 Return a copy of S converted to uppercase.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3863
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3864 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3865 unicode_upper(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3866 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3867 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3868 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3869 return fixup(self, fixupper);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3870 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3871
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3872 #if 0
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3873 static char zfill__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3874 "S.zfill(width) -> unicode\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3875 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3876 Pad a numeric string x with zeros on the left, to fill a field\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3877 of the specified width. The string x is never truncated.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3878
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3879 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3880 unicode_zfill(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3881 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3882 int fill;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3883 PyUnicodeObject *u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3884
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3885 int width;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3886 if (!PyArg_ParseTuple(args, "i:zfill", &width))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3887 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3888
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3889 if (self->length >= width) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3890 Py_INCREF(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3891 return (PyObject*) self;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3892 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3893
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3894 fill = width - self->length;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3895
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3896 u = pad(self, fill, 0, '0');
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3897
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3898 if (u->str[fill] == '+' \|\| u->str[fill] == '-') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3899 /* move sign to beginning of string */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3900 u->str[0] = u->str[fill];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3901 u->str[fill] = '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3902 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3903
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3904 return (PyObject*) u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3905 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3906 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3907
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3908 #if 0
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3909 static PyObject*
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3910 unicode_freelistsize(PyUnicodeObject self, PyObject args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3911 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3912 if (!PyArg_NoArgs(args))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3913 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3914 return PyInt_FromLong(unicode_freelist_size);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3915 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3916 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3917
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3918 static char startswith__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3919 "S.startswith(prefix[, start[, end]]) -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3920 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3921 Return 1 if S starts with the specified prefix, otherwise return 0. With\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3922 optional start, test S beginning at that position. With optional end, stop\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3923 comparing S at that position.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3924
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3925 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3926 unicode_startswith(PyUnicodeObject *self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3927 PyObject *args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3928 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3929 PyUnicodeObject *substring;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3930 int start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3931 int end = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3932 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3933
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3934 if (!PyArg_ParseTuple(args, "O\|ii:startswith", &substring, &start, &end))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3935 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3936 substring = (PyUnicodeObject *)PyUnicode_FromObject(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3937 (PyObject *)substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3938 if (substring == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3939 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3940
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3941 result = PyInt_FromLong(tailmatch(self, substring, start, end, -1));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3942
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3943 Py_DECREF(substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3944 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3945 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3946
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3947
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3948 static char endswith__doc__[] =
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3949 "S.endswith(suffix[, start[, end]]) -> int\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3950 \n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3951 Return 1 if S ends with the specified suffix, otherwise return 0. With\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3952 optional start, test S beginning at that position. With optional end, stop\n\
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3953 comparing S at that position.";
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3954
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3955 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3956 unicode_endswith(PyUnicodeObject *self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3957 PyObject *args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3958 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3959 PyUnicodeObject *substring;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3960 int start = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3961 int end = INT_MAX;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3962 PyObject *result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3963
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3964 if (!PyArg_ParseTuple(args, "O\|ii:endswith", &substring, &start, &end))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3965 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3966 substring = (PyUnicodeObject *)PyUnicode_FromObject(
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3967 (PyObject *)substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3968 if (substring == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3969 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3970
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3971 result = PyInt_FromLong(tailmatch(self, substring, start, end, +1));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3972
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3973 Py_DECREF(substring);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3974 return result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3975 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3976
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3977
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3978 static PyMethodDef unicode_methods[] = {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3979
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3980 /* Order is according to common usage: often used methods should
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3981 appear first, since lookup is done sequentially. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3982
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3983 {"encode", (PyCFunction) unicode_encode, 1, encode__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3984 {"replace", (PyCFunction) unicode_replace, 1, replace__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3985 {"split", (PyCFunction) unicode_split, 1, split__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3986 {"join", (PyCFunction) unicode_join, 1, join__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3987 {"capitalize", (PyCFunction) unicode_capitalize, 0, capitalize__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3988 {"title", (PyCFunction) unicode_title, 0, title__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3989 {"center", (PyCFunction) unicode_center, 1, center__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3990 {"count", (PyCFunction) unicode_count, 1, count__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3991 {"expandtabs", (PyCFunction) unicode_expandtabs, 1, expandtabs__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3992 {"find", (PyCFunction) unicode_find, 1, find__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3993 {"index", (PyCFunction) unicode_index, 1, index__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3994 {"ljust", (PyCFunction) unicode_ljust, 1, ljust__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3995 {"lower", (PyCFunction) unicode_lower, 0, lower__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3996 {"lstrip", (PyCFunction) unicode_lstrip, 0, lstrip__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3997 /* {"maketrans", (PyCFunction) unicode_maketrans, 1, maketrans__doc__}, */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3998 {"rfind", (PyCFunction) unicode_rfind, 1, rfind__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	3999 {"rindex", (PyCFunction) unicode_rindex, 1, rindex__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4000 {"rjust", (PyCFunction) unicode_rjust, 1, rjust__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4001 {"rstrip", (PyCFunction) unicode_rstrip, 0, rstrip__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4002 {"splitlines", (PyCFunction) unicode_splitlines, 1, splitlines__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4003 {"strip", (PyCFunction) unicode_strip, 0, strip__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4004 {"swapcase", (PyCFunction) unicode_swapcase, 0, swapcase__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4005 {"translate", (PyCFunction) unicode_translate, 1, translate__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4006 {"upper", (PyCFunction) unicode_upper, 0, upper__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4007 {"startswith", (PyCFunction) unicode_startswith, 1, startswith__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4008 {"endswith", (PyCFunction) unicode_endswith, 1, endswith__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4009 {"islower", (PyCFunction) unicode_islower, 0, islower__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4010 {"isupper", (PyCFunction) unicode_isupper, 0, isupper__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4011 {"istitle", (PyCFunction) unicode_istitle, 0, istitle__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4012 {"isspace", (PyCFunction) unicode_isspace, 0, isspace__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4013 {"isdecimal", (PyCFunction) unicode_isdecimal, 0, isdecimal__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4014 {"isdigit", (PyCFunction) unicode_isdigit, 0, isdigit__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4015 {"isnumeric", (PyCFunction) unicode_isnumeric, 0, isnumeric__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4016 #if 0
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4017 {"zfill", (PyCFunction) unicode_zfill, 1, zfill__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4018 {"capwords", (PyCFunction) unicode_capwords, 0, capwords__doc__},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4019 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4020
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4021 #if 0
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4022 /* This one is just used for debugging the implementation. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4023 {"freelistsize", (PyCFunction) unicode_freelistsize, 0},
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4024 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4025
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4026 {NULL, NULL}
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4027 };
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4028
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4029 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4030 unicode_getattr(PyUnicodeObject self, char name)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4031 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4032 return Py_FindMethod(unicode_methods, (PyObject*) self, name);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4033 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4034
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4035 static PySequenceMethods unicode_as_sequence = {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4036 (inquiry) unicode_length, /* sq_length */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4037 (binaryfunc) PyUnicode_Concat, /* sq_concat */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4038 (intargfunc) unicode_repeat, /* sq_repeat */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4039 (intargfunc) unicode_getitem, /* sq_item */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4040 (intintargfunc) unicode_slice, /* sq_slice */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4041 0, /* sq_ass_item */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4042 0, /* sq_ass_slice */
11997 38310eb0659e Add sq_contains implementation. Guido van Rossum <guido@python.org> parents: 11968 diff changeset	4043 (objobjproc)PyUnicode_Contains, /sq_contains/
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4044 };
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4045
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4046 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4047 unicode_buffer_getreadbuf(PyUnicodeObject *self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4048 int index,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4049 const void **ptr)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4050 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4051 if (index != 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4052 PyErr_SetString(PyExc_SystemError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4053 "accessing non-existent unicode segment");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4054 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4055 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4056 ptr = (void ) self->str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4057 return PyUnicode_GET_DATA_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4058 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4059
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4060 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4061 unicode_buffer_getwritebuf(PyUnicodeObject *self, int index,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4062 const void **ptr)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4063 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4064 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4065 "cannot use unicode as modifyable buffer");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4066 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4067 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4068
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4069 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4070 unicode_buffer_getsegcount(PyUnicodeObject *self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4071 int *lenp)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4072 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4073 if (lenp)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4074 *lenp = PyUnicode_GET_DATA_SIZE(self);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4075 return 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4076 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4077
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4078 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4079 unicode_buffer_getcharbuf(PyUnicodeObject *self,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4080 int index,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4081 const void **ptr)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4082 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4083 PyObject *str;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4084
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4085 if (index != 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4086 PyErr_SetString(PyExc_SystemError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4087 "accessing non-existent unicode segment");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4088 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4089 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4090 str = utf8_string(self, NULL);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4091 if (str == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4092 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4093 ptr = (void ) PyString_AS_STRING(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4094 return PyString_GET_SIZE(str);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4095 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4096
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4097 /* Helpers for PyUnicode_Format() */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4098
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4099 static PyObject *
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4100 getnextarg(args, arglen, p_argidx)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4101 PyObject *args;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4102 int arglen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4103 int *p_argidx;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4104 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4105 int argidx = *p_argidx;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4106 if (argidx < arglen) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4107 (*p_argidx)++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4108 if (arglen < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4109 return args;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4110 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4111 return PyTuple_GetItem(args, argidx);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4112 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4113 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4114 "not enough arguments for format string");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4115 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4116 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4117
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4118 #define F_LJUST (1<<0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4119 #define F_SIGN (1<<1)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4120 #define F_BLANK (1<<2)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4121 #define F_ALT (1<<3)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4122 #define F_ZERO (1<<4)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4123
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4124 static
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4125 #ifdef HAVE_STDARG_PROTOTYPES
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4126 int usprintf(register Py_UNICODE buffer, char format, ...)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4127 #else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4128 int usprintf(va_alist) va_dcl
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4129 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4130 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4131 register int i;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4132 int len;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4133 va_list va;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4134 char *charbuffer;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4135 #ifdef HAVE_STDARG_PROTOTYPES
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4136 va_start(va, format);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4137 #else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4138 Py_UNICODE *args;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4139 char *format;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4140
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4141 va_start(va);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4142 buffer = va_arg(va, Py_UNICODE *);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4143 format = va_arg(va, char *);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4144 #endif
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4145
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4146 /* First, format the string as char array, then expand to Py_UNICODE
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4147 array. */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4148 charbuffer = (char *)buffer;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4149 len = vsprintf(charbuffer, format, va);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4150 for (i = len - 1; i >= 0; i--)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4151 buffer[i] = (Py_UNICODE) charbuffer[i];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4152
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4153 va_end(va);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4154 return len;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4155 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4156
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4157 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4158 formatfloat(Py_UNICODE *buf,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4159 int flags,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4160 int prec,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4161 int type,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4162 PyObject *v)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4163 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4164 char fmt[20];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4165 double x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4166
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4167 x = PyFloat_AsDouble(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4168 if (x == -1.0 && PyErr_Occurred())
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4169 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4170 if (prec < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4171 prec = 6;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4172 if (prec > 50)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4173 prec = 50; /* Arbitrary limitation */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4174 if (type == 'f' && (fabs(x) / 1e25) >= 1e25)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4175 type = 'g';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4176 sprintf(fmt, "%%%s.%d%c", (flags & F_ALT) ? "#" : "", prec, type);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4177 return usprintf(buf, fmt, x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4178 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4179
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4180 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4181 formatint(Py_UNICODE *buf,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4182 int flags,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4183 int prec,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4184 int type,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4185 PyObject *v)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4186 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4187 char fmt[20];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4188 long x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4189
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4190 x = PyInt_AsLong(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4191 if (x == -1 && PyErr_Occurred())
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4192 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4193 if (prec < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4194 prec = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4195 sprintf(fmt, "%%%s.%dl%c", (flags & F_ALT) ? "#" : "", prec, type);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4196 return usprintf(buf, fmt, x);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4197 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4198
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4199 static int
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4200 formatchar(Py_UNICODE *buf,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4201 PyObject *v)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4202 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4203 if (PyUnicode_Check(v))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4204 buf[0] = PyUnicode_AS_UNICODE(v)[0];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4205
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4206 else if (PyString_Check(v))
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4207 buf[0] = (Py_UNICODE) PyString_AS_STRING(v)[0];
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4208
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4209 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4210 /* Integer input truncated to a character */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4211 long x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4212 x = PyInt_AsLong(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4213 if (x == -1 && PyErr_Occurred())
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4214 return -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4215 buf[0] = (char) x;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4216 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4217 buf[1] = '\0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4218 return 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4219 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4220
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4221 PyObject PyUnicode_Format(PyObject format,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4222 PyObject *args)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4223 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4224 Py_UNICODE fmt, res;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4225 int fmtcnt, rescnt, reslen, arglen, argidx;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4226 int args_owned = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4227 PyUnicodeObject *result = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4228 PyObject *dict = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4229 PyObject *uformat;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4230
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4231 if (format == NULL \|\| args == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4232 PyErr_BadInternalCall();
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4233 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4234 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4235 uformat = PyUnicode_FromObject(format);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4236 fmt = PyUnicode_AS_UNICODE(uformat);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4237 fmtcnt = PyUnicode_GET_SIZE(uformat);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4238
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4239 reslen = rescnt = fmtcnt + 100;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4240 result = _PyUnicode_New(reslen);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4241 if (result == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4242 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4243 res = PyUnicode_AS_UNICODE(result);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4244
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4245 if (PyTuple_Check(args)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4246 arglen = PyTuple_Size(args);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4247 argidx = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4248 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4249 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4250 arglen = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4251 argidx = -2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4252 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4253 if (args->ob_type->tp_as_mapping)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4254 dict = args;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4255
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4256 while (--fmtcnt >= 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4257 if (*fmt != '%') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4258 if (--rescnt < 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4259 rescnt = fmtcnt + 100;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4260 reslen += rescnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4261 if (_PyUnicode_Resize(result, reslen) < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4262 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4263 res = PyUnicode_AS_UNICODE(result) + reslen - rescnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4264 --rescnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4265 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4266 res++ = fmt++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4267 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4268 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4269 /* Got a format specifier */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4270 int flags = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4271 int width = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4272 int prec = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4273 int size = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4274 Py_UNICODE c = '\0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4275 Py_UNICODE fill;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4276 PyObject *v = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4277 PyObject *temp = NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4278 Py_UNICODE *buf;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4279 Py_UNICODE sign;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4280 int len;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4281 Py_UNICODE tmpbuf[120]; /* For format{float,int,char}() */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4282
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4283 fmt++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4284 if (*fmt == '(') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4285 Py_UNICODE *keystart;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4286 int keylen;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4287 PyObject *key;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4288 int pcount = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4289
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4290 if (dict == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4291 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4292 "format requires a mapping");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4293 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4294 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4295 ++fmt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4296 --fmtcnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4297 keystart = fmt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4298 /* Skip over balanced parentheses */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4299 while (pcount > 0 && --fmtcnt >= 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4300 if (*fmt == ')')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4301 --pcount;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4302 else if (*fmt == '(')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4303 ++pcount;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4304 fmt++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4305 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4306 keylen = fmt - keystart - 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4307 if (fmtcnt < 0 \|\| pcount > 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4308 PyErr_SetString(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4309 "incomplete format key");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4310 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4311 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4312 /* keys are converted to strings (using UTF-8) and
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4313 then looked up since Python uses strings to hold
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4314 variables names etc. in its namespaces and we
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4315 wouldn't want to break common idioms. The
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4316 alternative would be using Unicode objects for the
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4317 lookup but u"abc" and "abc" have different hash
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4318 values (on purpose). */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4319 key = PyUnicode_EncodeUTF8(keystart,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4320 keylen,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4321 NULL);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4322 if (key == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4323 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4324 if (args_owned) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4325 Py_DECREF(args);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4326 args_owned = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4327 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4328 args = PyObject_GetItem(dict, key);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4329 Py_DECREF(key);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4330 if (args == NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4331 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4332 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4333 args_owned = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4334 arglen = -1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4335 argidx = -2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4336 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4337 while (--fmtcnt >= 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4338 switch (c = *fmt++) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4339 case '-': flags \|= F_LJUST; continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4340 case '+': flags \|= F_SIGN; continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4341 case ' ': flags \|= F_BLANK; continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4342 case '#': flags \|= F_ALT; continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4343 case '0': flags \|= F_ZERO; continue;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4344 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4345 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4346 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4347 if (c == '*') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4348 v = getnextarg(args, arglen, &argidx);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4349 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4350 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4351 if (!PyInt_Check(v)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4352 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4353 "* wants int");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4354 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4355 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4356 width = PyInt_AsLong(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4357 if (width < 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4358 flags \|= F_LJUST;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4359 width = -width;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4360 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4361 if (--fmtcnt >= 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4362 c = *fmt++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4363 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4364 else if (c >= '0' && c <= '9') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4365 width = c - '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4366 while (--fmtcnt >= 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4367 c = *fmt++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4368 if (c < '0' \|\| c > '9')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4369 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4370 if ((width*10) / 10 != width) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4371 PyErr_SetString(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4372 "width too big");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4373 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4374 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4375 width = width*10 + (c - '0');
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4376 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4377 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4378 if (c == '.') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4379 prec = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4380 if (--fmtcnt >= 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4381 c = *fmt++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4382 if (c == '*') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4383 v = getnextarg(args, arglen, &argidx);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4384 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4385 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4386 if (!PyInt_Check(v)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4387 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4388 "* wants int");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4389 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4390 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4391 prec = PyInt_AsLong(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4392 if (prec < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4393 prec = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4394 if (--fmtcnt >= 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4395 c = *fmt++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4396 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4397 else if (c >= '0' && c <= '9') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4398 prec = c - '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4399 while (--fmtcnt >= 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4400 c = Py_CHARMASK(*fmt++);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4401 if (c < '0' \|\| c > '9')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4402 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4403 if ((prec*10) / 10 != prec) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4404 PyErr_SetString(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4405 "prec too big");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4406 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4407 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4408 prec = prec*10 + (c - '0');
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4409 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4410 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4411 } /* prec */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4412 if (fmtcnt >= 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4413 if (c == 'h' \|\| c == 'l' \|\| c == 'L') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4414 size = c;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4415 if (--fmtcnt >= 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4416 c = *fmt++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4417 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4418 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4419 if (fmtcnt < 0) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4420 PyErr_SetString(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4421 "incomplete format");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4422 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4423 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4424 if (c != '%') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4425 v = getnextarg(args, arglen, &argidx);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4426 if (v == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4427 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4428 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4429 sign = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4430 fill = ' ';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4431 switch (c) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4432
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4433 case '%':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4434 buf = tmpbuf;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4435 buf[0] = '%';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4436 len = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4437 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4438
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4439 case 's':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4440 case 'r':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4441 if (PyUnicode_Check(v) && c == 's') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4442 temp = v;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4443 Py_INCREF(temp);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4444 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4445 else {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4446 PyObject *unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4447 if (c == 's')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4448 temp = PyObject_Str(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4449 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4450 temp = PyObject_Repr(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4451 if (temp == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4452 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4453 if (!PyString_Check(temp)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4454 /* XXX Note: this should never happen, since
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4455 PyObject_Repr() and PyObject_Str() assure
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4456 this */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4457 Py_DECREF(temp);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4458 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4459 "%s argument has non-string str()");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4460 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4461 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4462 unicode = PyUnicode_DecodeUTF8(PyString_AS_STRING(temp),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4463 PyString_GET_SIZE(temp),
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4464 "strict");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4465 Py_DECREF(temp);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4466 temp = unicode;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4467 if (temp == NULL)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4468 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4469 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4470 buf = PyUnicode_AS_UNICODE(temp);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4471 len = PyUnicode_GET_SIZE(temp);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4472 if (prec >= 0 && len > prec)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4473 len = prec;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4474 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4475
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4476 case 'i':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4477 case 'd':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4478 case 'u':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4479 case 'o':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4480 case 'x':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4481 case 'X':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4482 if (c == 'i')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4483 c = 'd';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4484 buf = tmpbuf;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4485 len = formatint(buf, flags, prec, c, v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4486 if (len < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4487 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4488 sign = (c == 'd');
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4489 if (flags & F_ZERO) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4490 fill = '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4491 if ((flags&F_ALT) &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4492 (c == 'x' \|\| c == 'X') &&
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4493 buf[0] == '0' && buf[1] == c) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4494 res++ = buf++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4495 res++ = buf++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4496 rescnt -= 2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4497 len -= 2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4498 width -= 2;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4499 if (width < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4500 width = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4501 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4502 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4503 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4504
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4505 case 'e':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4506 case 'E':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4507 case 'f':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4508 case 'g':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4509 case 'G':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4510 buf = tmpbuf;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4511 len = formatfloat(buf, flags, prec, c, v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4512 if (len < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4513 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4514 sign = 1;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4515 if (flags&F_ZERO)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4516 fill = '0';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4517 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4518
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4519 case 'c':
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4520 buf = tmpbuf;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4521 len = formatchar(buf, v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4522 if (len < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4523 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4524 break;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4525
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4526 default:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4527 PyErr_Format(PyExc_ValueError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4528 "unsupported format character '%c' (0x%x)",
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4529 c, c);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4530 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4531 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4532 if (sign) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4533 if (buf == '-' \|\| buf == '+') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4534 sign = *buf++;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4535 len--;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4536 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4537 else if (flags & F_SIGN)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4538 sign = '+';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4539 else if (flags & F_BLANK)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4540 sign = ' ';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4541 else
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4542 sign = 0;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4543 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4544 if (width < len)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4545 width = len;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4546 if (rescnt < width + (sign != 0)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4547 reslen -= rescnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4548 rescnt = width + fmtcnt + 100;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4549 reslen += rescnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4550 if (_PyUnicode_Resize(result, reslen) < 0)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4551 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4552 res = PyUnicode_AS_UNICODE(result)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4553 + reslen - rescnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4554 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4555 if (sign) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4556 if (fill != ' ')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4557 *res++ = sign;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4558 rescnt--;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4559 if (width > len)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4560 width--;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4561 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4562 if (width > len && !(flags & F_LJUST)) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4563 do {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4564 --rescnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4565 *res++ = fill;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4566 } while (--width > len);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4567 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4568 if (sign && fill == ' ')
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4569 *res++ = sign;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4570 memcpy(res, buf, len * sizeof(Py_UNICODE));
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4571 res += len;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4572 rescnt -= len;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4573 while (--width >= len) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4574 --rescnt;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4575 *res++ = ' ';
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4576 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4577 if (dict && (argidx < arglen) && c != '%') {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4578 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4579 "not all arguments converted");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4580 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4581 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4582 Py_XDECREF(temp);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4583 } /* '%' */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4584 } /* until end */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4585 if (argidx < arglen && !dict) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4586 PyErr_SetString(PyExc_TypeError,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4587 "not all arguments converted");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4588 goto onError;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4589 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4590
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4591 if (args_owned) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4592 Py_DECREF(args);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4593 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4594 Py_DECREF(uformat);
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	4595 if (_PyUnicode_Resize(result, reslen - rescnt))
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	4596 goto onError;
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4597 return (PyObject *)result;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4598
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4599 onError:
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4600 Py_XDECREF(result);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4601 Py_DECREF(uformat);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4602 if (args_owned) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4603 Py_DECREF(args);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4604 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4605 return NULL;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4606 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4607
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4608 static PyBufferProcs unicode_as_buffer = {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4609 (getreadbufferproc) unicode_buffer_getreadbuf,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4610 (getwritebufferproc) unicode_buffer_getwritebuf,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4611 (getsegcountproc) unicode_buffer_getsegcount,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4612 (getcharbufferproc) unicode_buffer_getcharbuf,
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4613 };
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4614
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4615 PyTypeObject PyUnicode_Type = {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4616 PyObject_HEAD_INIT(&PyType_Type)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4617 0, /* ob_size */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4618 "unicode", /* tp_name */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4619 sizeof(PyUnicodeObject), /* tp_size */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4620 0, /* tp_itemsize */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4621 /* Slots */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4622 (destructor)_PyUnicode_Free, /* tp_dealloc */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4623 0, /* tp_print */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4624 (getattrfunc)unicode_getattr, /* tp_getattr */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4625 0, /* tp_setattr */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4626 (cmpfunc) unicode_compare, /* tp_compare */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4627 (reprfunc) unicode_repr, /* tp_repr */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4628 0, /* tp_as_number */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4629 &unicode_as_sequence, /* tp_as_sequence */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4630 0, /* tp_as_mapping */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4631 (hashfunc) unicode_hash, /* tp_hash*/
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4632 0, /* tp_call*/
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4633 (reprfunc) unicode_str, /* tp_str */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4634 (getattrofunc) NULL, /* tp_getattro */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4635 (setattrofunc) NULL, /* tp_setattro */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4636 &unicode_as_buffer, /* tp_as_buffer */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4637 Py_TPFLAGS_DEFAULT, /* tp_flags */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4638 };
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4639
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4640 /* Initialize the Unicode implementation */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4641
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4642 void _PyUnicode_Init()
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4643 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4644 /* Doublecheck the configuration... */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4645 if (sizeof(Py_UNICODE) != 2)
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4646 Py_FatalError("Unicode configuration error: "
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4647 "sizeof(Py_UNICODE) != 2 bytes");
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4648
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4649 unicode_empty = _PyUnicode_New(0);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4650 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4651
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4652 /* Finalize the Unicode implementation */
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4653
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4654 void
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4655 _PyUnicode_Fini()
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4656 {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4657 PyUnicodeObject *u = unicode_freelist;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4658
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4659 while (u != NULL) {
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4660 PyUnicodeObject *v = u;
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4661 u = (PyUnicodeObject *)u;
12329 3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	4662 if (v->str)
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	4663 free(v->str);
3cc77848a62a Marc-Andre Lemburg: Guido van Rossum <guido@python.org> parents: 12320 diff changeset	4664 Py_XDECREF(v->utf8str);
11968 13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4665 free(v);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4666 }
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4667 Py_XDECREF(unicode_empty);
13bc68faeb65 Unicode implementation by Marc-Andre Lemburg based on original code by Guido van Rossum <guido@python.org> parents: diff changeset	4668 }

Mercurial > cpython-lru_cache-weakref

annotate Objects/unicodeobject.c @ 12357:5b59ea41db4e legacy-trunk