cpython-lru_cache-weakref: Lib/multiprocessing/managers.py annotate

annotate Lib/multiprocessing/managers.py @ 78069:a8aa77458e12 3.2

Add c_size_t and c_ssize_t to the ctypes summary table.

author	Antoine Pitrou <solipsis@pitrou.net>
date	Thu, 12 Jul 2012 20:31:50 +0200
parents	9b99adef3c78
children	29cad1ac828c

rev	line source
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	2 # Module providing the `SyncManager` class for dealing
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	3 # with shared objects
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	4 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	5 # multiprocessing/managers.py
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	6 #
66886 71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	7 # Copyright (c) 2006-2008, R Oudkerk
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	8 # All rights reserved.
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	9 #
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	10 # Redistribution and use in source and binary forms, with or without
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	11 # modification, are permitted provided that the following conditions
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	12 # are met:
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	13 #
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	14 # 1. Redistributions of source code must retain the above copyright
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	15 # notice, this list of conditions and the following disclaimer.
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	16 # 2. Redistributions in binary form must reproduce the above copyright
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	17 # notice, this list of conditions and the following disclaimer in the
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	18 # documentation and/or other materials provided with the distribution.
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	19 # 3. Neither the name of author nor the names of any contributors may be
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	20 # used to endorse or promote products derived from this software
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	21 # without specific prior written permission.
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	22 #
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	23 # THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS "AS IS" AND
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	24 # ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	25 # IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	26 # ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	27 # FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	28 # DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	29 # OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	30 # HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	31 # LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	32 # OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
71fb03274a89 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56368 diff changeset	33 # SUCH DAMAGE.
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	34 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	35
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	36 __all__ = [ 'BaseManager', 'SyncManager', 'BaseProxy', 'Token' ]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	37
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	38 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	39 # Imports
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	40 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	41
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	42 import os
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	43 import sys
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	44 import weakref
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	45 import threading
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	46 import array
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	47 import queue
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	48
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	49 from traceback import format_exc
50871 8dc479b63e03 Issues #10867: remove old cPickle imports from multiprocessing Jesse Noller <jnoller@gmail.com> parents: 48966 diff changeset	50 from pickle import PicklingError
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	51 from multiprocessing import Process, current_process, active_children, Pool, util, connection
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	52 from multiprocessing.process import AuthenticationString
48780 99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	53 from multiprocessing.forking import exit, Popen, assert_spawning, ForkingPickler
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	54 from multiprocessing.util import Finalize, info
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	55
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	56 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	57 # Register some things for pickling
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	58 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	59
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	60 def reduce_array(a):
64355 fa8b57f987c5 Issue #8990: array.fromstring() and array.tostring() get renamed to Antoine Pitrou <solipsis@pitrou.net> parents: 56368 diff changeset	61 return array.array, (a.typecode, a.tobytes())
48780 99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	62 ForkingPickler.register(array.array, reduce_array)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	63
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	64 view_types = [type(getattr({}, name)()) for name in ('items','keys','values')]
48367 d1e864a5c60c make changes for py3k for multiprocessing Benjamin Peterson <benjamin@python.org> parents: 48366 diff changeset	65 if view_types[0] is not list: # only needed in Py3.0
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	66 def rebuild_as_list(obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	67 return list, (list(obj),)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	68 for view_type in view_types:
48780 99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	69 ForkingPickler.register(view_type, rebuild_as_list)
48792 51f2f8fee5c4 Partially revert r65883 to let the tests pass. Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48780 diff changeset	70 import copyreg
51f2f8fee5c4 Partially revert r65883 to let the tests pass. Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48780 diff changeset	71 copyreg.pickle(view_type, rebuild_as_list)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	72
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	73 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	74 # Type for identifying shared objects
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	75 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	76
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	77 class Token(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	78 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	79 Type to uniquely indentify a shared object
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	80 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	81 __slots__ = ('typeid', 'address', 'id')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	82
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	83 def __init__(self, typeid, address, id):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	84 (self.typeid, self.address, self.id) = (typeid, address, id)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	85
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	86 def __getstate__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	87 return (self.typeid, self.address, self.id)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	88
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	89 def __setstate__(self, state):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	90 (self.typeid, self.address, self.id) = state
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	91
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	92 def __repr__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	93 return 'Token(typeid=%r, address=%r, id=%r)' % \
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	94 (self.typeid, self.address, self.id)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	95
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	96 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	97 # Function for communication with a manager's server process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	98 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	99
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	100 def dispatch(c, id, methodname, args=(), kwds={}):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	101 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	102 Send a message to manager using connection `c` and return response
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	103 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	104 c.send((id, methodname, args, kwds))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	105 kind, result = c.recv()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	106 if kind == '#RETURN':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	107 return result
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	108 raise convert_to_error(kind, result)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	109
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	110 def convert_to_error(kind, result):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	111 if kind == '#ERROR':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	112 return result
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	113 elif kind == '#TRACEBACK':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	114 assert type(result) is str
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	115 return RemoteError(result)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	116 elif kind == '#UNSERIALIZABLE':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	117 assert type(result) is str
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	118 return RemoteError('Unserializable message: %s\n' % result)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	119 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	120 return ValueError('Unrecognized message type')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	121
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	122 class RemoteError(Exception):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	123 def __str__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	124 return ('\n' + '-'75 + '\n' + str(self.args[0]) + '-'75)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	125
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	126 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	127 # Functions for finding the method names of an object
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	128 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	129
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	130 def all_methods(obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	131 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	132 Return a list of names of methods of `obj`
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	133 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	134 temp = []
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	135 for name in dir(obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	136 func = getattr(obj, name)
73165 8e57b5d8f58f Closes #13258: Use callable() built-in in the standard library. Florent Xicluna <florent.xicluna@gmail.com> parents: 68257 diff changeset	137 if callable(func):
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	138 temp.append(name)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	139 return temp
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	140
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	141 def public_methods(obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	142 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	143 Return a list of names of methods of `obj` which do not start with '_'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	144 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	145 return [name for name in all_methods(obj) if name[0] != '_']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	146
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	147 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	148 # Server which is run in a process controlled by a manager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	149 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	150
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	151 class Server(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	152 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	153 Server class which runs in a process controlled by a manager object
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	154 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	155 public = ['shutdown', 'create', 'accept_connection', 'get_methods',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	156 'debug_info', 'number_of_objects', 'dummy', 'incref', 'decref']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	157
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	158 def __init__(self, registry, address, authkey, serializer):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	159 assert isinstance(authkey, bytes)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	160 self.registry = registry
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	161 self.authkey = AuthenticationString(authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	162 Listener, Client = listener_client[serializer]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	163
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	164 # do authentication later
74144 9b99adef3c78 Issue #13565: Increase multiprocessing's server socket backlog, to avoid Charles-François Natali <neologix@free.fr> parents: 73165 diff changeset	165 self.listener = Listener(address=address, backlog=16)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	166 self.address = self.listener.address
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	167
50962 a99decedf72d merge r68839 forward to py3k Jesse Noller <jnoller@gmail.com> parents: 50871 diff changeset	168 self.id_to_obj = {'0': (None, ())}
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	169 self.id_to_refcount = {}
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	170 self.mutex = threading.RLock()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	171 self.stop = 0
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	172
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	173 def serve_forever(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	174 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	175 Run the server forever
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	176 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	177 current_process()._manager_server = self
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	178 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	179 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	180 while 1:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	181 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	182 c = self.listener.accept()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	183 except (OSError, IOError):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	184 continue
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	185 t = threading.Thread(target=self.handle_request, args=(c,))
48749 6dda01643106 Merged revisions 65828 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48747 diff changeset	186 t.daemon = True
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	187 t.start()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	188 except (KeyboardInterrupt, SystemExit):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	189 pass
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	190 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	191 self.stop = 999
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	192 self.listener.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	193
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	194 def handle_request(self, c):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	195 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	196 Handle a new connection
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	197 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	198 funcname = result = request = None
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	199 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	200 connection.deliver_challenge(c, self.authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	201 connection.answer_challenge(c, self.authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	202 request = c.recv()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	203 ignore, funcname, args, kwds = request
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	204 assert funcname in self.public, '%r unrecognized' % funcname
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	205 func = getattr(self, funcname)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	206 except Exception:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	207 msg = ('#TRACEBACK', format_exc())
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	208 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	209 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	210 result = func(c, args, *kwds)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	211 except Exception:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	212 msg = ('#TRACEBACK', format_exc())
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	213 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	214 msg = ('#RETURN', result)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	215 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	216 c.send(msg)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	217 except Exception as e:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	218 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	219 c.send(('#TRACEBACK', format_exc()))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	220 except Exception:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	221 pass
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	222 util.info('Failure to send message: %r', msg)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	223 util.info(' ... request was %r', request)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	224 util.info(' ... exception was %r', e)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	225
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	226 c.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	227
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	228 def serve_client(self, conn):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	229 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	230 Handle requests from the proxies in a particular process/thread
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	231 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	232 util.debug('starting server thread to service %r',
48747 1fdfa382ae13 Merged revisions 65824 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48367 diff changeset	233 threading.current_thread().name)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	234
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	235 recv = conn.recv
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	236 send = conn.send
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	237 id_to_obj = self.id_to_obj
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	238
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	239 while not self.stop:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	240
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	241 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	242 methodname = obj = None
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	243 request = recv()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	244 ident, methodname, args, kwds = request
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	245 obj, exposed, gettypeid = id_to_obj[ident]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	246
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	247 if methodname not in exposed:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	248 raise AttributeError(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	249 'method %r of %r object is not in exposed=%r' %
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	250 (methodname, type(obj), exposed)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	251 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	252
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	253 function = getattr(obj, methodname)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	254
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	255 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	256 res = function(args, *kwds)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	257 except Exception as e:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	258 msg = ('#ERROR', e)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	259 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	260 typeid = gettypeid and gettypeid.get(methodname, None)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	261 if typeid:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	262 rident, rexposed = self.create(conn, typeid, res)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	263 token = Token(typeid, self.address, rident)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	264 msg = ('#PROXY', (rexposed, token))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	265 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	266 msg = ('#RETURN', res)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	267
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	268 except AttributeError:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	269 if methodname is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	270 msg = ('#TRACEBACK', format_exc())
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	271 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	272 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	273 fallback_func = self.fallback_mapping[methodname]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	274 result = fallback_func(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	275 self, conn, ident, obj, args, *kwds
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	276 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	277 msg = ('#RETURN', result)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	278 except Exception:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	279 msg = ('#TRACEBACK', format_exc())
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	280
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	281 except EOFError:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	282 util.debug('got EOF -- exiting thread serving %r',
48747 1fdfa382ae13 Merged revisions 65824 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48367 diff changeset	283 threading.current_thread().name)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	284 sys.exit(0)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	285
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	286 except Exception:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	287 msg = ('#TRACEBACK', format_exc())
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	288
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	289 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	290 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	291 send(msg)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	292 except Exception as e:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	293 send(('#UNSERIALIZABLE', repr(msg)))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	294 except Exception as e:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	295 util.info('exception in thread serving %r',
48747 1fdfa382ae13 Merged revisions 65824 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48367 diff changeset	296 threading.current_thread().name)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	297 util.info(' ... message was %r', msg)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	298 util.info(' ... exception was %r', e)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	299 conn.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	300 sys.exit(1)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	301
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	302 def fallback_getvalue(self, conn, ident, obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	303 return obj
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	304
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	305 def fallback_str(self, conn, ident, obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	306 return str(obj)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	307
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	308 def fallback_repr(self, conn, ident, obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	309 return repr(obj)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	310
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	311 fallback_mapping = {
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	312 '__str__':fallback_str,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	313 '__repr__':fallback_repr,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	314 '#GETVALUE':fallback_getvalue
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	315 }
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	316
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	317 def dummy(self, c):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	318 pass
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	319
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	320 def debug_info(self, c):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	321 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	322 Return some info --- useful to spot problems with refcounting
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	323 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	324 self.mutex.acquire()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	325 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	326 result = []
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	327 keys = list(self.id_to_obj.keys())
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	328 keys.sort()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	329 for ident in keys:
50962 a99decedf72d merge r68839 forward to py3k Jesse Noller <jnoller@gmail.com> parents: 50871 diff changeset	330 if ident != '0':
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	331 result.append(' %s: refcount=%s\n %s' %
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	332 (ident, self.id_to_refcount[ident],
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	333 str(self.id_to_obj[ident][0])[:75]))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	334 return '\n'.join(result)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	335 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	336 self.mutex.release()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	337
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	338 def number_of_objects(self, c):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	339 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	340 Number of shared objects
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	341 '''
50962 a99decedf72d merge r68839 forward to py3k Jesse Noller <jnoller@gmail.com> parents: 50871 diff changeset	342 return len(self.id_to_obj) - 1 # don't count ident='0'
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	343
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	344 def shutdown(self, c):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	345 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	346 Shutdown this process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	347 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	348 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	349 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	350 util.debug('manager received shutdown message')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	351 c.send(('#RETURN', None))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	352
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	353 if sys.stdout != sys.__stdout__:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	354 util.debug('resetting stdout, stderr')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	355 sys.stdout = sys.__stdout__
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	356 sys.stderr = sys.__stderr__
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	357
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	358 util._run_finalizers(0)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	359
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	360 for p in active_children():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	361 util.debug('terminating a child process of manager')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	362 p.terminate()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	363
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	364 for p in active_children():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	365 util.debug('terminating a child process of manager')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	366 p.join()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	367
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	368 util._run_finalizers()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	369 util.info('manager exiting with exitcode 0')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	370 except:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	371 import traceback
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	372 traceback.print_exc()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	373 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	374 exit(0)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	375
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	376 def create(self, c, typeid, args, *kwds):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	377 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	378 Create a new shared object and return its id
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	379 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	380 self.mutex.acquire()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	381 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	382 callable, exposed, method_to_typeid, proxytype = \
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	383 self.registry[typeid]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	384
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	385 if callable is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	386 assert len(args) == 1 and not kwds
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	387 obj = args[0]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	388 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	389 obj = callable(args, *kwds)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	390
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	391 if exposed is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	392 exposed = public_methods(obj)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	393 if method_to_typeid is not None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	394 assert type(method_to_typeid) is dict
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	395 exposed = list(exposed) + list(method_to_typeid)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	396
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	397 ident = '%x' % id(obj) # convert to string because xmlrpclib
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	398 # only has 32 bit signed integers
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	399 util.debug('%r callable returned object with id %r', typeid, ident)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	400
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	401 self.id_to_obj[ident] = (obj, set(exposed), method_to_typeid)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	402 if ident not in self.id_to_refcount:
48966 750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	403 self.id_to_refcount[ident] = 0
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	404 # increment the reference count immediately, to avoid
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	405 # this object being garbage collected before a Proxy
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	406 # object for it can be created. The caller of create()
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	407 # is responsible for doing a decref once the Proxy object
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	408 # has been created.
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	409 self.incref(c, ident)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	410 return ident, tuple(exposed)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	411 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	412 self.mutex.release()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	413
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	414 def get_methods(self, c, token):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	415 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	416 Return the methods of the shared object indicated by token
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	417 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	418 return tuple(self.id_to_obj[token.id][1])
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	419
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	420 def accept_connection(self, c, name):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	421 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	422 Spawn a new thread to serve this connection
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	423 '''
48747 1fdfa382ae13 Merged revisions 65824 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48367 diff changeset	424 threading.current_thread().name = name
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	425 c.send(('#RETURN', None))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	426 self.serve_client(c)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	427
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	428 def incref(self, c, ident):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	429 self.mutex.acquire()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	430 try:
48966 750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	431 self.id_to_refcount[ident] += 1
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	432 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	433 self.mutex.release()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	434
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	435 def decref(self, c, ident):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	436 self.mutex.acquire()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	437 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	438 assert self.id_to_refcount[ident] >= 1
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	439 self.id_to_refcount[ident] -= 1
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	440 if self.id_to_refcount[ident] == 0:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	441 del self.id_to_obj[ident], self.id_to_refcount[ident]
56368 c9bd62efe6ce Merged revisions 75231 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 53077 diff changeset	442 util.debug('disposing of obj with id %r', ident)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	443 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	444 self.mutex.release()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	445
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	446 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	447 # Class to represent state of a manager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	448 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	449
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	450 class State(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	451 __slots__ = ['value']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	452 INITIAL = 0
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	453 STARTED = 1
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	454 SHUTDOWN = 2
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	455
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	456 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	457 # Mapping from serializer name to Listener and Client types
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	458 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	459
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	460 listener_client = {
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	461 'pickle' : (connection.Listener, connection.Client),
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	462 'xmlrpclib' : (connection.XmlListener, connection.XmlClient)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	463 }
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	464
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	465 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	466 # Definition of BaseManager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	467 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	468
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	469 class BaseManager(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	470 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	471 Base class for managers
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	472 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	473 _registry = {}
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	474 _Server = Server
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	475
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	476 def __init__(self, address=None, authkey=None, serializer='pickle'):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	477 if authkey is None:
48773 25f06a703f89 Merged revisions 65864 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48749 diff changeset	478 authkey = current_process().authkey
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	479 self._address = address # XXX not final address if eg ('', 0)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	480 self._authkey = AuthenticationString(authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	481 self._state = State()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	482 self._state.value = State.INITIAL
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	483 self._serializer = serializer
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	484 self._Listener, self._Client = listener_client[serializer]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	485
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	486 def __reduce__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	487 return type(self).from_address, \
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	488 (self._address, self._authkey, self._serializer)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	489
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	490 def get_server(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	491 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	492 Return server object with serve_forever() method and address attribute
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	493 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	494 assert self._state.value == State.INITIAL
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	495 return Server(self._registry, self._address,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	496 self._authkey, self._serializer)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	497
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	498 def connect(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	499 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	500 Connect manager object to the server process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	501 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	502 Listener, Client = listener_client[self._serializer]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	503 conn = Client(self._address, authkey=self._authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	504 dispatch(conn, None, 'dummy')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	505 self._state.value = State.STARTED
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	506
53077 48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	507 def start(self, initializer=None, initargs=()):
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	508 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	509 Spawn a server process for this manager object
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	510 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	511 assert self._state.value == State.INITIAL
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	512
73165 8e57b5d8f58f Closes #13258: Use callable() built-in in the standard library. Florent Xicluna <florent.xicluna@gmail.com> parents: 68257 diff changeset	513 if initializer is not None and not callable(initializer):
53077 48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	514 raise TypeError('initializer must be a callable')
48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	515
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	516 # pipe over which we will retrieve address of server
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	517 reader, writer = connection.Pipe(duplex=False)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	518
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	519 # spawn process which runs a server
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	520 self._process = Process(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	521 target=type(self)._run_server,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	522 args=(self._registry, self._address, self._authkey,
53077 48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	523 self._serializer, writer, initializer, initargs),
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	524 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	525 ident = ':'.join(str(i) for i in self._process._identity)
48773 25f06a703f89 Merged revisions 65864 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48749 diff changeset	526 self._process.name = type(self).__name__ + '-' + ident
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	527 self._process.start()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	528
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	529 # get address of server
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	530 writer.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	531 self._address = reader.recv()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	532 reader.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	533
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	534 # register a finalizer
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	535 self._state.value = State.STARTED
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	536 self.shutdown = util.Finalize(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	537 self, type(self)._finalize_manager,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	538 args=(self._process, self._address, self._authkey,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	539 self._state, self._Client),
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	540 exitpriority=0
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	541 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	542
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	543 @classmethod
53077 48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	544 def _run_server(cls, registry, address, authkey, serializer, writer,
48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	545 initializer=None, initargs=()):
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	546 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	547 Create a server, report its address and run it
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	548 '''
53077 48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	549 if initializer is not None:
48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	550 initializer(*initargs)
48485604ed48 Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 50962 diff changeset	551
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	552 # create server
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	553 server = cls._Server(registry, address, authkey, serializer)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	554
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	555 # inform parent process of the server's address
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	556 writer.send(server.address)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	557 writer.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	558
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	559 # run the manager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	560 util.info('manager serving at %r', server.address)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	561 server.serve_forever()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	562
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	563 def _create(self, typeid, args, *kwds):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	564 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	565 Create a new shared object; return the token and exposed tuple
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	566 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	567 assert self._state.value == State.STARTED, 'server not yet started'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	568 conn = self._Client(self._address, authkey=self._authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	569 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	570 id, exposed = dispatch(conn, None, 'create', (typeid,)+args, kwds)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	571 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	572 conn.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	573 return Token(typeid, self._address, id), exposed
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	574
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	575 def join(self, timeout=None):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	576 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	577 Join the manager process (if it has been spawned)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	578 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	579 self._process.join(timeout)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	580
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	581 def _debug_info(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	582 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	583 Return some info about the servers shared objects and connections
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	584 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	585 conn = self._Client(self._address, authkey=self._authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	586 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	587 return dispatch(conn, None, 'debug_info')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	588 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	589 conn.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	590
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	591 def _number_of_objects(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	592 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	593 Return the number of shared objects
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	594 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	595 conn = self._Client(self._address, authkey=self._authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	596 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	597 return dispatch(conn, None, 'number_of_objects')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	598 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	599 conn.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	600
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	601 def __enter__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	602 return self
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	603
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	604 def __exit__(self, exc_type, exc_val, exc_tb):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	605 self.shutdown()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	606
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	607 @staticmethod
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	608 def _finalize_manager(process, address, authkey, state, _Client):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	609 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	610 Shutdown the manager process; will be registered as a finalizer
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	611 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	612 if process.is_alive():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	613 util.info('sending shutdown message to manager')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	614 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	615 conn = _Client(address, authkey=authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	616 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	617 dispatch(conn, None, 'shutdown')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	618 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	619 conn.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	620 except Exception:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	621 pass
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	622
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	623 process.join(timeout=0.2)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	624 if process.is_alive():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	625 util.info('manager still alive')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	626 if hasattr(process, 'terminate'):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	627 util.info('trying to `terminate()` manager process')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	628 process.terminate()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	629 process.join(timeout=0.1)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	630 if process.is_alive():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	631 util.info('manager still alive after terminate')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	632
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	633 state.value = State.SHUTDOWN
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	634 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	635 del BaseProxy._address_to_local[address]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	636 except KeyError:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	637 pass
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	638
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	639 address = property(lambda self: self._address)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	640
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	641 @classmethod
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	642 def register(cls, typeid, callable=None, proxytype=None, exposed=None,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	643 method_to_typeid=None, create_method=True):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	644 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	645 Register a typeid with the manager type
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	646 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	647 if '_registry' not in cls.__dict__:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	648 cls._registry = cls._registry.copy()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	649
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	650 if proxytype is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	651 proxytype = AutoProxy
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	652
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	653 exposed = exposed or getattr(proxytype, '_exposed_', None)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	654
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	655 method_to_typeid = method_to_typeid or \
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	656 getattr(proxytype, '_method_to_typeid_', None)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	657
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	658 if method_to_typeid:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	659 for key, value in list(method_to_typeid.items()):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	660 assert type(key) is str, '%r is not a string' % key
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	661 assert type(value) is str, '%r is not a string' % value
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	662
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	663 cls._registry[typeid] = (
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	664 callable, exposed, method_to_typeid, proxytype
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	665 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	666
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	667 if create_method:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	668 def temp(self, args, *kwds):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	669 util.debug('requesting creation of a shared %r object', typeid)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	670 token, exp = self._create(typeid, args, *kwds)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	671 proxy = proxytype(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	672 token, self._serializer, manager=self,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	673 authkey=self._authkey, exposed=exp
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	674 )
48966 750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	675 conn = self._Client(token.address, authkey=self._authkey)
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	676 dispatch(conn, None, 'decref', (token.id,))
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	677 return proxy
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	678 temp.__name__ = typeid
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	679 setattr(cls, typeid, temp)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	680
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	681 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	682 # Subclass of set which get cleared after a fork
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	683 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	684
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	685 class ProcessLocalSet(set):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	686 def __init__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	687 util.register_after_fork(self, lambda obj: obj.clear())
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	688 def __reduce__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	689 return type(self), ()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	690
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	691 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	692 # Definition of BaseProxy
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	693 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	694
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	695 class BaseProxy(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	696 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	697 A base for proxies of shared objects
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	698 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	699 _address_to_local = {}
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	700 _mutex = util.ForkAwareThreadLock()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	701
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	702 def __init__(self, token, serializer, manager=None,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	703 authkey=None, exposed=None, incref=True):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	704 BaseProxy._mutex.acquire()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	705 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	706 tls_idset = BaseProxy._address_to_local.get(token.address, None)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	707 if tls_idset is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	708 tls_idset = util.ForkAwareLocal(), ProcessLocalSet()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	709 BaseProxy._address_to_local[token.address] = tls_idset
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	710 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	711 BaseProxy._mutex.release()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	712
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	713 # self._tls is used to record the connection used by this
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	714 # thread to communicate with the manager at token.address
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	715 self._tls = tls_idset[0]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	716
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	717 # self._idset is used to record the identities of all shared
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	718 # objects for which the current process owns references and
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	719 # which are in the manager at token.address
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	720 self._idset = tls_idset[1]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	721
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	722 self._token = token
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	723 self._id = self._token.id
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	724 self._manager = manager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	725 self._serializer = serializer
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	726 self._Client = listener_client[serializer][1]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	727
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	728 if authkey is not None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	729 self._authkey = AuthenticationString(authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	730 elif self._manager is not None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	731 self._authkey = self._manager._authkey
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	732 else:
48773 25f06a703f89 Merged revisions 65864 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48749 diff changeset	733 self._authkey = current_process().authkey
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	734
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	735 if incref:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	736 self._incref()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	737
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	738 util.register_after_fork(self, BaseProxy._after_fork)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	739
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	740 def _connect(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	741 util.debug('making connection to manager')
48773 25f06a703f89 Merged revisions 65864 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48749 diff changeset	742 name = current_process().name
48747 1fdfa382ae13 Merged revisions 65824 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48367 diff changeset	743 if threading.current_thread().name != 'MainThread':
1fdfa382ae13 Merged revisions 65824 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48367 diff changeset	744 name += '\|' + threading.current_thread().name
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	745 conn = self._Client(self._token.address, authkey=self._authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	746 dispatch(conn, None, 'accept_connection', (name,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	747 self._tls.connection = conn
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	748
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	749 def _callmethod(self, methodname, args=(), kwds={}):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	750 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	751 Try to call a method of the referrent and return a copy of the result
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	752 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	753 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	754 conn = self._tls.connection
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	755 except AttributeError:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	756 util.debug('thread %r does not own a connection',
48747 1fdfa382ae13 Merged revisions 65824 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48367 diff changeset	757 threading.current_thread().name)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	758 self._connect()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	759 conn = self._tls.connection
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	760
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	761 conn.send((self._id, methodname, args, kwds))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	762 kind, result = conn.recv()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	763
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	764 if kind == '#RETURN':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	765 return result
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	766 elif kind == '#PROXY':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	767 exposed, token = result
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	768 proxytype = self._manager._registry[token.typeid][-1]
48966 750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	769 proxy = proxytype(
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	770 token, self._serializer, manager=self._manager,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	771 authkey=self._authkey, exposed=exposed
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	772 )
48966 750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	773 conn = self._Client(token.address, authkey=self._authkey)
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	774 dispatch(conn, None, 'decref', (token.id,))
750da2d18089 Merge r66115 forward to py3k, resolves issue3419 Jesse Noller <jnoller@gmail.com> parents: 48792 diff changeset	775 return proxy
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	776 raise convert_to_error(kind, result)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	777
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	778 def _getvalue(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	779 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	780 Get a copy of the value of the referent
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	781 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	782 return self._callmethod('#GETVALUE')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	783
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	784 def _incref(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	785 conn = self._Client(self._token.address, authkey=self._authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	786 dispatch(conn, None, 'incref', (self._id,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	787 util.debug('INCREF %r', self._token.id)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	788
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	789 self._idset.add(self._id)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	790
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	791 state = self._manager and self._manager._state
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	792
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	793 self._close = util.Finalize(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	794 self, BaseProxy._decref,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	795 args=(self._token, self._authkey, state,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	796 self._tls, self._idset, self._Client),
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	797 exitpriority=10
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	798 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	799
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	800 @staticmethod
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	801 def _decref(token, authkey, state, tls, idset, _Client):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	802 idset.discard(token.id)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	803
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	804 # check whether manager is still alive
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	805 if state is None or state.value == State.STARTED:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	806 # tell manager this process no longer cares about referent
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	807 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	808 util.debug('DECREF %r', token.id)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	809 conn = _Client(token.address, authkey=authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	810 dispatch(conn, None, 'decref', (token.id,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	811 except Exception as e:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	812 util.debug('... decref failed %s', e)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	813
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	814 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	815 util.debug('DECREF %r -- manager already shutdown', token.id)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	816
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	817 # check whether we can close this thread's connection because
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	818 # the process owns no more references to objects for this manager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	819 if not idset and hasattr(tls, 'connection'):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	820 util.debug('thread %r has no more proxies so closing conn',
48747 1fdfa382ae13 Merged revisions 65824 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48367 diff changeset	821 threading.current_thread().name)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	822 tls.connection.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	823 del tls.connection
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	824
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	825 def _after_fork(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	826 self._manager = None
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	827 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	828 self._incref()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	829 except Exception as e:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	830 # the proxy may just be for a manager which has shutdown
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	831 util.info('incref failed: %s' % e)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	832
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	833 def __reduce__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	834 kwds = {}
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	835 if Popen.thread_is_spawning():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	836 kwds['authkey'] = self._authkey
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	837
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	838 if getattr(self, '_isauto', False):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	839 kwds['exposed'] = self._exposed_
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	840 return (RebuildProxy,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	841 (AutoProxy, self._token, self._serializer, kwds))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	842 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	843 return (RebuildProxy,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	844 (type(self), self._token, self._serializer, kwds))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	845
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	846 def __deepcopy__(self, memo):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	847 return self._getvalue()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	848
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	849 def __repr__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	850 return '<%s object, typeid %r at %s>' % \
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	851 (type(self).__name__, self._token.typeid, '0x%x' % id(self))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	852
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	853 def __str__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	854 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	855 Return representation of the referent (or a fall-back if that fails)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	856 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	857 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	858 return self._callmethod('__repr__')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	859 except Exception:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	860 return repr(self)[:-1] + "; '__str__()' failed>"
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	861
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	862 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	863 # Function used for unpickling
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	864 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	865
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	866 def RebuildProxy(func, token, serializer, kwds):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	867 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	868 Function used for unpickling proxy objects.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	869
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	870 If possible the shared object is returned, or otherwise a proxy for it.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	871 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	872 server = getattr(current_process(), '_manager_server', None)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	873
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	874 if server and server.address == token.address:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	875 return server.id_to_obj[token.id][0]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	876 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	877 incref = (
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	878 kwds.pop('incref', True) and
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	879 not getattr(current_process(), '_inheriting', False)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	880 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	881 return func(token, serializer, incref=incref, **kwds)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	882
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	883 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	884 # Functions to create proxies and proxy types
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	885 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	886
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	887 def MakeProxyType(name, exposed, _cache={}):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	888 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	889 Return an proxy type whose methods are given by `exposed`
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	890 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	891 exposed = tuple(exposed)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	892 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	893 return _cache[(name, exposed)]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	894 except KeyError:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	895 pass
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	896
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	897 dic = {}
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	898
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	899 for meth in exposed:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	900 exec('''def %s(self, args, *kwds):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	901 return self._callmethod(%r, args, kwds)''' % (meth, meth), dic)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	902
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	903 ProxyType = type(name, (BaseProxy,), dic)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	904 ProxyType._exposed_ = exposed
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	905 _cache[(name, exposed)] = ProxyType
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	906 return ProxyType
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	907
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	908
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	909 def AutoProxy(token, serializer, manager=None, authkey=None,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	910 exposed=None, incref=True):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	911 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	912 Return an auto-proxy for `token`
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	913 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	914 _Client = listener_client[serializer][1]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	915
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	916 if exposed is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	917 conn = _Client(token.address, authkey=authkey)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	918 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	919 exposed = dispatch(conn, None, 'get_methods', (token,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	920 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	921 conn.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	922
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	923 if authkey is None and manager is not None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	924 authkey = manager._authkey
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	925 if authkey is None:
48773 25f06a703f89 Merged revisions 65864 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 48749 diff changeset	926 authkey = current_process().authkey
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	927
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	928 ProxyType = MakeProxyType('AutoProxy[%s]' % token.typeid, exposed)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	929 proxy = ProxyType(token, serializer, manager=manager, authkey=authkey,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	930 incref=incref)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	931 proxy._isauto = True
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	932 return proxy
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	933
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	934 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	935 # Types/callables which we will register with SyncManager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	936 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	937
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	938 class Namespace(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	939 def __init__(self, **kwds):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	940 self.__dict__.update(kwds)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	941 def __repr__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	942 items = list(self.__dict__.items())
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	943 temp = []
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	944 for name, value in items:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	945 if not name.startswith('_'):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	946 temp.append('%s=%r' % (name, value))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	947 temp.sort()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	948 return 'Namespace(%s)' % str.join(', ', temp)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	949
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	950 class Value(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	951 def __init__(self, typecode, value, lock=True):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	952 self._typecode = typecode
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	953 self._value = value
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	954 def get(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	955 return self._value
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	956 def set(self, value):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	957 self._value = value
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	958 def __repr__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	959 return '%s(%r, %r)'%(type(self).__name__, self._typecode, self._value)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	960 value = property(get, set)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	961
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	962 def Array(typecode, sequence, lock=True):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	963 return array.array(typecode, sequence)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	964
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	965 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	966 # Proxy types used by SyncManager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	967 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	968
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	969 class IteratorProxy(BaseProxy):
48367 d1e864a5c60c make changes for py3k for multiprocessing Benjamin Peterson <benjamin@python.org> parents: 48366 diff changeset	970 _exposed_ = ('__next__', 'send', 'throw', 'close')
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	971 def __iter__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	972 return self
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	973 def __next__(self, *args):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	974 return self._callmethod('__next__', args)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	975 def send(self, *args):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	976 return self._callmethod('send', args)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	977 def throw(self, *args):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	978 return self._callmethod('throw', args)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	979 def close(self, *args):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	980 return self._callmethod('close', args)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	981
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	982
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	983 class AcquirerProxy(BaseProxy):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	984 _exposed_ = ('acquire', 'release')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	985 def acquire(self, blocking=True):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	986 return self._callmethod('acquire', (blocking,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	987 def release(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	988 return self._callmethod('release')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	989 def __enter__(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	990 return self._callmethod('acquire')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	991 def __exit__(self, exc_type, exc_val, exc_tb):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	992 return self._callmethod('release')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	993
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	994
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	995 class ConditionProxy(AcquirerProxy):
47615 045f83a1b864 Merged revisions 64125 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 47595 diff changeset	996 _exposed_ = ('acquire', 'release', 'wait', 'notify', 'notify_all')
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	997 def wait(self, timeout=None):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	998 return self._callmethod('wait', (timeout,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	999 def notify(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1000 return self._callmethod('notify')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1001 def notify_all(self):
47615 045f83a1b864 Merged revisions 64125 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 47595 diff changeset	1002 return self._callmethod('notify_all')
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1003
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1004 class EventProxy(BaseProxy):
47642 5a9cff7fd08f attempt to fix multiprocessing Benjamin Peterson <benjamin@python.org> parents: 47615 diff changeset	1005 _exposed_ = ('is_set', 'set', 'clear', 'wait')
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1006 def is_set(self):
47642 5a9cff7fd08f attempt to fix multiprocessing Benjamin Peterson <benjamin@python.org> parents: 47615 diff changeset	1007 return self._callmethod('is_set')
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1008 def set(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1009 return self._callmethod('set')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1010 def clear(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1011 return self._callmethod('clear')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1012 def wait(self, timeout=None):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1013 return self._callmethod('wait', (timeout,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1014
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1015 class NamespaceProxy(BaseProxy):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1016 _exposed_ = ('__getattribute__', '__setattr__', '__delattr__')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1017 def __getattr__(self, key):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1018 if key[0] == '_':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1019 return object.__getattribute__(self, key)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1020 callmethod = object.__getattribute__(self, '_callmethod')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1021 return callmethod('__getattribute__', (key,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1022 def __setattr__(self, key, value):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1023 if key[0] == '_':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1024 return object.__setattr__(self, key, value)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1025 callmethod = object.__getattribute__(self, '_callmethod')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1026 return callmethod('__setattr__', (key, value))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1027 def __delattr__(self, key):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1028 if key[0] == '_':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1029 return object.__delattr__(self, key)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1030 callmethod = object.__getattribute__(self, '_callmethod')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1031 return callmethod('__delattr__', (key,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1032
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1033
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1034 class ValueProxy(BaseProxy):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1035 _exposed_ = ('get', 'set')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1036 def get(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1037 return self._callmethod('get')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1038 def set(self, value):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1039 return self._callmethod('set', (value,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1040 value = property(get, set)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1041
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1042
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1043 BaseListProxy = MakeProxyType('BaseListProxy', (
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1044 '__add__', '__contains__', '__delitem__', '__delslice__',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1045 '__getitem__', '__getslice__', '__len__', '__mul__',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1046 '__reversed__', '__rmul__', '__setitem__', '__setslice__',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1047 'append', 'count', 'extend', 'index', 'insert', 'pop', 'remove',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1048 'reverse', 'sort', '__imul__'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1049 )) # XXX __getslice__ and __setslice__ unneeded in Py3.0
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1050 class ListProxy(BaseListProxy):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1051 def __iadd__(self, value):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1052 self._callmethod('extend', (value,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1053 return self
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1054 def __imul__(self, value):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1055 self._callmethod('__imul__', (value,))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1056 return self
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1057
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1058
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1059 DictProxy = MakeProxyType('DictProxy', (
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1060 '__contains__', '__delitem__', '__getitem__', '__len__',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1061 '__setitem__', 'clear', 'copy', 'get', 'has_key', 'items',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1062 'keys', 'pop', 'popitem', 'setdefault', 'update', 'values'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1063 ))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1064
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1065
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1066 ArrayProxy = MakeProxyType('ArrayProxy', (
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1067 '__len__', '__getitem__', '__setitem__', '__getslice__', '__setslice__'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1068 )) # XXX __getslice__ and __setslice__ unneeded in Py3.0
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1069
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1070
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1071 PoolProxy = MakeProxyType('PoolProxy', (
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1072 'apply', 'apply_async', 'close', 'imap', 'imap_unordered', 'join',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1073 'map', 'map_async', 'terminate'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1074 ))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1075 PoolProxy._method_to_typeid_ = {
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1076 'apply_async': 'AsyncResult',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1077 'map_async': 'AsyncResult',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1078 'imap': 'Iterator',
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1079 'imap_unordered': 'Iterator'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1080 }
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1081
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1082 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1083 # Definition of SyncManager
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1084 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1085
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1086 class SyncManager(BaseManager):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1087 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1088 Subclass of `BaseManager` which supports a number of shared object types.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1089
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1090 The types registered are those intended for the synchronization
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1091 of threads, plus `dict`, `list` and `Namespace`.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1092
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1093 The `multiprocessing.Manager()` function creates started instances of
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1094 this class.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1095 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1096
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1097 SyncManager.register('Queue', queue.Queue)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1098 SyncManager.register('JoinableQueue', queue.Queue)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1099 SyncManager.register('Event', threading.Event, EventProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1100 SyncManager.register('Lock', threading.Lock, AcquirerProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1101 SyncManager.register('RLock', threading.RLock, AcquirerProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1102 SyncManager.register('Semaphore', threading.Semaphore, AcquirerProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1103 SyncManager.register('BoundedSemaphore', threading.BoundedSemaphore,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1104 AcquirerProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1105 SyncManager.register('Condition', threading.Condition, ConditionProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1106 SyncManager.register('Pool', Pool, PoolProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1107 SyncManager.register('list', list, ListProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1108 SyncManager.register('dict', dict, DictProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1109 SyncManager.register('Value', Value, ValueProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1110 SyncManager.register('Array', Array, ArrayProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1111 SyncManager.register('Namespace', Namespace, NamespaceProxy)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1112
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1113 # types returned by methods of PoolProxy
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1114 SyncManager.register('Iterator', proxytype=IteratorProxy, create_method=False)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1115 SyncManager.register('AsyncResult', create_method=False)

Mercurial > cpython-lru_cache-weakref

annotate Lib/multiprocessing/managers.py @ 78069:a8aa77458e12 3.2