cpython-lru_cache-weakref: Lib/multiprocessing/managers.py annotate

annotate Lib/multiprocessing/managers.py @ 79675:c0a2294de787 2.7

Issue #16199: Backport 2to3 typo fix from 3.2.

author	Chris Jerdonek <chris.jerdonek@gmail.com>
date	Thu, 11 Oct 2012 16:15:46 -0700
parents	94494a779c20
children	20b59fec1123

rev	line source
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	2 # Module providing the `SyncManager` class for dealing
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	3 # with shared objects
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	4 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	5 # multiprocessing/managers.py
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	6 #
66887 9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	7 # Copyright (c) 2006-2008, R Oudkerk
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	8 # All rights reserved.
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	9 #
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	10 # Redistribution and use in source and binary forms, with or without
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	11 # modification, are permitted provided that the following conditions
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	12 # are met:
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	13 #
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	14 # 1. Redistributions of source code must retain the above copyright
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	15 # notice, this list of conditions and the following disclaimer.
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	16 # 2. Redistributions in binary form must reproduce the above copyright
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	17 # notice, this list of conditions and the following disclaimer in the
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	18 # documentation and/or other materials provided with the distribution.
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	19 # 3. Neither the name of author nor the names of any contributors may be
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	20 # used to endorse or promote products derived from this software
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	21 # without specific prior written permission.
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	22 #
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	23 # THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS "AS IS" AND
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	24 # ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	25 # IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	26 # ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	27 # FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	28 # DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	29 # OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	30 # HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	31 # LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	32 # OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 56067 diff changeset	33 # SUCH DAMAGE.
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	34 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	35
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	36 __all__ = [ 'BaseManager', 'SyncManager', 'BaseProxy', 'Token' ]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	37
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	38 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	39 # Imports
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	40 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	41
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	42 import os
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	43 import sys
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	44 import weakref
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	45 import threading
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	46 import array
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	47 import Queue
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	48
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	49 from traceback import format_exc
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	50 from multiprocessing import Process, current_process, active_children, Pool, util, connection
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	51 from multiprocessing.process import AuthenticationString
47980 5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47834 diff changeset	52 from multiprocessing.forking import exit, Popen, assert_spawning, ForkingPickler
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	53 from multiprocessing.util import Finalize, info
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	54
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	55 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	56 from cPickle import PicklingError
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	57 except ImportError:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	58 from pickle import PicklingError
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	59
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	60 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	61 # Register some things for pickling
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	62 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	63
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	64 def reduce_array(a):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	65 return array.array, (a.typecode, a.tostring())
47980 5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47834 diff changeset	66 ForkingPickler.register(array.array, reduce_array)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	67
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	68 view_types = [type(getattr({}, name)()) for name in ('items','keys','values')]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	69
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	70 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	71 # Type for identifying shared objects
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	72 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	73
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	74 class Token(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	75 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	76 Type to uniquely indentify a shared object
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	77 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	78 __slots__ = ('typeid', 'address', 'id')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	79
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	80 def __init__(self, typeid, address, id):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	81 (self.typeid, self.address, self.id) = (typeid, address, id)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	82
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	83 def __getstate__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	84 return (self.typeid, self.address, self.id)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	85
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	86 def __setstate__(self, state):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	87 (self.typeid, self.address, self.id) = state
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	88
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	89 def __repr__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	90 return 'Token(typeid=%r, address=%r, id=%r)' % \
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	91 (self.typeid, self.address, self.id)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	92
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	93 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	94 # Function for communication with a manager's server process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	95 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	96
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	97 def dispatch(c, id, methodname, args=(), kwds={}):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	98 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	99 Send a message to manager using connection `c` and return response
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	100 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	101 c.send((id, methodname, args, kwds))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	102 kind, result = c.recv()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	103 if kind == '#RETURN':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	104 return result
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	105 raise convert_to_error(kind, result)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	106
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	107 def convert_to_error(kind, result):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	108 if kind == '#ERROR':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	109 return result
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	110 elif kind == '#TRACEBACK':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	111 assert type(result) is str
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	112 return RemoteError(result)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	113 elif kind == '#UNSERIALIZABLE':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	114 assert type(result) is str
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	115 return RemoteError('Unserializable message: %s\n' % result)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	116 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	117 return ValueError('Unrecognized message type')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	118
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	119 class RemoteError(Exception):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	120 def __str__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	121 return ('\n' + '-'75 + '\n' + str(self.args[0]) + '-'75)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	122
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	123 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	124 # Functions for finding the method names of an object
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	125 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	126
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	127 def all_methods(obj):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	128 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	129 Return a list of names of methods of `obj`
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	130 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	131 temp = []
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	132 for name in dir(obj):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	133 func = getattr(obj, name)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	134 if hasattr(func, '__call__'):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	135 temp.append(name)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	136 return temp
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	137
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	138 def public_methods(obj):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	139 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	140 Return a list of names of methods of `obj` which do not start with '_'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	141 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	142 return [name for name in all_methods(obj) if name[0] != '_']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	143
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	144 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	145 # Server which is run in a process controlled by a manager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	146 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	147
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	148 class Server(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	149 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	150 Server class which runs in a process controlled by a manager object
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	151 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	152 public = ['shutdown', 'create', 'accept_connection', 'get_methods',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	153 'debug_info', 'number_of_objects', 'dummy', 'incref', 'decref']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	154
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	155 def __init__(self, registry, address, authkey, serializer):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	156 assert isinstance(authkey, bytes)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	157 self.registry = registry
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	158 self.authkey = AuthenticationString(authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	159 Listener, Client = listener_client[serializer]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	160
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	161 # do authentication later
74143 94494a779c20 Issue #13565: Increase multiprocessing's server socket backlog, to avoid Charles-François Natali <neologix@free.fr> parents: 68256 diff changeset	162 self.listener = Listener(address=address, backlog=16)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	163 self.address = self.listener.address
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	164
50960 d274062816ff Issue 5009: multiprocessing: failure in manager._debug_info() Jesse Noller <jnoller@gmail.com> parents: 48931 diff changeset	165 self.id_to_obj = {'0': (None, ())}
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	166 self.id_to_refcount = {}
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	167 self.mutex = threading.RLock()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	168 self.stop = 0
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	169
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	170 def serve_forever(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	171 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	172 Run the server forever
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	173 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	174 current_process()._manager_server = self
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	175 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	176 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	177 while 1:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	178 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	179 c = self.listener.accept()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	180 except (OSError, IOError):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	181 continue
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	182 t = threading.Thread(target=self.handle_request, args=(c,))
48291 28d93c9c3a03 patch up multiprocessing until it's API can be changed too Benjamin Peterson <benjamin@python.org> parents: 48289 diff changeset	183 t.daemon = True
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	184 t.start()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	185 except (KeyboardInterrupt, SystemExit):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	186 pass
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	187 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	188 self.stop = 999
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	189 self.listener.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	190
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	191 def handle_request(self, c):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	192 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	193 Handle a new connection
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	194 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	195 funcname = result = request = None
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	196 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	197 connection.deliver_challenge(c, self.authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	198 connection.answer_challenge(c, self.authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	199 request = c.recv()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	200 ignore, funcname, args, kwds = request
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	201 assert funcname in self.public, '%r unrecognized' % funcname
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	202 func = getattr(self, funcname)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	203 except Exception:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	204 msg = ('#TRACEBACK', format_exc())
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	205 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	206 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	207 result = func(c, args, *kwds)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	208 except Exception:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	209 msg = ('#TRACEBACK', format_exc())
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	210 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	211 msg = ('#RETURN', result)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	212 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	213 c.send(msg)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	214 except Exception, e:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	215 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	216 c.send(('#TRACEBACK', format_exc()))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	217 except Exception:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	218 pass
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	219 util.info('Failure to send message: %r', msg)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	220 util.info(' ... request was %r', request)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	221 util.info(' ... exception was %r', e)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	222
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	223 c.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	224
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	225 def serve_client(self, conn):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	226 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	227 Handle requests from the proxies in a particular process/thread
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	228 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	229 util.debug('starting server thread to service %r',
48289 024b2b984866 change a few uses of the threading APIs Benjamin Peterson <benjamin@python.org> parents: 47980 diff changeset	230 threading.current_thread().name)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	231
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	232 recv = conn.recv
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	233 send = conn.send
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	234 id_to_obj = self.id_to_obj
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	235
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	236 while not self.stop:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	237
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	238 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	239 methodname = obj = None
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	240 request = recv()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	241 ident, methodname, args, kwds = request
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	242 obj, exposed, gettypeid = id_to_obj[ident]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	243
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	244 if methodname not in exposed:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	245 raise AttributeError(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	246 'method %r of %r object is not in exposed=%r' %
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	247 (methodname, type(obj), exposed)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	248 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	249
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	250 function = getattr(obj, methodname)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	251
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	252 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	253 res = function(args, *kwds)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	254 except Exception, e:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	255 msg = ('#ERROR', e)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	256 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	257 typeid = gettypeid and gettypeid.get(methodname, None)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	258 if typeid:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	259 rident, rexposed = self.create(conn, typeid, res)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	260 token = Token(typeid, self.address, rident)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	261 msg = ('#PROXY', (rexposed, token))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	262 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	263 msg = ('#RETURN', res)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	264
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	265 except AttributeError:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	266 if methodname is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	267 msg = ('#TRACEBACK', format_exc())
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	268 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	269 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	270 fallback_func = self.fallback_mapping[methodname]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	271 result = fallback_func(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	272 self, conn, ident, obj, args, *kwds
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	273 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	274 msg = ('#RETURN', result)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	275 except Exception:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	276 msg = ('#TRACEBACK', format_exc())
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	277
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	278 except EOFError:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	279 util.debug('got EOF -- exiting thread serving %r',
48289 024b2b984866 change a few uses of the threading APIs Benjamin Peterson <benjamin@python.org> parents: 47980 diff changeset	280 threading.current_thread().name)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	281 sys.exit(0)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	282
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	283 except Exception:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	284 msg = ('#TRACEBACK', format_exc())
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	285
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	286 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	287 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	288 send(msg)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	289 except Exception, e:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	290 send(('#UNSERIALIZABLE', repr(msg)))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	291 except Exception, e:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	292 util.info('exception in thread serving %r',
48289 024b2b984866 change a few uses of the threading APIs Benjamin Peterson <benjamin@python.org> parents: 47980 diff changeset	293 threading.current_thread().name)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	294 util.info(' ... message was %r', msg)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	295 util.info(' ... exception was %r', e)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	296 conn.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	297 sys.exit(1)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	298
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	299 def fallback_getvalue(self, conn, ident, obj):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	300 return obj
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	301
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	302 def fallback_str(self, conn, ident, obj):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	303 return str(obj)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	304
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	305 def fallback_repr(self, conn, ident, obj):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	306 return repr(obj)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	307
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	308 fallback_mapping = {
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	309 '__str__':fallback_str,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	310 '__repr__':fallback_repr,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	311 '#GETVALUE':fallback_getvalue
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	312 }
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	313
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	314 def dummy(self, c):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	315 pass
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	316
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	317 def debug_info(self, c):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	318 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	319 Return some info --- useful to spot problems with refcounting
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	320 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	321 self.mutex.acquire()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	322 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	323 result = []
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	324 keys = self.id_to_obj.keys()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	325 keys.sort()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	326 for ident in keys:
50960 d274062816ff Issue 5009: multiprocessing: failure in manager._debug_info() Jesse Noller <jnoller@gmail.com> parents: 48931 diff changeset	327 if ident != '0':
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	328 result.append(' %s: refcount=%s\n %s' %
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	329 (ident, self.id_to_refcount[ident],
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	330 str(self.id_to_obj[ident][0])[:75]))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	331 return '\n'.join(result)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	332 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	333 self.mutex.release()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	334
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	335 def number_of_objects(self, c):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	336 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	337 Number of shared objects
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	338 '''
50960 d274062816ff Issue 5009: multiprocessing: failure in manager._debug_info() Jesse Noller <jnoller@gmail.com> parents: 48931 diff changeset	339 return len(self.id_to_obj) - 1 # don't count ident='0'
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	340
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	341 def shutdown(self, c):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	342 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	343 Shutdown this process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	344 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	345 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	346 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	347 util.debug('manager received shutdown message')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	348 c.send(('#RETURN', None))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	349
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	350 if sys.stdout != sys.__stdout__:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	351 util.debug('resetting stdout, stderr')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	352 sys.stdout = sys.__stdout__
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	353 sys.stderr = sys.__stderr__
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	354
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	355 util._run_finalizers(0)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	356
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	357 for p in active_children():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	358 util.debug('terminating a child process of manager')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	359 p.terminate()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	360
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	361 for p in active_children():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	362 util.debug('terminating a child process of manager')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	363 p.join()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	364
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	365 util._run_finalizers()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	366 util.info('manager exiting with exitcode 0')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	367 except:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	368 import traceback
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	369 traceback.print_exc()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	370 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	371 exit(0)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	372
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	373 def create(self, c, typeid, args, *kwds):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	374 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	375 Create a new shared object and return its id
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	376 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	377 self.mutex.acquire()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	378 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	379 callable, exposed, method_to_typeid, proxytype = \
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	380 self.registry[typeid]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	381
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	382 if callable is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	383 assert len(args) == 1 and not kwds
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	384 obj = args[0]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	385 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	386 obj = callable(args, *kwds)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	387
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	388 if exposed is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	389 exposed = public_methods(obj)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	390 if method_to_typeid is not None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	391 assert type(method_to_typeid) is dict
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	392 exposed = list(exposed) + list(method_to_typeid)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	393
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	394 ident = '%x' % id(obj) # convert to string because xmlrpclib
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	395 # only has 32 bit signed integers
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	396 util.debug('%r callable returned object with id %r', typeid, ident)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	397
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	398 self.id_to_obj[ident] = (obj, set(exposed), method_to_typeid)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	399 if ident not in self.id_to_refcount:
48931 51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	400 self.id_to_refcount[ident] = 0
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	401 # increment the reference count immediately, to avoid
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	402 # this object being garbage collected before a Proxy
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	403 # object for it can be created. The caller of create()
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	404 # is responsible for doing a decref once the Proxy object
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	405 # has been created.
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	406 self.incref(c, ident)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	407 return ident, tuple(exposed)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	408 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	409 self.mutex.release()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	410
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	411 def get_methods(self, c, token):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	412 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	413 Return the methods of the shared object indicated by token
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	414 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	415 return tuple(self.id_to_obj[token.id][1])
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	416
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	417 def accept_connection(self, c, name):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	418 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	419 Spawn a new thread to serve this connection
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	420 '''
48289 024b2b984866 change a few uses of the threading APIs Benjamin Peterson <benjamin@python.org> parents: 47980 diff changeset	421 threading.current_thread().name = name
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	422 c.send(('#RETURN', None))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	423 self.serve_client(c)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	424
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	425 def incref(self, c, ident):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	426 self.mutex.acquire()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	427 try:
48931 51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	428 self.id_to_refcount[ident] += 1
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	429 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	430 self.mutex.release()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	431
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	432 def decref(self, c, ident):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	433 self.mutex.acquire()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	434 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	435 assert self.id_to_refcount[ident] >= 1
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	436 self.id_to_refcount[ident] -= 1
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	437 if self.id_to_refcount[ident] == 0:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	438 del self.id_to_obj[ident], self.id_to_refcount[ident]
56068 6fca35352f7b Merged revisions 74903 via svnmerge from Georg Brandl <georg@python.org> parents: 48931 diff changeset	439 util.debug('disposing of obj with id %r', ident)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	440 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	441 self.mutex.release()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	442
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	443 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	444 # Class to represent state of a manager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	445 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	446
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	447 class State(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	448 __slots__ = ['value']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	449 INITIAL = 0
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	450 STARTED = 1
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	451 SHUTDOWN = 2
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	452
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	453 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	454 # Mapping from serializer name to Listener and Client types
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	455 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	456
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	457 listener_client = {
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	458 'pickle' : (connection.Listener, connection.Client),
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	459 'xmlrpclib' : (connection.XmlListener, connection.XmlClient)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	460 }
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	461
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	462 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	463 # Definition of BaseManager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	464 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	465
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	466 class BaseManager(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	467 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	468 Base class for managers
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	469 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	470 _registry = {}
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	471 _Server = Server
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	472
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	473 def __init__(self, address=None, authkey=None, serializer='pickle'):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	474 if authkey is None:
48302 7ea805d879e1 issue3352: clean up the multiprocessing API to remove many get_/set_ methods and convert them to properties. Update the docs and the examples included. Jesse Noller <jnoller@gmail.com> parents: 48291 diff changeset	475 authkey = current_process().authkey
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	476 self._address = address # XXX not final address if eg ('', 0)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	477 self._authkey = AuthenticationString(authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	478 self._state = State()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	479 self._state.value = State.INITIAL
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	480 self._serializer = serializer
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	481 self._Listener, self._Client = listener_client[serializer]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	482
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	483 def __reduce__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	484 return type(self).from_address, \
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	485 (self._address, self._authkey, self._serializer)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	486
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	487 def get_server(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	488 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	489 Return server object with serve_forever() method and address attribute
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	490 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	491 assert self._state.value == State.INITIAL
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	492 return Server(self._registry, self._address,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	493 self._authkey, self._serializer)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	494
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	495 def connect(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	496 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	497 Connect manager object to the server process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	498 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	499 Listener, Client = listener_client[self._serializer]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	500 conn = Client(self._address, authkey=self._authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	501 dispatch(conn, None, 'dummy')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	502 self._state.value = State.STARTED
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	503
52727 71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	504 def start(self, initializer=None, initargs=()):
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	505 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	506 Spawn a server process for this manager object
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	507 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	508 assert self._state.value == State.INITIAL
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	509
52727 71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	510 if initializer is not None and not hasattr(initializer, '__call__'):
71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	511 raise TypeError('initializer must be a callable')
71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	512
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	513 # pipe over which we will retrieve address of server
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	514 reader, writer = connection.Pipe(duplex=False)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	515
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	516 # spawn process which runs a server
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	517 self._process = Process(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	518 target=type(self)._run_server,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	519 args=(self._registry, self._address, self._authkey,
52727 71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	520 self._serializer, writer, initializer, initargs),
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	521 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	522 ident = ':'.join(str(i) for i in self._process._identity)
48302 7ea805d879e1 issue3352: clean up the multiprocessing API to remove many get_/set_ methods and convert them to properties. Update the docs and the examples included. Jesse Noller <jnoller@gmail.com> parents: 48291 diff changeset	523 self._process.name = type(self).__name__ + '-' + ident
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	524 self._process.start()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	525
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	526 # get address of server
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	527 writer.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	528 self._address = reader.recv()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	529 reader.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	530
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	531 # register a finalizer
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	532 self._state.value = State.STARTED
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	533 self.shutdown = util.Finalize(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	534 self, type(self)._finalize_manager,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	535 args=(self._process, self._address, self._authkey,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	536 self._state, self._Client),
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	537 exitpriority=0
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	538 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	539
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	540 @classmethod
52727 71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	541 def _run_server(cls, registry, address, authkey, serializer, writer,
71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	542 initializer=None, initargs=()):
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	543 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	544 Create a server, report its address and run it
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	545 '''
52727 71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	546 if initializer is not None:
71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	547 initializer(*initargs)
71f6129ddad4 Add custom initializer argument to multiprocess.Manager, courtesy of lekma Jesse Noller <jnoller@gmail.com>* parents: 50960 diff changeset	548
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	549 # create server
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	550 server = cls._Server(registry, address, authkey, serializer)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	551
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	552 # inform parent process of the server's address
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	553 writer.send(server.address)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	554 writer.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	555
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	556 # run the manager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	557 util.info('manager serving at %r', server.address)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	558 server.serve_forever()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	559
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	560 def _create(self, typeid, args, *kwds):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	561 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	562 Create a new shared object; return the token and exposed tuple
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	563 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	564 assert self._state.value == State.STARTED, 'server not yet started'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	565 conn = self._Client(self._address, authkey=self._authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	566 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	567 id, exposed = dispatch(conn, None, 'create', (typeid,)+args, kwds)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	568 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	569 conn.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	570 return Token(typeid, self._address, id), exposed
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	571
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	572 def join(self, timeout=None):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	573 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	574 Join the manager process (if it has been spawned)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	575 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	576 self._process.join(timeout)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	577
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	578 def _debug_info(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	579 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	580 Return some info about the servers shared objects and connections
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	581 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	582 conn = self._Client(self._address, authkey=self._authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	583 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	584 return dispatch(conn, None, 'debug_info')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	585 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	586 conn.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	587
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	588 def _number_of_objects(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	589 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	590 Return the number of shared objects
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	591 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	592 conn = self._Client(self._address, authkey=self._authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	593 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	594 return dispatch(conn, None, 'number_of_objects')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	595 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	596 conn.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	597
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	598 def __enter__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	599 return self
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	600
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	601 def __exit__(self, exc_type, exc_val, exc_tb):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	602 self.shutdown()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	603
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	604 @staticmethod
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	605 def _finalize_manager(process, address, authkey, state, _Client):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	606 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	607 Shutdown the manager process; will be registered as a finalizer
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	608 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	609 if process.is_alive():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	610 util.info('sending shutdown message to manager')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	611 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	612 conn = _Client(address, authkey=authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	613 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	614 dispatch(conn, None, 'shutdown')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	615 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	616 conn.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	617 except Exception:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	618 pass
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	619
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	620 process.join(timeout=0.2)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	621 if process.is_alive():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	622 util.info('manager still alive')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	623 if hasattr(process, 'terminate'):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	624 util.info('trying to `terminate()` manager process')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	625 process.terminate()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	626 process.join(timeout=0.1)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	627 if process.is_alive():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	628 util.info('manager still alive after terminate')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	629
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	630 state.value = State.SHUTDOWN
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	631 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	632 del BaseProxy._address_to_local[address]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	633 except KeyError:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	634 pass
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	635
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	636 address = property(lambda self: self._address)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	637
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	638 @classmethod
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	639 def register(cls, typeid, callable=None, proxytype=None, exposed=None,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	640 method_to_typeid=None, create_method=True):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	641 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	642 Register a typeid with the manager type
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	643 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	644 if '_registry' not in cls.__dict__:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	645 cls._registry = cls._registry.copy()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	646
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	647 if proxytype is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	648 proxytype = AutoProxy
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	649
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	650 exposed = exposed or getattr(proxytype, '_exposed_', None)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	651
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	652 method_to_typeid = method_to_typeid or \
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	653 getattr(proxytype, '_method_to_typeid_', None)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	654
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	655 if method_to_typeid:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	656 for key, value in method_to_typeid.items():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	657 assert type(key) is str, '%r is not a string' % key
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	658 assert type(value) is str, '%r is not a string' % value
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	659
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	660 cls._registry[typeid] = (
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	661 callable, exposed, method_to_typeid, proxytype
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	662 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	663
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	664 if create_method:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	665 def temp(self, args, *kwds):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	666 util.debug('requesting creation of a shared %r object', typeid)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	667 token, exp = self._create(typeid, args, *kwds)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	668 proxy = proxytype(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	669 token, self._serializer, manager=self,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	670 authkey=self._authkey, exposed=exp
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	671 )
48931 51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	672 conn = self._Client(token.address, authkey=self._authkey)
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	673 dispatch(conn, None, 'decref', (token.id,))
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	674 return proxy
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	675 temp.__name__ = typeid
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	676 setattr(cls, typeid, temp)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	677
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	678 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	679 # Subclass of set which get cleared after a fork
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	680 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	681
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	682 class ProcessLocalSet(set):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	683 def __init__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	684 util.register_after_fork(self, lambda obj: obj.clear())
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	685 def __reduce__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	686 return type(self), ()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	687
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	688 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	689 # Definition of BaseProxy
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	690 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	691
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	692 class BaseProxy(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	693 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	694 A base for proxies of shared objects
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	695 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	696 _address_to_local = {}
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	697 _mutex = util.ForkAwareThreadLock()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	698
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	699 def __init__(self, token, serializer, manager=None,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	700 authkey=None, exposed=None, incref=True):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	701 BaseProxy._mutex.acquire()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	702 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	703 tls_idset = BaseProxy._address_to_local.get(token.address, None)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	704 if tls_idset is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	705 tls_idset = util.ForkAwareLocal(), ProcessLocalSet()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	706 BaseProxy._address_to_local[token.address] = tls_idset
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	707 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	708 BaseProxy._mutex.release()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	709
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	710 # self._tls is used to record the connection used by this
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	711 # thread to communicate with the manager at token.address
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	712 self._tls = tls_idset[0]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	713
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	714 # self._idset is used to record the identities of all shared
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	715 # objects for which the current process owns references and
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	716 # which are in the manager at token.address
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	717 self._idset = tls_idset[1]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	718
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	719 self._token = token
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	720 self._id = self._token.id
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	721 self._manager = manager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	722 self._serializer = serializer
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	723 self._Client = listener_client[serializer][1]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	724
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	725 if authkey is not None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	726 self._authkey = AuthenticationString(authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	727 elif self._manager is not None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	728 self._authkey = self._manager._authkey
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	729 else:
48302 7ea805d879e1 issue3352: clean up the multiprocessing API to remove many get_/set_ methods and convert them to properties. Update the docs and the examples included. Jesse Noller <jnoller@gmail.com> parents: 48291 diff changeset	730 self._authkey = current_process().authkey
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	731
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	732 if incref:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	733 self._incref()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	734
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	735 util.register_after_fork(self, BaseProxy._after_fork)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	736
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	737 def _connect(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	738 util.debug('making connection to manager')
48302 7ea805d879e1 issue3352: clean up the multiprocessing API to remove many get_/set_ methods and convert them to properties. Update the docs and the examples included. Jesse Noller <jnoller@gmail.com> parents: 48291 diff changeset	739 name = current_process().name
48289 024b2b984866 change a few uses of the threading APIs Benjamin Peterson <benjamin@python.org> parents: 47980 diff changeset	740 if threading.current_thread().name != 'MainThread':
024b2b984866 change a few uses of the threading APIs Benjamin Peterson <benjamin@python.org> parents: 47980 diff changeset	741 name += '\|' + threading.current_thread().name
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	742 conn = self._Client(self._token.address, authkey=self._authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	743 dispatch(conn, None, 'accept_connection', (name,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	744 self._tls.connection = conn
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	745
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	746 def _callmethod(self, methodname, args=(), kwds={}):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	747 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	748 Try to call a method of the referrent and return a copy of the result
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	749 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	750 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	751 conn = self._tls.connection
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	752 except AttributeError:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	753 util.debug('thread %r does not own a connection',
48289 024b2b984866 change a few uses of the threading APIs Benjamin Peterson <benjamin@python.org> parents: 47980 diff changeset	754 threading.current_thread().name)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	755 self._connect()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	756 conn = self._tls.connection
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	757
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	758 conn.send((self._id, methodname, args, kwds))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	759 kind, result = conn.recv()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	760
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	761 if kind == '#RETURN':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	762 return result
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	763 elif kind == '#PROXY':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	764 exposed, token = result
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	765 proxytype = self._manager._registry[token.typeid][-1]
48931 51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	766 proxy = proxytype(
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	767 token, self._serializer, manager=self._manager,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	768 authkey=self._authkey, exposed=exposed
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	769 )
48931 51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	770 conn = self._Client(token.address, authkey=self._authkey)
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	771 dispatch(conn, None, 'decref', (token.id,))
51f795c9530e revert r66114 for Jesse Benjamin Peterson <benjamin@python.org> parents: 48302 diff changeset	772 return proxy
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	773 raise convert_to_error(kind, result)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	774
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	775 def _getvalue(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	776 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	777 Get a copy of the value of the referent
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	778 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	779 return self._callmethod('#GETVALUE')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	780
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	781 def _incref(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	782 conn = self._Client(self._token.address, authkey=self._authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	783 dispatch(conn, None, 'incref', (self._id,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	784 util.debug('INCREF %r', self._token.id)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	785
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	786 self._idset.add(self._id)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	787
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	788 state = self._manager and self._manager._state
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	789
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	790 self._close = util.Finalize(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	791 self, BaseProxy._decref,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	792 args=(self._token, self._authkey, state,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	793 self._tls, self._idset, self._Client),
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	794 exitpriority=10
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	795 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	796
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	797 @staticmethod
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	798 def _decref(token, authkey, state, tls, idset, _Client):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	799 idset.discard(token.id)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	800
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	801 # check whether manager is still alive
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	802 if state is None or state.value == State.STARTED:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	803 # tell manager this process no longer cares about referent
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	804 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	805 util.debug('DECREF %r', token.id)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	806 conn = _Client(token.address, authkey=authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	807 dispatch(conn, None, 'decref', (token.id,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	808 except Exception, e:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	809 util.debug('... decref failed %s', e)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	810
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	811 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	812 util.debug('DECREF %r -- manager already shutdown', token.id)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	813
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	814 # check whether we can close this thread's connection because
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	815 # the process owns no more references to objects for this manager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	816 if not idset and hasattr(tls, 'connection'):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	817 util.debug('thread %r has no more proxies so closing conn',
48289 024b2b984866 change a few uses of the threading APIs Benjamin Peterson <benjamin@python.org> parents: 47980 diff changeset	818 threading.current_thread().name)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	819 tls.connection.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	820 del tls.connection
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	821
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	822 def _after_fork(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	823 self._manager = None
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	824 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	825 self._incref()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	826 except Exception, e:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	827 # the proxy may just be for a manager which has shutdown
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	828 util.info('incref failed: %s' % e)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	829
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	830 def __reduce__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	831 kwds = {}
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	832 if Popen.thread_is_spawning():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	833 kwds['authkey'] = self._authkey
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	834
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	835 if getattr(self, '_isauto', False):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	836 kwds['exposed'] = self._exposed_
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	837 return (RebuildProxy,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	838 (AutoProxy, self._token, self._serializer, kwds))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	839 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	840 return (RebuildProxy,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	841 (type(self), self._token, self._serializer, kwds))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	842
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	843 def __deepcopy__(self, memo):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	844 return self._getvalue()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	845
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	846 def __repr__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	847 return '<%s object, typeid %r at %s>' % \
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	848 (type(self).__name__, self._token.typeid, '0x%x' % id(self))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	849
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	850 def __str__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	851 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	852 Return representation of the referent (or a fall-back if that fails)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	853 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	854 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	855 return self._callmethod('__repr__')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	856 except Exception:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	857 return repr(self)[:-1] + "; '__str__()' failed>"
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	858
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	859 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	860 # Function used for unpickling
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	861 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	862
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	863 def RebuildProxy(func, token, serializer, kwds):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	864 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	865 Function used for unpickling proxy objects.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	866
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	867 If possible the shared object is returned, or otherwise a proxy for it.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	868 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	869 server = getattr(current_process(), '_manager_server', None)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	870
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	871 if server and server.address == token.address:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	872 return server.id_to_obj[token.id][0]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	873 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	874 incref = (
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	875 kwds.pop('incref', True) and
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	876 not getattr(current_process(), '_inheriting', False)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	877 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	878 return func(token, serializer, incref=incref, **kwds)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	879
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	880 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	881 # Functions to create proxies and proxy types
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	882 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	883
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	884 def MakeProxyType(name, exposed, _cache={}):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	885 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	886 Return an proxy type whose methods are given by `exposed`
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	887 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	888 exposed = tuple(exposed)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	889 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	890 return _cache[(name, exposed)]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	891 except KeyError:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	892 pass
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	893
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	894 dic = {}
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	895
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	896 for meth in exposed:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	897 exec '''def %s(self, args, *kwds):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	898 return self._callmethod(%r, args, kwds)''' % (meth, meth) in dic
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	899
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	900 ProxyType = type(name, (BaseProxy,), dic)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	901 ProxyType._exposed_ = exposed
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	902 _cache[(name, exposed)] = ProxyType
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	903 return ProxyType
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	904
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	905
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	906 def AutoProxy(token, serializer, manager=None, authkey=None,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	907 exposed=None, incref=True):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	908 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	909 Return an auto-proxy for `token`
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	910 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	911 _Client = listener_client[serializer][1]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	912
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	913 if exposed is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	914 conn = _Client(token.address, authkey=authkey)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	915 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	916 exposed = dispatch(conn, None, 'get_methods', (token,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	917 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	918 conn.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	919
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	920 if authkey is None and manager is not None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	921 authkey = manager._authkey
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	922 if authkey is None:
48302 7ea805d879e1 issue3352: clean up the multiprocessing API to remove many get_/set_ methods and convert them to properties. Update the docs and the examples included. Jesse Noller <jnoller@gmail.com> parents: 48291 diff changeset	923 authkey = current_process().authkey
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	924
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	925 ProxyType = MakeProxyType('AutoProxy[%s]' % token.typeid, exposed)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	926 proxy = ProxyType(token, serializer, manager=manager, authkey=authkey,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	927 incref=incref)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	928 proxy._isauto = True
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	929 return proxy
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	930
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	931 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	932 # Types/callables which we will register with SyncManager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	933 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	934
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	935 class Namespace(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	936 def __init__(self, **kwds):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	937 self.__dict__.update(kwds)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	938 def __repr__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	939 items = self.__dict__.items()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	940 temp = []
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	941 for name, value in items:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	942 if not name.startswith('_'):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	943 temp.append('%s=%r' % (name, value))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	944 temp.sort()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	945 return 'Namespace(%s)' % str.join(', ', temp)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	946
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	947 class Value(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	948 def __init__(self, typecode, value, lock=True):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	949 self._typecode = typecode
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	950 self._value = value
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	951 def get(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	952 return self._value
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	953 def set(self, value):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	954 self._value = value
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	955 def __repr__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	956 return '%s(%r, %r)'%(type(self).__name__, self._typecode, self._value)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	957 value = property(get, set)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	958
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	959 def Array(typecode, sequence, lock=True):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	960 return array.array(typecode, sequence)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	961
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	962 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	963 # Proxy types used by SyncManager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	964 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	965
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	966 class IteratorProxy(BaseProxy):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	967 # XXX remove methods for Py3.0 and Py2.6
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	968 _exposed_ = ('__next__', 'next', 'send', 'throw', 'close')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	969 def __iter__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	970 return self
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	971 def __next__(self, *args):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	972 return self._callmethod('__next__', args)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	973 def next(self, *args):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	974 return self._callmethod('next', args)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	975 def send(self, *args):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	976 return self._callmethod('send', args)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	977 def throw(self, *args):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	978 return self._callmethod('throw', args)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	979 def close(self, *args):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	980 return self._callmethod('close', args)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	981
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	982
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	983 class AcquirerProxy(BaseProxy):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	984 _exposed_ = ('acquire', 'release')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	985 def acquire(self, blocking=True):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	986 return self._callmethod('acquire', (blocking,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	987 def release(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	988 return self._callmethod('release')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	989 def __enter__(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	990 return self._callmethod('acquire')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	991 def __exit__(self, exc_type, exc_val, exc_tb):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	992 return self._callmethod('release')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	993
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	994
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	995 class ConditionProxy(AcquirerProxy):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	996 # XXX will Condition.notfyAll() name be available in Py3.0?
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	997 _exposed_ = ('acquire', 'release', 'wait', 'notify', 'notify_all')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	998 def wait(self, timeout=None):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	999 return self._callmethod('wait', (timeout,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1000 def notify(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1001 return self._callmethod('notify')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1002 def notify_all(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1003 return self._callmethod('notify_all')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1004
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1005 class EventProxy(BaseProxy):
47834 58dc367dc1ea fix isSet in _exposed Benjamin Peterson <benjamin@python.org> parents: 47833 diff changeset	1006 _exposed_ = ('is_set', 'set', 'clear', 'wait')
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1007 def is_set(self):
47833 7fbc374c959d use the new API Benjamin Peterson <benjamin@python.org> parents: 47826 diff changeset	1008 return self._callmethod('is_set')
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1009 def set(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1010 return self._callmethod('set')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1011 def clear(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1012 return self._callmethod('clear')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1013 def wait(self, timeout=None):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1014 return self._callmethod('wait', (timeout,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1015
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1016 class NamespaceProxy(BaseProxy):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1017 _exposed_ = ('__getattribute__', '__setattr__', '__delattr__')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1018 def __getattr__(self, key):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1019 if key[0] == '_':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1020 return object.__getattribute__(self, key)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1021 callmethod = object.__getattribute__(self, '_callmethod')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1022 return callmethod('__getattribute__', (key,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1023 def __setattr__(self, key, value):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1024 if key[0] == '_':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1025 return object.__setattr__(self, key, value)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1026 callmethod = object.__getattribute__(self, '_callmethod')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1027 return callmethod('__setattr__', (key, value))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1028 def __delattr__(self, key):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1029 if key[0] == '_':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1030 return object.__delattr__(self, key)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1031 callmethod = object.__getattribute__(self, '_callmethod')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1032 return callmethod('__delattr__', (key,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1033
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1034
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1035 class ValueProxy(BaseProxy):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1036 _exposed_ = ('get', 'set')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1037 def get(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1038 return self._callmethod('get')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1039 def set(self, value):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1040 return self._callmethod('set', (value,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1041 value = property(get, set)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1042
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1043
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1044 BaseListProxy = MakeProxyType('BaseListProxy', (
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1045 '__add__', '__contains__', '__delitem__', '__delslice__',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1046 '__getitem__', '__getslice__', '__len__', '__mul__',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1047 '__reversed__', '__rmul__', '__setitem__', '__setslice__',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1048 'append', 'count', 'extend', 'index', 'insert', 'pop', 'remove',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1049 'reverse', 'sort', '__imul__'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1050 )) # XXX __getslice__ and __setslice__ unneeded in Py3.0
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1051 class ListProxy(BaseListProxy):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1052 def __iadd__(self, value):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1053 self._callmethod('extend', (value,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1054 return self
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1055 def __imul__(self, value):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1056 self._callmethod('__imul__', (value,))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1057 return self
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1058
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1059
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1060 DictProxy = MakeProxyType('DictProxy', (
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1061 '__contains__', '__delitem__', '__getitem__', '__len__',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1062 '__setitem__', 'clear', 'copy', 'get', 'has_key', 'items',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1063 'keys', 'pop', 'popitem', 'setdefault', 'update', 'values'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1064 ))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1065
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1066
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1067 ArrayProxy = MakeProxyType('ArrayProxy', (
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1068 '__len__', '__getitem__', '__setitem__', '__getslice__', '__setslice__'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1069 )) # XXX __getslice__ and __setslice__ unneeded in Py3.0
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1070
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1071
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1072 PoolProxy = MakeProxyType('PoolProxy', (
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1073 'apply', 'apply_async', 'close', 'imap', 'imap_unordered', 'join',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1074 'map', 'map_async', 'terminate'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1075 ))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1076 PoolProxy._method_to_typeid_ = {
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1077 'apply_async': 'AsyncResult',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1078 'map_async': 'AsyncResult',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1079 'imap': 'Iterator',
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1080 'imap_unordered': 'Iterator'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1081 }
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1082
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1083 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1084 # Definition of SyncManager
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1085 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1086
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1087 class SyncManager(BaseManager):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1088 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1089 Subclass of `BaseManager` which supports a number of shared object types.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1090
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1091 The types registered are those intended for the synchronization
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1092 of threads, plus `dict`, `list` and `Namespace`.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1093
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1094 The `multiprocessing.Manager()` function creates started instances of
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1095 this class.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1096 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1097
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1098 SyncManager.register('Queue', Queue.Queue)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1099 SyncManager.register('JoinableQueue', Queue.Queue)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1100 SyncManager.register('Event', threading.Event, EventProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1101 SyncManager.register('Lock', threading.Lock, AcquirerProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1102 SyncManager.register('RLock', threading.RLock, AcquirerProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1103 SyncManager.register('Semaphore', threading.Semaphore, AcquirerProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1104 SyncManager.register('BoundedSemaphore', threading.BoundedSemaphore,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1105 AcquirerProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1106 SyncManager.register('Condition', threading.Condition, ConditionProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1107 SyncManager.register('Pool', Pool, PoolProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1108 SyncManager.register('list', list, ListProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1109 SyncManager.register('dict', dict, DictProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1110 SyncManager.register('Value', Value, ValueProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1111 SyncManager.register('Array', Array, ArrayProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1112 SyncManager.register('Namespace', Namespace, NamespaceProxy)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1113
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1114 # types returned by methods of PoolProxy
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1115 SyncManager.register('Iterator', proxytype=IteratorProxy, create_method=False)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1116 SyncManager.register('AsyncResult', create_method=False)

Mercurial > cpython-lru_cache-weakref

annotate Lib/multiprocessing/managers.py @ 79675:c0a2294de787 2.7