cpython-lru_cache-weakref: Lib/multiprocessing/forking.py annotate

annotate Lib/multiprocessing/forking.py @ 79675:c0a2294de787 2.7

Issue #16199: Backport 2to3 typo fix from 3.2.

author	Chris Jerdonek <chris.jerdonek@gmail.com>
date	Thu, 11 Oct 2012 16:15:46 -0700
parents	e4fe1daef9f7
children	92003d9aae0e

rev	line source
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	1 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	2 # Module for starting a process object using os.fork() or CreateProcess()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	3 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	4 # multiprocessing/forking.py
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	5 #
66887 9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	6 # Copyright (c) 2006-2008, R Oudkerk
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	7 # All rights reserved.
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	8 #
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	9 # Redistribution and use in source and binary forms, with or without
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	10 # modification, are permitted provided that the following conditions
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	11 # are met:
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	12 #
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	13 # 1. Redistributions of source code must retain the above copyright
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	14 # notice, this list of conditions and the following disclaimer.
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	15 # 2. Redistributions in binary form must reproduce the above copyright
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	16 # notice, this list of conditions and the following disclaimer in the
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	17 # documentation and/or other materials provided with the distribution.
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	18 # 3. Neither the name of author nor the names of any contributors may be
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	19 # used to endorse or promote products derived from this software
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	20 # without specific prior written permission.
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	21 #
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	22 # THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS "AS IS" AND
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	23 # ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	24 # IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	25 # ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	26 # FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	27 # DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	28 # OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	29 # HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	30 # LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	31 # OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
9ac8699d88d6 Merged revisions 87225 via svnmerge from R. David Murray <rdmurray@bitdance.com> parents: 62730 diff changeset	32 # SUCH DAMAGE.
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	33 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	34
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	35 import os
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	36 import sys
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	37 import signal
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	38
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	39 from multiprocessing import util, process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	40
47980 5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	41 __all__ = ['Popen', 'assert_spawning', 'exit', 'duplicate', 'close', 'ForkingPickler']
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	42
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	43 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	44 # Check that the current thread is spawning a child process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	45 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	46
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	47 def assert_spawning(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	48 if not Popen.thread_is_spawning():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	49 raise RuntimeError(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	50 '%s objects should only be shared between processes'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	51 ' through inheritance' % type(self).__name__
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	52 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	53
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	54 #
47980 5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	55 # Try making some callable types picklable
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	56 #
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	57
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	58 from pickle import Pickler
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	59 class ForkingPickler(Pickler):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	60 dispatch = Pickler.dispatch.copy()
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	61
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	62 @classmethod
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	63 def register(cls, type, reduce):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	64 def dispatcher(self, obj):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	65 rv = reduce(obj)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	66 self.save_reduce(obj=obj, *rv)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	67 cls.dispatch[type] = dispatcher
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	68
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	69 def _reduce_method(m):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	70 if m.im_self is None:
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	71 return getattr, (m.im_class, m.im_func.func_name)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	72 else:
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	73 return getattr, (m.im_self, m.im_func.func_name)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	74 ForkingPickler.register(type(ForkingPickler.save), _reduce_method)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	75
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	76 def _reduce_method_descriptor(m):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	77 return getattr, (m.__objclass__, m.__name__)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	78 ForkingPickler.register(type(list.append), _reduce_method_descriptor)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	79 ForkingPickler.register(type(int.__add__), _reduce_method_descriptor)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	80
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	81 #def _reduce_builtin_function_or_method(m):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	82 # return getattr, (m.__self__, m.__name__)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	83 #ForkingPickler.register(type(list().append), _reduce_builtin_function_or_method)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	84 #ForkingPickler.register(type(int().__add__), _reduce_builtin_function_or_method)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	85
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	86 try:
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	87 from functools import partial
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	88 except ImportError:
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	89 pass
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	90 else:
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	91 def _reduce_partial(p):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	92 return _rebuild_partial, (p.func, p.args, p.keywords or {})
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	93 def _rebuild_partial(func, args, keywords):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	94 return partial(func, args, *keywords)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	95 ForkingPickler.register(partial, _reduce_partial)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	96
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	97 #
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	98 # Unix
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	99 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	100
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	101 if sys.platform != 'win32':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	102 import time
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	103
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	104 exit = os._exit
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	105 duplicate = os.dup
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	106 close = os.close
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	107
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	108 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	109 # We define a Popen class similar to the one from subprocess, but
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	110 # whose constructor takes a process object as its argument.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	111 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	112
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	113 class Popen(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	114
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	115 def __init__(self, process_obj):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	116 sys.stdout.flush()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	117 sys.stderr.flush()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	118 self.returncode = None
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	119
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	120 self.pid = os.fork()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	121 if self.pid == 0:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	122 if 'random' in sys.modules:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	123 import random
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	124 random.seed()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	125 code = process_obj._bootstrap()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	126 sys.stdout.flush()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	127 sys.stderr.flush()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	128 os._exit(code)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	129
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	130 def poll(self, flag=os.WNOHANG):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	131 if self.returncode is None:
59451 41aef062d529 Backport the Popen.poll() protection from subprocess to multiprocessing. See #1731717. Florent Xicluna <florent.xicluna@gmail.com> parents: 48302 diff changeset	132 try:
41aef062d529 Backport the Popen.poll() protection from subprocess to multiprocessing. See #1731717. Florent Xicluna <florent.xicluna@gmail.com> parents: 48302 diff changeset	133 pid, sts = os.waitpid(self.pid, flag)
41aef062d529 Backport the Popen.poll() protection from subprocess to multiprocessing. See #1731717. Florent Xicluna <florent.xicluna@gmail.com> parents: 48302 diff changeset	134 except os.error:
41aef062d529 Backport the Popen.poll() protection from subprocess to multiprocessing. See #1731717. Florent Xicluna <florent.xicluna@gmail.com> parents: 48302 diff changeset	135 # Child process not yet created. See #1731717
41aef062d529 Backport the Popen.poll() protection from subprocess to multiprocessing. See #1731717. Florent Xicluna <florent.xicluna@gmail.com> parents: 48302 diff changeset	136 # e.errno == errno.ECHILD == 10
41aef062d529 Backport the Popen.poll() protection from subprocess to multiprocessing. See #1731717. Florent Xicluna <florent.xicluna@gmail.com> parents: 48302 diff changeset	137 return None
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	138 if pid == self.pid:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	139 if os.WIFSIGNALED(sts):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	140 self.returncode = -os.WTERMSIG(sts)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	141 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	142 assert os.WIFEXITED(sts)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	143 self.returncode = os.WEXITSTATUS(sts)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	144 return self.returncode
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	145
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	146 def wait(self, timeout=None):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	147 if timeout is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	148 return self.poll(0)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	149 deadline = time.time() + timeout
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	150 delay = 0.0005
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	151 while 1:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	152 res = self.poll()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	153 if res is not None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	154 break
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	155 remaining = deadline - time.time()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	156 if remaining <= 0:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	157 break
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	158 delay = min(delay * 2, remaining, 0.05)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	159 time.sleep(delay)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	160 return res
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	161
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	162 def terminate(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	163 if self.returncode is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	164 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	165 os.kill(self.pid, signal.SIGTERM)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	166 except OSError, e:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	167 if self.wait(timeout=0.1) is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	168 raise
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	169
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	170 @staticmethod
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	171 def thread_is_spawning():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	172 return False
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	173
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	174 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	175 # Windows
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	176 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	177
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	178 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	179 import thread
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	180 import msvcrt
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	181 import _subprocess
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	182 import time
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	183
64004 5f33653e3837 Fix #9600. Don't use relative imports for _multiprocessing on Windows. Brian Curtin <brian.curtin@gmail.com> parents: 48302 diff changeset	184 from _multiprocessing import win32, Connection, PipeConnection
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	185 from .util import Finalize
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	186
47980 5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	187 #try:
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	188 # from cPickle import dump, load, HIGHEST_PROTOCOL
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	189 #except ImportError:
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	190 from pickle import load, HIGHEST_PROTOCOL
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	191
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	192 def dump(obj, file, protocol=None):
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	193 ForkingPickler(file, protocol).dump(obj)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	194
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	195 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	196 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	197 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	198
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	199 TERMINATE = 0x10000
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	200 WINEXE = (sys.platform == 'win32' and getattr(sys, 'frozen', False))
69255 6507a5ba5c27 Fix #5162. Allow child spawning from Windows services (via pywin32). brian.curtin <brian@python.org> parents: 68256 diff changeset	201 WINSERVICE = sys.executable.lower().endswith("pythonservice.exe")
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	202
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	203 exit = win32.ExitProcess
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	204 close = win32.CloseHandle
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	205
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	206 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	207 # _python_exe is the assumed path to the python executable.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	208 # People embedding Python want to modify it.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	209 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	210
69255 6507a5ba5c27 Fix #5162. Allow child spawning from Windows services (via pywin32). brian.curtin <brian@python.org> parents: 68256 diff changeset	211 if WINSERVICE:
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	212 _python_exe = os.path.join(sys.exec_prefix, 'python.exe')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	213 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	214 _python_exe = sys.executable
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	215
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	216 def set_executable(exe):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	217 global _python_exe
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	218 _python_exe = exe
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	219
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	220 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	221 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	222 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	223
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	224 def duplicate(handle, target_process=None, inheritable=False):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	225 if target_process is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	226 target_process = _subprocess.GetCurrentProcess()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	227 return _subprocess.DuplicateHandle(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	228 _subprocess.GetCurrentProcess(), handle, target_process,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	229 0, inheritable, _subprocess.DUPLICATE_SAME_ACCESS
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	230 ).Detach()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	231
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	232 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	233 # We define a Popen class similar to the one from subprocess, but
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	234 # whose constructor takes a process object as its argument.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	235 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	236
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	237 class Popen(object):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	238 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	239 Start a subprocess to run the code of a process object
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	240 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	241 _tls = thread._local()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	242
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	243 def __init__(self, process_obj):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	244 # create pipe for communication with child
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	245 rfd, wfd = os.pipe()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	246
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	247 # get handle for read end of the pipe and make it inheritable
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	248 rhandle = duplicate(msvcrt.get_osfhandle(rfd), inheritable=True)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	249 os.close(rfd)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	250
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	251 # start process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	252 cmd = get_command_line() + [rhandle]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	253 cmd = ' '.join('"%s"' % x for x in cmd)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	254 hp, ht, pid, tid = _subprocess.CreateProcess(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	255 _python_exe, cmd, None, None, 1, 0, None, None, None
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	256 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	257 ht.Close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	258 close(rhandle)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	259
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	260 # set attributes of self
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	261 self.pid = pid
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	262 self.returncode = None
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	263 self._handle = hp
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	264
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	265 # send information to child
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	266 prep_data = get_preparation_data(process_obj._name)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	267 to_child = os.fdopen(wfd, 'wb')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	268 Popen._tls.process_handle = int(hp)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	269 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	270 dump(prep_data, to_child, HIGHEST_PROTOCOL)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	271 dump(process_obj, to_child, HIGHEST_PROTOCOL)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	272 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	273 del Popen._tls.process_handle
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	274 to_child.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	275
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	276 @staticmethod
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	277 def thread_is_spawning():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	278 return getattr(Popen._tls, 'process_handle', None) is not None
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	279
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	280 @staticmethod
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	281 def duplicate_for_child(handle):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	282 return duplicate(handle, Popen._tls.process_handle)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	283
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	284 def wait(self, timeout=None):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	285 if self.returncode is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	286 if timeout is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	287 msecs = _subprocess.INFINITE
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	288 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	289 msecs = max(0, int(timeout * 1000 + 0.5))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	290
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	291 res = _subprocess.WaitForSingleObject(int(self._handle), msecs)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	292 if res == _subprocess.WAIT_OBJECT_0:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	293 code = _subprocess.GetExitCodeProcess(self._handle)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	294 if code == TERMINATE:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	295 code = -signal.SIGTERM
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	296 self.returncode = code
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	297
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	298 return self.returncode
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	299
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	300 def poll(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	301 return self.wait(timeout=0)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	302
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	303 def terminate(self):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	304 if self.returncode is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	305 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	306 _subprocess.TerminateProcess(int(self._handle), TERMINATE)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	307 except WindowsError:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	308 if self.wait(timeout=0.1) is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	309 raise
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	310
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	311 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	312 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	313 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	314
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	315 def is_forking(argv):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	316 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	317 Return whether commandline indicates we are forking
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	318 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	319 if len(argv) >= 2 and argv[1] == '--multiprocessing-fork':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	320 assert len(argv) == 3
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	321 return True
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	322 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	323 return False
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	324
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	325
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	326 def freeze_support():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	327 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	328 Run code for process object if this in not the main process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	329 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	330 if is_forking(sys.argv):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	331 main()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	332 sys.exit()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	333
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	334
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	335 def get_command_line():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	336 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	337 Returns prefix of command line used for spawning a child process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	338 '''
78561 e4fe1daef9f7 Issue #15646: Prevent equivalent of a fork bomb when using multiprocessing Richard Oudkerk <shibturn@gmail.com> parents: 69255 diff changeset	339 if getattr(process.current_process(), '_inheriting', False):
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	340 raise RuntimeError('''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	341 Attempt to start a new process before the current process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	342 has finished its bootstrapping phase.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	343
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	344 This probably means that you are on Windows and you have
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	345 forgotten to use the proper idiom in the main module:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	346
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	347 if __name__ == '__main__':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	348 freeze_support()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	349 ...
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	350
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	351 The "freeze_support()" line can be omitted if the program
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	352 is not going to be frozen to produce a Windows executable.''')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	353
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	354 if getattr(sys, 'frozen', False):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	355 return [sys.executable, '--multiprocessing-fork']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	356 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	357 prog = 'from multiprocessing.forking import main; main()'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	358 return [_python_exe, '-c', prog, '--multiprocessing-fork']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	359
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	360
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	361 def main():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	362 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	363 Run code specifed by data received over pipe
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	364 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	365 assert is_forking(sys.argv)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	366
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	367 handle = int(sys.argv[-1])
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	368 fd = msvcrt.open_osfhandle(handle, os.O_RDONLY)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	369 from_parent = os.fdopen(fd, 'rb')
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	370
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	371 process.current_process()._inheriting = True
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	372 preparation_data = load(from_parent)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	373 prepare(preparation_data)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	374 self = load(from_parent)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	375 process.current_process()._inheriting = False
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	376
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	377 from_parent.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	378
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	379 exitcode = self._bootstrap()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	380 exit(exitcode)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	381
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	382
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	383 def get_preparation_data(name):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	384 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	385 Return info about parent needed by child to unpickle process object
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	386 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	387 from .util import _logger, _log_to_stderr
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	388
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	389 d = dict(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	390 name=name,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	391 sys_path=sys.path,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	392 sys_argv=sys.argv,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	393 log_to_stderr=_log_to_stderr,
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	394 orig_dir=process.ORIGINAL_DIR,
48302 7ea805d879e1 issue3352: clean up the multiprocessing API to remove many get_/set_ methods and convert them to properties. Update the docs and the examples included. Jesse Noller <jnoller@gmail.com> parents: 47980 diff changeset	395 authkey=process.current_process().authkey,
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	396 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	397
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	398 if _logger is not None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	399 d['log_level'] = _logger.getEffectiveLevel()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	400
69255 6507a5ba5c27 Fix #5162. Allow child spawning from Windows services (via pywin32). brian.curtin <brian@python.org> parents: 68256 diff changeset	401 if not WINEXE and not WINSERVICE:
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	402 main_path = getattr(sys.modules['__main__'], '__file__', None)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	403 if not main_path and sys.argv[0] not in ('', '-c'):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	404 main_path = sys.argv[0]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	405 if main_path is not None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	406 if not os.path.isabs(main_path) and \
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	407 process.ORIGINAL_DIR is not None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	408 main_path = os.path.join(process.ORIGINAL_DIR, main_path)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	409 d['main_path'] = os.path.normpath(main_path)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	410
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	411 return d
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	412
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	413 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	414 # Make (Pipe)Connection picklable
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	415 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	416
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	417 def reduce_connection(conn):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	418 if not Popen.thread_is_spawning():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	419 raise RuntimeError(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	420 'By default %s objects can only be shared between processes\n'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	421 'using inheritance' % type(conn).__name__
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	422 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	423 return type(conn), (Popen.duplicate_for_child(conn.fileno()),
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	424 conn.readable, conn.writable)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	425
47980 5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	426 ForkingPickler.register(Connection, reduce_connection)
5f6dc2f86a88 Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/ctypes Jesse Noller <jnoller@gmail.com> parents: 47696 diff changeset	427 ForkingPickler.register(PipeConnection, reduce_connection)
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	428
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	429 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	430 # Prepare current process
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	431 #
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	432
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	433 old_main_modules = []
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	434
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	435 def prepare(data):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	436 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	437 Try to get current process ready to unpickle process object
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	438 '''
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	439 old_main_modules.append(sys.modules['__main__'])
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	440
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	441 if 'name' in data:
48302 7ea805d879e1 issue3352: clean up the multiprocessing API to remove many get_/set_ methods and convert them to properties. Update the docs and the examples included. Jesse Noller <jnoller@gmail.com> parents: 47980 diff changeset	442 process.current_process().name = data['name']
47696 d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	443
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	444 if 'authkey' in data:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	445 process.current_process()._authkey = data['authkey']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	446
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	447 if 'log_to_stderr' in data and data['log_to_stderr']:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	448 util.log_to_stderr()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	449
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	450 if 'log_level' in data:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	451 util.get_logger().setLevel(data['log_level'])
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	452
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	453 if 'sys_path' in data:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	454 sys.path = data['sys_path']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	455
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	456 if 'sys_argv' in data:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	457 sys.argv = data['sys_argv']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	458
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	459 if 'dir' in data:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	460 os.chdir(data['dir'])
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	461
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	462 if 'orig_dir' in data:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	463 process.ORIGINAL_DIR = data['orig_dir']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	464
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	465 if 'main_path' in data:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	466 main_path = data['main_path']
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	467 main_name = os.path.splitext(os.path.basename(main_path))[0]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	468 if main_name == '__init__':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	469 main_name = os.path.basename(os.path.dirname(main_path))
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	470
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	471 if main_name != 'ipython':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	472 import imp
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	473
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	474 if main_path is None:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	475 dirs = None
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	476 elif os.path.basename(main_path).startswith('__init__.py'):
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	477 dirs = [os.path.dirname(os.path.dirname(main_path))]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	478 else:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	479 dirs = [os.path.dirname(main_path)]
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	480
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	481 assert main_name not in sys.modules, main_name
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	482 file, path_name, etc = imp.find_module(main_name, dirs)
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	483 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	484 # We would like to do "imp.load_module('__main__', ...)"
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	485 # here. However, that would cause 'if __name__ ==
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	486 # "__main__"' clauses to be executed.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	487 main_module = imp.load_module(
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	488 '__parents_main__', file, path_name, etc
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	489 )
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	490 finally:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	491 if file:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	492 file.close()
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	493
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	494 sys.modules['__main__'] = main_module
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	495 main_module.__name__ = '__main__'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	496
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	497 # Try to make the potentially picklable objects in
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	498 # sys.modules['__main__'] realize they are in the main
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	499 # module -- somewhat ugly.
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	500 for obj in main_module.__dict__.values():
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	501 try:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	502 if obj.__module__ == '__parents_main__':
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	503 obj.__module__ = '__main__'
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	504 except Exception:
d01165fae98e darn! I converted half of the files the wrong way. Benjamin Peterson <benjamin@python.org> parents: 47694 diff changeset	505 pass

Mercurial > cpython-lru_cache-weakref

annotate Lib/multiprocessing/forking.py @ 79675:c0a2294de787 2.7