cpython-lru_cache-weakref: Lib/multiprocessing/forking.py annotate

annotate Lib/multiprocessing/forking.py @ 78069:a8aa77458e12 3.2

Add c_size_t and c_ssize_t to the ctypes summary table.

author	Antoine Pitrou <solipsis@pitrou.net>
date	Thu, 12 Jul 2012 20:31:50 +0200
parents	2863d9273abd
children	20f8a2455ffb 96c1de5acbd3

rev	line source
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	1 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	2 # Module for starting a process object using os.fork() or CreateProcess()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	3 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	4 # multiprocessing/forking.py
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	5 #
66885 b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	6 # Copyright (c) 2006-2008, R Oudkerk
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	7 # All rights reserved.
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	8 #
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	9 # Redistribution and use in source and binary forms, with or without
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	10 # modification, are permitted provided that the following conditions
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	11 # are met:
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	12 #
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	13 # 1. Redistributions of source code must retain the above copyright
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	14 # notice, this list of conditions and the following disclaimer.
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	15 # 2. Redistributions in binary form must reproduce the above copyright
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	16 # notice, this list of conditions and the following disclaimer in the
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	17 # documentation and/or other materials provided with the distribution.
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	18 # 3. Neither the name of author nor the names of any contributors may be
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	19 # used to endorse or promote products derived from this software
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	20 # without specific prior written permission.
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	21 #
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	22 # THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS "AS IS" AND
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	23 # ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	24 # IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	25 # ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	26 # FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	27 # DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	28 # OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	29 # HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	30 # LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	31 # OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
b084b50e4aa6 9162: fix license in multiprocessing files R. David Murray <rdmurray@bitdance.com> parents: 63736 diff changeset	32 # SUCH DAMAGE.
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	33 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	34
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	35 import os
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	36 import sys
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	37 import signal
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	38
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	39 from multiprocessing import util, process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	40
48780 99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	41 __all__ = ['Popen', 'assert_spawning', 'exit', 'duplicate', 'close', 'ForkingPickler']
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	42
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	43 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	44 # Check that the current thread is spawning a child process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	45 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	46
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	47 def assert_spawning(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	48 if not Popen.thread_is_spawning():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	49 raise RuntimeError(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	50 '%s objects should only be shared between processes'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	51 ' through inheritance' % type(self).__name__
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	52 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	53
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	54 #
48780 99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	55 # Try making some callable types picklable
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	56 #
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	57
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	58 from pickle import _Pickler as Pickler
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	59 class ForkingPickler(Pickler):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	60 dispatch = Pickler.dispatch.copy()
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	61 @classmethod
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	62 def register(cls, type, reduce):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	63 def dispatcher(self, obj):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	64 rv = reduce(obj)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	65 if isinstance(rv, str):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	66 self.save_global(obj, rv)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	67 else:
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	68 self.save_reduce(obj=obj, *rv)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	69 cls.dispatch[type] = dispatcher
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	70
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	71 def _reduce_method(m):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	72 if m.__self__ is None:
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	73 return getattr, (m.__class__, m.__func__.__name__)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	74 else:
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	75 return getattr, (m.__self__, m.__func__.__name__)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	76 class _C:
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	77 def f(self):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	78 pass
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	79 ForkingPickler.register(type(_C().f), _reduce_method)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	80
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	81
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	82 def _reduce_method_descriptor(m):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	83 return getattr, (m.__objclass__, m.__name__)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	84 ForkingPickler.register(type(list.append), _reduce_method_descriptor)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	85 ForkingPickler.register(type(int.__add__), _reduce_method_descriptor)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	86
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	87 try:
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	88 from functools import partial
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	89 except ImportError:
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	90 pass
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	91 else:
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	92 def _reduce_partial(p):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	93 return _rebuild_partial, (p.func, p.args, p.keywords or {})
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	94 def _rebuild_partial(func, args, keywords):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	95 return partial(func, args, *keywords)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	96 ForkingPickler.register(partial, _reduce_partial)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	97
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	98 #
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	99 # Unix
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	100 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	101
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	102 if sys.platform != 'win32':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	103 import time
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	104
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	105 exit = os._exit
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	106 duplicate = os.dup
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	107 close = os.close
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	108
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	109 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	110 # We define a Popen class similar to the one from subprocess, but
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	111 # whose constructor takes a process object as its argument.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	112 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	113
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	114 class Popen(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	115
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	116 def __init__(self, process_obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	117 sys.stdout.flush()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	118 sys.stderr.flush()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	119 self.returncode = None
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	120
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	121 self.pid = os.fork()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	122 if self.pid == 0:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	123 if 'random' in sys.modules:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	124 import random
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	125 random.seed()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	126 code = process_obj._bootstrap()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	127 os._exit(code)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	128
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	129 def poll(self, flag=os.WNOHANG):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	130 if self.returncode is None:
59472 024c53a86521 Merged revisions 78777,78787,78790 via svnmerge from Florent Xicluna <florent.xicluna@gmail.com> parents: 50871 diff changeset	131 try:
024c53a86521 Merged revisions 78777,78787,78790 via svnmerge from Florent Xicluna <florent.xicluna@gmail.com> parents: 50871 diff changeset	132 pid, sts = os.waitpid(self.pid, flag)
024c53a86521 Merged revisions 78777,78787,78790 via svnmerge from Florent Xicluna <florent.xicluna@gmail.com> parents: 50871 diff changeset	133 except os.error:
024c53a86521 Merged revisions 78777,78787,78790 via svnmerge from Florent Xicluna <florent.xicluna@gmail.com> parents: 50871 diff changeset	134 # Child process not yet created. See #1731717
024c53a86521 Merged revisions 78777,78787,78790 via svnmerge from Florent Xicluna <florent.xicluna@gmail.com> parents: 50871 diff changeset	135 # e.errno == errno.ECHILD == 10
024c53a86521 Merged revisions 78777,78787,78790 via svnmerge from Florent Xicluna <florent.xicluna@gmail.com> parents: 50871 diff changeset	136 return None
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	137 if pid == self.pid:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	138 if os.WIFSIGNALED(sts):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	139 self.returncode = -os.WTERMSIG(sts)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	140 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	141 assert os.WIFEXITED(sts)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	142 self.returncode = os.WEXITSTATUS(sts)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	143 return self.returncode
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	144
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	145 def wait(self, timeout=None):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	146 if timeout is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	147 return self.poll(0)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	148 deadline = time.time() + timeout
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	149 delay = 0.0005
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	150 while 1:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	151 res = self.poll()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	152 if res is not None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	153 break
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	154 remaining = deadline - time.time()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	155 if remaining <= 0:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	156 break
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	157 delay = min(delay * 2, remaining, 0.05)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	158 time.sleep(delay)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	159 return res
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	160
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	161 def terminate(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	162 if self.returncode is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	163 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	164 os.kill(self.pid, signal.SIGTERM)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	165 except OSError as e:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	166 if self.wait(timeout=0.1) is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	167 raise
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	168
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	169 @staticmethod
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	170 def thread_is_spawning():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	171 return False
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	172
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	173 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	174 # Windows
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	175 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	176
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	177 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	178 import _thread
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	179 import msvcrt
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	180 import _subprocess
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	181 import time
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	182
50871 8dc479b63e03 Issues #10867: remove old cPickle imports from multiprocessing Jesse Noller <jnoller@gmail.com> parents: 48780 diff changeset	183 from pickle import dump, load, HIGHEST_PROTOCOL
63736 fd7f73e12568 Fix #9513 to remove relative imports from multiprocessing. Brian Curtin <brian.curtin@gmail.com> parents: 59472 diff changeset	184 from _multiprocessing import win32, Connection, PipeConnection
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	185 from .util import Finalize
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	186
48780 99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	187 def dump(obj, file, protocol=None):
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	188 ForkingPickler(file, protocol).dump(obj)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	189
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	190 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	191 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	192 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	193
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	194 TERMINATE = 0x10000
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	195 WINEXE = (sys.platform == 'win32' and getattr(sys, 'frozen', False))
69252 1f41b1ab8924 Fix #5162. Allow child spawning from Windows services (via pywin32). brian.curtin <brian@python.org> parents: 66885 diff changeset	196 WINSERVICE = sys.executable.lower().endswith("pythonservice.exe")
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	197
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	198 exit = win32.ExitProcess
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	199 close = win32.CloseHandle
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	200
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	201 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	202 # _python_exe is the assumed path to the python executable.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	203 # People embedding Python want to modify it.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	204 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	205
69252 1f41b1ab8924 Fix #5162. Allow child spawning from Windows services (via pywin32). brian.curtin <brian@python.org> parents: 66885 diff changeset	206 if WINSERVICE:
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	207 _python_exe = os.path.join(sys.exec_prefix, 'python.exe')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	208 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	209 _python_exe = sys.executable
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	210
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	211 def set_executable(exe):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	212 global _python_exe
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	213 _python_exe = exe
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	214
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	215 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	216 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	217 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	218
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	219 def duplicate(handle, target_process=None, inheritable=False):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	220 if target_process is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	221 target_process = _subprocess.GetCurrentProcess()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	222 return _subprocess.DuplicateHandle(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	223 _subprocess.GetCurrentProcess(), handle, target_process,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	224 0, inheritable, _subprocess.DUPLICATE_SAME_ACCESS
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	225 ).Detach()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	226
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	227 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	228 # We define a Popen class similar to the one from subprocess, but
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	229 # whose constructor takes a process object as its argument.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	230 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	231
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	232 class Popen(object):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	233 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	234 Start a subprocess to run the code of a process object
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	235 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	236 _tls = _thread._local()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	237
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	238 def __init__(self, process_obj):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	239 # create pipe for communication with child
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	240 rfd, wfd = os.pipe()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	241
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	242 # get handle for read end of the pipe and make it inheritable
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	243 rhandle = duplicate(msvcrt.get_osfhandle(rfd), inheritable=True)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	244 os.close(rfd)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	245
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	246 # start process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	247 cmd = get_command_line() + [rhandle]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	248 cmd = ' '.join('"%s"' % x for x in cmd)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	249 hp, ht, pid, tid = _subprocess.CreateProcess(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	250 _python_exe, cmd, None, None, 1, 0, None, None, None
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	251 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	252 ht.Close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	253 close(rhandle)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	254
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	255 # set attributes of self
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	256 self.pid = pid
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	257 self.returncode = None
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	258 self._handle = hp
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	259
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	260 # send information to child
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	261 prep_data = get_preparation_data(process_obj._name)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	262 to_child = os.fdopen(wfd, 'wb')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	263 Popen._tls.process_handle = int(hp)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	264 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	265 dump(prep_data, to_child, HIGHEST_PROTOCOL)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	266 dump(process_obj, to_child, HIGHEST_PROTOCOL)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	267 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	268 del Popen._tls.process_handle
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	269 to_child.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	270
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	271 @staticmethod
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	272 def thread_is_spawning():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	273 return getattr(Popen._tls, 'process_handle', None) is not None
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	274
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	275 @staticmethod
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	276 def duplicate_for_child(handle):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	277 return duplicate(handle, Popen._tls.process_handle)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	278
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	279 def wait(self, timeout=None):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	280 if self.returncode is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	281 if timeout is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	282 msecs = _subprocess.INFINITE
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	283 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	284 msecs = max(0, int(timeout * 1000 + 0.5))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	285
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	286 res = _subprocess.WaitForSingleObject(int(self._handle), msecs)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	287 if res == _subprocess.WAIT_OBJECT_0:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	288 code = _subprocess.GetExitCodeProcess(self._handle)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	289 if code == TERMINATE:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	290 code = -signal.SIGTERM
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	291 self.returncode = code
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	292
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	293 return self.returncode
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	294
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	295 def poll(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	296 return self.wait(timeout=0)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	297
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	298 def terminate(self):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	299 if self.returncode is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	300 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	301 _subprocess.TerminateProcess(int(self._handle), TERMINATE)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	302 except WindowsError:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	303 if self.wait(timeout=0.1) is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	304 raise
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	305
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	306 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	307 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	308 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	309
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	310 def is_forking(argv):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	311 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	312 Return whether commandline indicates we are forking
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	313 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	314 if len(argv) >= 2 and argv[1] == '--multiprocessing-fork':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	315 assert len(argv) == 3
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	316 return True
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	317 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	318 return False
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	319
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	320
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	321 def freeze_support():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	322 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	323 Run code for process object if this in not the main process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	324 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	325 if is_forking(sys.argv):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	326 main()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	327 sys.exit()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	328
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	329
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	330 def get_command_line():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	331 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	332 Returns prefix of command line used for spawning a child process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	333 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	334 if process.current_process()._identity==() and is_forking(sys.argv):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	335 raise RuntimeError('''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	336 Attempt to start a new process before the current process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	337 has finished its bootstrapping phase.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	338
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	339 This probably means that you are on Windows and you have
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	340 forgotten to use the proper idiom in the main module:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	341
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	342 if __name__ == '__main__':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	343 freeze_support()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	344 ...
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	345
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	346 The "freeze_support()" line can be omitted if the program
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	347 is not going to be frozen to produce a Windows executable.''')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	348
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	349 if getattr(sys, 'frozen', False):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	350 return [sys.executable, '--multiprocessing-fork']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	351 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	352 prog = 'from multiprocessing.forking import main; main()'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	353 return [_python_exe, '-c', prog, '--multiprocessing-fork']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	354
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	355
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	356 def main():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	357 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	358 Run code specifed by data received over pipe
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	359 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	360 assert is_forking(sys.argv)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	361
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	362 handle = int(sys.argv[-1])
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	363 fd = msvcrt.open_osfhandle(handle, os.O_RDONLY)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	364 from_parent = os.fdopen(fd, 'rb')
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	365
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	366 process.current_process()._inheriting = True
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	367 preparation_data = load(from_parent)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	368 prepare(preparation_data)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	369 self = load(from_parent)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	370 process.current_process()._inheriting = False
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	371
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	372 from_parent.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	373
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	374 exitcode = self._bootstrap()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	375 exit(exitcode)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	376
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	377
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	378 def get_preparation_data(name):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	379 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	380 Return info about parent needed by child to unpickle process object
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	381 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	382 from .util import _logger, _log_to_stderr
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	383
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	384 d = dict(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	385 name=name,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	386 sys_path=sys.path,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	387 sys_argv=sys.argv,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	388 log_to_stderr=_log_to_stderr,
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	389 orig_dir=process.ORIGINAL_DIR,
48773 25f06a703f89 Merged revisions 65864 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 47595 diff changeset	390 authkey=process.current_process().authkey,
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	391 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	392
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	393 if _logger is not None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	394 d['log_level'] = _logger.getEffectiveLevel()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	395
69252 1f41b1ab8924 Fix #5162. Allow child spawning from Windows services (via pywin32). brian.curtin <brian@python.org> parents: 66885 diff changeset	396 if not WINEXE and not WINSERVICE:
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	397 main_path = getattr(sys.modules['__main__'], '__file__', None)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	398 if not main_path and sys.argv[0] not in ('', '-c'):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	399 main_path = sys.argv[0]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	400 if main_path is not None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	401 if not os.path.isabs(main_path) and \
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	402 process.ORIGINAL_DIR is not None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	403 main_path = os.path.join(process.ORIGINAL_DIR, main_path)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	404 d['main_path'] = os.path.normpath(main_path)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	405
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	406 return d
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	407
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	408 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	409 # Make (Pipe)Connection picklable
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	410 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	411
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	412 def reduce_connection(conn):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	413 if not Popen.thread_is_spawning():
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	414 raise RuntimeError(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	415 'By default %s objects can only be shared between processes\n'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	416 'using inheritance' % type(conn).__name__
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	417 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	418 return type(conn), (Popen.duplicate_for_child(conn.fileno()),
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	419 conn.readable, conn.writable)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	420
48780 99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	421 ForkingPickler.register(Connection, reduce_connection)
99e783ec7781 Issue #3125: Remove copy_reg in multiprocessing and replace it with Amaury Forgeot d'Arc <amauryfa@gmail.com> parents: 48773 diff changeset	422 ForkingPickler.register(PipeConnection, reduce_connection)
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	423
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	424 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	425 # Prepare current process
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	426 #
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	427
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	428 old_main_modules = []
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	429
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	430 def prepare(data):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	431 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	432 Try to get current process ready to unpickle process object
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	433 '''
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	434 old_main_modules.append(sys.modules['__main__'])
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	435
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	436 if 'name' in data:
48773 25f06a703f89 Merged revisions 65864 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: 47595 diff changeset	437 process.current_process().name = data['name']
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	438
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	439 if 'authkey' in data:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	440 process.current_process()._authkey = data['authkey']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	441
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	442 if 'log_to_stderr' in data and data['log_to_stderr']:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	443 util.log_to_stderr()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	444
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	445 if 'log_level' in data:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	446 util.get_logger().setLevel(data['log_level'])
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	447
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	448 if 'sys_path' in data:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	449 sys.path = data['sys_path']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	450
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	451 if 'sys_argv' in data:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	452 sys.argv = data['sys_argv']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	453
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	454 if 'dir' in data:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	455 os.chdir(data['dir'])
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	456
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	457 if 'orig_dir' in data:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	458 process.ORIGINAL_DIR = data['orig_dir']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	459
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	460 if 'main_path' in data:
67811 c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	461 # XXX (ncoghlan): The following code makes several bogus
c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	462 # assumptions regarding the relationship between __file__
c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	463 # and a module's real name. See PEP 302 and issue #10845
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	464 main_path = data['main_path']
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	465 main_name = os.path.splitext(os.path.basename(main_path))[0]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	466 if main_name == '__init__':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	467 main_name = os.path.basename(os.path.dirname(main_path))
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	468
67811 c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	469 if main_name == '__main__':
c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	470 main_module = sys.modules['__main__']
c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	471 main_module.__file__ = main_path
c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	472 elif main_name != 'ipython':
c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	473 # Main modules not actually called __main__.py may
c82588ca3a79 Issue #10845: Improve compatibility between multiprocessing on Windows and package, zipfile and directory execution (Reviewed by Antoine Pitrou and approved by Georg Brandl) Nick Coghlan <ncoghlan@gmail.com> parents: 66885 diff changeset	474 # contain additional code that should still be executed
47595 5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	475 import imp
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	476
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	477 if main_path is None:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	478 dirs = None
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	479 elif os.path.basename(main_path).startswith('__init__.py'):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	480 dirs = [os.path.dirname(os.path.dirname(main_path))]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	481 else:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	482 dirs = [os.path.dirname(main_path)]
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	483
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	484 assert main_name not in sys.modules, main_name
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	485 file, path_name, etc = imp.find_module(main_name, dirs)
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	486 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	487 # We would like to do "imp.load_module('__main__', ...)"
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	488 # here. However, that would cause 'if __name__ ==
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	489 # "__main__"' clauses to be executed.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	490 main_module = imp.load_module(
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	491 '__parents_main__', file, path_name, etc
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	492 )
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	493 finally:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	494 if file:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	495 file.close()
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	496
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	497 sys.modules['__main__'] = main_module
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	498 main_module.__name__ = '__main__'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	499
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	500 # Try to make the potentially picklable objects in
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	501 # sys.modules['__main__'] realize they are in the main
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	502 # module -- somewhat ugly.
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	503 for obj in list(main_module.__dict__.values()):
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	504 try:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	505 if obj.__module__ == '__parents_main__':
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	506 obj.__module__ = '__main__'
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	507 except Exception:
5c6cdfcd6eae Merged revisions 64104,64117 via svnmerge from Benjamin Peterson <benjamin@python.org> parents: diff changeset	508 pass

Mercurial > cpython-lru_cache-weakref

annotate Lib/multiprocessing/forking.py @ 78069:a8aa77458e12 3.2