Mercurial > cpython-lru_cache-weakref
annotate Lib/idlelib/rpc.py @ 79675:c0a2294de787 2.7
Issue #16199: Backport 2to3 typo fix from 3.2.
| author | Chris Jerdonek <chris.jerdonek@gmail.com> |
|---|---|
| date | Thu, 11 Oct 2012 16:15:46 -0700 |
| parents | 684960fb1cbf |
| children | cd0191a9b5c9 |
| rev | line source |
|---|---|
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
1 """RPC Implemention, originally written for the Python Idle IDE |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
2 |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
3 For security reasons, GvR requested that Idle's Python execution server process |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
4 connect to the Idle process, which listens for the connection. Since Idle has |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
5 has only one client per server, this was not a limitation. |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
6 |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
7 +---------------------------------+ +-------------+ |
|
47241
ba1fa511b72d
socketserver renaming reversal part 3: move the module into the right
Georg Brandl <georg@python.org>
parents:
47189
diff
changeset
|
8 | SocketServer.BaseRequestHandler | | SocketIO | |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
9 +---------------------------------+ +-------------+ |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
10 ^ | register() | |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
11 | | unregister()| |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
12 | +-------------+ |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
13 | ^ ^ |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
14 | | | |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
15 | + -------------------+ | |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
16 | | | |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
17 +-------------------------+ +-----------------+ |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
18 | RPCHandler | | RPCClient | |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
19 | [attribute of RPCServer]| | | |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
20 +-------------------------+ +-----------------+ |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
21 |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
22 The RPCServer handler class is expected to provide register/unregister methods. |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
23 RPCHandler inherits the mix-in class SocketIO, which provides these methods. |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
24 |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
25 See the Idle run.main() docstring for further information on how this was |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
26 accomplished in Idle. |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
27 |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
28 """ |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
29 |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
30 import sys |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
31 import os |
| 23547 | 32 import socket |
| 33 import select | |
|
47241
ba1fa511b72d
socketserver renaming reversal part 3: move the module into the right
Georg Brandl <georg@python.org>
parents:
47189
diff
changeset
|
34 import SocketServer |
| 23547 | 35 import struct |
| 36 import cPickle as pickle | |
| 37 import threading | |
|
47248
9acb314b9072
Queue renaming reversal part 3: move module into place and
Georg Brandl <georg@python.org>
parents:
47241
diff
changeset
|
38 import Queue |
| 23547 | 39 import traceback |
|
47189
f419b2e96a98
Revert copy_reg -> copyreg rename.
Georg Brandl <georg@python.org>
parents:
46929
diff
changeset
|
40 import copy_reg |
| 23547 | 41 import types |
| 42 import marshal | |
| 43 | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
44 |
| 23547 | 45 def unpickle_code(ms): |
| 46 co = marshal.loads(ms) | |
| 47 assert isinstance(co, types.CodeType) | |
| 48 return co | |
| 49 | |
| 50 def pickle_code(co): | |
| 51 assert isinstance(co, types.CodeType) | |
| 52 ms = marshal.dumps(co) | |
| 53 return unpickle_code, (ms,) | |
| 54 | |
|
25020
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
55 # XXX KBK 24Aug02 function pickling capability not used in Idle |
|
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
56 # def unpickle_function(ms): |
|
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
57 # return ms |
| 23547 | 58 |
|
25020
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
59 # def pickle_function(fn): |
|
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
60 # assert isinstance(fn, type.FunctionType) |
|
31515
71a294bd7950
Replace backticks with repr() or "%r"
Walter Dörwald <walter@livinglogic.de>
parents:
31413
diff
changeset
|
61 # return repr(fn) |
| 26959 | 62 |
|
47189
f419b2e96a98
Revert copy_reg -> copyreg rename.
Georg Brandl <georg@python.org>
parents:
46929
diff
changeset
|
63 copy_reg.pickle(types.CodeType, pickle_code, unpickle_code) |
|
f419b2e96a98
Revert copy_reg -> copyreg rename.
Georg Brandl <georg@python.org>
parents:
46929
diff
changeset
|
64 # copy_reg.pickle(types.FunctionType, pickle_function, unpickle_function) |
| 23547 | 65 |
| 66 BUFSIZE = 8*1024 | |
|
29365
72ce7cc03f27
Avoid problem resolving 'localhost'
Kurt B. Kaiser <kbk@shore.net>
parents:
29254
diff
changeset
|
67 LOCALHOST = '127.0.0.1' |
| 23547 | 68 |
|
47241
ba1fa511b72d
socketserver renaming reversal part 3: move the module into the right
Georg Brandl <georg@python.org>
parents:
47189
diff
changeset
|
69 class RPCServer(SocketServer.TCPServer): |
| 23547 | 70 |
| 71 def __init__(self, addr, handlerclass=None): | |
| 72 if handlerclass is None: | |
| 73 handlerclass = RPCHandler | |
|
47241
ba1fa511b72d
socketserver renaming reversal part 3: move the module into the right
Georg Brandl <georg@python.org>
parents:
47189
diff
changeset
|
74 SocketServer.TCPServer.__init__(self, addr, handlerclass) |
| 23547 | 75 |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
76 def server_bind(self): |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
77 "Override TCPServer method, no bind() phase for connecting entity" |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
78 pass |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
79 |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
80 def server_activate(self): |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
81 """Override TCPServer method, connect() instead of listen() |
| 26959 | 82 |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
83 Due to the reversed connection, self.server_address is actually the |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
84 address of the Idle Client to which we are connecting. |
|
23995
41468f9353ce
Shutdown subprocess debugger and associated Proxies/Adapters when closing
Kurt B. Kaiser <kbk@shore.net>
parents:
23876
diff
changeset
|
85 |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
86 """ |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
87 self.socket.connect(self.server_address) |
| 26959 | 88 |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
89 def get_request(self): |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
90 "Override TCPServer method, return already connected socket" |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
91 return self.socket, self.server_address |
| 23547 | 92 |
| 27920 | 93 def handle_error(self, request, client_address): |
|
28384
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
94 """Override TCPServer method |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
95 |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
96 Error message goes to __stderr__. No error message if exiting |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
97 normally or socket raised EOF. Other exceptions not handled in |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
98 server code will cause os._exit. |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
99 |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
100 """ |
| 27920 | 101 try: |
| 102 raise | |
| 103 except SystemExit: | |
| 104 raise | |
|
28384
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
105 except: |
|
28386
94601d8fa51d
Correct error in last checkin noticed by Neal Norwitz. And some more.
Kurt B. Kaiser <kbk@shore.net>
parents:
28384
diff
changeset
|
106 erf = sys.__stderr__ |
|
94601d8fa51d
Correct error in last checkin noticed by Neal Norwitz. And some more.
Kurt B. Kaiser <kbk@shore.net>
parents:
28384
diff
changeset
|
107 print>>erf, '\n' + '-'*40 |
|
28384
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
108 print>>erf, 'Unhandled server exception!' |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
109 print>>erf, 'Thread: %s' % threading.currentThread().getName() |
|
28386
94601d8fa51d
Correct error in last checkin noticed by Neal Norwitz. And some more.
Kurt B. Kaiser <kbk@shore.net>
parents:
28384
diff
changeset
|
110 print>>erf, 'Client Address: ', client_address |
|
28384
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
111 print>>erf, 'Request: ', repr(request) |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
112 traceback.print_exc(file=erf) |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
113 print>>erf, '\n*** Unrecoverable, server exiting!' |
|
b872297406aa
Improve error message handling.
Kurt B. Kaiser <kbk@shore.net>
parents:
28294
diff
changeset
|
114 print>>erf, '-'*40 |
|
28386
94601d8fa51d
Correct error in last checkin noticed by Neal Norwitz. And some more.
Kurt B. Kaiser <kbk@shore.net>
parents:
28384
diff
changeset
|
115 os._exit(0) |
| 27920 | 116 |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
117 #----------------- end class RPCServer -------------------- |
| 27920 | 118 |
| 23547 | 119 objecttable = {} |
|
47248
9acb314b9072
Queue renaming reversal part 3: move module into place and
Georg Brandl <georg@python.org>
parents:
47241
diff
changeset
|
120 request_queue = Queue.Queue(0) |
|
9acb314b9072
Queue renaming reversal part 3: move module into place and
Georg Brandl <georg@python.org>
parents:
47241
diff
changeset
|
121 response_queue = Queue.Queue(0) |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
122 |
| 23547 | 123 |
|
34212
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
124 class SocketIO(object): |
| 23547 | 125 |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
126 nextseq = 0 |
|
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
127 |
| 23547 | 128 def __init__(self, sock, objtable=None, debugging=None): |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
129 self.sockthread = threading.currentThread() |
| 23547 | 130 if debugging is not None: |
| 131 self.debugging = debugging | |
| 132 self.sock = sock | |
| 133 if objtable is None: | |
| 134 objtable = objecttable | |
| 135 self.objtable = objtable | |
| 136 self.responses = {} | |
| 137 self.cvars = {} | |
| 138 | |
| 139 def close(self): | |
| 140 sock = self.sock | |
| 141 self.sock = None | |
| 142 if sock is not None: | |
| 143 sock.close() | |
| 144 | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
145 def exithook(self): |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
146 "override for specific exit action" |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
147 os._exit() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
148 |
| 23547 | 149 def debug(self, *args): |
| 150 if not self.debugging: | |
| 151 return | |
| 26557 | 152 s = self.location + " " + str(threading.currentThread().getName()) |
| 23547 | 153 for a in args: |
| 154 s = s + " " + str(a) | |
| 26557 | 155 print>>sys.__stderr__, s |
| 23547 | 156 |
| 157 def register(self, oid, object): | |
| 158 self.objtable[oid] = object | |
| 159 | |
| 160 def unregister(self, oid): | |
| 161 try: | |
| 162 del self.objtable[oid] | |
| 163 except KeyError: | |
| 164 pass | |
| 165 | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
166 def localcall(self, seq, request): |
| 26959 | 167 self.debug("localcall:", request) |
| 23547 | 168 try: |
| 169 how, (oid, methodname, args, kwargs) = request | |
| 170 except TypeError: | |
| 171 return ("ERROR", "Bad request format") | |
|
56436
684960fb1cbf
replace has_key with 'in' operator
Benjamin Peterson <benjamin@python.org>
parents:
56435
diff
changeset
|
172 if oid not in self.objtable: |
|
31515
71a294bd7950
Replace backticks with repr() or "%r"
Walter Dörwald <walter@livinglogic.de>
parents:
31413
diff
changeset
|
173 return ("ERROR", "Unknown object id: %r" % (oid,)) |
| 23547 | 174 obj = self.objtable[oid] |
| 175 if methodname == "__methods__": | |
| 176 methods = {} | |
| 177 _getmethods(obj, methods) | |
| 178 return ("OK", methods) | |
| 179 if methodname == "__attributes__": | |
| 180 attributes = {} | |
| 181 _getattributes(obj, attributes) | |
| 182 return ("OK", attributes) | |
| 183 if not hasattr(obj, methodname): | |
|
31515
71a294bd7950
Replace backticks with repr() or "%r"
Walter Dörwald <walter@livinglogic.de>
parents:
31413
diff
changeset
|
184 return ("ERROR", "Unsupported method name: %r" % (methodname,)) |
| 23547 | 185 method = getattr(obj, methodname) |
| 186 try: | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
187 if how == 'CALL': |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
188 ret = method(*args, **kwargs) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
189 if isinstance(ret, RemoteObject): |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
190 ret = remoteref(ret) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
191 return ("OK", ret) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
192 elif how == 'QUEUE': |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
193 request_queue.put((seq, (method, args, kwargs))) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
194 return("QUEUED", None) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
195 else: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
196 return ("ERROR", "Unsupported message type: %s" % how) |
| 27920 | 197 except SystemExit: |
| 198 raise | |
| 28266 | 199 except socket.error: |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
200 raise |
| 23547 | 201 except: |
|
34244
b044735c927b
Improve error message if rpc'l localcall() fails with unexpected
Kurt B. Kaiser <kbk@shore.net>
parents:
34212
diff
changeset
|
202 msg = "*** Internal Error: rpc.py:SocketIO.localcall()\n\n"\ |
|
b044735c927b
Improve error message if rpc'l localcall() fails with unexpected
Kurt B. Kaiser <kbk@shore.net>
parents:
34212
diff
changeset
|
203 " Object: %s \n Method: %s \n Args: %s\n" |
|
b044735c927b
Improve error message if rpc'l localcall() fails with unexpected
Kurt B. Kaiser <kbk@shore.net>
parents:
34212
diff
changeset
|
204 print>>sys.__stderr__, msg % (oid, method, args) |
| 28096 | 205 traceback.print_exc(file=sys.__stderr__) |
| 27545 | 206 return ("EXCEPTION", None) |
| 207 | |
| 23547 | 208 def remotecall(self, oid, methodname, args, kwargs): |
| 27920 | 209 self.debug("remotecall:asynccall: ", oid, methodname) |
| 23547 | 210 seq = self.asynccall(oid, methodname, args, kwargs) |
| 26557 | 211 return self.asyncreturn(seq) |
| 23547 | 212 |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
213 def remotequeue(self, oid, methodname, args, kwargs): |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
214 self.debug("remotequeue:asyncqueue: ", oid, methodname) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
215 seq = self.asyncqueue(oid, methodname, args, kwargs) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
216 return self.asyncreturn(seq) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
217 |
| 23547 | 218 def asynccall(self, oid, methodname, args, kwargs): |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
219 request = ("CALL", (oid, methodname, args, kwargs)) |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
220 seq = self.newseq() |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
221 if threading.currentThread() != self.sockthread: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
222 cvar = threading.Condition() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
223 self.cvars[seq] = cvar |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
224 self.debug(("asynccall:%d:" % seq), oid, methodname, args, kwargs) |
|
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
225 self.putmessage((seq, request)) |
| 23547 | 226 return seq |
| 227 | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
228 def asyncqueue(self, oid, methodname, args, kwargs): |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
229 request = ("QUEUE", (oid, methodname, args, kwargs)) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
230 seq = self.newseq() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
231 if threading.currentThread() != self.sockthread: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
232 cvar = threading.Condition() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
233 self.cvars[seq] = cvar |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
234 self.debug(("asyncqueue:%d:" % seq), oid, methodname, args, kwargs) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
235 self.putmessage((seq, request)) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
236 return seq |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
237 |
| 23547 | 238 def asyncreturn(self, seq): |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
239 self.debug("asyncreturn:%d:call getresponse(): " % seq) |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
240 response = self.getresponse(seq, wait=0.05) |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
241 self.debug(("asyncreturn:%d:response: " % seq), response) |
| 23547 | 242 return self.decoderesponse(response) |
| 243 | |
| 244 def decoderesponse(self, response): | |
| 245 how, what = response | |
| 246 if how == "OK": | |
| 247 return what | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
248 if how == "QUEUED": |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
249 return None |
| 23547 | 250 if how == "EXCEPTION": |
| 27920 | 251 self.debug("decoderesponse: EXCEPTION") |
| 252 return None | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
253 if how == "EOF": |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
254 self.debug("decoderesponse: EOF") |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
255 self.decode_interrupthook() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
256 return None |
| 23547 | 257 if how == "ERROR": |
| 26959 | 258 self.debug("decoderesponse: Internal ERROR:", what) |
| 23547 | 259 raise RuntimeError, what |
| 260 raise SystemError, (how, what) | |
| 261 | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
262 def decode_interrupthook(self): |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
263 "" |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
264 raise EOFError |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
265 |
| 23547 | 266 def mainloop(self): |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
267 """Listen on socket until I/O not ready or EOF |
|
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
268 |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
269 pollresponse() will loop looking for seq number None, which |
|
28294
65dd9612a748
Move setting of ioready 'wait' earlier in call chain, to
Kurt B. Kaiser <kbk@shore.net>
parents:
28282
diff
changeset
|
270 never comes, and exit on EOFError. |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
271 |
|
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
272 """ |
| 23547 | 273 try: |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
274 self.getresponse(myseq=None, wait=0.05) |
| 23547 | 275 except EOFError: |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
276 self.debug("mainloop:return") |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
277 return |
| 23547 | 278 |
|
28294
65dd9612a748
Move setting of ioready 'wait' earlier in call chain, to
Kurt B. Kaiser <kbk@shore.net>
parents:
28282
diff
changeset
|
279 def getresponse(self, myseq, wait): |
|
65dd9612a748
Move setting of ioready 'wait' earlier in call chain, to
Kurt B. Kaiser <kbk@shore.net>
parents:
28282
diff
changeset
|
280 response = self._getresponse(myseq, wait) |
| 23547 | 281 if response is not None: |
| 282 how, what = response | |
| 283 if how == "OK": | |
| 284 response = how, self._proxify(what) | |
| 285 return response | |
| 286 | |
| 287 def _proxify(self, obj): | |
| 288 if isinstance(obj, RemoteProxy): | |
| 289 return RPCProxy(self, obj.oid) | |
| 290 if isinstance(obj, types.ListType): | |
| 291 return map(self._proxify, obj) | |
| 292 # XXX Check for other types -- not currently needed | |
| 293 return obj | |
| 294 | |
|
28294
65dd9612a748
Move setting of ioready 'wait' earlier in call chain, to
Kurt B. Kaiser <kbk@shore.net>
parents:
28282
diff
changeset
|
295 def _getresponse(self, myseq, wait): |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
296 self.debug("_getresponse:myseq:", myseq) |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
297 if threading.currentThread() is self.sockthread: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
298 # this thread does all reading of requests or responses |
| 23547 | 299 while 1: |
|
28294
65dd9612a748
Move setting of ioready 'wait' earlier in call chain, to
Kurt B. Kaiser <kbk@shore.net>
parents:
28282
diff
changeset
|
300 response = self.pollresponse(myseq, wait) |
| 23547 | 301 if response is not None: |
| 302 return response | |
| 303 else: | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
304 # wait for notification from socket handling thread |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
305 cvar = self.cvars[myseq] |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
306 cvar.acquire() |
|
56436
684960fb1cbf
replace has_key with 'in' operator
Benjamin Peterson <benjamin@python.org>
parents:
56435
diff
changeset
|
307 while myseq not in self.responses: |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
308 cvar.wait() |
| 23547 | 309 response = self.responses[myseq] |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
310 self.debug("_getresponse:%s: thread woke up: response: %s" % |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
311 (myseq, response)) |
| 23547 | 312 del self.responses[myseq] |
| 313 del self.cvars[myseq] | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
314 cvar.release() |
| 27920 | 315 return response |
| 23547 | 316 |
| 317 def newseq(self): | |
| 318 self.nextseq = seq = self.nextseq + 2 | |
| 319 return seq | |
| 320 | |
| 321 def putmessage(self, message): | |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
322 self.debug("putmessage:%d:" % message[0]) |
| 23547 | 323 try: |
| 324 s = pickle.dumps(message) | |
|
31413
ec8a4685b360
rpc.py:SocketIO - Large modules were generating large pickles when downloaded
Kurt B. Kaiser <kbk@shore.net>
parents:
30390
diff
changeset
|
325 except pickle.PicklingError: |
|
31515
71a294bd7950
Replace backticks with repr() or "%r"
Walter Dörwald <walter@livinglogic.de>
parents:
31413
diff
changeset
|
326 print >>sys.__stderr__, "Cannot pickle:", repr(message) |
| 23547 | 327 raise |
| 328 s = struct.pack("<i", len(s)) + s | |
| 329 while len(s) > 0: | |
| 27920 | 330 try: |
|
31413
ec8a4685b360
rpc.py:SocketIO - Large modules were generating large pickles when downloaded
Kurt B. Kaiser <kbk@shore.net>
parents:
30390
diff
changeset
|
331 r, w, x = select.select([], [self.sock], []) |
|
ec8a4685b360
rpc.py:SocketIO - Large modules were generating large pickles when downloaded
Kurt B. Kaiser <kbk@shore.net>
parents:
30390
diff
changeset
|
332 n = self.sock.send(s[:BUFSIZE]) |
|
34948
e4e0cff16bc7
Improve subprocess link error notification
Kurt B. Kaiser <kbk@shore.net>
parents:
34244
diff
changeset
|
333 except (AttributeError, TypeError): |
|
e4e0cff16bc7
Improve subprocess link error notification
Kurt B. Kaiser <kbk@shore.net>
parents:
34244
diff
changeset
|
334 raise IOError, "socket no longer exists" |
|
e4e0cff16bc7
Improve subprocess link error notification
Kurt B. Kaiser <kbk@shore.net>
parents:
34244
diff
changeset
|
335 except socket.error: |
|
e4e0cff16bc7
Improve subprocess link error notification
Kurt B. Kaiser <kbk@shore.net>
parents:
34244
diff
changeset
|
336 raise |
| 27920 | 337 else: |
| 338 s = s[n:] | |
| 23547 | 339 |
| 340 buffer = "" | |
| 341 bufneed = 4 | |
| 342 bufstate = 0 # meaning: 0 => reading count; 1 => reading data | |
| 343 | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
344 def pollpacket(self, wait): |
| 23547 | 345 self._stage0() |
| 346 if len(self.buffer) < self.bufneed: | |
|
31413
ec8a4685b360
rpc.py:SocketIO - Large modules were generating large pickles when downloaded
Kurt B. Kaiser <kbk@shore.net>
parents:
30390
diff
changeset
|
347 r, w, x = select.select([self.sock.fileno()], [], [], wait) |
|
ec8a4685b360
rpc.py:SocketIO - Large modules were generating large pickles when downloaded
Kurt B. Kaiser <kbk@shore.net>
parents:
30390
diff
changeset
|
348 if len(r) == 0: |
| 23547 | 349 return None |
| 350 try: | |
| 351 s = self.sock.recv(BUFSIZE) | |
| 352 except socket.error: | |
| 353 raise EOFError | |
| 354 if len(s) == 0: | |
| 355 raise EOFError | |
| 356 self.buffer += s | |
| 357 self._stage0() | |
| 358 return self._stage1() | |
| 359 | |
| 360 def _stage0(self): | |
| 361 if self.bufstate == 0 and len(self.buffer) >= 4: | |
| 362 s = self.buffer[:4] | |
| 363 self.buffer = self.buffer[4:] | |
| 364 self.bufneed = struct.unpack("<i", s)[0] | |
| 365 self.bufstate = 1 | |
| 366 | |
| 367 def _stage1(self): | |
| 368 if self.bufstate == 1 and len(self.buffer) >= self.bufneed: | |
| 369 packet = self.buffer[:self.bufneed] | |
| 370 self.buffer = self.buffer[self.bufneed:] | |
| 371 self.bufneed = 4 | |
| 372 self.bufstate = 0 | |
| 373 return packet | |
| 374 | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
375 def pollmessage(self, wait): |
| 23547 | 376 packet = self.pollpacket(wait) |
| 377 if packet is None: | |
| 378 return None | |
| 379 try: | |
| 380 message = pickle.loads(packet) | |
|
31413
ec8a4685b360
rpc.py:SocketIO - Large modules were generating large pickles when downloaded
Kurt B. Kaiser <kbk@shore.net>
parents:
30390
diff
changeset
|
381 except pickle.UnpicklingError: |
| 23547 | 382 print >>sys.__stderr__, "-----------------------" |
|
31515
71a294bd7950
Replace backticks with repr() or "%r"
Walter Dörwald <walter@livinglogic.de>
parents:
31413
diff
changeset
|
383 print >>sys.__stderr__, "cannot unpickle packet:", repr(packet) |
| 23547 | 384 traceback.print_stack(file=sys.__stderr__) |
| 385 print >>sys.__stderr__, "-----------------------" | |
| 386 raise | |
| 387 return message | |
| 388 | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
389 def pollresponse(self, myseq, wait): |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
390 """Handle messages received on the socket. |
|
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
391 |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
392 Some messages received may be asynchronous 'call' or 'queue' requests, |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
393 and some may be responses for other threads. |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
394 |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
395 'call' requests are passed to self.localcall() with the expectation of |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
396 immediate execution, during which time the socket is not serviced. |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
397 |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
398 'queue' requests are used for tasks (which may block or hang) to be |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
399 processed in a different thread. These requests are fed into |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
400 request_queue by self.localcall(). Responses to queued requests are |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
401 taken from response_queue and sent across the link with the associated |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
402 sequence numbers. Messages in the queues are (sequence_number, |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
403 request/response) tuples and code using this module removing messages |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
404 from the request_queue is responsible for returning the correct |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
405 sequence number in the response_queue. |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
406 |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
407 pollresponse() will loop until a response message with the myseq |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
408 sequence number is received, and will save other responses in |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
409 self.responses and notify the owning thread. |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
410 |
|
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
411 """ |
| 23547 | 412 while 1: |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
413 # send queued response if there is one available |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
414 try: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
415 qmsg = response_queue.get(0) |
|
47248
9acb314b9072
Queue renaming reversal part 3: move module into place and
Georg Brandl <georg@python.org>
parents:
47241
diff
changeset
|
416 except Queue.Empty: |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
417 pass |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
418 else: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
419 seq, response = qmsg |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
420 message = (seq, ('OK', response)) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
421 self.putmessage(message) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
422 # poll for message on link |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
423 try: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
424 message = self.pollmessage(wait) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
425 if message is None: # socket not ready |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
426 return None |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
427 except EOFError: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
428 self.handle_EOF() |
| 23547 | 429 return None |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
430 except AttributeError: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
431 return None |
| 23547 | 432 seq, resq = message |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
433 how = resq[0] |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
434 self.debug("pollresponse:%d:myseq:%s" % (seq, myseq)) |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
435 # process or queue a request |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
436 if how in ("CALL", "QUEUE"): |
| 27379 | 437 self.debug("pollresponse:%d:localcall:call:" % seq) |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
438 response = self.localcall(seq, resq) |
| 27379 | 439 self.debug("pollresponse:%d:localcall:response:%s" |
| 440 % (seq, response)) | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
441 if how == "CALL": |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
442 self.putmessage((seq, response)) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
443 elif how == "QUEUE": |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
444 # don't acknowledge the 'queue' request! |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
445 pass |
| 23547 | 446 continue |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
447 # return if completed message transaction |
| 23547 | 448 elif seq == myseq: |
| 449 return resq | |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
450 # must be a response for a different thread: |
| 23547 | 451 else: |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
452 cv = self.cvars.get(seq, None) |
| 27920 | 453 # response involving unknown sequence number is discarded, |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
454 # probably intended for prior incarnation of server |
| 23547 | 455 if cv is not None: |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
456 cv.acquire() |
| 27920 | 457 self.responses[seq] = resq |
| 23547 | 458 cv.notify() |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
459 cv.release() |
| 23547 | 460 continue |
| 26959 | 461 |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
462 def handle_EOF(self): |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
463 "action taken upon link being closed by peer" |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
464 self.EOFhook() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
465 self.debug("handle_EOF") |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
466 for key in self.cvars: |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
467 cv = self.cvars[key] |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
468 cv.acquire() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
469 self.responses[key] = ('EOF', None) |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
470 cv.notify() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
471 cv.release() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
472 # call our (possibly overridden) exit function |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
473 self.exithook() |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
474 |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
475 def EOFhook(self): |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
476 "Classes using rpc client/server can override to augment EOF action" |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
477 pass |
|
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
478 |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
479 #----------------- end class SocketIO -------------------- |
| 23547 | 480 |
|
34212
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
481 class RemoteObject(object): |
| 23547 | 482 # Token mix-in class |
| 483 pass | |
| 484 | |
| 485 def remoteref(obj): | |
| 486 oid = id(obj) | |
| 487 objecttable[oid] = obj | |
| 488 return RemoteProxy(oid) | |
| 489 | |
|
34212
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
490 class RemoteProxy(object): |
| 23547 | 491 |
| 492 def __init__(self, oid): | |
| 493 self.oid = oid | |
| 494 | |
|
47241
ba1fa511b72d
socketserver renaming reversal part 3: move the module into the right
Georg Brandl <georg@python.org>
parents:
47189
diff
changeset
|
495 class RPCHandler(SocketServer.BaseRequestHandler, SocketIO): |
| 23547 | 496 |
| 26557 | 497 debugging = False |
| 498 location = "#S" # Server | |
| 23547 | 499 |
| 500 def __init__(self, sock, addr, svr): | |
| 501 svr.current_handler = self ## cgt xxx | |
| 502 SocketIO.__init__(self, sock) | |
|
47241
ba1fa511b72d
socketserver renaming reversal part 3: move the module into the right
Georg Brandl <georg@python.org>
parents:
47189
diff
changeset
|
503 SocketServer.BaseRequestHandler.__init__(self, sock, addr, svr) |
| 23547 | 504 |
| 505 def handle(self): | |
|
47241
ba1fa511b72d
socketserver renaming reversal part 3: move the module into the right
Georg Brandl <georg@python.org>
parents:
47189
diff
changeset
|
506 "handle() method required by SocketServer" |
| 23547 | 507 self.mainloop() |
| 508 | |
| 509 def get_remote_proxy(self, oid): | |
| 510 return RPCProxy(self, oid) | |
| 511 | |
| 512 class RPCClient(SocketIO): | |
| 513 | |
| 26557 | 514 debugging = False |
| 515 location = "#C" # Client | |
| 516 | |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
517 nextseq = 1 # Requests coming from the client are odd numbered |
| 23547 | 518 |
| 519 def __init__(self, address, family=socket.AF_INET, type=socket.SOCK_STREAM): | |
|
25020
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
520 self.listening_sock = socket.socket(family, type) |
|
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
521 self.listening_sock.bind(address) |
|
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
522 self.listening_sock.listen(1) |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
523 |
|
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
524 def accept(self): |
|
25020
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
525 working_sock, address = self.listening_sock.accept() |
|
26768
346a07270e87
Remove debugging connection message
Kurt B. Kaiser <kbk@shore.net>
parents:
26557
diff
changeset
|
526 if self.debugging: |
|
27366
6147bc14d277
1. Eliminate putrequest(): only used in asynccall(), merge it there.
Kurt B. Kaiser <kbk@shore.net>
parents:
26959
diff
changeset
|
527 print>>sys.__stderr__, "****** Connection request from ", address |
|
29365
72ce7cc03f27
Avoid problem resolving 'localhost'
Kurt B. Kaiser <kbk@shore.net>
parents:
29254
diff
changeset
|
528 if address[0] == LOCALHOST: |
|
25020
e41058845b79
1. Revert subprocess environment clearing, will restart subprocess
Kurt B. Kaiser <kbk@shore.net>
parents:
25019
diff
changeset
|
529 SocketIO.__init__(self, working_sock) |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
530 else: |
|
26768
346a07270e87
Remove debugging connection message
Kurt B. Kaiser <kbk@shore.net>
parents:
26557
diff
changeset
|
531 print>>sys.__stderr__, "** Invalid host: ", address |
|
24386
0e27b67247da
Reverse the RPC socket connection: Python execution server connects to
Kurt B. Kaiser <kbk@shore.net>
parents:
23995
diff
changeset
|
532 raise socket.error |
| 23547 | 533 |
| 534 def get_remote_proxy(self, oid): | |
| 535 return RPCProxy(self, oid) | |
| 536 | |
|
34212
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
537 class RPCProxy(object): |
| 23547 | 538 |
| 539 __methods = None | |
| 540 __attributes = None | |
| 541 | |
| 542 def __init__(self, sockio, oid): | |
| 543 self.sockio = sockio | |
| 544 self.oid = oid | |
| 545 | |
| 546 def __getattr__(self, name): | |
| 547 if self.__methods is None: | |
| 548 self.__getmethods() | |
| 549 if self.__methods.get(name): | |
| 550 return MethodProxy(self.sockio, self.oid, name) | |
| 551 if self.__attributes is None: | |
| 552 self.__getattributes() | |
|
56436
684960fb1cbf
replace has_key with 'in' operator
Benjamin Peterson <benjamin@python.org>
parents:
56435
diff
changeset
|
553 if name in self.__attributes: |
|
34212
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
554 value = self.sockio.remotecall(self.oid, '__getattribute__', |
|
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
555 (name,), {}) |
|
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
556 return value |
|
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
557 else: |
| 23547 | 558 raise AttributeError, name |
|
29034
656493534cc7
1. Implement processing of user code in subprocess MainThread. Pass loop
Kurt B. Kaiser <kbk@shore.net>
parents:
28386
diff
changeset
|
559 |
| 23547 | 560 def __getattributes(self): |
| 561 self.__attributes = self.sockio.remotecall(self.oid, | |
| 562 "__attributes__", (), {}) | |
| 563 | |
| 564 def __getmethods(self): | |
| 565 self.__methods = self.sockio.remotecall(self.oid, | |
| 566 "__methods__", (), {}) | |
| 567 | |
| 568 def _getmethods(obj, methods): | |
| 569 # Helper to get a list of methods from an object | |
| 570 # Adds names to dictionary argument 'methods' | |
| 571 for name in dir(obj): | |
| 572 attr = getattr(obj, name) | |
|
56435
57ee0793e462
replace callable()
Benjamin Peterson <benjamin@python.org>
parents:
55552
diff
changeset
|
573 if hasattr(attr, '__call__'): |
| 23547 | 574 methods[name] = 1 |
| 575 if type(obj) == types.InstanceType: | |
| 576 _getmethods(obj.__class__, methods) | |
| 577 if type(obj) == types.ClassType: | |
| 578 for super in obj.__bases__: | |
| 579 _getmethods(super, methods) | |
| 580 | |
| 581 def _getattributes(obj, attributes): | |
| 582 for name in dir(obj): | |
| 583 attr = getattr(obj, name) | |
|
56435
57ee0793e462
replace callable()
Benjamin Peterson <benjamin@python.org>
parents:
55552
diff
changeset
|
584 if not hasattr(attr, '__call__'): |
| 26959 | 585 attributes[name] = 1 |
| 23547 | 586 |
|
34212
1e8b033f91dc
The remote procedure call module rpc.py can now access data attributes of
Kurt B. Kaiser <kbk@shore.net>
parents:
31515
diff
changeset
|
587 class MethodProxy(object): |
| 23547 | 588 |
| 589 def __init__(self, sockio, oid, name): | |
| 590 self.sockio = sockio | |
| 591 self.oid = oid | |
| 592 self.name = name | |
| 593 | |
| 594 def __call__(self, *args, **kwargs): | |
| 595 value = self.sockio.remotecall(self.oid, self.name, args, kwargs) | |
| 596 return value | |
| 597 | |
| 598 | |
| 30390 | 599 # XXX KBK 09Sep03 We need a proper unit test for this module. Previously |
|
55552
fcea7ba4b034
Easier reference to find (at least while svn continues being used).
Guilherme Polo <ggpolo@gmail.com>
parents:
52799
diff
changeset
|
600 # existing test code was removed at Rev 1.27 (r34098). |
