Your miner inherited an old poclbm bug (or just recreated it) - reading pool's answer takes very long time with your miner, about ~200 ms and up to 2 sec in some cases - i see this in my pool's log. When we discussed this with m0mchil, he managed to fix it and now this delay is close to 0 ms.
I'm the primary maintainer of all the code in the minerutil package, which looks like it may be the culprit. Did you send me a PM too? I didn't get one either.
1) Python bug - reading HTTP headers by one byte at a time ( http://bugs.python.org/issue1542407 )
2) TCP_NODELAY not used (looks like the main cause).
What's interesting is RPCProtocol doesn't use any Python HTTP libraries, it's all done through Twisted;
so while it could be a problem in Twisted, I don't think the linked bug is the answer.
The lack of TCP_NODELAY is interesting. Doesn't that only disable Nagle's algorithm, which affects sends?
How would it delay received data?