Does my Latency matter where I mine? Lets say my current pool gives me a ping of 100ms but a node closer to me gives me a ping of 25 ms should I which to node mining? Does it even really matter?
Very little, if you are paid for the share submitted, it has a negligible impact. When the block change and the pool ask you to dump your work and start on the next one, a lower MS would be "better" but its insignificant.
If you are solo mining, it can be significant, if you have a bad connection it may take more time to propagate your block and someone could beat you to it if he happen to find the solution at the same time.
If my pool is having a hard time finding a block what should I do in general. Wait it out or switch to another pool? How long should you wait before switching to another pool?
Thats up to you. Personally Kano is having a rough time for a long time so i split my hashrate and put it on a big pool for more stable payouts. With a small pool, it will merely take a longer time for you to normalize your returns.