You can, a little, but not easily, and not by shutting down 2 days before the retarget.
The problem with that theory is that miners are already so far ahead by that point, those two days won't change anything except make the difficulty rise a little smaller. It would take a concerted effort by a massive amount of hashing power to collude and make that happen.
Alt-coins see this happening regularly. What they do is mine hard for a cycle and then switch to another coin while that previous coin is reset lower during the next cycle. Back and forth keeping the difficulty a little more stable and profiting a little more than just driving their coin of choice up. To do this in Bitcoin, you would either have to have an alt to switch to (with merged mining, anything worth mining has astronomical difficulty too) OR just stop for the whole next retarget. 2016 blocks on, 2016 blocks off, so the difficulty creates a sawtooth type wave. Mine the lows and shut off during the highs. The problem with this is it may balance itself out in the long run similar to variance in luck. So it's lose lose and no one really benefits from it.