Well, I do care, but I just don't buy that explanation. AFAIK, the biggest damage an evil miner could do by pushing the time limit is slightly increased amount of orphans. And half of those orphans would be his own. It would depend on that if his clock is ahead or behind average network time. Most damage with smallest lost would be keeping his clock at average, where he would get half of the 'extra' orphans created because of pushing the time limit. Going forward would increase the orphans, but he would get them by himself. Going backward would decrease the amount of 'extra' orphans.
There would be no damage to transactions and miners loses would be neglible (only that evil miner would lose noticeable amounts). I do not consider a damage that time would not stay in realtime, it is not doing it anyway.
Even this damage would be practically nothing, if we would allow timestamp to jump over one block back in time.
If you do
If nlocktime is to be worried, it should be fixed by decreasing that 2 hour limit. (However, that would make timejacking easier, so network time variance should be limited as well, but that's another story)