Once there's no longer inflation, the network is prone to deflation. Theoretically, bitcoins can deflate to 0, which would mean that every bitcoin mined would be lost. If a rogue miner solely mines transactions to remove the reward, given the miner has enough hash, he would eventually remove all bitcoins in circulation.
This is not possible with inflation, unless said miner has 100% of network hash.
Inflation in real world and bitcoin are not akin. Gold miners could stop mining and the gold they created still exists. If bitcoin miners stopped mining all bitcoins ever mined would become valueless.
I'm really really tired at the moment, but this seems genius. Because i'm invested in Bitcoin I have tried to consider all possible attack vectors to the fundamentals.
The things that I think about include the blockchain issues and a way to allow people with limited bandwidth participate as a fraction of a full node (swarm nodes I call them) instead of dumb lite clients only.
But, the sweft attack is amazing. Like I said i'm tired and may have missed a flaw in your argument, but right now it seems sound.
A person wants to destroy Bitcoin, they mine away and send all the transaction fee reward into oblivion. On a long enough time line this will destroy Bitcoin, with a absolute cap at 21 million this is a viable attack.