If you look at the last 2 years you will see that the daily average it has doubled in the last 12 months. Even if the growth is linear rather than exponential, if it continues at that pace it will be 0.60 MB/block by mid-2016.
This proves the point that there was no rush to get ...20MB or 8MB blocks.
That's more like a DOS attack that is temporary and can be circumvented by someone paying higher fees to get confirmed immediately.
Spam attack, in the sense of bloating the blockchain for the lolz, would be far cheaper with larger blocks as no competition means that a spammer could easily push through a few megabytes, with almost zero fees. And that kind of spam attack leaves a permanent imprint for the future. And then there is also the possibility that some third party actually wants to spend money in fees just to spam the blockchain for years worth of transactions, in a couple of weeks.
The bolded part is an assumption. Assumption is the mother of all fuckups, and, when network abuse is concerned, it will be a guaranteed disaster.
Security assumptions like "noone is going to spam the blockchain" cannot be taken for granted. If they do, then bitcoin XT is DOA. Such a level of irresponsibility and wishful thinking is unacceptable for a multibillion dollar project that wants to rival the traditional money system.
The attack vectors surrounding a system like Bitcoin, from a game theory perspective, are wider than the Bitcoin ecosystem itself.
For example, from a game theory perspective, and if we look at this only from inside the ecosystem, a spam attack that costs a few BTC per day to make the blockchain bloated doesn't make sense, so it's illogical and would not happen.
But if we look at it from the broader financial ecosystem, a rival (a bank, a credit card, the governments etc etc) might want to do just that and be willing to pay the few BTCs in fees to bloat the hell out of the blockchain. And make sure that they do that as cheaply as possible, and with as little pruning potential as possible, by designing the proper "transactions". So they pay a few hundred BTCs per day in fees just to make the blockchain unusable.
In what financial world is it acceptable for a multibillion project to be under threat through such cheap attack vectors?
The alternative attack vector of DoSing the transactions confirmed by fee competition is far more acceptable because it doesn't leave a permanent imprint and it can be bypassed by the user who wants transaction priority.
If user A wants to pay user B 10 BTCs and the confirmation can be done in one block with 0.002 instead of 0.001 btc, if he so decides to pay them, he'll pay them and get on with it.
Block size should increase in parallel with actual usage to prevent the bloat-vector conducted by a Bitcoin enemy. Scaling should be primarily improved through work in the underlying protocol or data storage.
Fee measures should already be taken to eliminate dust and spam due to this:
That is true. If a minimum fee of (say) 0.001 BTC = 0.20 USD was imposed on each transaction, the traffic would probably drop by 80% or more, and the block size limit would not be a pressing issue for a couple of years, at least. But neither camp wants to see hat, for several reasons...