I don't trust off-blockchain transactions...Especially with...the "threat" that they could be executed by being put into the blockchain at any time
Keep in mind that when we talk about off-blockchain transactions, we are talking about alternate block chains. These would be separate crypto-currencies with different properties. Ripple is one example (it relies on trust, unlike Bitcoin). I'm sure there will be others when the opportunity for profit arises.
No we are not. At least I'm not. I'm talking about off-network Bitcoin transactions, of any type, but that are still denominated in bitcoins. This could be people who trade in sets of private keys (unsafe, yes; but possible), it could be people who trade in a paper currency denominated and/or backed by a bitcoin reserve, or this could be people trading within a single online wallet service (think Ebay, using something like MyBitcoin.com rather than Paypal as the default transaction method) or a potential parrallel network of wallet services that function like banks, taking the Bitcoin equivilant of bankchecks and settling up with one another on much longer intervals.
All of these methods, at least all that I can think of, require more trust between parties and involve greater risk than using the main Bitcoin network; but that is also why they would be a cheaper alternative most of the time. If you're going to be buying/selling a car with bitcoins, you're going to want to use the Bitcoin network; but if you're buying a snickers bar at the store, a standardized method of trading private keys might be a viable alternative to a blockchain transaction fee. Microtransactions were never Bitcoin's strong point; distance & high security with low trust were. Not all transactions require that kind of certainty.
I'd rather see a dynamic solution...
There are a lot of things we'd rather see but the point being made is that there are limits to what can be done with Bitcoin, while keeping it Bitcoin (global consensus, proof of work, etc...) Raising the block limit by a non-trivial amount may not be practical.
It should be easy to see that if there was no limit on block sizes, that fees would trend towards zero (ignoring the OP's original stated problem of miners attacking other miners by producing large padded blocks). Do you understand that with increasing block sizes come smaller fees?
For that matter I've seen a lot of talking about bandwidth, storage, and processing power but it seems everyone has overlooked that:
Fees will decrease as block size is increased (all else being equal)Do people not get this, or am I wrong?
I get this, and I agree from an economic incentives perspective. This is the very same problem of scarcity that prompted a minimum fee rule, in order for a transaction to be considered a fee paying transaction according to the priority score algo that Gavin put in a couple of years ago. The limits prompt delays in free transactions, and that is a cost to consumers. Wise consumers will pay a fee for speed, but not more than they must. If the transaction fees can ever be expected to replace the decending block reward, there must be some kind of scarcity there. If we remove the limits altogether, the supply of transaction space will (functionally) be as close to infinate as the supply of bandwidth availabe to email spammers. There will be no incentive for the majority of users to contribute a fee, even after the block rewards decrease to nominally zero, unless they are running up against some kind of limiting resource. I believe that free transactions should always be possible, but if speed of confirmation is the concern you're going to have to contribute. We can suffer a lot more 'freeloading' than can VISA or Mastercard, but the network is not costless, so the service to users cannot be costless either.