https://bitcointalksearch.org/topic/is-the-private-key-really-all-that-i-need-488560
Yes, thanks, there's some interesting stuff in that thread too that isn't intuitive and I didn't understand at first:
Longer version:-
It's impossible to spend less than the amount you received in a previous transaction, but, obviously, the majority of the time you won't want to spend the exact amount of a TXIN (or multiple ones combined), so, what do you do? You send the amount you want to spend to the receiver, then, you send the remainder ('change') back to yourself, normally, on a different address, meaning the private key for the last address is now worthless.
Personally, I recommend Armory (Or any other client that uses a pre-saved seed to generate keys), as, it fights this by using a seed which you print off to generate all addresses, this means even if you receive money on an address after paying, or, send change to a new address, that printed wallet two-line long string still saves all your funds.