If that sounds "too geeky" and you're not willing to go through the learning curve right now, then perhaps Bitcoin and you are not ready for each other for the moment. Interesting projects like Trezor are on development, and they could bring the two of you together again soon enough.
Again OP, don't take my post in a bad way, I am really sorry this has happened to you. But please don't claim that you haven't been warned - I'm definitely not the first one saying this -, or that there are no ways to hold Bitcoins safely, because you know that's not the case.
I am sorry - but this is not a very realistic position. What if you are in a short position, ie holding USD pending rebuy at a lower price? If this issue exists, then thief can just buy bitcoins from your balance and xfer the USD out.
If this was any other regulated situation - like a stock-brokerage account, the broker could and WOULD be held accountable for their lax security.