1. If I buy the bitcoins, is it safe to leave them on the exchange? If not, what is a simple guide for me to follow so I can download them (note I am not a technical person). I want something very safe.
I personally wouldn't feel comfortable leaving that much money under the control of someone else unless it was insured by a reputable company. Even then I'd think twice unless I knew there was a reasonable chance of recovering funds through legal action. You'll have ot decide for yourself how much risk you are willing to take. You probably should learn a bit about bitcoin wallets and how to use and secure them. At the bare minimum, I'd transfer the funds to a blockchain.info wallet and have a backup of the wallet sent to me. If you don't plan to spend the funds any time soon, I'd consider a paper wallet.
2. If I want to buy $5k worth of bitcoin, do I use limit order and if so how? Right now the bitcoin price is $30.41. How do I buy $5k worth of bitcoin for $30.41 each? I'm confused by the different options.
If you place a limit order for $5k worth at $30.41, then you will only receive the bitcoins if and when someone is willing to sell theirs at $30.41. If the market price increases above $30.41 and never drops back down, then your limit order will just sit out there unfilled.
If you place a market order for $5k worth of bitcoin, then you will get the bitcoin at whatever the ask price availability is at the exact moment that you place your order. If the lowest available ask price is less than $30.41 then you'll get them cheaper, if the lowest available ask price is higher than $30.41, then they will be more expensive.
With a market order, there may be some slippage of the price if the volume associated with the current ask is low.
Example:
Albert has a limit order to sell $1000 worth of bitcoin at $31.42.
Brian has a limit order to sell $2000 worth of bitcoin at $31.45.
Carl has a limit order to sell $1000 worth of bitcoin at $31.50.
David has a limit order to sell $500 worth of bitcoin at $31.55.
Earl has a limit order to sell $1000 worth of bitcoin at $31.63.
Seeing that the current ask price is $31.42, you place a market order to purchase $5000 worth of bitcoin.
BitStamp transfers $1000 from you to Albert and 31.8268619 BTC from Albert to you.
BitStamp transfers $2000 from you to Brian and 63.5930048 BTC from Brian to you.
BitStamp transfers $1000 from you to Carl and 31.7460317 BTC from Carl to you.
BitStamp transfers $500 from you to David and 15.8478605 BTC from David to you.
BitStamp transfers $500 from you to Earl and 15.8077774 BTC from Earl to you.
When your exchange is complete, the new ask price is $31.63
You have spent $5000 and acquired 158.821536 BTC
Which works out to an exchange rate of $31.48.
So even though the current "ask" was $31.42, you actually ended up spending $31.48