Thanks in advance for the help.
The first thing you will need to do though before buying your bitcoins is to choose what type of wallet you want to use. Bitcoin.org has its own wallet which is called Bitcoin-QT. I wouldn't suggest going with this option because the first time you load the client it will require approximately a 24 hour syncing time where the wallet needs to sync up with the entire bitcoin network and essentially download a copy of every transaction that has ever occurred on the network. Its a great wallet, but not very user friendly.
Instead, I would suggest that you look at the wallet offered by Blockchain.info. It is a free wallet, it is web-based which means that you do not need to wait the 24 hour waiting time to sync up with the network. The user interface is much more pleasing to the eye. I use that one and so do most people nowadays. There is lots of info on both these wallets if you just do a quick search around the Reddit forums or the Bitcointalk.org forums.
Once you have your wallet you need to buy the bitcoins.
Bitcoin-Brokers is set up so that you can walk into any major bank in the USA such as Bank of America, Wells Fargo, Chase, PNC, Citibank, Capital One and make a cash deposit into an account.
You do not need an account at the bank. No ID, no sign ups.
Here is a 12,000 view thread discussing the service:
https://bitcointalksearch.org/topic/buy-bitcoin-with-cash-deposits-at-most-banks-in-the-usa-with-bitcoin-brokers-237164