You could probably use it to run Electrum without going through Tor if you only want a pre-installed wallet..
http://news.softpedia.com/news/Tails-1-3-Out-Now-Introduces-the-Electrum-Bitcoin-Wallet-474176.shtml
Recently this Linux distribution called Bitcoinos was released with pre-installed wallets, but it's so new I don't know how good it is. It could be advisable to wait for reviews of it before risking using it to store Bitcoins.
https://www.reddit.com/r/Bitcoin/comments/2t88ak/introducing_bitcoinos_linux_distro_with_several/