The main reason I am sceptical in regards to persistence is that I don't like the idea of a growing system: malicious code caught on some malicious websites, growing log-files, all sorts of stuff bloating the system... A LiveCD gives you a fresh start at each reboot.
At least for managing your bitcoin-life savings that's what I see as being safer. A working environment is a different story altogether...
Probably I don't explain well the way it will works (English is not my primary language) : the operating system is a ISO file exactly as the one you can find on a liveCD, all the settings are stored in ram. No way to add files or programs to it unless you know how it has been built (and to do that you need a properly configured server, rebuild the iso, start a Linux system, delete the old iso from the usb key and replace with the fresh one, and the fresh one has to be build from the same snapshot of the startup files on the usb key, otherwise you've to reinstall also the boot file: not a 5 min work - actually installing a liveCD via automated scripts with all the files ready can take up to 10-15 minutes ). On the same media you can write all the files you want, exactly as if is a standard usb key (formatted Ext2), but they're not seen from the system unless you manually mount the pen. There you can create a encrypted area and store there your wallet.dat.
Over the liveCD+usb stick solution you have some advantages: 1 only media to carry, faster to bootup and execute programs (you can use a USB stick), when you want to upgrade the software you've only to download the new media from the official site and launch a script to have it installed and ready to go.