You dont have to store your Bitcoins on a Computer.. you just need a Private-/Public Key Pair.
You could generate them with PC (or you could even "generate" it from hand)..
A Paper Wallet can't be "hacked".. Neither can a properly build Hardware wallet be hacked.
Remember that not all people are aware as to how to run BTC from an USB nor do they understand paper wallets.
This is what is making it confusing for other people and since most of them are 'lazy' they stick with the opinion that crypto in general are dangerous.
We all now how risky exchanges and online wallets are so there must come a more easy solution. A hardware wallet for just 20 bucks f.e.
There are hardware wallets available for about 40 Bucks.
I think getting even cheaper will kinda be impossible if you still want to have secure algorithms and secured hardware.