Time. If the average Joe who has no better reason to exchange funds to Bitcoins other that trying to make 100,000% profitszzzzz per year stays a away for a months or even years that doesn't undermine the value of Bitcoin. In 2015 or 2016 Bitcoin ecosystem will be even stronger. ASICs will be online making the network more secure, the clients will be better developed, hardware wallets will exist, there will be more and deeper exchanges who learned lessons (or went out business) from the lag-crash(es) of 2013.
If you believe Bitcoin has UTILITY as value transfer system (i.e. a currency) then it isn't hurt by a little less mainstream attention in the short span. When Bitcoin is still around a decade or so after launch "the average Joe" will take another look at it. If Bitcoin never had UTILITY then it didn't matter if the average Joe bought into it or not, the end result was going to be failure either way.
So ask yourself, does Bitcoin have UTILITY? If the answer is no then sell all your coins now while you can, and logout. If the answer is yes ....