You might remember from back in 2014 when Mt. Gox was beginning to collapse and halted trading/withdrawals, that the original founder of Dreamhost created a site called Bitcoinbuilder.com which let people sell the coins that they had kept in the exchange to those who were willing to take the risk of Mt. Gox collapsing. That person was Josh Jones. He left Dreamhost before the Mt. Gox incident and founded a new web hosting company called Chunkhost:
I've never used them but they do offer a 5% discount if you pay via Bitcoin. They seem to specialize in VPS hosting and since most of my experience so far has been with shared hosting, I'm not sure if they're good or not from reading their plans but they might be worth checking out:
http://www.chunkhost.com/