We can't stop those banks if they are seeing that bitcoin has the potential to bump their services for the people. And that's for sure to happen that they will charge us for using their service and its up to us if we will avail their bitcoin banking services. But since there are already exchange sites, we can be our own bank with it.
Isn't exchanges the same as bitcoin bank? we deposit our bitcoin there and we transact using bitcoin exchanges, so I think there is no need to have a bitcoin bank, besides, it would just be a hassle for us to go there if there is really a physical bank. Hacks here and there are common, who knows, they might use it as an alibi too to make money.