I think it's hugely naive to think that bitcoin's success isn't directly related to sites like Silk Road.
I mean, with the exception of hobbyists and enthusiasts, why would anyone go to the trouble of using bitcoin to buy something they could just buy on amazon or at the shops?
If coins are to succeed, they need a niche. Sex toys and steam codes are not a niche, I can buy a vibrator in town and ensure anonymity with shades and a hat. I can buy steam codes, from steam.
Drugs however, well I'm not 15 anymore. Hypothetically, I don't want to be waiting on back streets for someone who might or might not mug me to get a bad deal on a bad product. I, and most other sensible people, would much prefer to go online, select from a wide array of reviewed sellers and get stuff delivered to my door by someone who definitely won't mug me, ie, the mail man.
This is crypto-currencies main niche, this is the key to it's success, this is it's future. If you don't like drugs or think that crypto needs to cast off this "bad image" then, frankly, I think you are in the wrong place. You shut down SR (et al), you shut down Bitcoin.
I don't think that by shutting down SR directly defines bitcoins fall, but it will severely damage bitcoins current somewhat stable economy. A lot more companies adopting it is what will eventually sustain bitcoin. That's why it's necessary that we spread the word as much as we can so that eventually the number of people that support bitcoin outweighs SR's support.