Now, I would agree to the point you are trying to establish! Having an weapon doesn't always mean it will be misfired and used against the humanity! So even if the quantum computer is built so capable enough to break the encryption of bitcoin network, it is least likely to be used for this purpose!
As the bitcoin network is of complex algorithms there existed some fear. As for experts view the super computer at present has got only 53 Qbits which is the power calculation. To break the bitcoin network it requires at least 1500 Qbits. This way bitcoin is always secure.