Unfortunately, without miners to confirm your transactions, it is entirely possible for a government that controls hashing power to control when transactions get processed. What good is your bitcoin if you cannot spend it unless you register your address with one of these mining entities?
There is another aspect to this, mining use to represent a cost effective way of buying bitcoins. Now mining is no longer cost effective.
Despite the rebuttals you are right to raise this as a concern. I have been tracking Team China on BTC Guild for some time now:
http://www.btcguild.com/index.php?page=rankings§ion=teamsNot very scientific I know but I think we are seeing an increase in centralisation for a variety of reasons.
Check pages 3 & 4 of Satoshi's paper which talks about the Proof of Work model.
http://bitcoin.org/bitcoin.pdfPage 3
If a majority of CPU power is controlled by honest nodes, the honest chain will grow the fastest and outpace any competing chains. To modify a past block, an attacker would have to redo the proof-of-work of the block and all blocks after it and then catch up with and surpass the
work of the honest nodes.
Page 4
The incentive may help encourage nodes to stay honest. If a greedy attacker is able to assemble more CPU power than all the honest nodes, he would have to choose between using it to defraud people by stealing back his payments, or using it to generate new coins. He ought to find it more profitable to play by the rules, such rules that favour him with more new coins than everyone else combined, than to undermine the system and the validity of his own wealth.
Emphasis mine.
A lot of what has fuelled this rise in price and adoption is greed. If hash rate drops sharply due to lower mining profitability then we could be left with slower confirmations and lower price.
And so the design of Bitcoin continues to be tested as the hashrate continues to rise even as the price drops. One of the interesting difference with scrypt mining is that at least a graphics card or CPU is a multi purpose piece of equipment that they can be used for gaming or sold easily on the open market. Those ASICs are going to make excellent door stops and do nothing for the enviroment.