I too find this hard to believe...
The blockchain download code in the standard wallet has recently been improved quite a bit so that the download time in the client is comparable to the torrent download time (it was considerably slower before.) I did not perform an actual measurement, but I think it's reasonably similar now. A big chunk of the blockchain syncing time seems to be spent on block and transaction verification and management of the UTXO set and memory pool. At least on my machine, network activity consumes comparably little time, so further optimizing this will probably not yield a much faster blockchain download.
Onkel Paul
The explanation you've given actually makes a lot of sense, and explains a lot for me... So, it's basically the fact that a lot of processor power is needed to verify all transactions that slows down the whole process, so this becomes the bottleneck instead of downloading the chain in itself.
Thanks