The servers are all run by volunteers using open source code that was made non-profit out of the good will of people's hearts.
You probably connected to a server that was having difficulties, maybe their cat slept on the escape key or something.
If you have connection issues, try reconnecting, try connecting to a different server, etc.
Maybe in the future, there will be some sort of business running official professionally maintained servers for Electrum. Until then, you're basically relying on a group of volunteers. (then of course... the same can be said for the Bitcoin Core, multibit, or ANY bitcoin wallet...)
Thanks for the explanation, I wasn't aware.