Pages:
Author

Topic: blockchain.info you are the best :D (Read 4928 times)

hero member
Activity: 910
Merit: 1005
January 04, 2013, 10:25:51 PM
#21
Can we get a pic of the blockchain.info server rack? Just curious as to what this all looks like.

Here is a photo of the rack https://i.imgur.com/wMFG1.jpg. We do not have a full rack to ourselves yet.

3 mac mins (top) - 4 servers in one chassis (middle) - firewall & intrusion detection (bottom).

how good is this company?
http://www.blacklotus.net/

They are not really ddos attacks which a company like that would be able to help with. It is more just a few dozen tor ip addresses causing problems. For example one ip opening 1000's of websocket connections, or generating huge numbers of forwarding addresses.

I would have never tought to ask this here but hey why not... How do you find NDB to be? What kind of query/second can you handle? Are you keeping the whole database on ram or indexes only? I was always interested in it but always ended up with other solutions!

It is entirely in ram. The site averages about 200-300 queries / second which isn't anything particularly special but cpu usage of ndb averages about 20%, considering this is decent 4 server cluster I feel like the load should be lower. However I haven't benchmarked it against any other database so I don't know if it really is an ndb problem or poor schema/query design. On the plus side it's pretty stable, I think before the recent maintenance it ran for 100 consecutive days without problems. In future I imagine moving to something like HBase/Cassandra but not for a while yet.



legendary
Activity: 1031
Merit: 1000
January 03, 2013, 11:00:33 PM
#20
how good is this company?
http://www.blacklotus.net/

I hear they have good moxie.
newbie
Activity: 42
Merit: 0
January 03, 2013, 06:50:17 PM
#19
how long will it be down for?
legendary
Activity: 1176
Merit: 1001
January 03, 2013, 05:58:50 PM
#18
I would have never tought to ask this here but hey why not... How do you find NDB to be? What kind of query/second can you handle? Are you keeping the whole database on ram or indexes only? I was always interested in it but always ended up with other solutions!
hero member
Activity: 743
Merit: 500
January 03, 2013, 05:24:11 PM
#17
dos attacks and high load in general coupled with the fact I have been away. The changes made today should help a lot with reliability.
how good is this company?
http://www.blacklotus.net/
hero member
Activity: 784
Merit: 1000
January 03, 2013, 04:47:26 PM
#16
ddos atacks astound me.  Don't little kiddies have better things to do with their time?
hero member
Activity: 910
Merit: 1005
January 03, 2013, 03:34:51 PM
#15
Ok back online, just catching up with the blockchain. Apologies for the downtime everyone.

piuk, good to hear things are going well. I'm curious as to what caused the surge of problems though? I intended to rely on your receive api but now I'm having second thoughts. Was fairly spotty before you went down.

dos attacks and high load in general coupled with the fact I have been away. The changes made today should help a lot with reliability.
full member
Activity: 214
Merit: 100
January 03, 2013, 03:26:31 PM
#14
piuk, good to hear things are going well. I'm curious as to what caused the surge of problems though? I intended to rely on your receive api but now I'm having second thoughts. Was fairly spotty before you went down.
legendary
Activity: 1736
Merit: 1000
Truly decentralized stable asset
January 03, 2013, 02:48:32 PM
#13
You are the man, Piuk!
hero member
Activity: 910
Merit: 1005
January 03, 2013, 02:39:01 PM
#12
Close now?

Database partitioning finished. Just need to make a full backup, run one alter table query, catch up bitcoind and the site can be brought back online.
legendary
Activity: 1974
Merit: 1029
January 03, 2013, 02:34:28 PM
#11
Easy guys, they're working on it, right?
legendary
Activity: 1736
Merit: 1000
Truly decentralized stable asset
January 03, 2013, 02:25:17 PM
#10
Close now?
member
Activity: 73
Merit: 10
www.bitex.co.uk - A new begining in cryptotech
January 03, 2013, 02:04:10 PM
#9
cool thanks Smiley
hero member
Activity: 910
Merit: 1005
January 03, 2013, 01:52:45 PM
#8
Any updates?

Still waiting for a job to finish, should not be much longer.

-----

The database needs rebalancing as when the site was moved from two servers to 4 servers the existing tables were not repartitioned. This means the load is much higher on two of the servers rather than being distributed equally. The task is taking much longer to complete than I was expecting but it is important that it is done.

member
Activity: 73
Merit: 10
www.bitex.co.uk - A new begining in cryptotech
January 03, 2013, 01:33:48 PM
#7
Any updates?
hero member
Activity: 910
Merit: 1005
January 03, 2013, 12:29:26 PM
#6
Can we get a pic of the blockchain.info server rack? Just curious as to what this all looks like.

I have asked the guys at the datacenter to take a photo.

-----

Couple of problems upgrading the database, ETA another hour.
member
Activity: 62
Merit: 10
January 03, 2013, 11:54:34 AM
#5
Can we get a pic of the blockchain.info server rack? Just curious as to what this all looks like.
hero member
Activity: 910
Merit: 1005
January 03, 2013, 11:08:49 AM
#4
which programming language you used to serve

Java

If you now move stuff to the mac mini again … I'm confused. Do you expect improved performance from that??? Kind of doesn't make sense to me.

Spreading the workload around. Bitcoind resource usage is increasing, running in VMs is putting too much load on the main servers but a mac mini can run a full node without problem freeing up resources.
legendary
Activity: 1862
Merit: 1105
WalletScrutiny.com
January 03, 2013, 10:58:11 AM
#3
Actually that is an old maintenance message which i forgot to update, the servers were switched a few months back. The old mac minis are being fired up again and some processes are being moved over (Bitcoind, Email server etc) as well as upgrading the firewall on the firewall and the laster mysql cluster version. Should be back fairly soon.

Ok, hmm … I was about to ask which programming language you used to serve so many users with so decent speed.
And as blockexplorer.com is down, too (at least when trying to find the balance of an address), I'm getting impatient now.

If you now move stuff to the mac mini again … I'm confused. Do you expect improved performance from that??? Kind of doesn't make sense to me.
hero member
Activity: 910
Merit: 1005
January 03, 2013, 10:49:34 AM
#2
Actually that is an old maintenance message which i forgot to update, the servers were switched a few months back. The old mac minis are being fired up again and some processes are being moved over (Bitcoind, Email server etc) as well as upgrading the firmware on the firewall and installing the latest mysql cluster version. Should be back fairly soon.
Pages:
Jump to: