[~1000 GH/sec] BTC Guild - 0% Fee Pool, LP, SSL, Full Precision, and More - page 96.

melanarchy

newbie

Activity: 22

Merit: 0

So instead of reloading the block stats and my account pages on the site all the time I whipped up a quick python script to curl down the data from the api and display it. It requires python and curl to be installed, I've tested it on ubuntu but there isn't a reason it wouldn't work with any other os. For now you need to just put your API Key in the top, and if you're on a different os flavor update the #! python path and the curl path.

Here is the sample of the output:

Code:

+-+-+-+-BTC GUILD Pool Stats for XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX-+-+-+-+
+ Confirmed Payout : 0.58573323 +
+ Unconfirmed Payout : 0.34381127 +
+ Estimated Payout : 0.02086434 +
+ Sum Total (inc est): 0.95040884 +
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
+ Total Worker Hashrate 615.61 Shares 1375 Stales 3 Stale% 0.22 +
+ Pool Average Block Time (seconds) 2825 +
+ Latest Block Times 1:07:50 0:36:48 0:12:03 0:07:46 0:14:48 0:44:14 +
+ Pool Est Blks/24hrs 31 Miner Est 24hr Rewards : 0.61859068 +
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

https://github.com/johnmarc/BTC-Guild-Stats

I'll likely provide some updates to allow for all sorts of extras (config files, idle warnings, etc.) as well but this is a start at least. Feel free to pm me if you have questions, and you can always submit a pull request to change the code.

eleuthria

legendary

Activity: 1750

Merit: 1007

Quote from: disq on June 16, 2011, 05:01:25 AM

Quote from: kodess on June 16, 2011, 03:39:47 AM

Quote from: Xer on June 16, 2011, 02:29:02 AM

Quote from: swusc2 on June 16, 2011, 01:50:01 AM

**********PSA**********

This is in your best interested to distribute yourselves out.

Whats stopping btcguild from using round robin or some other distributing algoritm when going over? that would solve the single server overload issue directly.
Deepbit points you to the closest server when you use their adress so it is possible to do.

Edit. everyone mining with the guiminer or other mining softwartes with hardcoded addresses would have to change miners to use those links.

he tried round robin, it overloaded the balancer...

well, the round-robin doesn't need to be smart, he could use vanilla DNS for it without any balancer. can't control it automatically and fast though (well, unless very short TTLs are used along with some bash-fu to check availability/update the main dns record) but at least wouldn't lose mining time and the eventual hashing power drop could be avoided. (of course, port 80 needs to be redirected to the main webserver which needs to run in a subdomain, maybe 'www')

Round robin at the DNS level does not work. Miner clients are dumb and re-query the DNS every connection, rather than resolve the host at the start. This causes them to bounce between servers randomly when the DNS round robin was enabled, causing work to be sent everywhere and get rejected. To date, we've tried:
DNS Round Robin - Tossed a miner between servers randomly, causing rejects.
HAProxy Load Balancing - Can't handle that many connections being proxied to remote servers.
Custom DNS Server program - DNS queries are peer-to-peer, so "sticking" a client ended up sticking a chain of DNS servers. OpenDNS and Google DNS are distributed, so a miner was sometimes being shot to different servers based on where their DNS query was routed at the time.

The final solution, which is what most people would use is to consolidate the servers to a single data center, put a HAProxy/Pen/Pound server in front of the nodes, and have it do local load balancing. However, this means that if you have connection problems to one server, you have them with every server.

disq

newbie

Activity: 41

Merit: 0

Quote from: kodess on June 16, 2011, 03:39:47 AM

Quote from: Xer on June 16, 2011, 02:29:02 AM

Quote from: swusc2 on June 16, 2011, 01:50:01 AM

**********PSA**********

This is in your best interested to distribute yourselves out.

Whats stopping btcguild from using round robin or some other distributing algoritm when going over? that would solve the single server overload issue directly.
Deepbit points you to the closest server when you use their adress so it is possible to do.

Edit. everyone mining with the guiminer or other mining softwartes with hardcoded addresses would have to change miners to use those links.

he tried round robin, it overloaded the balancer...

well, the round-robin doesn't need to be smart, he could use vanilla DNS for it without any balancer. can't control it automatically and fast though (well, unless very short TTLs are used along with some bash-fu to check availability/update the main dns record) but at least wouldn't lose mining time and the eventual hashing power drop could be avoided. (of course, port 80 needs to be redirected to the main webserver which needs to run in a subdomain, maybe 'www')

hugolp

legendary

Activity: 1148

Merit: 1001

Radix-The Decentralized Finance Protocol

It might be random but there is the overloading in USA central and weve been almost 4 hours without finding a block.

kodess

newbie

Activity: 32

Merit: 0

Quote from: Xer on June 16, 2011, 02:29:02 AM

Quote from: swusc2 on June 16, 2011, 01:50:01 AM

**********PSA**********

Everyone Directed to btcguild.com Should Redirect Themselves to One of the Following Servers.

uswest.btcguild.com
useast.btcguild.com
uk.btcguild.com
nl.btcguild.com

Everyone directing themselves to btcguild.com is being redirect straight to uscentral.btcguild.com. This is going to cause uscentral.btcguild.com to overload

This is in your best interested to distribute yourselves out.

Whats stopping btcguild from using round robin or some other distributing algoritm when going over? that would sovle the single server overload issue directly.
Deepbit points you to the closest server when you use their adress so it is possible to do.

Edit. everyone mining with the guiminer or other mining softwartes with hardcoded addresses would have to change miners to use those links.

he tried round robin, it overloaded the balancer...

Xer

member

Activity: 99

Merit: 10

Quote from: swusc2 on June 16, 2011, 01:50:01 AM

**********PSA**********

Everyone Directed to btcguild.com Should Redirect Themselves to One of the Following Servers.

uswest.btcguild.com
useast.btcguild.com
uk.btcguild.com
nl.btcguild.com

Everyone directing themselves to btcguild.com is being redirect straight to uscentral.btcguild.com. This is going to cause uscentral.btcguild.com to overload

This is in your best interested to distribute yourselves out.

Whats stopping btcguild from using round robin or some other distributing algoritm when going over? that would sovle the single server overload issue directly.
Deepbit points you to the closest server when you use their adress so it is possible to do.

Edit. everyone mining with the guiminer or other mining softwartes with hardcoded addresses would have to change miners to use those links.

swusc2

sr. member

Activity: 304

Merit: 250

Do your part for Bitcoin!

**********PSA**********

Everyone Directed to btcguild.com Should Redirect Themselves to One of the Following Servers.

uswest.btcguild.com
useast.btcguild.com
uk.btcguild.com
nl.btcguild.com

Everyone directing themselves to btcguild.com is being redirect straight to uscentral.btcguild.com. This is going to cause uscentral.btcguild.com to overload

This is in your best interested to distribute yourselves out.

Lumpy

full member

Activity: 237

Merit: 100

US Central seems to be overloaded... for those of you having trouble, you should manually choose another option.

tripper22

full member

Activity: 188

Merit: 100

Quote from: eleuthria on June 15, 2011, 11:40:38 PM

US West and web server are having a small bit of downtime right now to bring up a US Central server. US West still seems to hang for a few minutes when its bombarded by all of the new getwork requests after a brief downtime.

eleuthria

Thanks for all the hard work. When do you think everything will be finished? I would love to stay with BTC Guild but it's been too inconsistent.

eleuthria

legendary

Activity: 1750

Merit: 1007

US West and web server are having a small bit of downtime right now to bring up a US Central server. US West still seems to hang for a few minutes when its bombarded by all of the new getwork requests after a brief downtime.

eleuthria

legendary

Activity: 1750

Merit: 1007

Quote from: BitMinerN8 on June 15, 2011, 08:48:17 PM

Quote from: eleuthria on June 14, 2011, 10:12:48 PM

Tomorrow afternoon I will be switching pools over to difficulty 2 shares. I will also be changing the way the pools are handled until I can work getting multiple servers in a single datacenter to do -real- load balancing (2+ pool servers behind a frontend that relays connections to the pools).

Has this "difficulty 2 shares" gone into effect?

Difficulty 2 patch has been delayed for now. The goal was to get the load off the servers from pushpool receiving shares and posting them to MySQL. Last night a fix was made to the users mysql table that dramatically dropped the CPU usage of the process. The problem in scaling has now been narrowed down to the pushpool<->bitcoind communications. Working on patching this ASAP before moving on to a difficulty adjustment.

bodhipraxis

newbie

Activity: 56

Merit: 0

As of 2:04 AM Thurs (UTC), when I attempt to connect to "My Account" on the btcguild website, I see the error message:

"Failed to connect to US Central BTCGuild."

UPDATE: 3 minutes later, I was able to connect. Eleuthria* said that "many patches were being applied" today. Probl. the cause of this?

hugolp

legendary

Activity: 1148

Merit: 1001

Radix-The Decentralized Finance Protocol

Quote from: BitMinerN8 on June 15, 2011, 08:48:17 PM

Quote from: eleuthria on June 14, 2011, 10:12:48 PM

Tomorrow afternoon I will be switching pools over to difficulty 2 shares. I will also be changing the way the pools are handled until I can work getting multiple servers in a single datacenter to do -real- load balancing (2+ pool servers behind a frontend that relays connections to the pools).

Has this "difficulty 2 shares" gone into effect?

Some hours ago I got an odd share numer so I guess it did not yet.

BitMinerN8

hero member

Activity: 626

Merit: 500

Mining since May 2011.

Quote from: eleuthria on June 14, 2011, 10:12:48 PM

Tomorrow afternoon I will be switching pools over to difficulty 2 shares. I will also be changing the way the pools are handled until I can work getting multiple servers in a single datacenter to do -real- load balancing (2+ pool servers behind a frontend that relays connections to the pools).

Has this "difficulty 2 shares" gone into effect?

eleuthria

legendary

Activity: 1750

Merit: 1007

Main post and the website's "How to Connect" page have been modified to direct miners to point towards a particular pool rather than the generic "btcguild.com" . This has been accompanied by a Server Status widget on the side, giving a simple description of the load per server.

Picking a server close to you has a minimal effect on your mining performance. The server load has a much higher chance of affecting your performance. If your miners have trouble with frequent idles, it is recommended you check the website server status widget and relocate your miners to a server identifying either LOW or Normal load.

The urls once again are: uswest.btcguild.com , useast.btcguild.com , nl.btcguild.com , uk.btcguild.com

Many patches were applied to server configurations today, and it has shown a dramatic increase in overall server performance.

BitMinerN8

hero member

Activity: 626

Merit: 500

Mining since May 2011.

@eleuthria, I know your busy with a ton of stuff. Just an FYI in case you did not know. Currently for me "Workers" that are tagged as hidden on the Worker Management page are showing up under the Worker Summary on the My Account page. Lips sealed

eleuthria

legendary

Activity: 1750

Merit: 1007

Quote from: spyjai on June 15, 2011, 09:49:41 AM

Quote from: eleuthria on June 15, 2011, 08:41:17 AM

I can tell you with full certainty that if anything was hacked, it was either at your email, or your computer itself. Even if a security flaw were in BTC Guild's database, the hash retrieved for your password is strongly salted. The salt cannot be retrieved without the person having shell access to the server, at which point they would certainly be going straight for the server's wallet, not users. Even if the salted passwords were pulled from the database, they would be useless in trying to access another site like MtGox.

I'm adding a "Revert to Prior Email" option right now so you can force the server to restore your original email address. I highly recommend you change your EMAIL PASSWORD if you haven't already. Given the attacker hit multiple sites, that is the common weakness.

Thanks. I just tried changing my email address but the same message popped up saying I need to wait 24 hours, perhaps the feature is not yet implemented. Yes, I think you are quite right with my email being the common weakness. I've since resetted my email pw and added secondary verification through cellphone text message to be able to login. It's more likely that I've been hit by a trojan/keylogger, but seeing that I did not visit any dodgey websites, I guess that I've been attacked via IP.

There is now a link titled "Reset to Prior Email" next to the change email button.

spyjai

newbie

Activity: 19

Merit: 0

Quote from: eleuthria on June 15, 2011, 08:41:17 AM

I can tell you with full certainty that if anything was hacked, it was either at your email, or your computer itself. Even if a security flaw were in BTC Guild's database, the hash retrieved for your password is strongly salted. The salt cannot be retrieved without the person having shell access to the server, at which point they would certainly be going straight for the server's wallet, not users. Even if the salted passwords were pulled from the database, they would be useless in trying to access another site like MtGox.

I'm adding a "Revert to Prior Email" option right now so you can force the server to restore your original email address. I highly recommend you change your EMAIL PASSWORD if you haven't already. Given the attacker hit multiple sites, that is the common weakness.

Thanks. I just tried changing my email address but the same message popped up saying I need to wait 24 hours, perhaps the feature is not yet implemented. Yes, I think you are quite right with my email being the common weakness. I've since resetted my email pw and added secondary verification through cellphone text message to be able to login. It's more likely that I've been hit by a trojan/keylogger, but seeing that I did not visit any dodgey websites, I guess that I've been attacked via IP.

eleuthria

legendary

Activity: 1750

Merit: 1007

Quote from: Nesetalis on June 15, 2011, 08:26:23 AM

seems useast is having major problems? can't see what my account stats are on the site, and last night was filled with invalid shares and longpoll errors.

The problem was actually US West being unable to connect to the other servers (US East being top on the list). It's been sorted out. Moving the website off of the US West pool server is still a project I'm working on, but right now other issues have taken priority.

eleuthria

legendary

Activity: 1750

Merit: 1007

Quote from: spyjai on June 15, 2011, 03:08:21 AM

URGENT NOTICE

When I tried logging in this morning to btcguild.com, I realised I couldn't do it. I then tried logging in mtgox.com as well with no success. I then tried logging in my gmail account which is tied to both mtgox and btcguild, and realised the password has been changed. I recovered my gmail password, which then I reset my btcguild.com password. When I log in to btcguild, I found that my email address has been changed (my prior email address with a "1" appended at the end of it, eg originally [email protected] became [email protected]), as well as my payout address has been changed. Luckily, I had payout lockout enabled so the hacker could not retrieve the funds yet. As of this moment, I'm still unable to recover my mtgox account password. I've sent in a help request through the support forum to freeze all my assets asap and I'm now waiting for their reply.

I urge everyone to change their mtgox and/or btcguild passwords asap, there may be some security vulnerabilities in either of these sites or my computer. I'm not sure whether I've been hacked or what, but everyone please becareful.

I can tell you with full certainty that if anything was hacked, it was either at your email, or your computer itself. Even if a security flaw were in BTC Guild's database, the hash retrieved for your password is strongly salted. The salt cannot be retrieved without the person having shell access to the server, at which point they would certainly be going straight for the server's wallet, not users. Even if the salted passwords were pulled from the database, they would be useless in trying to access another site like MtGox.

I'm adding a "Revert to Prior Email" option right now so you can force the server to restore your original email address. I highly recommend you change your EMAIL PASSWORD if you haven't already. Given the attacker hit multiple sites, that is the common weakness.

Topic: [~1000 GH/sec] BTC Guild - 0% Fee Pool, LP, SSL, Full Precision, and More - page 96. (Read 379078 times)