[ANN][AUTO-SWITCH] Profit-switch auto-exchange pool: CleverMining.com - page 113.

muchdogecpumine

newbie

Activity: 36

Merit: 0

Quote from: byt411 on April 24, 2014, 10:29:51 AM

Quote from: dragonmike on April 24, 2014, 10:24:59 AM

Quote from: muchdogecpumine on April 24, 2014, 10:04:43 AM

Is anybody else having trouble accessing their user page? I can connect to the other clevermining pages, but when I try to load my user page I get a 504 error.

same.

I can't even access the homepage. CloudFlare is working fine, so CleverMining might have gotten DDOSed? I thought the frontend couldn't be DDOSed, since CloudFlare is supposed to protect, but I guess there's still the possibility.

They really should post updates to their twitter or here. If the web page is down but stratum is up, we get a bit jumpy.

byt411

hero member

Activity: 798

Merit: 1000

Quote from: dragonmike on April 24, 2014, 10:24:59 AM

Quote from: muchdogecpumine on April 24, 2014, 10:04:43 AM

Is anybody else having trouble accessing their user page? I can connect to the other clevermining pages, but when I try to load my user page I get a 504 error.

same.

I can't even access the homepage. CloudFlare is working fine, so CleverMining might have gotten DDOSed? I thought the frontend couldn't be DDOSed, since CloudFlare is supposed to protect, but I guess there's still the possibility.

PCMiner

full member

Activity: 123

Merit: 100

Quote from: suchmoon on April 22, 2014, 11:17:02 PM

I noticed something amusing today. Can you spot a difference between these two fragments of cgminer logs:

Code:

[2014-04-23 04:08:23] Network diff set to 766
[2014-04-23 04:08:23] Stratum from pool 0 detected new block
[2014-04-23 04:09:00] Network diff set to 901
[2014-04-23 04:09:00] Stratum from pool 0 detected new block
[2014-04-23 04:09:14] Network diff set to 1.01K
[2014-04-23 04:09:14] Stratum from pool 0 detected new block
[2014-04-23 04:09:15] Network diff set to 314
[2014-04-23 04:09:15] Stratum from pool 0 detected new block
[2014-04-23 04:09:40] Network diff set to 288
[2014-04-23 04:09:40] Stratum from pool 0 detected new block
[2014-04-23 04:09:49] Network diff set to 299
[2014-04-23 04:09:49] Stratum from pool 0 detected new block
[2014-04-23 04:10:40] Network diff set to 317
[2014-04-23 04:10:40] Stratum from pool 0 detected new block
[2014-04-23 04:11:26] Network diff set to 319
[2014-04-23 04:11:26] Stratum from pool 0 detected new block
[2014-04-23 04:11:29] Network diff set to 325
[2014-04-23 04:11:29] Stratum from pool 0 detected new block

Code:

[2014-04-23 04:08:23] Network diff set to 766
[2014-04-23 04:08:23] Stratum from pool 0 detected new block
[2014-04-23 04:09:00] Network diff set to 901
[2014-04-23 04:09:00] Stratum from pool 0 detected new block
[2014-04-23 04:09:14] Network diff set to 1.01K
[2014-04-23 04:09:14] Stratum from pool 0 detected new block
[2014-04-23 04:09:18] Network diff set to 314
[2014-04-23 04:09:18] Stratum from pool 0 detected new block
[2014-04-23 04:09:39] Network diff set to 288
[2014-04-23 04:09:39] Stratum from pool 0 detected new block
[2014-04-23 04:09:48] Network diff set to 299
[2014-04-23 04:09:48] Stratum from pool 0 detected new block
[2014-04-23 04:10:40] Network diff set to 317
[2014-04-23 04:10:40] Stratum from pool 0 detected new block
[2014-04-23 04:11:25] Network diff set to 319
[2014-04-23 04:11:25] Stratum from pool 0 detected new block
[2014-04-23 04:11:29] Network diff set to 325
[2014-04-23 04:11:29] Stratum from pool 0 detected new block

The first one is from CleverMining, the second one from WafflePool (or maybe it's the other way around). Great minds think alike?

Actually what you are reading is from one pool, not from both. whichever one "pool 0" is in your settings is just reporting a change even if it's not the pool actively being mined on. I only figured this out (by accident) after having two machines side by side, one on a stable LTC pool with Clevermining as a fall over and the other on Clevermining with the LTC pool as it's backup. The network dif changes (in my case, from clevermining) were reporting instantly on both machines at the same time even though they were technically mining on different pools.

dragonmike

hero member

Activity: 1274

Merit: 556

Quote from: muchdogecpumine on April 24, 2014, 10:04:43 AM

Is anybody else having trouble accessing their user page? I can connect to the other clevermining pages, but when I try to load my user page I get a 504 error.

same.

muchdogecpumine

newbie

Activity: 36

Merit: 0

Is anybody else having trouble accessing their user page? I can connect to the other clevermining pages, but when I try to load my user page I get a 504 error.

Xenocyde

sr. member

Activity: 265

Merit: 250

Quote from: Kapz786 on April 24, 2014, 06:25:19 AM

Would really like a Hong Kong or Australian based server - get a lot of rejects at the moment Sad

You are getting fake rejects most likely. If you see "Untracked share" warning in your miner, then that's a fake reject. Real rejects rate is 1-2%.

Kapz786

hero member

Activity: 697

Merit: 503

Would really like a Hong Kong or Australian based server - get a lot of rejects at the moment Sad

Ibistru

full member

Activity: 129

Merit: 100

Quote from: Terk on April 23, 2014, 12:28:16 AM

Quote from: Ibistru on April 22, 2014, 01:17:29 PM

I have noticed that on this pool there is a long delay, several hours usually, before mined coins are exchanged for bitcoins.
My question is: doesn't this undermine the very concept of multi-coin mining, i.e. mining the coins that are most profitable in that moment? If you wait several hours before trading at the exchange don't you risk to lose profitability (or to take a loss)?

The pool marks coins as exchanged after they are withdrawn from exchanges plus three confirmations. Actual exchanging into BTC is done much earlier and is ongoing. Withdrawing is done few times per day and at this moment balances are marked as exchanged.

Thanks, this sounds reasonable and answers my question.

EDIT: you may wish to write this on the website, other people may wonder. Great job on your pool!

Monayman

newbie

Activity: 33

Merit: 0

Quote from: suchmoon on April 22, 2014, 11:17:02 PM

I noticed something amusing today. Can you spot a difference between these two fragments of cgminer logs:

Code:

[2014-04-23 04:08:23] Network diff set to 766
[2014-04-23 04:08:23] Stratum from pool 0 detected new block
[2014-04-23 04:09:00] Network diff set to 901
[2014-04-23 04:09:00] Stratum from pool 0 detected new block
[2014-04-23 04:09:14] Network diff set to 1.01K
[2014-04-23 04:09:14] Stratum from pool 0 detected new block
[2014-04-23 04:09:15] Network diff set to 314
[2014-04-23 04:09:15] Stratum from pool 0 detected new block
[2014-04-23 04:09:40] Network diff set to 288
[2014-04-23 04:09:40] Stratum from pool 0 detected new block
[2014-04-23 04:09:49] Network diff set to 299
[2014-04-23 04:09:49] Stratum from pool 0 detected new block
[2014-04-23 04:10:40] Network diff set to 317
[2014-04-23 04:10:40] Stratum from pool 0 detected new block
[2014-04-23 04:11:26] Network diff set to 319
[2014-04-23 04:11:26] Stratum from pool 0 detected new block
[2014-04-23 04:11:29] Network diff set to 325
[2014-04-23 04:11:29] Stratum from pool 0 detected new block

Code:

[2014-04-23 04:08:23] Network diff set to 766
[2014-04-23 04:08:23] Stratum from pool 0 detected new block
[2014-04-23 04:09:00] Network diff set to 901
[2014-04-23 04:09:00] Stratum from pool 0 detected new block
[2014-04-23 04:09:14] Network diff set to 1.01K
[2014-04-23 04:09:14] Stratum from pool 0 detected new block
[2014-04-23 04:09:18] Network diff set to 314
[2014-04-23 04:09:18] Stratum from pool 0 detected new block
[2014-04-23 04:09:39] Network diff set to 288
[2014-04-23 04:09:39] Stratum from pool 0 detected new block
[2014-04-23 04:09:48] Network diff set to 299
[2014-04-23 04:09:48] Stratum from pool 0 detected new block
[2014-04-23 04:10:40] Network diff set to 317
[2014-04-23 04:10:40] Stratum from pool 0 detected new block
[2014-04-23 04:11:25] Network diff set to 319
[2014-04-23 04:11:25] Stratum from pool 0 detected new block
[2014-04-23 04:11:29] Network diff set to 325
[2014-04-23 04:11:29] Stratum from pool 0 detected new block

The first one is from CleverMining, the second one from WafflePool (or maybe it's the other way around). Great minds think alike?

You had me spend a couple of minutes looking for the smallest discrepancy between both ... and then i gave up and read your final comment -_-

GolfCabalist

newbie

Activity: 36

Merit: 0

Quote from: jordo on April 23, 2014, 01:33:13 AM

Quote from: GolfCabalist on April 22, 2014, 03:04:40 PM

Quote from: boxofspuds on April 22, 2014, 01:18:09 AM

Quote from: GolfCabalist on April 22, 2014, 12:01:20 AM

Quote from: boxofspuds on April 21, 2014, 11:29:43 PM

so I may have missed this in the many pages here, but have we ever gotten an API?

The whole cloudflare/ddos protection stuff is nice to keep the pool up, but incredibly annoying for both checking hte pages and trying to write data scrapers to track my performance.

If there is no API (still) any one have any suggestions on how to scrape data from their miner pages? I cant seem to get around the cloudflare junk

I am having the same problem in trying to "data scrape" as you call it. I read on the CloudFlare site that their protection does not prevent web crawlers from scanning the site (so I am confident we can find a way to do it), and I'm thinking what I will try next is to write code to accept their cookie(s). Of course, my guess is worthless until I have it running.

What I unsuccessfully tried in php was to file_get_contents, then do a javascript setTimeout of 10 seconds, after which I do a window.location.reload.

hmmm, well i guess if they say web crawlers can scan it, there has to be a way. what's the link where you read this?

I went the python route a few weeks back, but got no where. After reading your post, i fired wireshark back up and it looks like there's a hidden form that needs some special key to return in order to let us through ... so I also think we'll need some code to accept their cookie/whatever and respond back similar to how a browser would. still kind of pain to grab some data Undecided

update: ok so i did some digging. got this from the cloudflare site:
Javascript and cookies are required for the tests, and to record the fact that the tests were correctly passed. The page which your visitors see when in IUAM can be fully customized to reflect your branding. I'm Under Attack mode does not block search engine crawlers or your existing CloudFlare whitelist.

My guess is they whitelisted known and allowed search engine crawlers which is why those bots work where as ours dont. Add to it that it looks like Terk opted to put the domain in a permanent I'm Under Attack Mode and we are where we are. So pretty much we need to mimic the expected behavior if we want anything to work ... lovely

I neednt link you now, your text is exactly what I read. I did not reach the conclusion that you did about the crawlers being whitelisted, thanks for helping me think! Wink

As to "kind of a pain", well, it would be worth it so I could get some sleep, I'm plain stupid about having to check every hour and enter data into a spreadsheet. Auto-reading from CM is the only missing link. I'm databasing the exchange rates of 5 different coins once every five minutes, making graphs, all automatically.

See https://github.com/jordoh/miner-monitor/blob/master/pools/clever_mining.rb#L84-L102 for ruby code. The basic process is:

1. Get the 503 page from CloudFlare - it contains a verification code (in the HTML) and simple equation to solve (in the JS).
2. Make a get request for http://www.clevermining.com/cdn-cgi/l/chk_jschl?jschl_vc=&jschl_answer= with the referer header set to the page you are trying to access. If you got the answer right, you'll a 302 (redirect) response with a cf_clearance cookie.
3. Follow the redirect (i.e. request the original page you were trying to access), including the cf_clearance cookie.

Jordo! Thanks 10^6.
I was getting the answer, but knew nothing about the cf_clearance cookie.
You take a huge risk putting yourself in a support position Wink

toxic0n

member

Activity: 413

Merit: 10

Quote from: jordo on April 23, 2014, 01:33:13 AM

Quote from: GolfCabalist on April 22, 2014, 03:04:40 PM

Quote from: boxofspuds on April 22, 2014, 01:18:09 AM

Quote from: GolfCabalist on April 22, 2014, 12:01:20 AM

Quote from: boxofspuds on April 21, 2014, 11:29:43 PM

so I may have missed this in the many pages here, but have we ever gotten an API?

The whole cloudflare/ddos protection stuff is nice to keep the pool up, but incredibly annoying for both checking hte pages and trying to write data scrapers to track my performance.

If there is no API (still) any one have any suggestions on how to scrape data from their miner pages? I cant seem to get around the cloudflare junk

I am having the same problem in trying to "data scrape" as you call it. I read on the CloudFlare site that their protection does not prevent web crawlers from scanning the site (so I am confident we can find a way to do it), and I'm thinking what I will try next is to write code to accept their cookie(s). Of course, my guess is worthless until I have it running.

What I unsuccessfully tried in php was to file_get_contents, then do a javascript setTimeout of 10 seconds, after which I do a window.location.reload.

hmmm, well i guess if they say web crawlers can scan it, there has to be a way. what's the link where you read this?

I went the python route a few weeks back, but got no where. After reading your post, i fired wireshark back up and it looks like there's a hidden form that needs some special key to return in order to let us through ... so I also think we'll need some code to accept their cookie/whatever and respond back similar to how a browser would. still kind of pain to grab some data Undecided

update: ok so i did some digging. got this from the cloudflare site:
Javascript and cookies are required for the tests, and to record the fact that the tests were correctly passed. The page which your visitors see when in IUAM can be fully customized to reflect your branding. I'm Under Attack mode does not block search engine crawlers or your existing CloudFlare whitelist.

My guess is they whitelisted known and allowed search engine crawlers which is why those bots work where as ours dont. Add to it that it looks like Terk opted to put the domain in a permanent I'm Under Attack Mode and we are where we are. So pretty much we need to mimic the expected behavior if we want anything to work ... lovely

I neednt link you now, your text is exactly what I read. I did not reach the conclusion that you did about the crawlers being whitelisted, thanks for helping me think! Wink

As to "kind of a pain", well, it would be worth it so I could get some sleep, I'm plain stupid about having to check every hour and enter data into a spreadsheet. Auto-reading from CM is the only missing link. I'm databasing the exchange rates of 5 different coins once every five minutes, making graphs, all automatically.

See https://github.com/jordoh/miner-monitor/blob/master/pools/clever_mining.rb#L84-L102 for ruby code. The basic process is:

1. Get the 503 page from CloudFlare - it contains a verification code (in the HTML) and simple equation to solve (in the JS).
2. Make a get request for http://www.clevermining.com/cdn-cgi/l/chk_jschl?jschl_vc=&jschl_answer= with the referer header set to the page you are trying to access. If you got the answer right, you'll a 302 (redirect) response with a cf_clearance cookie.
3. Follow the redirect (i.e. request the original page you were trying to access), including the cf_clearance cookie.

Thanks for this, I was looking into making an Android widget for CM and looks like I will have a way to do so.

rolk

newbie

Activity: 15

Merit: 0

Quote from: suchmoon on April 22, 2014, 11:17:02 PM

I noticed something amusing today. Can you spot a difference between these two fragments of cgminer logs:

The first one is from CleverMining, the second one from WafflePool (or maybe it's the other way around). Great minds think alike?

maybe clevermining joined wafflepool? Grin

jedimstr

hero member

Activity: 798

Merit: 1000

Quote from: slimdim on April 23, 2014, 01:42:27 AM

why there are no payments?

Last Payout 3 days ago

Ready For Payout 0.00440377 BTC

Per the Pool's "About" page:

Daily Payouts with 0.01 BTC minimum payout balance.
Additional weekly payout for small balances (0.001 BTC).

slimdim

full member

Activity: 140

Merit: 100

why there are no payments?

Last Payout 3 days ago

Ready For Payout 0.00440377 BTC

jordo

newbie

Activity: 1

Merit: 0

Quote from: GolfCabalist on April 22, 2014, 03:04:40 PM

Quote from: boxofspuds on April 22, 2014, 01:18:09 AM

Quote from: GolfCabalist on April 22, 2014, 12:01:20 AM

Quote from: boxofspuds on April 21, 2014, 11:29:43 PM

so I may have missed this in the many pages here, but have we ever gotten an API?

The whole cloudflare/ddos protection stuff is nice to keep the pool up, but incredibly annoying for both checking hte pages and trying to write data scrapers to track my performance.

If there is no API (still) any one have any suggestions on how to scrape data from their miner pages? I cant seem to get around the cloudflare junk

I am having the same problem in trying to "data scrape" as you call it. I read on the CloudFlare site that their protection does not prevent web crawlers from scanning the site (so I am confident we can find a way to do it), and I'm thinking what I will try next is to write code to accept their cookie(s). Of course, my guess is worthless until I have it running.

What I unsuccessfully tried in php was to file_get_contents, then do a javascript setTimeout of 10 seconds, after which I do a window.location.reload.

hmmm, well i guess if they say web crawlers can scan it, there has to be a way. what's the link where you read this?

I went the python route a few weeks back, but got no where. After reading your post, i fired wireshark back up and it looks like there's a hidden form that needs some special key to return in order to let us through ... so I also think we'll need some code to accept their cookie/whatever and respond back similar to how a browser would. still kind of pain to grab some data Undecided

update: ok so i did some digging. got this from the cloudflare site:
Javascript and cookies are required for the tests, and to record the fact that the tests were correctly passed. The page which your visitors see when in IUAM can be fully customized to reflect your branding. I'm Under Attack mode does not block search engine crawlers or your existing CloudFlare whitelist.

My guess is they whitelisted known and allowed search engine crawlers which is why those bots work where as ours dont. Add to it that it looks like Terk opted to put the domain in a permanent I'm Under Attack Mode and we are where we are. So pretty much we need to mimic the expected behavior if we want anything to work ... lovely

I neednt link you now, your text is exactly what I read. I did not reach the conclusion that you did about the crawlers being whitelisted, thanks for helping me think! Wink

As to "kind of a pain", well, it would be worth it so I could get some sleep, I'm plain stupid about having to check every hour and enter data into a spreadsheet. Auto-reading from CM is the only missing link. I'm databasing the exchange rates of 5 different coins once every five minutes, making graphs, all automatically.

See https://github.com/jordoh/miner-monitor/blob/master/pools/clever_mining.rb#L84-L102 for ruby code. The basic process is:

1. Get the 503 page from CloudFlare - it contains a verification code (in the HTML) and simple equation to solve (in the JS).
2. Make a get request for http://www.clevermining.com/cdn-cgi/l/chk_jschl?jschl_vc=&jschl_answer= with the referer header set to the page you are trying to access. If you got the answer right, you'll a 302 (redirect) response with a cf_clearance cookie.
3. Follow the redirect (i.e. request the original page you were trying to access), including the cf_clearance cookie.

Terk

hero member

Activity: 616

Merit: 522

Quote from: Ibistru on April 22, 2014, 01:17:29 PM

I have noticed that on this pool there is a long delay, several hours usually, before mined coins are exchanged for bitcoins.
My question is: doesn't this undermine the very concept of multi-coin mining, i.e. mining the coins that are most profitable in that moment? If you wait several hours before trading at the exchange don't you risk to lose profitability (or to take a loss)?

The pool marks coins as exchanged after they are withdrawn from exchanges plus three confirmations. Actual exchanging into BTC is done much earlier and is ongoing. Withdrawing is done few times per day and at this moment balances are marked as exchanged.

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

I noticed something amusing today. Can you spot a difference between these two fragments of cgminer logs:

Code:

[2014-04-23 04:08:23] Network diff set to 766
[2014-04-23 04:08:23] Stratum from pool 0 detected new block
[2014-04-23 04:09:00] Network diff set to 901
[2014-04-23 04:09:00] Stratum from pool 0 detected new block
[2014-04-23 04:09:14] Network diff set to 1.01K
[2014-04-23 04:09:14] Stratum from pool 0 detected new block
[2014-04-23 04:09:15] Network diff set to 314
[2014-04-23 04:09:15] Stratum from pool 0 detected new block
[2014-04-23 04:09:40] Network diff set to 288
[2014-04-23 04:09:40] Stratum from pool 0 detected new block
[2014-04-23 04:09:49] Network diff set to 299
[2014-04-23 04:09:49] Stratum from pool 0 detected new block
[2014-04-23 04:10:40] Network diff set to 317
[2014-04-23 04:10:40] Stratum from pool 0 detected new block
[2014-04-23 04:11:26] Network diff set to 319
[2014-04-23 04:11:26] Stratum from pool 0 detected new block
[2014-04-23 04:11:29] Network diff set to 325
[2014-04-23 04:11:29] Stratum from pool 0 detected new block

Code:

[2014-04-23 04:08:23] Network diff set to 766
[2014-04-23 04:08:23] Stratum from pool 0 detected new block
[2014-04-23 04:09:00] Network diff set to 901
[2014-04-23 04:09:00] Stratum from pool 0 detected new block
[2014-04-23 04:09:14] Network diff set to 1.01K
[2014-04-23 04:09:14] Stratum from pool 0 detected new block
[2014-04-23 04:09:18] Network diff set to 314
[2014-04-23 04:09:18] Stratum from pool 0 detected new block
[2014-04-23 04:09:39] Network diff set to 288
[2014-04-23 04:09:39] Stratum from pool 0 detected new block
[2014-04-23 04:09:48] Network diff set to 299
[2014-04-23 04:09:48] Stratum from pool 0 detected new block
[2014-04-23 04:10:40] Network diff set to 317
[2014-04-23 04:10:40] Stratum from pool 0 detected new block
[2014-04-23 04:11:25] Network diff set to 319
[2014-04-23 04:11:25] Stratum from pool 0 detected new block
[2014-04-23 04:11:29] Network diff set to 325
[2014-04-23 04:11:29] Stratum from pool 0 detected new block

The first one is from CleverMining, the second one from WafflePool (or maybe it's the other way around). Great minds think alike?

lk_qwerty

newbie

Activity: 4

Merit: 0

Quote from: mpalenciac on April 22, 2014, 09:00:17 PM

Quote from: lk_qwerty on April 22, 2014, 03:19:29 PM

based on a rough calculation it looks like there is about a 2-3% drag due to significantly aged unexchanged balances. do these ever work their way out, or should profitability be viewed from the perspective that not all balances will eventually be realized?

http://www.clevermining.com/balances

Sure they do, I've been mining at clevermining for a while and it's the best I've seen. I figure that this is caused by the huge hashrate and of course the huge volume, the volume of alts generated on a daily basis has to be incredible which is what shows how well this pool is, handling such a king sized volume of coins has to be quite challenging.

what is a reasonable time frame to expect? i was only looking at those older than 2 weeks, and there is a fair amount older than a month.

mpalenciac

full member

Activity: 168

Merit: 100

Quote from: lk_qwerty on April 22, 2014, 03:19:29 PM

based on a rough calculation it looks like there is about a 2-3% drag due to significantly aged unexchanged balances. do these ever work their way out, or should profitability be viewed from the perspective that not all balances will eventually be realized?

http://www.clevermining.com/balances

Sure they do, I've been mining at clevermining for a while and it's the best I've seen. I figure that this is caused by the huge hashrate and of course the huge volume, the volume of alts generated on a daily basis has to be incredible which is what shows how well this pool is, handling such a king sized volume of coins has to be quite challenging.

lk_qwerty

newbie

Activity: 4

Merit: 0

based on a rough calculation it looks like there is about a 2-3% drag due to significantly aged unexchanged balances. do these ever work their way out, or should profitability be viewed from the perspective that not all balances will eventually be realized?

http://www.clevermining.com/balances

Topic: [ANN][AUTO-SWITCH] Profit-switch auto-exchange pool: CleverMining.com - page 113. (Read 554401 times)