Pages:
Author

Topic: Avalon batch [2] countdown! - page 51. (Read 141540 times)

legendary
Activity: 1246
Merit: 1002
May 19, 2013, 11:45:41 PM
I believe this would be a better graph to look at. The purple line is the 3-day estimate. For the period I brought up (May 13-16) it is a lot more coherent. The slow decline bet. May 14 and May 19 could be the FPGAs being turned off. Pools like BTC Guild are kicking them all out at this point because they cannot use the stratum servers and they want to switch off their getwork servers (old stuff).

[ ... ]

Even a three day estimate is too short. The 14 day window estimate is more useful.

Thing is, that to create such massive changes in the network you need a large number of people in different timezones to act at exactly the same time. That drop looks to be about 10 Thps - it's more likely that this drop is due at least in part to variance, rather than 12500 800Mhps FPGAs being switched off.

What you say might be possible, but it is by no means even close to being provable.


It could be a combination of ASICs coming offline (Avalon mining with batch#2 before shipping them on the 13th), then online (people receiving them and turning them on) and all at the same time FPGAs leaving the pools. Long shot for an explanation but something seems the have been going on in that period.





People mining alt coins?
member
Activity: 95
Merit: 10
May 19, 2013, 11:43:51 PM
I believe this would be a better graph to look at. The purple line is the 3-day estimate. For the period I brought up (May 13-16) it is a lot more coherent. The slow decline bet. May 14 and May 19 could be the FPGAs being turned off. Pools like BTC Guild are kicking them all out at this point because they cannot use the stratum servers and they want to switch off their getwork servers (old stuff).

[ ... ]


Even a three day estimate is too short. The 14 day window estimate is more useful.

Thing is, that to create such massive changes in the network you need a large number of people in different timezones to act at exactly the same time. That drop looks to be about 10 Thps - it's more likely that this drop is due at least in part to variance, rather than 12500 800Mhps FPGAs being switched off.

What you say might be possible, but it is by no means even close to being provable.


It could be a combination of ASICs coming offline (Avalon mining with batch#2 before shipping them on the 13th), then online (people receiving them and turning them on) and all at the same time FPGAs leaving the pools. Long shot for an explanation but something seems the have been going on in that period.




donator
Activity: 2058
Merit: 1007
Poor impulse control.
May 19, 2013, 11:41:21 PM
Geek humor. Never mind any of that.  Grin

Are you posting your graphs somewhere?

Are you saying I'm not geek enough? I want satisfaction, sir!

organofcorti.blogspot.com is where I post most of my odds and ends. Unfortunately I don't have sufficient web-fu to make a website that would serve a real time network hashrate chart though.
donator
Activity: 2058
Merit: 1007
Poor impulse control.
May 19, 2013, 11:39:02 PM
I believe this would be a better graph to look at. The purple line is the 3-day estimate. For the period I brought up (May 13-16) it is a lot more coherent. The slow decline bet. May 14 and May 19 could be the FPGAs being turned off. Pools like BTC Guild are kicking them all out at this point because they cannot use the stratum servers and they want to switch off their getwork servers (old stuff).

[ ... ]

Even a three day estimate is too short. The 14 day window estimate is more useful.

Thing is, that to create such massive changes in the network you need a large number of people in different timezones to act at exactly the same time. That drop looks to be about 10 Thps - it's more likely that this drop is due at least in part to variance, rather than 12500 800Mhps FPGAs being switched off.

What you say might be possible, but it is by no means even close to being provable.






member
Activity: 95
Merit: 10
May 19, 2013, 11:32:47 PM
Geek humor. Never mind any of that.  Grin

Are you posting your graphs somewhere?
donator
Activity: 2058
Merit: 1007
Poor impulse control.
May 19, 2013, 11:30:21 PM
So, would you say the approach below would be a better way to determine the hash rate?
This of course takes into account the maximum likelihood. L() is in fact the likelihood function. I've always been terrible with statistical models but this one may give you a more coherent distribution than Poisson's which smells really fishy wink wink



 Tongue



Can you explain how the above likelihood function would help? I'm not sure I follow.

Here's how I understand estimates of the network hashrate:

Firstly, if the network hashrate is unchanging then the number of blocks per unit time is Poisson distributed.

Any hash has the same chance of being sufficiently under target to solve a block, the number of hashes per block is geometrically distributed, with p = 1/target. Since p is extremely small we can approximate this quite closely using the exponential distribution. Assuming the hashrate doesn't change, then the amount of time between block solves is exponentially distributed, and thus the block solving process is a Poisson process.

However the block solved rate changes, sometimes significantly, between any two retargets. This makes the process a non-homogenous Poisson process.

So you can calculate the hashrate from the number of blocks per time, or the inverse of the amount time per block/s, and use confidence intervals based on whichever method you used (Poisson distribution for blocks per time, Erlang distribution for amount time per block/s).

My own method is to use a non-parametric smoothing spline. I then time stretch the data so that the smoothing spline is 12 blocks every two hours and optimize such that all of the actual two hourly hashrate are Poisson distributed random variables with a mean rate of 12.

member
Activity: 95
Merit: 10
May 19, 2013, 11:25:34 PM
Very simple. I've been looking here for the network hashrate without thinking much of it:

http://bitcoincharts.com/bitcoin

legendary
Activity: 1246
Merit: 1002
May 19, 2013, 11:19:53 PM

Again, no. Sorry! This is all very tricky and I suggest you read about non-homogenous Poisson processes and the geometric distribution. Variance will increase as the hashrate increases, but it will remain a nearly constant proportion of the hashrate.


Now you're just throwing crazy words out there left and right! Do you realize how much time it would take someone to google all these words?

  • non-homogenous
  • Poisson processes
  • geometric distribution
  • Variance

 Grin

Is there any reason you chose the most extreme values in the red graph, when you also had the choice of some more moderate values in the green graph, when you were trying to understand what was happening?



Neither of them should be used. Did you quote the wrong person?


Yeah.  I meant josh_nc.  I'm more interested in why he made his choices, vis-a-vie interpreting such random things as "the hockey stick" than I am a high finess resolution of which model is best.

member
Activity: 95
Merit: 10
May 19, 2013, 11:11:16 PM
I believe this would be a better graph to look at. The purple line is the 3-day estimate. For the period I brought up (May 13-16) it is a lot more coherent. The slow decline bet. May 14 and May 19 could be the FPGAs being turned off. Pools like BTC Guild are kicking them all out at this point because they cannot use the stratum servers and they want to switch off their getwork servers (old stuff).

donator
Activity: 2058
Merit: 1007
Poor impulse control.
May 19, 2013, 11:05:49 PM

Again, no. Sorry! This is all very tricky and I suggest you read about non-homogenous Poisson processes and the geometric distribution. Variance will increase as the hashrate increases, but it will remain a nearly constant proportion of the hashrate.


Now you're just throwing crazy words out there left and right! Do you realize how much time it would take someone to google all these words?

  • non-homogenous
  • Poisson processes
  • geometric distribution
  • Variance

 Grin

Is there any reason you chose the most extreme values in the red graph, when you also had the choice of some more moderate values in the green graph, when you were trying to understand what was happening?



Neither of them should be used. Did you quote the wrong person?
legendary
Activity: 1246
Merit: 1002
May 19, 2013, 10:58:31 PM

Again, no. Sorry! This is all very tricky and I suggest you read about non-homogenous Poisson processes and the geometric distribution. Variance will increase as the hashrate increases, but it will remain a nearly constant proportion of the hashrate.


Now you're just throwing crazy words out there left and right! Do you realize how much time it would take someone to google all these words?

  • non-homogenous
  • Poisson processes
  • geometric distribution
  • Variance

 Grin

Is there any reason you chose the most extreme values in the red graph, when you also had the choice of some more moderate values in the green graph, when you were trying to understand what was happening?

member
Activity: 95
Merit: 10
May 19, 2013, 10:29:34 PM
Corrected above.

Mind you this can always be skewed by tweaking with localization functors and realified global structures... but I wouldn't advise this method as it is prone to cause too much bias from the mean deviation.  Shocked
donator
Activity: 2058
Merit: 1007
Poor impulse control.
May 19, 2013, 10:27:35 PM

L(\theta|X,Y) = \prod_{i=1}^m \frac{e^{y_i \theta' x_i} e^{-e^{\theta' x_i}}}{y_i!}

 Tongue



I don't read mathjax or laTeX or whatever - mind rephrasing in something both I and SMF understand? Smiley
member
Activity: 95
Merit: 10
May 19, 2013, 10:19:50 PM

Again, no. Sorry! This is all very tricky and I suggest you read about non-homogenous Poisson processes and the geometric distribution. Variance will increase as the hashrate increases, but it will remain a nearly constant proportion of the hashrate.


Now you're just throwing crazy words out there left and right! Do you realize how much time it would take someone to google all these words?


 Grin

Dammit! You caught me out. I was of course pulling all those words out of my butt Wink

So, would you say the approach below would be a better way to determine the hash rate?
This of course takes into account the maximum likelihood. L() is in fact the likelihood function. I've always been terrible with statistical models but this one may give you a more coherent distribution than Poisson's which smells really fishy wink wink



 Tongue

member
Activity: 114
Merit: 10
Find a Way or Make One
May 19, 2013, 09:46:22 PM
It all sounds like abracadabra to me......  Grin

You think that's abracadabra.. try this. http://www.kurims.kyoto-u.ac.jp/~motizuki/Inter-universal%20Teichmuller%20Theory%20II.pdf

Apparently he could be Satoshi.

OMG (mathematics)  Roll Eyes  Roll Eyes  Roll Eyes
sr. member
Activity: 294
Merit: 250
May 19, 2013, 07:51:18 PM
It all sounds like abracadabra to me......  Grin

You think that's abracadabra.. try this. http://www.kurims.kyoto-u.ac.jp/~motizuki/Inter-universal%20Teichmuller%20Theory%20II.pdf

Apparently he could be Satoshi.

My brain started hurting just reading the title on that thing.

It's actually a 4 part series; the one I linked is part 2. Apparently no one could really understand it either.
hero member
Activity: 956
Merit: 1001
May 19, 2013, 07:39:19 PM
It all sounds like abracadabra to me......  Grin

You think that's abracadabra.. try this. http://www.kurims.kyoto-u.ac.jp/~motizuki/Inter-universal%20Teichmuller%20Theory%20II.pdf

Apparently he could be Satoshi.

My brain started hurting just reading the title on that thing.
sr. member
Activity: 294
Merit: 250
May 19, 2013, 07:20:41 PM
It all sounds like abracadabra to me......  Grin

You think that's abracadabra.. try this. http://www.kurims.kyoto-u.ac.jp/~motizuki/Inter-universal%20Teichmuller%20Theory%20II.pdf

Apparently he could be Satoshi.
newbie
Activity: 44
Merit: 0
May 19, 2013, 06:21:19 PM
It all sounds like abracadabra to me......  Grin
donator
Activity: 2058
Merit: 1007
Poor impulse control.
May 19, 2013, 05:52:52 PM

Again, no. Sorry! This is all very tricky and I suggest you read about non-homogenous Poisson processes and the geometric distribution. Variance will increase as the hashrate increases, but it will remain a nearly constant proportion of the hashrate.


Now you're just throwing crazy words out there left and right! Do you realize how much time it would take someone to google all these words?


 Grin

Dammit! You caught me out. I was of course pulling all those words out of my butt Wink
Pages:
Jump to: