Is bitcoinfees.earn.com systematically overestimating fees? - page 2.

TheQuin

hero member

Activity: 2576

Merit: 883

Freebitco.in Support https://bit.ly/2I9BVS2

Quote from: Thirdspace on February 24, 2018, 06:41:27 PM

bitcoinfees.earn.com, I don't know which mempool source they used to estimate the fee
I think last december/january high tx fee rate was the product of misplaced trust in bitcoinfees.earn.com estimation fee

I'm not certain but I'm guessing they are running their own node.

Quote from: squatter on February 25, 2018, 05:06:00 AM

Quote from: jtipt on February 25, 2018, 12:56:43 AM

Seems like someone at bitcoinfees.earn.com saw this thread, because they have now lowered the recommended fees to 10 sat/byte like everyone else.

You'd still be overpaying by following them. It looks like 10 sat/byte is the lowest they estimate -- they round to the top of each fee range and it jumps from 0 to 1-10. That's pretty annoying during low fee periods like this.

None of the estimators are great. I sent an urgent transaction earlier today during an apparent traffic spike. Core estimated the next-block fee ~ 65 sat/byte. Earn.com estimated it at 100 sat/byte. I sent it ~ 20 sat/byte and it got confirmed in the next block. I should have checked the most recent blocks; 1-2 sat/byte transactions were confirming.

Core seems pretty slow to react to drops in mempool size. But earn.com seems slower, by hours.

Right now the mempool is completely empty and miners can't find enough transactions to fill the blocks but earn.com still shows many transactions queued up at high fees.

https://i.snag.gy/rEwRaU.jpg

squatter

legendary

Activity: 1666

Merit: 1196

STOP SNITCHIN'

Quote from: jtipt on February 25, 2018, 12:56:43 AM

Seems like someone at bitcoinfees.earn.com saw this thread, because they have now lowered the recommended fees to 10 sat/byte like everyone else.

You'd still be overpaying by following them. It looks like 10 sat/byte is the lowest they estimate -- they round to the top of each fee range and it jumps from 0 to 1-10. That's pretty annoying during low fee periods like this.

None of the estimators are great. I sent an urgent transaction earlier today during an apparent traffic spike. Core estimated the next-block fee ~ 65 sat/byte. Earn.com estimated it at 100 sat/byte. I sent it ~ 20 sat/byte and it got confirmed in the next block. I should have checked the most recent blocks; 1-2 sat/byte transactions were confirming.

Core seems pretty slow to react to drops in mempool size. But earn.com seems slower, by hours.

jtipt

hero member

Activity: 1050

Merit: 529

Seems like someone at bitcoinfees.earn.com saw this thread, because they have now lowered the recommended fees to 10 sat/byte like everyone else.

Thirdspace

hero member

Activity: 1232

Merit: 738

Mixing reinvented for your privacy | chipmixer.com

"Is bitcoinfees.earn.com systematically overestimating fees?"
It looks just like that!
https://btc.com/stats/unconfirmed-tx 1 Satoshis/vbyte | 0.00001 BTC/KvB
https://bitcoinfees.earn.com/ 90 satoshis/byte
https://coinb.in/#fees 1 Sat/Byte

btc.com uses his own mempool to estimate the recommended fee
coinb.in uses specific tx fee rate used in recent block (previous ~3 blocks)
bitcoinfees.earn.com, I don't know which mempool source they used to estimate the fee
I think last december/january high tx fee rate was the product of misplaced trust in bitcoinfees.earn.com estimation fee

TheQuin

hero member

Activity: 2576

Merit: 883

Freebitco.in Support https://bit.ly/2I9BVS2

Quote from: ?? on ??

bitcoinfees.earn.com is great website, the only problem is they give recommendation fee for very fast confirmation a.k.a next-block confirmation after broadcast the transaction. Also, i think the data isn't real time since they mentioned that "The predictions are based on blockchain data of the last 3 hours, as well as the current pool of unconfirmed transactions (mempool)." which cause the problem you mentioned.

I think simply see their vertical bar and choose lowest fees with fastest delay 1 block is good enough for everyday usage.

But just have a look at the images I posted above. The data in those bars doesn't match what the miners are doing. They have old transactions that are not getting confirmed that stay in those bars and make the estimate you can make wrong.

Stedsm

legendary

Activity: 3052

Merit: 1273

I believe this is probably getting done ON-PURPOSE only, else there's no reason as to why would they keep showing the charts with more than 10 sats/byte (or even more comparatively) to be sent in a transaction to get it confirmed early, while those with even 3-5 sats/byte are getting involved in the next block after they were done. I don't follow Bitcoinfees anymore because the one you gave me - https://jochen-hoenicke.de/queue/#1,2h seems to be providing with the best estimates needed for me to save a lot in my transaction fees.

Samarkand

sr. member

Activity: 658

Merit: 282

Quote from: LoyceV on February 21, 2018, 12:16:47 PM

...
A better alternative (far more accurate): https://coinb.in/#fees

This has become my new favourite now. Note that you can still go under the recommended if you don't need it confirmed within the next few blocks.

...

The fee estimator by coinb.in is great!

However, I think that the following fee estimator is even better:
https://whatthefee.io/

Quote

If you use CELL feerate (sat/vbyte) you will have 1+ confirmations after at
most ROW time with at least COLUMN % certainty.

TheQuin

hero member

Activity: 2576

Merit: 883

Freebitco.in Support https://bit.ly/2I9BVS2

Update on this. Currently, the mining pools are not finding enough transactions to fill blocks, the mempool is empty as far as they are concerned.

Image loading.. (maybe)...

But bitcoinfees.earn.com is still showing many transactions in their mempool including a lot at high fees.

Image loading.. (maybe)...

I'm pretty convinced that setting the mempool to keep transactions for 14 days must be inconsistent with the settings used by the mining pools and this is a large part of what is causing them to consistently overestimate fees.

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

I've seen several fee estimating website give very high estimates. I can't help but think some of them might have some financial gains from high fees as a motivator (aka miners).

Quote from: OmegaStarScream on February 21, 2018, 05:01:24 AM

A better alternative (far more accurate): https://coinb.in/#fees

This has become my new favourite now. Note that you can still go under the recommended if you don't need it confirmed within the next few blocks.

I try to pay as little as possible for two reasons:
1. safe money
2. don't join the fee war by making all fees higher, after which we all still wait.

It's amazing 2 sat/byte is enough now for a fast transaction, in December and January many transactions with even 600 sat/byte got stuck for days.

Bitcoin Core's estimate is 1.177 sat/byte to confirm within 24 hours. For 20 minutes, it estimates 5.4 sat/byte, still more than coinb's recommendation.

TheQuin

hero member

Activity: 2576

Merit: 883

Freebitco.in Support https://bit.ly/2I9BVS2

Quote from: buwaytress on February 21, 2018, 05:35:52 AM

Note that they keep the data in two ranges... the first bar is for 14 days (336 hours) and the second is for 1 day (24 hours) so the data will stay there for a while. Maybe they're doing it on purpose, maybe they just use a different, less flexible dataset. I wouldn't know.

The first bar is what is in the mempool, ie. what is queued up waiting to be confirmed. How long a transaction is held in a node's mempool is configurable so they're just telling you that theirs is set to 14 days. If you look on https://www.blocktrail.com/BTC, for example, they always show a smaller number of transactions queued because they set theirs to kick out anything older than 3 days.

The second bar is the number of transactions that have been confirmed in the last 24hrs. That figure would be the same anywhere regardless of how the mempool is configured, everyone gets the same blockchain.

So what I'm seeing here is queued transactions not being confirmed even though they have higher fees than transactions than those that are being confirmed.

jseverson

hero member

Activity: 1834

Merit: 759

I also use it exclusively for my transactions and have never run into problems. I only ever use it to see how much people are paying for their transactions though, and have never once followed their recommended fee. I always assumed that that was just for people who absolutely needed to confirm their transactions by the next block, which is why it's as absurd as it is. The hourFee figure in their API seems to provide a much more reasonable estimate at 10 sats/byte, but it's still quite high for the current volume, and could actually be enough to confirm a transaction by the next block.

For what it's worth, I've never seen their graph look like that, but I don't rule out the possibility that they may be trying to inflate fees.

Quote from: OmegaStarScream on February 21, 2018, 05:01:24 AM

https://coinb.in/#fees

Will probably use this from now on, thanks!

buwaytress

legendary

Activity: 3010

Merit: 3724

Join the world-leading crypto sportsbook NOW!

Quote from: TheQuin on February 21, 2018, 04:02:15 AM

I've been intrigued for some time as to why the recommended fee on bitcoinfees.earn.com is usually at least 10 times what you really need to pay to get included in the next block. Over the last few days, I've noticed that they show about 600 transactions at 211+ and about another 650 at 141-150. After each block is found these do not disappear.

This screenshot was taken immediately after a block which included many transactions at 5 sats/byte.

Image loading....

These transactions are not shown on https://jochen-hoenicke.de/queue/#1,2h

So as every node has its own version of the mempool these transactions for some reason must not be getting propagated around the network. Obviously, if the data they are using to estimate fees has 1200 high fee transactions that cannot get confirmed then their estimate is going to be much higher than it needs to be.

How does this happen? Is this a bug?

Bitcoinfees has been my most-used estimator and has always been very accurate in helping me estimate a good fee to pay (I seldom seek next-block confirmation). However, someone (DH I think) correctly pointed out a few weeks ago that their "fastest and cheapest fee" is far above what is actually efficient. I don't recommend to use it anymore, but their raw numbers still look pretty good to me.

Note that they keep the data in two ranges... the first bar is for 14 days (336 hours) and the second is for 1 day (24 hours) so the data will stay there for a while. Maybe they're doing it on purpose, maybe they just use a different, less flexible dataset. I wouldn't know.

Quote from: OmegaStarScream on February 21, 2018, 05:01:24 AM

It could be done on purpose because as far as I can remember, their suggested fees were always high compared to what you actually need to pay to get your transaction confirmed so If it was a technical issue, they would've figured it out already. A better alternative (far more accurate): https://coinb.in/#fees

I think when I first started using it, it was pretty okay, but never paid attention to their recommended fees, just used the bars to estimate manually. But yeah, it's been pointed out for a while now so they've had plenty of time to fix it. Negligence or deliberation?

And yeah, coinb.in seems to be the better alternative now!

TheQuin

hero member

Activity: 2576

Merit: 883

Freebitco.in Support https://bit.ly/2I9BVS2

I was trying to stay away from the tinfoil hat route of them doing it on purpose, although I do acknowledge that anything is possible. Personally, I like to work out fees from https://jochen-hoenicke.de/queue/#1,2h as it is really easy to see what is included in each block and if there is a trend up or down. I'll even admit that the estimated fee on BTC.COM is pretty reliable for anyone who doesn't want to get involved with working it out.

I've been watching this for a while and I'm just trying to work out any technical explanation for their mempool to have all these transactions seemly stuck and not being propagated around the network.

OmegaStarScream

staff

Activity: 3500

Merit: 6152

It could be done on purpose because as far as I can remember, their suggested fees were always high compared to what you actually need to pay to get your transaction confirmed so If it was a technical issue, they would've figured it out already. A better alternative (far more accurate): https://coinb.in/#fees

TheQuin

hero member

Activity: 2576

Merit: 883

Freebitco.in Support https://bit.ly/2I9BVS2

I've been intrigued for some time as to why the recommended fee on bitcoinfees.earn.com is usually at least 10 times what you really need to pay to get included in the next block. Over the last few days, I've noticed that they show about 600 transactions at 211+ and about another 650 at 141-150. After each block is found these do not disappear.

This screenshot was taken immediately after a block which included many transactions at 5 sats/byte.

Image loading....

These transactions are not shown on https://jochen-hoenicke.de/queue/#1,2h

So as every node has its own version of the mempool these transactions for some reason must not be getting propagated around the network. Obviously, if the data they are using to estimate fees has 1200 high fee transactions that cannot get confirmed then their estimate is going to be much higher than it needs to be.

How does this happen? Is this a bug?

Topic: Is bitcoinfees.earn.com systematically overestimating fees? - page 2. (Read 548 times)