Pages:
Author

Topic: Summarizing issues in the bitcoin community and how to address them. (Read 316 times)

hero member
Activity: 862
Merit: 662
More of 80% of the pending transacction on mempool are dust.

Well that is actually anoying i did a small sampling from the mempool pending TXs and I count only those with one input, one ouput and output value less than 600 satoshis, and more of the 80% of those match with this criteria.


Here is the code that i used was:

Code:
import sys
import json
import math
import time
import random
import requests

def round_up_to_decimals(number, decimals):
    factor = 10 ** decimals
    rounded_number = math.ceil(number * factor) / factor
    return rounded_number

def get_tx(txid):
    tx = None
    try:
        url = ""
        if networkname=="bitcoin":
            url = "https://mempool.space/api/tx/" + txid
        elif networkname=="testnet":
            url = "https://mempool.space/testnet/api/tx/" + txid
        else:
            print("Unknow network")
            exit()
        response = requests.get(url)
        if response.status_code == 200:
            tx = response.json()
            return tx
        else:
            return tx
    except Exception as e:
        print(f"An error occurred: {e}")
        return tx

def get_mempool_txids():
    time.sleep(0.01)
    txids = []
    try:
        url = ""
        if networkname=="bitcoin":
            url = "https://mempool.space/api/mempool/txids"
        elif networkname=="testnet":
            url = "https://mempool.space/testnet/api/mempool/txids"
        else:
            print("Unknow network")
            exit()
        response = requests.get(url)
        if response.status_code == 200:
            txids = response.json()
            return txids
    except Exception as e:
        print(f"An error occurred: {e}")
        return txids
       
networkname = "bitcoin"
print("Downloading mempool txids list")
txids = get_mempool_txids()
# Save in to file optional
#print("Saving file....")
#with open("mempooltxids.txt", "w") as file:
#    file.writelines("%s\n" % txid for txid in txids)
if len(txids) == 0:
    print("Error getting mempool TX")
print(f"Total TX on mempool: {len(txids)}")
dust_counter = 0
total_counter = 0
for i in range(0,1000):
    txid = random.choice(txids)
    tx = get_tx(txid)
    if(tx is None):
        print(f"Error")
        dust_percentage = 100 * (round_up_to_decimals(dust_counter/total_counter,4))
        print(f"\nTotal dust tx found {dust_counter} of {total_counter}: %{dust_percentage}")
        exit()
    if(len(tx['vin']) == 1 and len(tx['vout']) == 1 and tx['vout'][0]['value'] < 600):
        dust_counter += 1
    #txids.remove(txid)
    total_counter += 1
    print(".",end="")
    sys.stdout.flush()
dust_percentage = 100 * (round_up_to_decimals(dust_counter/total_counter,2))
print(f"\nTotal dust txs found {dust_counter} of {total_counter}: %{dust_percentage}")


Output:
Code:
albertobsd:~$ python3 count_dust_tx_mempool.py
Downloading mempool txids list
Saving file....
Total TX on mempool: 564411
...
Total dust txs found 855 of 1000: %85.5

According to the Mempool.space API documentation:

Quote
GET Mempool Transaction IDs
Get the full list of txids in the mempool as an array. The order of the txids is arbitrary and does not match bitcoind.

I use random choice in python

Quote
The choice() method returns a randomly selected element from the specified sequence.

So in general this problem may get worse in the future if the ordinals don't stop their SPAM

legendary
Activity: 3234
Merit: 5637
Blackjack.fun-Free Raffle-Join&Win $50🎲
So you really think $0.65 is too expensive for the average Joe? The one who cannot pay that amount for the transaction has much bigger problems than the current situation with mempool...

average joe is not part of the the hundreds of millions of "first worlders" but the multi billion populous of "3rd worlders"

you might want to check minimum wage amounts of the average joe

after all bitcoin was made for the unbanked not the elitists


I thought that Bitcoin was made for everyone who wants an alternative to the existing system, but it is not Satoshi's fault that those who are unbanked are still mostly the same ones who do not have access to the Internet, and therefore neither to Bitcoin.

Regarding the minimum wages, I know people work for only a few $ in Venezuela, or a few tens of $ in some African countries, but they can't even afford BTC, so I wonder if it makes a difference if the fee is $0.10 or $0.60?
legendary
Activity: 2422
Merit: 1191
Privacy Servers. Since 2009.
OP, I very much appreciate your post--you didn't explain a lot of things in detail, but that's OK because I came away from reading it with a lot of questions about terms I've seen in various places but never bothered to learn the meaning of.  That's me being relatively stupid and incredibly lazy (typical me).

But god I love legacy addresses.  Am I the only one?  I can't be, even though I do understand some of the drawbacks.

after all bitcoin was made for the unbanked not the elitists
I never read bitcoin's whitepaper or even what was written way back when about its "true purpose" but I'd agree that the unbanked population is who it should be for.  Unfortunately, here we are in 2023 and it hasn't really turned out that way.

The real issue that they are themselves to blame for this situation in a way. But perhaps many of them don't need a bank account? If you are facing issues like hunger, thirst, homelessness, poverty, war, abuse, extreme weather etc lack of bank account is not your #1 priority in life.    Shocked
hero member
Activity: 784
Merit: 672
Top Crypto Casino

average joe is not part of the the hundreds of millions of "first worlders" but the multi billion populous of "3rd worlders"

you might want to check minimum wage amounts of the average joe

after all bitcoin was made for the unbanked not the elitists

Well, I agree with you the ones in third world countries can be considered as average joe because they hardly earn enough to fulfill their basic needs. However, I still think that Bitcoin wasn't made for the unbanked ones only but it was made for everyone. The banked users and the unbanked users both can benefit from Bitcoin, and I must say that elitists are also into Bitcoin and we can't ignore that thing. The Bitcoin was mostly created to solve the issue that users faced with regulatory authorities, but now most people consider it as an asset.

@OP I believe that the highest priority issue with Bitcoin blockchain is network congestion and whether it happens due to Ordinals or due to something else but it's really the highest priority problem for the whole community. The network congestion increases the transaction fees to very high levels and many people get scared due to high transaction fees. The most important issue to address should be the network congestion issue and we must have to find a better solution in order to avoid that issue. We are mostly trapped because of the limited size of Bitcoin blockchain block size of just 1 MB and that's why we can't really do anything to solve the issue right now, but who knows that there may be a better solution for the issue in future.


legendary
Activity: 3500
Merit: 6981
Top Crypto Casino
OP, I very much appreciate your post--you didn't explain a lot of things in detail, but that's OK because I came away from reading it with a lot of questions about terms I've seen in various places but never bothered to learn the meaning of.  That's me being relatively stupid and incredibly lazy (typical me).

But god I love legacy addresses.  Am I the only one?  I can't be, even though I do understand some of the drawbacks.

after all bitcoin was made for the unbanked not the elitists
I never read bitcoin's whitepaper or even what was written way back when about its "true purpose" but I'd agree that the unbanked population is who it should be for.  Unfortunately, here we are in 2023 and it hasn't really turned out that way.
hero member
Activity: 862
Merit: 662
Ps: you said you did not found any topic related ro this issue and now I think i am reading your reply late while I already read 3 topics on this issue before reading yours.

The thing that i didn't found was a topic about the current problems, issues or things that may affect to the bitcoin ecosystem.
legendary
Activity: 2422
Merit: 1191
Privacy Servers. Since 2009.
Guys, it seems to me you're focusing on ordinals too much. This thread is named "Summarizing issues in the bitcoin community and how to address them", OP just mentioned ordinals as an example of a Bitcoin issue. Remember that bad publicity is still publicity so you're in fact promoting the damn thing. Just let it die natural death.  Cool
hero member
Activity: 1414
Merit: 670
This is actually a very helpful post. Most of the time, there are a bunch of us who lose track of the current events and issues surrounding the Bitcoin community, especially those who are only treating Bitcoin as a side investment, hence having this post we will be able to just go here and update ourselves. Knowing the current issues and possible ways to address them are also a good way for beginners to get themselves familiar with and ready as they learn more about Bitcoin, it also shows them the reality of the Bitcoin community, that it is not perfect and there are some risks to deal with. Hence, I will surely save this post and get back to this as more updates are made, especially when I feel like I am losing track of the things happening in the community. And perhaps I'll add some of my own ways in addressing these issues.
Actually this is not something new instead it was a issue initiated way before when the Ordinals came into being. This is just starting to cause problems again. To be honest I was now aware of the whole story before but after reading some topics related to this issue I also aware of this know and you are right just like you I also cane to know about such issue due to this forum as members here are really active. And they all are sharing insightful ideas too, to solve the problems.

Currently, the only issue to BTC blockchain is due to Ordinals but there are many other issues which BTC needs to solve them.
How are we going to beat the reptilians when monkeys are kicking our ass? You should read this new thread and also read some replies to get better ideas about which issues BTC is facing and which issues need instant solutions.

The solutions which OP had mentioned in his post,  are definitely not enough but that's why he has said I want to read you. As he might not bw a BTC developer neither I am but in my opinion these issues can only be solved by the developers while people like us who are after BTC and are miners too then they might try to manipulate the network with dust transactions. This needs to be stopped otherwise it might create problems for the whole network in future.
hero member
Activity: 1386
Merit: 513
Payment Gateway Allows Recurring Payments
You have started a good topic here and this is my 3rd or 4th topic related to the issue of ordinals and at current state I am started to bit confused as things are acting normal but the only difference might be one facing is they have to pay more TX fee to increase the priority level so their transaction could not be delayed. Well ordinals are not considered as good for BTC blockchain while they are tagged as spam by stompix and DDmr said miner are trying to manipulate the transaction fee by making small transactions just to fill up the block so that tx makers have to select more higher fee using RBF so that there transaction could get more priority. (Not mentioning the links to there threads but you can find them in my recent replies).

And one more thing, which would help a lot, you can add links to the useful threads which actually are tutorials of how to reduce or pay lesser fee using wallets or any platform. I found this one about the use of electrum to pay lesser fee which is a good one actually I was trying to find another thread but did not found it so instead of that this might work too. i know this is not enough but still as I said it would ve better in my thoughts otherwise it is ignorable.

Ps: you said you did not found any topic related ro this issue and now I think i am reading your reply late while I already read 3 topics on this issue before reading yours.
legendary
Activity: 4410
Merit: 4766
So you really think $0.65 is too expensive for the average Joe? The one who cannot pay that amount for the transaction has much bigger problems than the current situation with mempool...

average joe is not part of the the hundreds of millions of "first worlders" but the multi billion populous of "3rd worlders"

you might want to check minimum wage amounts of the average joe

after all bitcoin was made for the unbanked not the elitists
legendary
Activity: 3542
Merit: 1352
Cashback 15%
This is actually a very helpful post. Most of the time, there are a bunch of us who lose track of the current events and issues surrounding the Bitcoin community, especially those who are only treating Bitcoin as a side investment, hence having this post we will be able to just go here and update ourselves. Knowing the current issues and possible ways to address them are also a good way for beginners to get themselves familiar with and ready as they learn more about Bitcoin, it also shows them the reality of the Bitcoin community, that it is not perfect and there are some risks to deal with. Hence, I will surely save this post and get back to this as more updates are made, especially when I feel like I am losing track of the things happening in the community. And perhaps I'll add some of my own ways in addressing these issues.
hero member
Activity: 862
Merit: 662

Nice to know @ETFbitcoin always good post with you.
I just checked the lastest blocks of that minner and I see that it is true, there are some block with a few ADDED transaction with low fee like 3 or 5 sat/vB.

Regardless that they page advertise some 10000 sat/kB ~10 sat/vB

So you really think $0.65 is too expensive for the average Joe? The one who cannot pay that amount for the transaction has much bigger problems than the current situation with mempool...

Agree with you, that depends of course of the amount that are you going to move, if you are moving 1 BTC you really don't worry about the fee to pay for it, but if you are going to move only 30K sat those fees may worry you, anyway i recomend to anyone that is moving smalls sats amounts just wait for lower fee to consolidate their uxtos.

there are several threads discussing this so I really don't see the point in making this another one.

The title of the topic said "Summarizing issues..."

none of those who can do something concrete will lift a finger to change something about how someone feels about blockchain being used in this way.

Thay may be true, but one of my sugestion is to educate people:

but atleast i think that having more educated people can raise more awareness about how to handle this situtation IMHO
legendary
Activity: 3234
Merit: 5637
Blackjack.fun-Free Raffle-Join&Win $50🎲
~snip~
But there is occasional spikes in the network, and just like now, I see that the fastest is around 20 sat/vB which I think it's too expensive for us average Joe and all we can do is wait for the mempool to at least clear in the next hour and see how the fees will be.

So you really think $0.65 is too expensive for the average Joe? The one who cannot pay that amount for the transaction has much bigger problems than the current situation with mempool...



As for ordinals and their nonsense, there are several threads discussing this so I really don't see the point in making this another one. Besides, none of those who can do something concrete will lift a finger to change something about how someone feels about blockchain being used in this way.
hero member
Activity: 2842
Merit: 772
The current network congestion caused by the spam/dust transactions of Ordinals.

I don't know if this still exist as a problem or challenge facing the bitcoin community any longer ever since it was addressed and talked about by many, transaction fee is no more a contention for us to make a bitcoin transaction, you have many alternatives to make you avoid any exorbitant hike on transaction fee, whereas ordinals are no more that affecting the network with high transaction fee, you can also customize your fee, or look at the mempool for when it's less congested before making your transactions with lower fee rate.

Few months back though, it was a huge issues, the network congestion was due to the BRC20 and Ordinals and it really took bitcoin enthusiast by storm. But lately though, at least at this point is has slow down a bit.

But there is occasional spikes in the network, and just like now, I see that the fastest is around 20 sat/vB which I think it's too expensive for us average Joe and all we can do is wait for the mempool to at least clear in the next hour and see how the fees will be.
legendary
Activity: 2870
Merit: 7490
Crypto Swap Exchange
I think developers should find side-chain solutions for Ordinals to be used just for that.... it will reduce "dust" on-chain and it can alleviate congestion in the Mempool.  Tongue

Such solution already exist even before Ordinal gaining popularity. For starter, take a look at Liquid and RSK. But sidechain is generally unpopular, even among Bitcoin enthusiast.

Quote
If you are miner

  • Check the possibility of reducing a little the priority to those dust transactions in any case the mempool is full of legit transactions that are also paying fees.
I don't think the miner will consider this because they will see on the different perspective.

ViaBTC actually does that[1] with some limitation. Although it's possible their main goal isn't community service, but rather promote their pool and offer their paid service.

[1] https://www.viabtc.com/tools/txaccelerator/
hero member
Activity: 1316
Merit: 561
Leading Crypto Sports Betting & Casino Platform
a gaping hole exists: mass education. How to drill down these dense topics to the average user? They often possess limited technical know-how; a comprehensive, user-friendly knowledge base, universally accessible, solves this.

Secondly, community consensus is invaluable in streamlining transaction priorities. Should developers create a decentralized voting system embedded into the blockchain? Users, miners, and businesses alike could upvote/downvote types of transactions. Decentralized democracy at play. And we'll need incentives to participate in such systems; micro-rewards, perhaps?

You touched upon miner ethics. The power dynamics between miners and users are stark. A decentralized “code of conduct” ratified by the community would hold them accountable. This isnt merely theoretical; its a systemic overhaul that would sustain Bitcoin's core philosophy.
hero member
Activity: 812
Merit: 560
The current network congestion caused by the spam/dust transactions of Ordinals.

I don't know if this still exist as a problem or challenge facing the bitcoin community any longer ever since it was addressed and talked about by many, transaction fee is no more a contention for us to make a bitcoin transaction, you have many alternatives to make you avoid any exorbitant hike on transaction fee, whereas ordinals are no more that affecting the network with high transaction fee, you can also customize your fee, or look at the mempool for when it's less congested before making your transactions with lower fee rate.
hero member
Activity: 862
Merit: 662
I think developers should find side-chain solutions for Ordinals to be used just for that.... it will reduce "dust" on-chain and it can alleviate congestion in the Mempool.  Tongue

Totally agree with that. Ordinal problems can be solved if they move to anoter chain or simplely shut it down that shit

I don't think the miner will consider this because they will see on the different perspective.

High fee is good for them while low fee is bad for them regardless it's BRC-20 transaction or Bitcoin transaction.

Yes that is why i add "a little" even if they allow 1% of the block for non dust TX, they aren't lose 1% of their profits.. (I want to make a calculation about this)

How will these tips help in solving the problem of spam/dust transactions of Ordinals?

It can be said that your advice is good for those who want to reduce fees, but it will not solve the problem of Ordinals.

From my point of view (that it may be wrong) the main idea of use segwit addresses or Taproot address is that those Transactions need less space on the block, for example so if we can change 100 UXTOs P2PKH by 150 UXTOS P2TR or P2WPKH then i think that "it is something" good.

My bet it is on the long run, a faster adoption of those Address may lead in more transactions included in a single block and yes i know that this don't have anything with the fee sat/vB that people opt to pay in their transacctions, but atleast i think that having more educated people can raise more awareness about how to handle this situtation IMHO
hero member
Activity: 406
Merit: 443
How will these tips help in solving the problem of spam/dust transactions of Ordinals?

It can be said that your advice is good for those who want to reduce fees, but it will not solve the problem of Ordinals.

To reduce fees, I can add tips such as:


If you are miner

  • Check the possibility of reserve some little percentage of space the block to include some stuck transactions, less than 3% or even 1% will be good those transactions can be selected randomly
  • Remember that the health of the network depends in a wide way of your actions

This is definitely something that no mining pool will do. Trying to refuse to accept transactions or allocate block space to transactions and give priority to them apart from fees is not the correct approach. Dust transactions are valid transactions and can be bypassed by preventing nodes from broadcasting  transactions with less than 5-7 sat/vByte
sr. member
Activity: 602
Merit: 387
Rollbit is for you. Take $RLB token!
If a wallet has dust attacks and dust UTXOs, you will need to use Freeze an address feature in your wallet.

Dust Attack, what it is, why it is dangerous and how to prevent falling to it

In Electrum wallet, click on that address, right click and choose Freeze.
Pages:
Jump to: