I am going to go back to the point I made here about cheaply self hosting a node: https://bitcointalksearch.org/topic/cheap-node-self-hosting-just-because-you-can-does-not-mean-you-should-5399730
Can you do what the OP wants to save some $ on HD storage space? Yes.
Will it cost them a lot of time trying to do it this way and if something changes will it cost them even more time to do it again since they don't have all the data? Yes.
Just because you CAN does not mean you SHOULD.
For a thought experiment fine. For someone who has been playing with crypto for years and knows what the real issues can be fine.
But for real use, probably not.
-Dave
Topic: Any way to run a server providing any address balance and using pruned node? (Read 177 times)
June 22, 2022, 05:44:58 AM
June 22, 2022, 04:40:16 AM
Alternatively, copy chainstate directory somewhere else. It's easier and faster.
...Just if fresh / up-to-date values are important for OP he may have to do this either on every new block coming, either for each call he makes.
It really depends on OP needs.
From what I see OP wants to just do tests. If he goes on this route and wants to switch afterwards to full blockchain, and maybe txindex too, the effort done now may be for nothing.
So now, with fresher head, I think that ardb should still consider going for full data from start.
June 21, 2022, 11:40:54 PM
One show stopper may be the fact Level DB doesn't like concurrent access from multiple apps, hence you may have to use the chainstate while bitcoind is stopped, or keep a copy for the job...
Easy to circumvent. Just make a C library that exports the particular details that you need from the chainstate, and make the library a build-time dependency of Bitcoin Core, so that they get compiled together.
So that accesses to LevelDB from your library will still use Bitcoin Core's internal locks.
June 21, 2022, 05:45:04 PM
If it's not yet been mentioned, bitcoinj works a bit like electrum but scans blocks received from Bitcoin nodes that it's able to connect to which might be something you could also look at too: https://bitcoin.org - I'm not sure it's too user friendly though as the last time I used it in its raw form it was only usable via the command line (I also only used it to convert a wallet file).
June 21, 2022, 02:52:42 PM
According to this answer, all UTXO are indeed kept in pruned data.
While chainstate does contains the UTXOs, there are no addresses there, it's scriptPubKeys (and amounts) (see here and here)
Clearly scriptPubKey doesn't necessarily translate to an address, but that may not be a big problem. Even more, a tutorial here tells how to extract the data.
One show stopper may be the fact Level DB doesn't like concurrent access from multiple apps, hence you may have to use the chainstate while bitcoind is stopped, or keep a copy for the job...
While chainstate does contains the UTXOs, there are no addresses there, it's scriptPubKeys (and amounts) (see here and here)
Clearly scriptPubKey doesn't necessarily translate to an address, but that may not be a big problem. Even more, a tutorial here tells how to extract the data.
One show stopper may be the fact Level DB doesn't like concurrent access from multiple apps, hence you may have to use the chainstate while bitcoind is stopped, or keep a copy for the job...
Thanks! It looks promising. I'll try to run levelDB instance on working node data with chainstate directory exposed as read only.
I suppose I need to discover how to recognize new records on updates and learn how to convert scripts to addresses.
But luckily LoyceV linked something interesting...
June 21, 2022, 11:54:45 AM
But full UTXO database is still kept in chainstate DB in pruned node, isn't it?
I think so, yes.Quote
If so, what is the technical problem of making a sum for a given address?
You can try https://github.com/in3rsha/bitcoin-utxo-dump to dump all addresses and their balance. I haven't tested it myself, so use at your own risk. June 21, 2022, 11:34:12 AM
Pruned node and "any address' balance" don't go together.
But full UTXO database is still kept in chainstate DB in pruned node, isn't it?
If so, what is the technical problem of making a sum for a given address?
My answer was based on the fact that whenever you change the wallet (not to a new one) in a pruned Bitcoin Core you have to download everything again.
Also afaik getbalance returns 0 for addresses not in your wallet.
However, when I've done more research I've found somewhat contradicting info.
According to this answer, all UTXO are indeed kept in pruned data.
While chainstate does contains the UTXOs, there are no addresses there, it's scriptPubKeys (and amounts) (see here and here)
Clearly scriptPubKey doesn't necessarily translate to an address, but that may not be a big problem. Even more, a tutorial here tells how to extract the data.
One show stopper may be the fact Level DB doesn't like concurrent access from multiple apps, hence you may have to use the chainstate while bitcoind is stopped, or keep a copy for the job...
June 21, 2022, 10:27:54 AM
Pruned node and "any address' balance" don't go together.
But full UTXO database is still kept in chainstate DB in pruned node, isn't it?
If so, what is the technical problem of making a sum for a given address?
June 21, 2022, 07:45:37 AM
If you have fixed list of address you want to watch, you can create watch only wallet and import the list of the address before you start sync process.
You can also add a new watch-only address to a pruned node before it gets funded. Example:Code:
importaddress 1NXYoJ5xU91Jp83XfVMHwwTUyZFK64BoAD theymos false
June 21, 2022, 07:40:20 AM
Pruned node and "any address' balance" don't go together. But if you only have a clear fixed list of addresses you may have a chance.
If the addresses are few, EPS may do.
On EPS readme I've also found out about BWT, which may also be useful for you. I've never used it though.
I'll add that I've had some small experience with EPS and I've found it unpleasant to set it up.
If the addresses are few, EPS may do.
On EPS readme I've also found out about BWT, which may also be useful for you. I've never used it though.
I'll add that I've had some small experience with EPS and I've found it unpleasant to set it up.
June 21, 2022, 07:21:11 AM
Since you want to run this on a tiny server, I'm guessing that you're not expecting many requests? If so, why don't you just use some (free) block explorer API instead? Someone compiled a list not so long ago, I suggest you check it out: https://bitcointalksearch.org/topic/bitcoin-blockchain-data-apis-5386348
June 21, 2022, 07:18:05 AM
I'd like to monitor some BTC address balances. Since bitcoin core does not provide such feature I was thinking about a separate electrummx server or something similar. But I see that these solutions require to have transaction indexing turned on and in consequence bitcoin core database cannot be pruned. Is there any open source solution I can use on a tiny server without the necessity of having a not-pruned node?
It is acceptable for it to start with a full node for initial indexing but then I'd like it to update using pruned-node data. Any chance?
It is acceptable for it to start with a full node for initial indexing but then I'd like it to update using pruned-node data. Any chance?
Jump to: