Pages:
Author

Topic: Get list of all addresses with a balance over x? - page 10. (Read 43435 times)

jr. member
Activity: 36
Merit: 3
Hi @btctousd81! Please tell what tool you use for to create such database?
sr. member
Activity: 434
Merit: 270
here it is latest dump


Code:
[root@btcnode tmp]# head btctousd81_29jan2018.csv
1111111111111111111114oLvT2,0000000000000000000000000000000000000000,6531128743
111111111111111111112BEH2ro,000000000000000000000000000000000000000a,10940
111111111111111111112xT3273,0000000000000000000000000000000000000011,5340
1111111111111111111141MmnWZ,000000000000000000000000000000000000001a,5340
111111111111111111114ysyUW1,0000000000000000000000000000000000000023,5340
11111111111111111111BZbvjr,0000000000000000000000000000000000000001,1028212


can you, please, sort it by balance row next time? Thanks!


yes, i can do that.,

you can do that too, by loading it in mysql or any other db or
load it in excel. and do sort by amount.
jr. member
Activity: 39
Merit: 6
here it is latest dump


Code:
[root@btcnode tmp]# head btctousd81_29jan2018.csv
1111111111111111111114oLvT2,0000000000000000000000000000000000000000,6531128743
111111111111111111112BEH2ro,000000000000000000000000000000000000000a,10940
111111111111111111112xT3273,0000000000000000000000000000000000000011,5340
1111111111111111111141MmnWZ,000000000000000000000000000000000000001a,5340
111111111111111111114ysyUW1,0000000000000000000000000000000000000023,5340
11111111111111111111BZbvjr,0000000000000000000000000000000000000001,1028212


can you, please, sort it by balance row next time? Thanks!
newbie
Activity: 7
Merit: 0
here it is latest dump

...

Awesome, thank you so much! I owe you one. Smiley
sr. member
Activity: 434
Merit: 270
here it is latest dump

https://www.transfernow.net/51dss251ddg5


format

Code:
btc address,hash160,amount in satoshis

Code:
[root@btcnode tmp]# head btctousd81_29jan2018.csv
1111111111111111111114oLvT2,0000000000000000000000000000000000000000,6531128743
111111111111111111112BEH2ro,000000000000000000000000000000000000000a,10940
111111111111111111112xT3273,0000000000000000000000000000000000000011,5340
1111111111111111111141MmnWZ,000000000000000000000000000000000000001a,5340
111111111111111111114ysyUW1,0000000000000000000000000000000000000023,5340
11111111111111111111BZbvjr,0000000000000000000000000000000000000001,1028212
11111111111111111111CJawggc,0000000000000000000000000000000000000064,1548
11111111111111111111HV1eYjP,0000000000000000000000000000000000000092,2730
11111111111111111111HeBAGj,0000000000000000000000000000000000000002,5481
11111111111111111111QekFQw,0000000000000000000000000000000000000003,1

Code:
[root@btcnode tmp]# tail btctousd81_29jan2018.csv
1DpBda3jw6x2rbkSJUFrBfUPKgFbZsr5t9,8c8deefad99de1daffac1446a01132266c9d58fa,35264328
1JtY892wdpUfeVqg3nH3fed2whZBi9xTf,036217897bf7eb792d129b962e8d478e2030ac94,19446553
19b8mLDpqbUwZCZ8Sa9TbMj2ofhcUwc5HF,5e35a15c10dd14e888b58320f737142c48e2eea6,3366861
15SQ4c9BRsR77hbBLBXxGi8h7V7pDFtShG,30ae274c7101a903e1cce0d429383b2d680c947f,10524100
1HB4EbQygbDBqj4DeRWrEHvqEyPdW2k9B7,b168df40270271f6d71e2cd961e40f58e86f7d9e,2882
1H9KeUz92d3DwdTdnH2dR4tjF9Q1ma8uHW,b114e7c464188535cdea560ac484e609d92e07ee,2182583
1GxScqUcg5MZRrkQQeTziivX6CfVTywCXh,af06263ce147c366a49e12964e50f7106e8368e1,3294
3BceAG61bUsfBxb64JpMKB5TuE1mqzPkao,6cdd6d3eb7084e3487eadb47bcec761c87ca966e,540545
1LsweYaesdzt86Ze2WSQQHso5AjoNDRikv,da0cce25e3b57eaa2822ca328a5581a9a694e2ee,3739000
15ozPLgWzBokpRUbNecatNqqDbfpADFtUb,34c38a43d285e03e0a0b4bf65ca0a6f9ae8c97e6,349051
newbie
Activity: 7
Merit: 0
Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances
and filter out the ones < x

Problem solved. ?

It's fairly easy to pull this info from a full node. The full node I run is in a VM with 4GB RAM, and the method I'm familiar with (https://github.com/znort987/blockparser) requires a machine with closer to 128GB.
member
Activity: 142
Merit: 10
Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances
and filter out the ones < x

Problem solved. ?

Then you are relying on the other database to be up-to-date. Plus that db is going to be pretty large as there are quite a few discovered addresses.
copper member
Activity: 81
Merit: 0
Look around you , nothing is secure
Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances
and filter out the ones < x

Problem solved. ?
newbie
Activity: 7
Merit: 0

give me few hours, i ll upload it tonight., so most probably i will post updated link tomorrow.,

thanks

Thank you very much! I'll keep an eye on the thread. Much appreciated!
sr. member
Activity: 434
Merit: 270
Quote

edit: here it is

Code:
https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z

Hi @btctousd81,

Is there still a working link to download this? I would love a copy and my current full node isn't powerful enough to generate in a reasonable time.

Either way, thanks!

give me few hours, i ll upload it tonight., so most probably i will post updated link tomorrow.,

thanks
newbie
Activity: 7
Merit: 0
Quote

edit: here it is

Code:
https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z

Hi @btctousd81,

Is there still a working link to download this? I would love a copy and my current full node isn't powerful enough to generate in a reasonable time.

Either way, thanks!
jr. member
Activity: 36
Merit: 3
It doesn't matter what OS you have. Blockchain is equal and fully cross platform. I mean blk*.dat binaries and so on.
@Anti-Cen, "string butcher", so please show us your script that extract all non-zero ballances from blockchain Smiley
member
Activity: 210
Merit: 26
High fees = low BTC price
i have full node running at home, on linux centos 7 dedicated to only bitcoind.

Yes that's my killer because I run Windows spyware version 10 and is too old to
move over and learn Linux and most the time I can make apps that sing and dance
on windows without any trouble at all.

in fact i am the best "string butcher" in the world
sr. member
Activity: 434
Merit: 270
thanks @btctousd81.

would you give the script that allows to create this csv?
did you do it in bash or python or anything else?


Nice so did you do it from windows or Linux without using a wrapper around someones
mega-big API or running a full-node and using RPC ?

I am trying to code this myself to read block.dat from several  types of forked BC  from Bitcoin
so I need to go back to raw files I think and then see what happens after a fork date to the data
so off the shelf API's won't help me out.

Will be interesting to see who has money in the forks and are not using it





i have full node running at home, on linux centos 7 dedicated to only bitcoind.

there is no single readymade script to get all addresses having balance.

what i did was i used rusty-blockparser to get all unspent outputs in csv.
then loaded it in myql
then some queries to get data in proper format and bitcoin-tool to get address to hash160.

then i have this php script which gets run every 4-6 hours and parses all new blocks using rpc. and updates my mysql db.

it was time consuming task took me 2-3 days to get everything in db.

it would be great if someone could create app which can directly read chainstate db.

parsing blockchain is pretty simple using rpc but its fuckin slow as hell.

every output is +1 and old amount + new amount
while
every input is -1 and old amount - new amount

this is my logic to get uptodate all addresses having balance ..

hope this helps.,

i could upload regular updated db daily but my home net has very slow upload speed so it takes around 7-8 hours to upload above dump.

-------------------------------

edit:

if you want only addresses having balance not care about the amount of btc its holding, then just run

rusty-blockparser with unspentcsv callback

you wiill get huge csv dump file then just use grep sed something like that to only get addresses.

the parser takes around 8 -12 hours., even on my amd fx 8350 , 32 gig dedicated machine.
member
Activity: 210
Merit: 26
High fees = low BTC price

Nice so did you do it from windows or Linux without using a wrapper around someones
mega-big API or running a full-node and using RPC ?

I am trying to code this myself to read block.dat from several  types of forked BC  from Bitcoin
so I need to go back to raw files I think and then see what happens after a fork date to the data
so off the shelf API's won't help me out.

Will be interesting to see who has money in the forks and are not using it



member
Activity: 210
Merit: 26
High fees = low BTC price
Interested in doing this too. Found this to import blockchain into MongoDB: https://github.com/thelinuxkid/bitcoinquery

it says "In order to use bitcoinquery you need a Bitcoind RPC server"

I want to do it from windows without running a full node and doing RPC to the local node
See https://bitcointalk.org/index.php?topic=2748620.new#new
Looks like i need some form of Berkeley-DB to run in windows to read Block.dat files that is not so easy to come
by in windows and yes I know it's all spyware

Will upload if i get anything working that should sum all balances (I hope)
but it will be windows based




newbie
Activity: 2
Merit: 0
thanks @btctousd81.

would you give the script that allows to create this csv?
did you do it in bash or python or anything else?
sr. member
Activity: 434
Merit: 270
give me few hours, ill upload latest one.

Your lists just pull addresses with balances right? You don't list every address on the blockchain, or do you?

nope, only addresses having balance.

edit: here it is

Code:
https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z
format

Code:
addresss, hash160, amount
member
Activity: 142
Merit: 10
give me few hours, ill upload latest one.

Your lists just pull addresses with balances right? You don't list every address on the blockchain, or do you?
sr. member
Activity: 434
Merit: 270
give me few hours, ill upload latest one.
Pages:
Jump to: