Generate All bitcoin addresses with balance

PawGo

legendary

Activity: 952

Merit: 1386

Quote from: databoi on June 02, 2022, 08:34:30 AM

I open-sourced the Bitcoin blockchain https://www.dolthub.com/repositories/web3/bitcoin. It's a little behind (will catch up soon to the head block) but you can easily query all wallets in SQL with it. CC this blog https://www.dolthub.com/blog/2022-06-01-free-the-sql-data/ for some ideas.

Very interesting, I was not aware of that. Usually what I do for my needs (if I need to check many addresses from program), is just to download snapshot with addresses/balances etc and load into postgresql database.
I will take a look at that project, if it save me some time, I would probably start using it.

NotATether

legendary

Activity: 1568

Merit: 6660

bitcoincleanup.com / bitmixlist.org

All this parsing is in fact unnecessary because @LoyceV has a project called List of all Bitcoin addresses with a balance that is updated daily with address dumps from Blockchair.

It is merely a text file of addresses with balances next to them.

databoi

newbie

Activity: 5

Merit: 83

I open-sourced the Bitcoin blockchain https://www.dolthub.com/repositories/web3/bitcoin. It's a little behind (will catch up soon to the head block) but you can easily query all wallets in SQL with it. CC this blog https://www.dolthub.com/blog/2022-06-01-free-the-sql-data/ for some ideas.

lightningmelo

copper member

Activity: 70

Merit: 22

What you are looking for is the current UTXO set.

UTXO stands for Unspent Transaction Output.

This is the set of all the transaction outputs that can be spent.

Paperweight

jr. member

Activity: 41

Merit: 41

As an aside, the FAQ at https://bitkeys.work/faq.php seems a bit...wrong and alarmist?

He's implying that you need 2^80 (~1e24) tries to get a 50% chance of "colliding with one of those keys" (using the birthday paradox). Which seems pretty bad given the current network hashrate of ~1e20 H/s.

But... I think you'd only be colliding with one of your other zillion collision attempts, not one of the relatively miniscule ~1e8 addresses actually used. Unless my math is wrong. *shrug*

(1eX = 1*10^X)

More info: https://download.wpsoftware.net/bitcoin-birthday.pdf

crofrihosl

jr. member

Activity: 56

Merit: 3

Quote from: ABCbits on September 17, 2019, 12:35:56 PM

Possible if you have ~~unlimited~~ tons of time to be wasted, would you want to edit 500K HTML pages manually?

write/edit some python or C++ scripts Grin

1-concat all the 500k HTML pages into one file (or 50k pages each time)
2-use some condition delete/keep all lines with/contain
3-sort and done

i did try this Grin

starmyc

full member

Activity: 198

Merit: 130

Some random software engineer

Quote from: ABCbits on September 17, 2019, 12:35:56 PM

I was digging history of my spent merit and found https://github.com/mycroft/chainstate which parse UTXO from Bitcoin Core chainstate.
I think this is what you're looking for.

Thanks you quoting me!
The tool is still working great FYI, and https://balances.syndevio.com/ is still maintained with it too, for whoever might be insterested :-)

ABCbits

legendary

Activity: 2870

Merit: 7490

Crypto Swap Exchange

I was digging history of my spent merit and found https://github.com/mycroft/chainstate which parse UTXO from Bitcoin Core chainstate.
I think this is what you're looking for.

Quote from: crofrihosl on September 16, 2019, 09:17:20 PM

it is possible Grin

1- with idm go to tasks > add batch download>from 0 to 1000> ok (about 110MB) (50*1000=50k top bitcoin addresses)
concatenating all the htmls files in one html edit with notepad++ the final file and make sure to only keep the addresses in first column

(you need to repeat this many times)

i did try this ... bored and stop Cry

Possible if you have ~~unlimited~~ tons of time to be wasted, would you want to edit 500K HTML pages manually?

crofrihosl

jr. member

Activity: 56

Merit: 3

Quote from: ?? on ??

You want to crawl 524620 pages? I'm afraid it's impossible if you're using customer desktop because :
1. Each page have size about 100KB (only HTML code tag, excluding all external files) or about 50GB in total
2. If they have protection against DDoS, bot or spammer, you'd be banned before you could crawl 500K pages

IMO contacting them to ask JSON/dumped SQL data is more realistic option.But it's one good website in this case.

it is possible Grin

1- with idm go to tasks > add batch download>from 0 to 1000> ok (about 110MB) (50*1000=50k top bitcoin addresses)
concatenating all the htmls files in one html edit with notepad++ the final file and make sure to only keep the addresses in first column

(you need to repeat this many times)

i did try this ... bored and stop Cry

crofrihosl

jr. member

Activity: 56

Merit: 3

Quote from: jay2212 on September 15, 2019, 09:12:19 AM

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.

this website have all bitcoin addresses and sorted https://bitkeys.work/?page=0 Cool

if someone have an idea to crawl and extract the list text file Huh

Rath_

legendary

Activity: 1876

Merit: 3139

Quote from: jay2212 on September 15, 2019, 09:12:19 AM

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.

You should be able to do it using this BlockParser. Note that you will have to run a fully synchronised node with txindex set to 1.

jay2212

newbie

Activity: 1

Merit: 0

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.

Topic: Generate All bitcoin addresses with balance (Read 553 times)