Pages:
Author

Topic: List of all Bitcoin addresses ever used - currently UNavailable on temp location (Read 4247 times)

legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
How can you generate an address with a dash inside?
You can't, it doesn't exist:
Q&A
Can you please clarify, what is the type of these d- and s- addresses?
This is how Blockchair.com shows OP_RETURN.
newbie
Activity: 1
Merit: 1
Some interesting (?) statistics
Total address count: 1,484,589,749
1... address count: 1,039,899,708
3... address count: 343,485,961
bc1q... address count: 55,006,904
...-... (with a "dash") address count: 46,197,161

Unique address count: 693,180,830
1... address count: 470,943,308
3... address count: 167,941,821
bc1q... address count: 39,137,878
...-... (with a "dash") weird address count: 15,157,808


How can you generate an address with a dash inside?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Quoting myself here because it's relevant:
It was brought to my attention that my "sort" is "different" now, and I got these results testing:

Code:
cat Bitcoin_addresses_LATEST.txt.gz | gunzip | sha256sum
df0baad2301e9b897a02bd3fccb115968c82eb3956143e2f5b4c3ad7b2c227bf  -

So far so good.
Now, this file is sorted on my server from a cronjob. But when I sort it on my local computer, I get this:
Code:
cat Bitcoin_addresses_LATEST.txt.gz | gunzip | sort -S20% | sha256sum
27c2541369d0546ec7c7e70d09d807d8fc6d39435f8857e5ebbf8386584be2d2  -

Has anyone else noticed an incompatible sorting method? Should I change this to a different sorting? Or would that break scripts from people who are currently using it?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
This data is back online!
After my sponsored dedicated server disappeared, I had to restore data on a new server. Everything including weekly updates should be working again, please let me know if anything fails.

The data
See alladdresses.loyce.club

1. All Bitcoin addresses ever used, in chronological order, without duplicates.
all_Bitcoin_addresses_ever_used_in_order_of_first_appearance.txt.gz: (Warning: 36 GB)

2. All Bitcoin addresses ever used, sorted by address, without duplicates.
all_Bitcoin_addresses_ever_used_sorted.txt.gz: (Warning: 32 GB)

Updates
Updates happen on Tuesday!

Bandwidth
This server can use unlimited bandwidth, at 250 Mbit/s. If things get crazy, I may have to resort to using torrents.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
The download is going at 100 KB/s for me right now.
That sounds like you're downloading from Blockchair, they have speed restrictions. Try my mirror.

Quote
This would be solvable with a better distribution system (e.g., torrents).
As long as my (donated) server is only using 20% of it's allowed bandwidth, I won't bother.
newbie
Activity: 3
Merit: 1
The download is going at 100 KB/s for me right now. This would be solvable with a better distribution system (e.g., torrents).

If you use torrents to distribute the file, you'd be able to publish an RSS feed which automatically lets people download the latest version if they want to help seed.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Would you consider open-sourcing the code that generates this list?
I don't really see the point. There's not much to it, but you'll need to download a lot of data to use it.
I get the data from Blockchair, extract the files, get the addresses, and sort them. That's it.
newbie
Activity: 3
Merit: 1
Would you consider open-sourcing the code that generates this list? It seems like it would be helpful to the community to have available.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Is this thread still beeing updated?
It looks like the daily updates didn't happen, which means the weekly update had no fresh data. I'm not sure why, I'll check it tomorrow.

Update: it's fixed. It was waiting for another stuck update. The weekly update is running now, this takes a few hours to complete. Thanks for reporting this.
newbie
Activity: 3
Merit: 1
I made a Python library and CLI tool to check this list for addresses in bulk and in other scripts. Check it out on my GitHub: https://github.com/RecRanger/used-addr-check
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Have you considered posting torrents for all these links? Would make downloding faster, and would help ease the strain on your server.
This question pops up once in a while (including your own post about it back in 2021). Short answer: there's no need, and frequent updates are annoying with torrents. Long answer: click All, CTRL-F "torrent".
newbie
Activity: 5
Merit: 0
Have you considered posting torrents for all these links? Would make downloding faster, and would help ease the strain on your server.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
newbie
Activity: 9
Merit: 13
Is this thread still beeing updated?

Thanks.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Hey how much ram do you need to run this with your server?
I recently tested it: the more cores I use for sorting, the more RAM it takes. I tested the difference, and reduced the sorting to only 2 cores. It writes a lot of temp files (on HDD) with 32 GB RAM. I guess I could use 128 or even 256 to speed this up, but I update the large file once a week, so it doesn't matter that it takes a few hours.

Quote
I have a threadripper  doing nothing it has  128gb ram would it be better than the server you are using.

I could donate it to you.
Thanks for the offer, but I'm good for now. This server takes about 12 TB of bandwidth per month.

If you want to find a good use for your server: how about using it to run your own block explorer (mempool.space clone) or Electrum server?
legendary
Activity: 4354
Merit: 9201
'The right to privacy matters'
Hey how much ram do you need to run this with your server?

128gb  or 256gb.

I have a threadripper  doing nothing it has  128gb ram would it be better than the server you are using.


I could donate it to you.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Parse litecoin all addresses usage possible?
I can do it: make me an offer Smiley
newbie
Activity: 4
Merit: 0
Parse litecoin all addresses usage possible?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
How/why could this be useful for us bitcoin users?
I'm not sure Undecided If you don't know what to do with this, I guess it's not for you. But some people download it, and it's actually consuming quite a bit of bandwidth so there must be something.

You can see how many new addresses were added / used in a particular timeframe.
There's no time stamp information included, so you'll need to get Bitcoin block data (728 GB): inputs, outputs and transactions for the full data.

Quote
Depending on what you need it for there are other ways of getting it but he is doing the back end work for you.
What can I say: I like data Cheesy
legendary
Activity: 3500
Merit: 6320
Crypto Swap Exchange
Hello LoyceV,

How/why could this be useful for us bitcoin users?

I mean yes we got a overview about all used addresses, but for me i am not sure how this could be helpful for us.

Thanks

For some people it's interesting statistical information. You can see how many new addresses were added / used in a particular timeframe.
Depending on what you need it for there are other ways of getting it but he is doing the back end work for you.
For you to use BTC day to day it's not important, but if you are doing blockchain research it's a handy thing to have.

-Dave
Pages:
Jump to: