Pages:
Author

Topic: List of all Bitcoin addresses ever used - currently UNavailable on temp location (Read 4090 times)

legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
The download is going at 100 KB/s for me right now.
That sounds like you're downloading from Blockchair, they have speed restrictions. Try my mirror.

Quote
This would be solvable with a better distribution system (e.g., torrents).
As long as my (donated) server is only using 20% of it's allowed bandwidth, I won't bother.
newbie
Activity: 3
Merit: 1
The download is going at 100 KB/s for me right now. This would be solvable with a better distribution system (e.g., torrents).

If you use torrents to distribute the file, you'd be able to publish an RSS feed which automatically lets people download the latest version if they want to help seed.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Would you consider open-sourcing the code that generates this list?
I don't really see the point. There's not much to it, but you'll need to download a lot of data to use it.
I get the data from Blockchair, extract the files, get the addresses, and sort them. That's it.
newbie
Activity: 3
Merit: 1
Would you consider open-sourcing the code that generates this list? It seems like it would be helpful to the community to have available.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Is this thread still beeing updated?
It looks like the daily updates didn't happen, which means the weekly update had no fresh data. I'm not sure why, I'll check it tomorrow.

Update: it's fixed. It was waiting for another stuck update. The weekly update is running now, this takes a few hours to complete. Thanks for reporting this.
newbie
Activity: 3
Merit: 1
I made a Python library and CLI tool to check this list for addresses in bulk and in other scripts. Check it out on my GitHub: https://github.com/RecRanger/used-addr-check
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Have you considered posting torrents for all these links? Would make downloding faster, and would help ease the strain on your server.
This question pops up once in a while (including your own post about it back in 2021). Short answer: there's no need, and frequent updates are annoying with torrents. Long answer: click All, CTRL-F "torrent".
newbie
Activity: 5
Merit: 0
Have you considered posting torrents for all these links? Would make downloding faster, and would help ease the strain on your server.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
newbie
Activity: 9
Merit: 13
Is this thread still beeing updated?

Thanks.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Hey how much ram do you need to run this with your server?
I recently tested it: the more cores I use for sorting, the more RAM it takes. I tested the difference, and reduced the sorting to only 2 cores. It writes a lot of temp files (on HDD) with 32 GB RAM. I guess I could use 128 or even 256 to speed this up, but I update the large file once a week, so it doesn't matter that it takes a few hours.

Quote
I have a threadripper  doing nothing it has  128gb ram would it be better than the server you are using.

I could donate it to you.
Thanks for the offer, but I'm good for now. This server takes about 12 TB of bandwidth per month.

If you want to find a good use for your server: how about using it to run your own block explorer (mempool.space clone) or Electrum server?
legendary
Activity: 4326
Merit: 8914
'The right to privacy matters'
Hey how much ram do you need to run this with your server?

128gb  or 256gb.

I have a threadripper  doing nothing it has  128gb ram would it be better than the server you are using.


I could donate it to you.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Parse litecoin all addresses usage possible?
I can do it: make me an offer Smiley
newbie
Activity: 4
Merit: 0
Parse litecoin all addresses usage possible?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
How/why could this be useful for us bitcoin users?
I'm not sure Undecided If you don't know what to do with this, I guess it's not for you. But some people download it, and it's actually consuming quite a bit of bandwidth so there must be something.

You can see how many new addresses were added / used in a particular timeframe.
There's no time stamp information included, so you'll need to get Bitcoin block data (728 GB): inputs, outputs and transactions for the full data.

Quote
Depending on what you need it for there are other ways of getting it but he is doing the back end work for you.
What can I say: I like data Cheesy
legendary
Activity: 3500
Merit: 6320
Crypto Swap Exchange
Hello LoyceV,

How/why could this be useful for us bitcoin users?

I mean yes we got a overview about all used addresses, but for me i am not sure how this could be helpful for us.

Thanks

For some people it's interesting statistical information. You can see how many new addresses were added / used in a particular timeframe.
Depending on what you need it for there are other ways of getting it but he is doing the back end work for you.
For you to use BTC day to day it's not important, but if you are doing blockchain research it's a handy thing to have.

-Dave
member
Activity: 194
Merit: 14
Hello LoyceV,

How/why could this be useful for us bitcoin users?

I mean yes we got a overview about all used addresses, but for me i am not sure how this could be helpful for us.

Thanks
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
I'm far from being an expert with Apache, but maybe this is related?

https://cwiki.apache.org/confluence/display/httpd/DirectoryListings

More specificially, "Directory Listings" and "Some files aren't listed".
None of the files are forbidden, they're just regular files, like the other files.

It's even weirder that the date of the 2 large files is incorrect. That's the date it had before I updated the file, the file as it shows it doesn't even exist anymore. If you download it, you get the correct updated file.


You are creating the folder under blockdata and some way it's linked to alladdresses.
I copied it there to show it works fine on another subdomain:
I think that can't be the problem, because it works for other virtual hosts. I copied the files:
Code:
cp -a test* ../../blockdata.loyce.club/public_html/
They show up on http://blockdata.loyce.club/ as expected.
I've deleted them from "blockdata" again.

Another solution is to build a site for that subdomain. That way you can manipulate all the links without problems.
FML! I feel sooooooooooooooooooooooo stupid now
I used wget to transfer files from the old server to the new server, and as you can see in my terminal screenshot, that created an index.html file. So instead of getting a fresh listing from Apache, it shows the old one. That explains everything, no scorcery involved, just my own stupidity.



Updates work again!
I've moved this data to a (kindly donated) dedicated server. The large files are updated each Tuesday. Enjoy!
legendary
Activity: 3346
Merit: 3130
Ok, looks like i found something mate:

Code:
http://blockdata.loyce.club/
It show the test2 folder with the same modification time.



I have no idea why, but i know this is a nice hint for the solution Wink

You are creating the folder under blockdata and some way it's linked to alladdresses.

-----------------------


Another solution is to build a site for that subdomain. That way you can manipulate all the links without problems.
Pages:
Jump to: