Pages:
Author

Topic: . - page 6. (Read 39124 times)

legendary
Activity: 980
Merit: 1008
October 07, 2012, 08:16:38 PM
#79
Great! Is it possible to read addresses from a file that just contains concatenated hash160 addresses as raw bytes? Ie. 20 bytes followed by 20 bytes etc. I use this format to save space when storing a large number of addresses. I tried modifying the code to do this, but it seems it would require substituting fgets with fread, and things started looking messy so I gave up.
legendary
Activity: 980
Merit: 1008
October 07, 2012, 05:10:06 PM
#78
Cool. Just tried it. blockparser reports the balance of the address 991fd9bf50ad8d6a551efceb5c228d21bcc0fe92 to be 200.777, but blockchain.info says it's 351.06501343 BTC. Who's right?

bitcoin-qt says my block chain is up to date (last block was found 8 minutes ago).

Armory's block chain tool reports the same balance as blockparser (200.777) so it seems that this is valid. But why does this disagree with blockchain.info?
legendary
Activity: 980
Merit: 1008
October 07, 2012, 03:35:29 PM
#77
This looks cool. Do you have any plans to add a feature that allows the program to output the total balance for a specific bunch of addresses? Like:

./parser showBalance < addresses.txt

or alternatively

./parser showBalance -i addresses.txt

Where addresses.txt would contain a list of addresses (hash160/base58).
sr. member
Activity: 456
Merit: 250
October 06, 2012, 06:52:41 AM
#76
figured it out.  had my home directory encrypted.. disabled encrypt and all is well.. fun adventure.. btw great tool!
sr. member
Activity: 456
Merit: 250
October 06, 2012, 05:40:11 AM
#75
now using a different machine.. I get

Code:
gato@50cal:~/blockparser$ ./parser all

info: Starting command "allBalances"

info: analyzing blockchain ...
fatal: Invalid argument: failed to open block chain file /home/gato/.bitcoin/blk0001.dat
Aborted (core dumped)
gato@50cal:~/blockparser$


everything is there.. soooooo.. I have no idea.
not my day lol
sr. member
Activity: 456
Merit: 250
October 06, 2012, 12:08:17 AM
#74
I installed this and started doing some of the examples in the readme file and everything is working until I ran allbalances.

I get this output.

Quote
xxxxx@xxxxxxxx:~/blockparser$ ./parser allbalances >allbalances.txt

info: Starting command "allBalances"

info: analyzing blockchain ...
info:        0 blocks,    0.000 MegaMoves ,    0.000 MegaAddrs ,  0.00%
info:   118089 blocks,    1.049 MegaMoves ,    0.381 MegaAddrs , 59.56%
info:   129462 blocks,    2.097 MegaMoves ,    0.722 MegaAddrs , 65.29%
info:   134099 blocks,    3.146 MegaMoves ,    1.060 MegaAddrs , 67.63%
info:   138049 blocks,    4.194 MegaMoves ,    1.462 MegaAddrs , 69.62%
info:   142392 blocks,    5.243 MegaMoves ,    1.844 MegaAddrs , 71.81%
info:   146931 blocks,    6.291 MegaMoves ,    2.164 MegaAddrs , 74.10%
info:   152726 blocks,    7.340 MegaMoves ,    2.481 MegaAddrs , 77.02%
info:   158931 blocks,    8.389 MegaMoves ,    2.733 MegaAddrs , 80.15%
info:   164693 blocks,    9.437 MegaMoves ,    2.953 MegaAddrs , 83.06%
info:   169636 blocks,   10.486 MegaMoves ,    3.182 MegaAddrs , 85.55%
info:   174740 blocks,   11.534 MegaMoves ,    3.410 MegaAddrs , 88.13%
info:   178761 blocks,   12.583 MegaMoves ,    3.635 MegaAddrs , 90.15%
info:   180687 blocks,   13.631 MegaMoves ,    3.811 MegaAddrs , 91.13%
info:   181868 blocks,   14.680 MegaMoves ,    3.968 MegaAddrs , 91.72%
info:   183095 blocks,   15.729 MegaMoves ,    4.125 MegaAddrs , 92.34%
info:   184314 blocks,   16.777 MegaMoves ,    4.273 MegaAddrs , 92.96%
info:   185046 blocks,   17.826 MegaMoves ,    4.407 MegaAddrs , 93.32%
info:   186241 blocks,   18.874 MegaMoves ,    4.558 MegaAddrs , 93.93%
info:   187702 blocks,   19.923 MegaMoves ,    4.754 MegaAddrs , 94.66%
info:   189164 blocks,   20.972 MegaMoves ,    4.931 MegaAddrs , 95.40%
info:   190250 blocks,   22.020 MegaMoves ,    5.094 MegaAddrs , 95.95%
info:   191531 blocks,   23.069 MegaMoves ,    5.262 MegaAddrs , 96.60%
info:   192657 blocks,   24.117 MegaMoves ,    5.449 MegaAddrs , 97.16%
info:   193834 blocks,   25.166 MegaMoves ,    5.630 MegaAddrs , 97.76%
info:   194764 blocks,   26.214 MegaMoves ,    5.815 MegaAddrs , 98.23%
info:   195960 blocks,   27.263 MegaMoves ,    6.006 MegaAddrs , 98.83%
info:   197082 blocks,   28.312 MegaMoves ,    6.172 MegaAddrs , 99.39%
fatal: o2i_ECPublicKey failed
Aborted (core dumped)


This is a fresh Ubuntu 12.04 install with 8Gb of ram. Any thoughts on why I got this message? The allbalances.txt file is created but is empty so I assume the file is not written until the command is completed.

***Disclaimer***
I am just barely above noob level on linux.

Yeah, I hit this too a couple of days back.

Turns out someone managed to include a few transactions in the blockchain
that send funds to invalid compressed keys, something my code assumed was
not possible.

I have a fix for it, I'll push it to the git repo sometimes today.



Fix pushed to github.


Im still getting this when I run allabalances..  Sad
legendary
Activity: 1400
Merit: 1005
September 27, 2012, 05:39:53 PM
#73
It'd be great if someone could host this on the web, maybe charging a small fee for each lookup or something.


Mmmh, not really : this is designed to run a full linear sweep of the entire
blockchain for every query ... that's truly heavy duty (both raw I/O and CPU).

The moment 5 users hit the web site at the same time, the server will basically die.

The way blockchain.info does it is the right approach for what you describe:
they dump the blockchain into a DB with a crapload of pre-computed indices
and update said DB incrementally to keep the queryable version up to date.
I guess I just don't like blockchain.info's way of displaying the data it finds.  Maybe I need to get used to it more.

Regardless, jobs could be queued, and the resource-intensiveness is why I suggested a small fee for each lookup.

There are those of us who do not know linux well enough to run something like what you have created here, but would still like it to be accessible.  Wink
legendary
Activity: 1400
Merit: 1005
September 27, 2012, 04:17:14 PM
#72
It'd be great if someone could host this on the web, maybe charging a small fee for each lookup or something.
hero member
Activity: 905
Merit: 1001
September 27, 2012, 09:57:42 AM
#71
ok i see. i am good at php coding but c++ is not my best friend Cheesy i dont think that i am able to provide some patches.
hero member
Activity: 905
Merit: 1001
September 27, 2012, 07:33:01 AM
#70
great work znort!
is it also possible to use this parser for a litecoin blockchain? i think so...

unfortunately i only have debian 32bit so i have to organize a 64bit server for testing this.
legendary
Activity: 1652
Merit: 1016
September 22, 2012, 11:30:00 AM
#69
haven't touched windows in 10 years and don't plan to do so ever again.

6 years for me; and counting.
donator
Activity: 2058
Merit: 1007
Poor impulse control.
September 21, 2012, 07:44:04 PM
#68
Great, thanks!

Btw, are there any pre-built windows binaries available?

Nope.
And there's unlikely ever going to be any.
haven't touched windows in 10 years and don't plan to do so ever again.


What, you're saying that we just have to work when we're at work? It's people like you that make it hard for me to be a slacker.
legendary
Activity: 2940
Merit: 1333
September 21, 2012, 07:02:03 PM
#67
Great, thanks!

Btw, are there any pre-built windows binaries available?

Nope.
And there's unlikely ever going to be any.
haven't touched windows in 10 years and don't plan to do so ever again.

+1
legendary
Activity: 1092
Merit: 1016
760930
September 21, 2012, 08:12:30 AM
#66
Great, thanks!

Btw, are there any pre-built windows binaries available?
member
Activity: 107
Merit: 10
September 20, 2012, 04:14:38 AM
#65
sorry for the newb question:

is it possible to find out how many addresses containing over 500 btc have NOT been used since January 2011, for instance?

(not used = not used for sending coins)
newbie
Activity: 75
Merit: 0
September 12, 2012, 12:13:02 PM
#64

Cool thanks znort987 for the future fix. I am just tinkering but I have seen other people on the forums doing serious analysis with this tool and I applaud you for releasing this to everyone.
legendary
Activity: 910
Merit: 1000
Quality Printing Services by Federal Reserve Bank
September 11, 2012, 02:42:19 PM
#63
I am having trouble compiling.
http://pastebin.com/TrfSecqA

From the README:

Code:
sudo apt-get install libssl-dev build-essential g++-4.4 libboost-all-dev libsparsehash-dev git-core perl

Did you do that ?


I am going to attempt building it in Gentoo.
(most of this stuff is probably installed)
Code:
emerge -atvu1 dev-libs/openssl dev-libs/boost dev-cpp/sparsehash dev-vcs/git dev-lang/perl

newbie
Activity: 75
Merit: 0
September 11, 2012, 02:24:48 PM
#62
I installed this and started doing some of the examples in the readme file and everything is working until I ran allbalances.

I get this output.

Quote
xxxxx@xxxxxxxx:~/blockparser$ ./parser allbalances >allbalances.txt

info: Starting command "allBalances"

info: analyzing blockchain ...
info:        0 blocks,    0.000 MegaMoves ,    0.000 MegaAddrs ,  0.00%
info:   118089 blocks,    1.049 MegaMoves ,    0.381 MegaAddrs , 59.56%
info:   129462 blocks,    2.097 MegaMoves ,    0.722 MegaAddrs , 65.29%
info:   134099 blocks,    3.146 MegaMoves ,    1.060 MegaAddrs , 67.63%
info:   138049 blocks,    4.194 MegaMoves ,    1.462 MegaAddrs , 69.62%
info:   142392 blocks,    5.243 MegaMoves ,    1.844 MegaAddrs , 71.81%
info:   146931 blocks,    6.291 MegaMoves ,    2.164 MegaAddrs , 74.10%
info:   152726 blocks,    7.340 MegaMoves ,    2.481 MegaAddrs , 77.02%
info:   158931 blocks,    8.389 MegaMoves ,    2.733 MegaAddrs , 80.15%
info:   164693 blocks,    9.437 MegaMoves ,    2.953 MegaAddrs , 83.06%
info:   169636 blocks,   10.486 MegaMoves ,    3.182 MegaAddrs , 85.55%
info:   174740 blocks,   11.534 MegaMoves ,    3.410 MegaAddrs , 88.13%
info:   178761 blocks,   12.583 MegaMoves ,    3.635 MegaAddrs , 90.15%
info:   180687 blocks,   13.631 MegaMoves ,    3.811 MegaAddrs , 91.13%
info:   181868 blocks,   14.680 MegaMoves ,    3.968 MegaAddrs , 91.72%
info:   183095 blocks,   15.729 MegaMoves ,    4.125 MegaAddrs , 92.34%
info:   184314 blocks,   16.777 MegaMoves ,    4.273 MegaAddrs , 92.96%
info:   185046 blocks,   17.826 MegaMoves ,    4.407 MegaAddrs , 93.32%
info:   186241 blocks,   18.874 MegaMoves ,    4.558 MegaAddrs , 93.93%
info:   187702 blocks,   19.923 MegaMoves ,    4.754 MegaAddrs , 94.66%
info:   189164 blocks,   20.972 MegaMoves ,    4.931 MegaAddrs , 95.40%
info:   190250 blocks,   22.020 MegaMoves ,    5.094 MegaAddrs , 95.95%
info:   191531 blocks,   23.069 MegaMoves ,    5.262 MegaAddrs , 96.60%
info:   192657 blocks,   24.117 MegaMoves ,    5.449 MegaAddrs , 97.16%
info:   193834 blocks,   25.166 MegaMoves ,    5.630 MegaAddrs , 97.76%
info:   194764 blocks,   26.214 MegaMoves ,    5.815 MegaAddrs , 98.23%
info:   195960 blocks,   27.263 MegaMoves ,    6.006 MegaAddrs , 98.83%
info:   197082 blocks,   28.312 MegaMoves ,    6.172 MegaAddrs , 99.39%
fatal: o2i_ECPublicKey failed
Aborted (core dumped)


This is a fresh Ubuntu 12.04 install with 8Gb of ram. Any thoughts on why I got this message? The allbalances.txt file is created but is empty so I assume the file is not written until the command is completed.

***Disclaimer***
I am just barely above noob level on linux.
newbie
Activity: 42
Merit: 0
August 27, 2012, 12:55:41 AM
#61
Hey all.

I developed an online tool that does the exact same kind of operations (grouping addresses together through connected components) in O(1) while giving you the ability to visualize an ownership network that is built on top of it.  For that first address you calculated, you can check out the results by going here: http://blockviewer.com/#/owns/1CjLmm25ty4aSjxzG8Er4qSiQ63bqaQGA8 and then clicking on the "owner" node (they are sort of hard to click on... I'm working on that).  That will pull up all the addresses associated with it, along with other information.

If you think this is interesting, check out my announcement post here -> https://bitcointalksearch.org/topic/announce-blockviewercom-visualize-the-bitcoin-block-chain-103609
I don't mean to thread jack you all, but I thought you all would find this interesting.  If you would like to check more addresses, simply type it in in the search bar and select "Owner Address".  Then, as usual, click the owner node and start traversing the block chain!

Enjoy!
hero member
Activity: 574
Merit: 500
August 02, 2012, 10:43:00 AM
#60
znort987:

Could you add to parser.c:

#ifndef O_DIRECT
#define O_DIRECT 0x10000000
#endif

O_DIRECT isn't defined on OSX. Otherwise I was able to compile on my macbook with macports.

Pages:
Jump to: