Author

Topic: blkXXXX.dat to csv [blockchain parser] (Read 322 times)

jr. member
Activity: 36
Merit: 3
newbie
Activity: 4
Merit: 0
November 02, 2019, 06:34:31 PM
#9
This will probably do exactly what you're looking to do..

https://pypi.org/project/bitcoin-etl/#description
newbie
Activity: 4
Merit: 0
November 01, 2019, 02:22:28 PM
#8
I've been building a python library that scans Core and assembles several tables into .xlsx files (which you could easily save as .csv instead). It's not public or on GitHub yet though
newbie
Activity: 11
Merit: 0
October 25, 2019, 03:19:07 AM
#7
Not running bitcoin core myself so that wouldn't be an option on my end. Good information from nc50lc and segwit data/structure changes that must be taken into account for any parser requirements.

Just got data block 600947 and was 8.2mb with 2774 transactions.

json without tx's and raw data are as follows:

https://i.imgur.com/N4oH2ZS.png
https://i.imgur.com/qIFbqiX.png
https://i.imgur.com/tvNSK5R.png

Trying to wrap this around my head how to organize data in .csv file and be of use for your request?     

Just a FYI, been awhile since I wrote any personal code for data collection/organizing/scraping of information, but been following the blockchain technology the last few years closely and figure reading/writing some code is only a positive to being active on the forum and in space.
copper member
Activity: 1666
Merit: 1901
Amazon Prime Member #7
October 20, 2019, 11:17:03 PM
#6
nah nothing works... I need the blockchain to json to csv for future analytic work but I keep failing to do so I would pay with gold for anything that works
How much are you offering?

This should not be very difficult if you have bitcoin core running.
newbie
Activity: 6
Merit: 0
October 18, 2019, 07:30:30 AM
#5
The thing is i set the direction correctly but it auto-adds the r .
Try to set it after closing local-blockchain-parser and all of its background process(es).

Quote from: Sinsix
When I delete it it says wrong path...
Of course it will, there will be no dat file directory.
If just the "r", I have no other idea aside from you've given the wrong path.

I haven't used that parser but you need to know that most of them are incapable of parsing blk.dat files with SegWit data in it.
Somewhere around blk00971.dat+.

nah nothing works... I need the blockchain to json to csv for future analytic work but I keep failing to do so I would pay with gold for anything that works
legendary
Activity: 2534
Merit: 6080
Self-proclaimed Genius
October 18, 2019, 03:27:19 AM
#4
The thing is i set the direction correctly but it auto-adds the r .
Try to set it after closing local-blockchain-parser and all of its background process(es).

Quote from: Sinsix
When I delete it it says wrong path...
Of course it will, there will be no dat file directory.
If just the "r", I have no other idea aside from you've given the wrong path.

I haven't used that parser but you need to know that most of them are incapable of parsing blk.dat files with SegWit data in it.
Somewhere around blk00971.dat+.
newbie
Activity: 6
Merit: 0
October 18, 2019, 02:23:33 AM
#3
You might have written an extra "r" to your Bitcoin blocks directory during the initial setup of the parser.
There shouldn't be any "r" folder there unless you've created one and moved your blocks dir.
According to the "readme", you can change it by editing the "wlff-blockchain.json" file from local-blockchain-parser's installation directory.

The thing is i set the direction correctly but it auto-adds the r . When I delete it it says wrong path...
legendary
Activity: 2534
Merit: 6080
Self-proclaimed Genius
October 17, 2019, 09:23:47 PM
#2
EDIT: I have tried this https://github.com/spooktheducks/local-blockchain-parser but I am getting problem

You might have written an extra "r" to your Bitcoin blocks directory during the initial setup of the parser.
There shouldn't be any "r" folder there unless you've created one and moved your blocks dir.
According to the "readme", you can change it by editing the "wlff-blockchain.json" file from local-blockchain-parser's installation directory.
newbie
Activity: 6
Merit: 0
October 17, 2019, 02:39:44 PM
#1
Hello.

I want to parser all blkXXXX.dat to json and then to csv to make my own database for analytic work but I just keep failing. I wonder if there is anyone to help me. I would be very grateful.

Looking for blockchain parser for windows10

EDIT: I have tried this https://github.com/spooktheducks/local-blockchain-parser but I am getting problem https://gyazo.com/6e1c5a38e75dd4a57a916a592b01fdb8
Jump to: