What are the setup costs of developing your own bitcoin blockchain explorer

keychainX

member

Activity: 378

Merit: 53

Telegram @keychainX

Quote from: GreatArkansas on January 02, 2020, 05:20:38 AM

Quote from: keychainX on January 01, 2020, 08:05:18 AM

(.....)
In terms on online server, amazon instances are pretty good (we run both an BTC and ETH explorer) which are accessed from anywhere in the world using RPC calls and runs 24/7. Cost is about 300 USD/month for the data transfer.

This is quite a huge amount of money since the OP said he/she wanted to gain personal experience of developing blockchain explorer.
Do you have any idea if, for example, I'll do it first locally, just for fun or experience just what like OP wants, Do I still need those 500GB of space
or minimum/DELL R200 with 4GB of ram and an old Pentium CPU just what you told?

The only difference to run it locally would be to skip the Amazon EC2 instance costs.

If you are on a budget there are several GITHUB repositories you could borrow from but it is still quite a challenging project
to run your own block explorer. (instead of hiring an experienced coder)

/KX

R.I.U. iol

newbie

Activity: 15

Merit: 2

Quote from: GreatArkansas on January 02, 2020, 05:20:38 AM

This is quite a huge amount of money since the OP said he/she wanted to gain personal experience of developing blockchain explorer.
Do you have any idea if, for example, I'll do it first locally, just for fun or experience just what like OP wants, Do I still need those 500GB of space
or minimum/DELL R200 with 4GB of ram and an old Pentium CPU just what you told?

Yes, you will still need to store all those data locally

GreatArkansas

legendary

Activity: 2534

Merit: 1397

Quote from: keychainX on January 01, 2020, 08:05:18 AM

(.....)
In terms on online server, amazon instances are pretty good (we run both an BTC and ETH explorer) which are accessed from anywhere in the world using RPC calls and runs 24/7. Cost is about 300 USD/month for the data transfer.

This is quite a huge amount of money since the OP said he/she wanted to gain personal experience of developing blockchain explorer.
Do you have any idea if, for example, I'll do it first locally, just for fun or experience just what like OP wants, Do I still need those 500GB of space
or minimum/DELL R200 with 4GB of ram and an old Pentium CPU just what you told?

@Bitcoinstein, probably this is one of the best personal experience to be added in your portfolio.
This is also one on my portfolio bucketlist, a blockchain explorer or any blockchain-related that code from the scratch. Well, good luck to you.

R.I.U. iol

newbie

Activity: 15

Merit: 2

You need at least to run a full node.
You also need to index properties that the users might search (such as all addresses, transactions, block heights, which a full node does not do by default)
Accoring to blockchair (https://blockchair.com/dumps), it's entire database with indexes is 900 GB (compared to ~250 GB for the raw blockchain alone)

tranthidung

legendary

Activity: 2310

Merit: 4085

Farewell o_e_l_e_o

One of very first things you have to consider in-depth before you start to build up you own bitcoin blockchain explorer is:

Which types of features your explorer will make it different and better (somewhat) than the current others on the market?

If you simply want to learn and practice how to set one explorer up, it is cool (it seems not your intention), but if you want to run a business with your own-built explorer, that is the same as the current others or worse, it is not a good start of your plans.

There are list of blockchain explorers, and I think you should spend sometime to experience them to see which things they do well, which things they can be improved (that you can apply to your explorer). There are ratings for each explorers (by that OP or by the others, but they are subjectively ratings, so you should take your own experience).

List of useful Bitcoin block explorers

I am not a coder and programmer, but from the perspective of user, that is what I can give you: "Analyse the cost-benefit and probability to successfully jump in the service market."

keychainX

member

Activity: 378

Merit: 53

Telegram @keychainX

Quote from: Bitcoinstein on December 31, 2019, 05:46:17 AM

So the only useful guide I've found is by hackernoon and it is talking about ethereum blockchain explorer setup.
I've been in Bitcoin for several years and now working on my own project. I am looking to develop a blockchain explorer from scratch rather than using existing API (for my personal experience).

What would it really takes in terms of hardware, code requirements and costs?

As far as I understand I first need to setup a Bitcoin node, making sure I have enough storage capacity to handle all historical blocks and transactions (am I right?)
But what am I doing from there? how do I turn it into an database and making my own API?

Does anyone have any guide for it?

First, do you want it to run locally or access through internet?

To run an explorer like the blockchain.com API you need about 500GB of space, except of above code, you would need to make a database of all TXs so you can parse it quickly. Either code yourself in Python or hire a coder. You would probably land on 2000 USD to have a fast and secure explorer. A simple windows/unbuntu box is fine, your can run it on as little as a DELL R200 with 4GB of ram and an old Pentium CPU. Most critical is good bandwith for data transfer and fast SSD disk.

In terms on online server, amazon instances are pretty good (we run both an BTC and ETH explorer) which are accessed from anywhere in the world using RPC calls and runs 24/7. Cost is about 300 USD/month for the data transfer.

Good luck
/KX

Pmalek

legendary

Activity: 2730

Merit: 7065

Before developing a new explorer, will it have any features that we can't find in existing solutions? What does it offer to its users?

Check out this post by pooya87 from 2017, maybe you will find what you are looking for there.
https://bitcointalksearch.org/topic/m.19353488

Quote from: pooya87 on June 04, 2017, 12:11:35 AM

https://github.com/bitcoin-abe/bitcoin-abe
announcement: https://bitcointalksearch.org/topic/announce-abe-07-open-source-block-explorer-knockoff-22785

used by blockexplorer.com
https://github.com/bitcoin-blockexplorer

used by live.blockcypher.com:
https://github.com/blockcypher/explorer

insight used by insight.bitpay.com and chain.localbitcoins.com
https://github.com/bitpay/insight/

3 more i found using Github search engine:
https://github.com/iquidus/explorer
https://github.com/lbryio/lbry-explorer
https://github.com/tsileo/btcplex

Monero block explorer:
https://github.com/moneroexamples/onion-monero-blockchain-explorer

MixMAx123

full member

Activity: 161

Merit: 168

I am also currently programming my own Blockchain Explorer. For the database I use the BLK files from BitcoinCore and an index file with pointers to the correct blocks in the correct order.

Hardware, you only need a PC with sufficient storage space on which the blockchain fits.
The best SSD for fast access times.

Bitcoinstein

jr. member

Activity: 46

Merit: 1

So the only useful guide I've found is by hackernoon and it is talking about ethereum blockchain explorer setup.
I've been in Bitcoin for several years and now working on my own project. I am looking to develop a blockchain explorer from scratch rather than using existing API (for my personal experience).

What would it really takes in terms of hardware, code requirements and costs?

As far as I understand I first need to setup a Bitcoin node, making sure I have enough storage capacity to handle all historical blocks and transactions (am I right?)
But what am I doing from there? how do I turn it into an database and making my own API?

Does anyone have any guide for it?

Topic: What are the setup costs of developing your own bitcoin blockchain explorer (Read 253 times)