How grab 100 daily transactions with details - Using an api

GameUnits

jr. member

Activity: 102

Merit: 5

GameBit - The Network

Quote from: mocacinno on April 16, 2021, 07:35:44 AM

or just run a full node with the txindex option activated? That way you can use a simple json-rpc to query as much as you'd like without anybody limiting you... It's your node, your mempool, your txindex,.... the only one stopping you is you

Made my Day! From my view that mempool open source tool doesnt seem to be that complicated to rebuild. Indeed you would just need to connect the right API to your app then. I dont know if there a lot of "good" API services which provide a high per minute frequency of calls.

Good luck!

ABCbits

legendary

Activity: 2870

Merit: 7490

Crypto Swap Exchange

Quote from: mocacinno on April 17, 2021, 11:22:26 AM

Quote from: ?? on ??

Quote from: mocacinno on April 16, 2021, 07:35:44 AM

or just run a full node with the txindex option activated? That way you can use a simple json-rpc to query as much as you'd like without anybody limiting you... It's your node, your mempool, your txindex,.... the only one stopping you is you

Bitcoin Core JSON-RPC is limited, especially because there's no index for transaction.--snip--

txindex=1 is a valid bitcoin core option (default=0). When set to 1, a full transaction index should be maintained. Truth be told, I haven't run a node with txindex=1 for many, many years... Turning this option on requires more resources, and turning it on on an existing node triggers a full rescan..... But when turned on, a full node is sufficient, and json-rpc query's should do the trick... With this option, he should be able to query as many confirmed AND unconfirmed transactions as his hardware can handle.

For other things, like addressindex, you'll require a patched bitcoin core node, since such an index is not available in the default implementation... Bitcore used to have a patch, but afaik, they stopped using a patched node implementation around version 0.16.0 and switched to their own implementation (at least, that's what my memory is telling me)

Actually i wanted to say txindex and addressindex, but forget to mention it. That's why i recommend self-hosted block-explorer (which usually use Bitcoin Core or other compatible client). Performance when enabling txindex on Bitcoin Core is barely noticeable (i use HDD), but the txindex size isn't small (about 30GB).

AFAIK Bitcoin Core never implement txindex. There are some attempt to implement another index (such as #14053 and #10370), but without success.

mocacinno

legendary

Activity: 3612

Merit: 5297

https://merel.mobi => buy facemasks with BTC/LTC

Quote from: ?? on ??

Quote from: mocacinno on April 16, 2021, 07:35:44 AM

or just run a full node with the txindex option activated? That way you can use a simple json-rpc to query as much as you'd like without anybody limiting you... It's your node, your mempool, your txindex,.... the only one stopping you is you

Bitcoin Core JSON-RPC is limited, especially because there's no index for transaction.--snip--

txindex=1 is a valid bitcoin core option (default=0). When set to 1, a full transaction index should be maintained. Truth be told, I haven't run a node with txindex=1 for many, many years... Turning this option on requires more resources, and turning it on on an existing node triggers a full rescan..... But when turned on, a full node is sufficient, and json-rpc query's should do the trick... With this option, he should be able to query as many confirmed AND unconfirmed transactions as his hardware can handle.

For other things, like addressindex, you'll require a patched bitcoin core node, since such an index is not available in the default implementation... Bitcore used to have a patch, but afaik, they stopped using a patched node implementation around version 0.16.0 and switched to their own implementation (at least, that's what my memory is telling me)

Quote from: ranochigo on April 17, 2021, 08:52:13 AM

--snip--
Unfortunately, I don't think they are ordered by the time received nor do I know of any API which does that.

the getrawmempool json-rpc query should (amongst other things) return the time:

Code:

 "time" : xxx,                         (numeric) local time transaction entered pool in seconds since 1 Jan 1970 GMT

ranochigo

legendary

Activity: 3038

Merit: 4418

Crypto Swap Exchange

Quote from: ?? on ??

Bitcoin Core JSON-RPC is limited, especially because there's no index for transaction. OP also need to run self-hosted block explorer with API features (such as mempool.space which already mentioned).

Since OP also requires unconfirmed transaction, I reckon it would be possible to just do a getrawmempool to the Bitcoin Core and arrange the transactions accordingly. Unfortunately, I don't think they are ordered by the time received nor do I know of any API which does that.

Getting the confirmed transaction is probably easier by querying the latest block.

mocacinno

legendary

Activity: 3612

Merit: 5297

https://merel.mobi => buy facemasks with BTC/LTC

or just run a full node with the txindex option activated? That way you can use a simple json-rpc to query as much as you'd like without anybody limiting you... It's your node, your mempool, your txindex,.... the only one stopping you is you

PrimeNumber7

copper member

Activity: 1666

Merit: 1901

Amazon Prime Member #7

Quote from: Vort3x.Layers on April 15, 2021, 09:55:32 AM

How can i use mempool.space api for that purpose and grab 100 new confirmed or unconfirmed transactions with details?

You should review the documentation for their API. You should click on the "Transactions" tab.

If you are making 100 API calls every 5 minutes, you may run into rate limit issues and may get blocked. I don't see anything about rate limits, or the ability to buy a "premium" subscription to their API service that would allow you to make a higher volume of queries.

As others have mentioned, you can also create your own API (or hire someone to do so) that you can use to query this information.

NotATether

legendary

Activity: 1568

Merit: 6660

bitcoincleanup.com / bitmixlist.org

As far as I can tell the API is located here https://github.com/mempool/mempool/tree/master/backend/src/api

So you would open each file and see what classes it exports from its classes eg. getRecommendedFee().

You also have to dig around to see if the endpoints are served on some long path because I doubt they're all at the top level of the URL. Also you'll have to inspect the backend code to see what encoding it uses for the REST(?) request such as application/json, application/x-www-form-urlencoded or something else.

DaveF

legendary

Activity: 3500

Merit: 6320

Crypto Swap Exchange

mempool.space is open source:
https://github.com/mempool/mempool

You can run it locally and do whatever you want with it in terms of how much data you pull without getting blocked.

Looking at what they give you it's going to be separate calls for each thing you want.
Not a big deal, but I don't know how many requests they allow you before a block / throttle.

-Dave

Vort3x.Layers

jr. member

Activity: 47

Merit: 11

Hi dear developers,
It seems mempool.space has a api for developers.
I have a question from you.
I grabbed last 100 transactions in every 5 minutes using url below :
blockchain.com - unconfirmed-transactions
I have two problems on this :
1-blockchain.com blocked me after some requests on this url.
I need details of every tx hash such as status & inputs & outputs.

How can i use mempool.space api for that purpose and grab 100 new confirmed or unconfirmed transactions with details?

If mempool.space api is n't capable for that purpose please introduce me another api.

Topic: How grab 100 daily transactions with details - Using an api (Read 241 times)