Author

Topic: [DCX] The Digital Currency Index Project (Read 5467 times)

full member
Activity: 218
Merit: 100
October 12, 2013, 02:19:05 PM
#45
The DCX Index Project has been put on hold as of this week and until further notice, the reason being that we collected most of our trading data from btct.

As mentioned earlier, I am willing to share the source code, detailed formula and data, etc. if someone decides to continue it. Please PM me if you are interested.
hero member
Activity: 968
Merit: 515
September 08, 2013, 03:47:06 PM
#44
What is the plan with BTCGARDEN? Will you replace it with another security? How about LTC-Global.
full member
Activity: 218
Merit: 100
September 08, 2013, 02:53:29 PM
#43
Nice page Smidge.

Anyone know what caused these: https://i.imgur.com/MQYTuL4.png
Hi carpetbagger,

Sorry for the late response. I have fixed the values a while ago and they should display correctly again. There are certain occasions where some data cannot be fetched from the exchanges, which causes the odd values. I will add a sustainable bugfix soon.
sr. member
Activity: 258
Merit: 250
You can trust me, I have an avatar
September 04, 2013, 12:28:17 AM
#42
Nice page Smidge.

Anyone know what caused these: https://i.imgur.com/MQYTuL4.png
full member
Activity: 218
Merit: 100
August 13, 2013, 12:50:43 AM
#41
What language are you using?
Hi pankkake,

It's coded in php with a MySQL Database under Linux.

full member
Activity: 153
Merit: 100
August 12, 2013, 07:31:22 PM
#40
Hi Smidge,

Do you have plans to add a graph that can be time-period-defined? Eg. 7 days, 30 Days, 3 months, 6mths, 1 year etc etc. That would be really helpful.
full member
Activity: 182
Merit: 100
August 12, 2013, 03:14:23 PM
#39
What determines the securities that make up DCX?
Hi zefyr0s,

It's primarily market cap. If it's non-mining, I would prefer it though even with smaller market cap to make the index more independent from mining ventures. The API of the exchange that it is listed on also plays a role currently. I am currently figuring out the Bitfunder (beta) API in order to add LabRatMining to the index next.


Any particular reason why you use bitfunder over other exchanges?

Edit: What I mean to ask is, do you use one exchange or several exchanges to determine the value and market cap.
full member
Activity: 218
Merit: 100
August 12, 2013, 02:24:23 PM
#38
Hi everyone,

Because I will be focusing all my time and energy on the Smidge.Com A fund, I would like someone to take over the DCX Index or at least the idea. I am willing to share the source code, detailed formula and data, etc. if someone agrees to give it a new home and continue it.

Please let me know if you are interested. I think the digital currency community needs a reference index and if it is well composed, with enough (historical) data and professionally managed, it can become the single most important figure besides BTC/USD.

full member
Activity: 218
Merit: 100
August 08, 2013, 12:56:20 PM
#37
Maybe there could be also displayed change in BTC/USD rate (just for reference). Today it fell 5%, that's one of the reasons for the market crash - people cashing out USD.
Hi Progressive,

Of course BTC/USD is the single most important figure (and reference!). Will do, thanks.
full member
Activity: 218
Merit: 100
August 08, 2013, 12:55:20 PM
#36
What determines the securities that make up DCX?
Hi zefyr0s,

It's primarily market cap. If it's non-mining, I would prefer it though even with smaller market cap to make the index more independent from mining ventures. The API of the exchange that it is listed on also plays a role currently. I am currently figuring out the Bitfunder (beta) API in order to add LabRatMining to the index next.
full member
Activity: 181
Merit: 100
August 08, 2013, 12:52:44 PM
#35
Maybe there could be also displayed change in BTC/USD rate (just for reference). Today it fell 5%, that's one of the reasons for the market crash - people cashing out USD.
sr. member
Activity: 245
Merit: 250
August 08, 2013, 12:43:57 PM
#34
What determines the securities that make up DCX?
full member
Activity: 218
Merit: 100
August 08, 2013, 12:28:01 PM
#33
DCX is tanking today, -9.92% atm.

BASIC-MINING (-40%), COGNITIVE (-15%) and ASICMINER (-11%) being among the biggest losers.
hero member
Activity: 663
Merit: 500
August 06, 2013, 05:02:12 PM
#32
Wow!!! Nice work Smidge !
legendary
Activity: 1106
Merit: 1026
August 06, 2013, 04:08:55 PM
#31
For example, any bitfunder JSON is at /json/BF/, for example, http://coinflow.co/json/BF/TAT.ASICMINER

Hi parseval,

thanks (again). What I would like to have though is the number of outstanding shares of the past. This numbers can only be calculated for BF, as BTC-TC keeps an every-day-backup of their shareholders list.

I want to learn more about the Laspeyres method in real finance, because it seems it's a bit more tricky than using the formula with tick (or hour) data and previous tick (or hour) data. p0 doesn't have to use the last-tick-cap-data which I assumed, but can use an older value as basis. For example the basis value could be the end-of-day capitalization sum of the day (or month, or..) before. Here is a detailed paper about the DAX as input, which uses this approach.

Another approach I will test in the next days is to use the sum of market capitalization (BSI in my last post), but with a volume based averaged price. This should prevent that a very small change in price leads to huge changes in the index value.


Some more brainstorming:

  • Create an index for each exchange with (almost) all securities?
     
  • Create an index in which more than one exchange is included?
     
  • Only include the n most capitalized companies either for one or more exchanges?
     
full member
Activity: 218
Merit: 100
August 06, 2013, 02:19:21 PM
#30
I can provide you with historical JSON trade data from the Coinflow site.  It has several months worth of bitfunder, havelock, and MPEX data pulled from IRC bot logs, since these sites don't have APIs with historical data.

Just replace '/chart/' in the URL of any page with '/json/' for the JSON data.

For example, any bitfunder JSON is at /json/BF/, for example, http://coinflow.co/json/BF/TAT.ASICMINER

I might work on creating a more complete export if there's demand for it...  I record whether it's a bid or ask, but that's not in the JSON currently.
Hi parseval,

Interesting, thanks a bunch. Once I have a solid charting engine up an running, I will move to importing historical data.
member
Activity: 97
Merit: 10
August 06, 2013, 01:16:09 PM
#29

Highly interesting. I need a more flexible charting engine (ClarkMoody style would be awesome), plus focus on getting historical data in there as a priority.

....

I think historical data is a quick win, plus I received the suggestion to add Moving Averages.
Get data from other exchanges would increase the number of price fixings (=liquidity).

I can provide you with historical JSON trade data from the Coinflow site.  It has several months worth of bitfunder, havelock, and MPEX data pulled from IRC bot logs, since these sites don't have APIs with historical data.

Just replace '/chart/' in the URL of any page with '/json/' for the JSON data.

For example, any bitfunder JSON is at /json/BF/, for example, http://coinflow.co/json/BF/TAT.ASICMINER

I might work on creating a more complete export if there's demand for it...  I record whether it's a bid or ask, but that's not in the JSON currently.

full member
Activity: 360
Merit: 100
August 06, 2013, 11:53:33 AM
#28
Anyone have a realistic description of all relevant securities out there with their number of shares and market cap? I am currently only accumulating data from btct.co. The goal would be to create a waterproof composition of the index to really have it reflect and be regarded as "The Market".


This is great - I started a similar thread : https://bitcointalksearch.org/topic/valuations-of-mining-shares-on-bitfunder-267682 to attempt to put a valuation on  some of these 'things' listed on bitfunder - would be happy to collaborate with you on your DCX initiative -- kinda like the djia and the nasdaq of bitcoins - love it!

full member
Activity: 218
Merit: 100
August 05, 2013, 11:56:45 AM
#27
When prices change, the market cap and % of Index change as well. The market cap should be calculated by price * outstanding shares.
Hi eltopo,

You are referring to the market cap being a function of the number of shares times the current share price, hence being dynamic at all times.

I agree that this is an important consideration, but currently I tend to simplify it by resetting the market cap manually (because it is a source of error). It is on the todo list though and will be implemented down the road. Thanks.
legendary
Activity: 1022
Merit: 1033
August 05, 2013, 09:35:39 AM
#26
It would be cool if you also display relative price difference for each security in this index.

For example, currently it is down: -4.61%, but to see what happened I need to go to btct.co, and as it uses different time reference, it isn't easy to see how change is explained.
Hi killerstorm,

Exactly right. There is currently no reference to what is exactly causing the index deviation and you have to look for it manually. I am working on this as we speak, thanks a lot.


done Cool

Thanks, this is great!
full member
Activity: 230
Merit: 100
August 05, 2013, 08:09:32 AM
#25
When prices change, the market cap and % of Index change as well. The market cap should be calculated by price * outstanding shares.
full member
Activity: 218
Merit: 100
August 05, 2013, 07:44:48 AM
#24
It would be cool if you also display relative price difference for each security in this index.

For example, currently it is down: -4.61%, but to see what happened I need to go to btct.co, and as it uses different time reference, it isn't easy to see how change is explained.
Hi killerstorm,

Exactly right. There is currently no reference to what is exactly causing the index deviation and you have to look for it manually. I am working on this as we speak, thanks a lot.


done Cool

full member
Activity: 218
Merit: 100
August 05, 2013, 05:45:56 AM
#23
DCX and Smidge.Com A (re-post from Smidge.Com thread)

I would like to clarify that Smidge.Com A is not an ETF on the DCX index and does not map or try to map its performance in any way.

  • DCX is a reference index that displays the performance of the securities with the highest market cap, to provide an indication of "The Market"
  • Smidge.Com A is a fund that I actively manage myself, that invests into a broad range of securities and aims to beat "The Market"
full member
Activity: 218
Merit: 100
August 05, 2013, 05:45:24 AM
#22
It would be cool if you also display relative price difference for each security in this index.

For example, currently it is down: -4.61%, but to see what happened I need to go to btct.co, and as it uses different time reference, it isn't easy to see how change is explained.
Hi killerstorm,

Exactly right. There is currently no reference to what is exactly causing the index deviation and you have to look for it manually. I am working on this as we speak, thanks a lot.
legendary
Activity: 1022
Merit: 1033
August 05, 2013, 04:30:33 AM
#21
It would be cool if you also display relative price difference for each security in this index.

For example, currently it is down: -4.61%, but to see what happened I need to go to btct.co, and as it uses different time reference, it isn't easy to see how change is explained.
full member
Activity: 218
Merit: 100
August 04, 2013, 01:27:21 PM
#20
Up for almost 48 hours, nice recovery today with +2.86%.

The forces of the market at work... beautiful Smiley


full member
Activity: 218
Merit: 100
August 04, 2013, 01:03:22 PM
#19
Cool idea but not sure why are you calling it currency index?
It looks more like "The BTCT Mining Index" Smiley
Hi EskimoBob,

Currently, it is more or less a Mining Index. But it is made up of the securities that reflect our market. This may change over time as new business models get implemented, for it is a very long term project.
legendary
Activity: 910
Merit: 1000
Quality Printing Services by Federal Reserve Bank
August 04, 2013, 11:24:38 AM
#18
Cool idea but not sure why are you calling it currency index?
It looks more like "The BTCT Mining Index" Smiley

full member
Activity: 218
Merit: 100
August 04, 2013, 07:56:29 AM
#17
Added change in percent to previous day's close (currently +1.01% to yesterday).
full member
Activity: 218
Merit: 100
August 04, 2013, 02:39:59 AM
#16
Hi dexX7,

Yay, I really support this. Smiley

I played a bit around with the Laspeyres formula and I'm not sure, if this is correct: I took BTCGARDEN, LABCOIN, ACTIVEMINING, COGNITIVE, ASICMINER-PT (no BASIC because split and simplicity...) and used the current number of issued shares as basis. This is not ideal, but I don't have data on historical numbers of issued shares and this is experimental anyway.

The share prices were grouped into 1 hour groups for each asset and I calculated the index output like this:

p0 = BTCGARDEN pricen * 2000000 + ... + ASICMINER-PT 1 hour pricen * 26006
p1 = BTCGARDEN pricen +1 * 2000000 + ... + ASICMINER-PT 1 hour pricen +1 * 26006

index value = p1 / p0 * 100.


Highly interesting. I need a more flexible charting engine (ClarkMoody style would be awesome), plus focus on getting historical data in there as a priority.


Brainstorming:

  • Exclude company held shares
     
  • Get historical outstanding share data
     
  • Which assets should be included?
     
  • What is a more realistic model for a representation of the market?
     
  • Fetch data from other exchanges
     


I don't have a very financial background and to be honest, I'm not even sure, where this leads, but one thing is for sure: it's time for the next level! A general overview of the Bitcoin markets is only the beginning and this thread by Smidged is the initial experiment to accomplish this. Cheesy

Any input and discussion is very welcomed.

I think historical data is a quick win, plus I received the suggestion to add Moving Averages.
Get data from other exchanges would increase the number of price fixings (=liquidity).

legendary
Activity: 1106
Merit: 1026
August 03, 2013, 06:25:59 PM
#15
Yay, I really support this. Smiley

I played a bit around with the Laspeyres formula and I'm not sure, if this is correct: I took BTCGARDEN, LABCOIN, ACTIVEMINING, COGNITIVE, ASICMINER-PT (no BASIC because split and simplicity...) and used the current number of issued shares as basis. This is not ideal, but I don't have data on historical numbers of issued shares and this is experimental anyway.

The share prices were grouped into 1 hour groups for each asset and I calculated the index output like this:

p0 = BTCGARDEN pricen * 2000000 + ... + ASICMINER-PT 1 hour pricen * 26006
p1 = BTCGARDEN pricen +1 * 2000000 + ... + ASICMINER-PT 1 hour pricen +1 * 26006

index value = p1 / p0 * 100.


Here are the results:

Daily, 1H groups with volume weighted average price


Daily, 1H groups with 1H closing price


Daily, 1H groups with line on close


So basically the Laspeyres formula can be used to track down changes in market cap and a steady value around 100 means that there is not much price fluctuation.



I also created market capitalization charts. Those represent simply the sum of the market capitalization of the above mentioned assets:

Daily combined market cap


Daily combined market cap with line on close



Brainstorming:

  • Exclude company held shares
     
  • Get historical outstanding share data
     
  • Which assets should be included?
     
  • What is a more realistic model for a representation of the market?
     
  • Fetch data from other exchanges
     


I don't have a very financial background and to be honest, I'm not even sure, where this leads, but one thing is for sure: it's time for the next level! A general overview of the Bitcoin markets is only the beginning and this thread by Smidged is the initial experiment to accomplish this. Cheesy

Any input and discussion is very welcomed.
full member
Activity: 218
Merit: 100
August 03, 2013, 02:12:02 PM
#14
Added CIPHERMINE to the index with a weight of currently 6.86% (about 542k LTC/15k BTC mkt cap)

https://www.litecoinglobal.com/security/CIPHERMINE
full member
Activity: 218
Merit: 100
August 03, 2013, 10:53:22 AM
#13
The basic question is, should the index describe the market 1:1 (market cap weighted) or should it regard all included stocks as equal...

There could be more than one basic question; one might be what sort of description would be most useful? For some people, equal weighted would probably be more useful, while for others some type of fundamental weighting might also be useful. For some ETFs, for example, it's earnings weightings that count.

I agree that it should focus on usefulness for the community.

...I see the index like a portfolio of securities and that is how it should behave...

I'm not sure I follow. Any index can behave like a portfolio of securities; there's more than one way to build a portfolio, and more than one way to have an index behave like a portfolio.

What I mean by this is that individual securities should not behave like they have a "distorted" value because we equal weight them. A compromise could be capping the security's weight at a certain percentage.

...long run, where we ideally want to have several more or less equal sized stocks competing along lots of small ones...

Why would that be ideal?

Because the index would be more diversified and not tied to one or a few security's performance, creating less overall volatility.

Edit: One solution could be to set a maximum weight that an individual security can have in the index (in the DAX, that is 10%, but there are 30 securities in there altogether). I think 25% would be enough. Thoughts?

Caps like that, although arbitrary, seem like at least one good way of helping an index provide more of a glimpse into something other than just its largest one or two constituents. If you're coming at it from the standpoint of how an index should behave, and you believe it should be market weighted, then a cap like that would be all wrong, but on the other hand it could make it more useful.

Thanks a lot for your input. I think the ideal setup for the BTC world lies somewhere in between. I am looking forward to discussing this further down the road and making the necessary adjustments.
full member
Activity: 218
Merit: 100
August 03, 2013, 10:32:52 AM
#12
(I've put this in the FAQ above)

Some input about variance and reference points:

smidge: in which intervals are p1 and p0 calculated? this seems to be critical, because if you do the calc.. well, let's say every new trade, the difference is very small (as only one number changes) and the result oscillates very close to 100
dexX7 very good question, i currently plan on setting the interval to daily
as you described, the variance would be too low
smidge: would you then take the end of day (or whatever interval) price of each asset or some averaged value?
dex the last price of the day would be used as reference for the next
sr. member
Activity: 316
Merit: 250
August 03, 2013, 08:48:11 AM
#11
this seems pretty cool nice work
sr. member
Activity: 330
Merit: 255
August 03, 2013, 08:37:28 AM
#10
The basic question is, should the index describe the market 1:1 (market cap weighted) or should it regard all included stocks as equal...

There could be more than one basic question; one might be what sort of description would be most useful? For some people, equal weighted would probably be more useful, while for others some type of fundamental weighting might also be useful. For some ETFs, for example, it's earnings weightings that count.

...I see the index like a portfolio of securities and that is how it should behave...

I'm not sure I follow. Any index can behave like a portfolio of securities; there's more than one way to build a portfolio, and more than one way to have an index behave like a portfolio.

...long run, where we ideally want to have several more or less equal sized stocks competing along lots of small ones...

Why would that be ideal?

Edit: One solution could be to set a maximum weight that an individual security can have in the index (in the DAX, that is 10%, but there are 30 securities in there altogether). I think 25% would be enough. Thoughts?

Caps like that, although arbitrary, seem like at least one good way of helping an index provide more of a glimpse into something other than just its largest one or two constituents. If you're coming at it from the standpoint of how an index should behave, and you believe it should be market weighted, then a cap like that would be all wrong, but on the other hand it could make it more useful.
full member
Activity: 218
Merit: 100
August 03, 2013, 08:07:26 AM
#9
Hi DrGregMulhauser,

The index is calculated using the Laspayres method. It is also used to calculate the traditional indices like DOW, DAX etc.

(Side note: Laspeyres -- not Laspayres -- method. Also, most major indices are market cap weighted, but the Dow is price weighted.)

Both fixed! Thank you.

Since the disadvantages of market cap weighted indexes are well known, have you considered an equal weighted index? Just a-wundrin'...

The basic question is, should the index describe the market 1:1 (market cap weighted) or should it regard all included stocks as equal, ignoring their market cap? I chose the previous for DCX, because I see the index like a portfolio of securities and that is how it should behave. As stated above, I think it is the best setup for the long run, where we ideally want to have several more or less equal sized stocks competing along lots of small ones.

Edit: One solution could be to set a maximum weight that an individual security can have in the index (in the DAX, that is 10%, but there are 30 securities in there altogether). I think 25% would be enough. Thoughts?

sr. member
Activity: 330
Merit: 255
August 03, 2013, 07:46:55 AM
#8
The index is calculated using the Laspayres method. It is also used to calculate the traditional indices like DOW, DAX etc.

(Side note: Laspeyres -- not Laspayres -- method. Also, most major indices are market cap weighted, but the Dow is price weighted.)

Since the disadvantages of market cap weighted indexes are well known, have you considered an equal weighted index? Just a-wundrin'...
full member
Activity: 218
Merit: 100
August 03, 2013, 06:47:19 AM
#7
102.7 seems to be a hard resistance today! Let's make a snapshot of it for the archives... Wink


full member
Activity: 218
Merit: 100
August 03, 2013, 05:31:36 AM
#6
Anyone have a realistic description of all relevant securities out there with their number of shares and market cap? I am currently only accumulating data from btct.co. The goal would be to create a waterproof composition of the index to really have it reflect and be regarded as "The Market".
hero member
Activity: 487
Merit: 500
Are You Shpongled?
August 03, 2013, 05:28:31 AM
#5
Very cool. I can't wait to see it when it gets a few weeks of data.
hero member
Activity: 518
Merit: 500
August 03, 2013, 05:23:08 AM
#4
Good work!
full member
Activity: 218
Merit: 100
August 03, 2013, 05:11:13 AM
#3
reserved
full member
Activity: 218
Merit: 100
August 03, 2013, 05:05:44 AM
#2
reserved
full member
Activity: 218
Merit: 100
August 03, 2013, 05:04:34 AM
#1
I hereby want to make an announcement for a Digital Currency Index (WORK IN PROGRESS) that can be used to indicate the current state of the market, as benchmark etc.

Feel free to shoot holes in it as you desire by just replying, but please make sure you take a look at the discussion that has been going on in this thread. I am excited about any feedback and looking forward to developing this project beyond it's Alpha stages.

If anyone with more data, capabilities etc. wants to pick this up and take it to new heights, I would be happy to cooperate and have lots of ideas (sub-indices, certificates, options...). Please contact me.

Cheers,
Smidge

-------------------------

[DCX] The Digital Currency Index Project

http://dcx.smidge.com

What is it?

DCX is the attempt to create an index like the DAX, FTSE etc. that you know from real world markets for the digital currency community.

Why do we need this?

Primarily as a benchmark. You can compare the performance of a stock, fund or any other security to this index, which should be a broad indication of securities that make up most of the digital currency market. In it's final form, you could regard it as "The Market" and check how a security (or your own portfolio) has performed against it, just like in the real world markets.

A fund manager for example can announce their fund's NAV being up 10% in just a week, which sounds pretty good. If "The Market", meaning a roundup of all securities, is up 25%, then the fund's performance relative to the market is pretty bad.

What is it's value?

It started on Friday, August 2nd, 22:00 CET with a value of 100.00. You can check it's current value at http://dcx.smidge.com or via the API. It's already up a few points at the time of this post Smiley

Why 8 decimal places?

Because we're used to it Smiley
This might be too much and could change pretty soon.

How often does this update?

Currently "only" once per minute. It cannot be used for (professional) daytrading yet, which is also not its current purpose. There will be improvements on this soon though, so that you can speculate on short term movements.

There is not enough data in there for me to plan my next move!

It's been running a few hours! Just give it a few days or weeks to accumulate more data.

The current chart looks like a bunch of crap

I know. There will be improvements on this soon, please note that the project is in Alpha stage. The current focus is accumulating data rather than displaying it in fancy ways.

It is also displayed as a Candlestick Chart, which describes the high/low and the opening/close values of the current data period (1 hour) at the same time. There is a lot of documentation out there on how to read it in case it confuses you.

Plus, you can always create your own charts by using the API!

Why are there no funds in it?

A fund traditionally invests in other securities, which means a fund itself is a compilation of standalone securities. Including it would lead to dilution and/or overweight of some standalone securities.

Some securities are dominating the index

That is correct. This lies in the nature of the current market and is not a problem of the index itself, I would describe it as "If ASICMINER coughs, the market gets a cold". As the index is made for the very long run, we will hopefully see worthy competition arise that evens out this imbalance.

How does it work?

The index is calculated using the Laspeyres method. It is also used to calculate the traditional indices like DAX, FTSE etc. The formula is described in detail below, plus here is a simplified example (S1-S3 being the securities included, price0 and price1 are their previous and current values, mkt cap is number of shares times the price):

Nameprice0price1mkt cap
S14040200
S25055300
S36060400



The value of 103.19 means that if the securities would perform in the way described in the table, the index would rise by 3.19% in the given timeframe. In detail, security S2 has a market cap of 300 (1/3 of the total 900 in the index) and gains 10% in value. This pushes the index up by 3.19% when using the Laspeyres method.

In which intervals are price0 and price1 from the example above calculated?

The interval is set to daily, which means the deviation (not the index value!) is "reset" at 0:00 CET and it begins using the new reference point from then on (for the next day).

Is there an API?

A very basic one, yes:

Current value: http://dcx.smidge.com/ticker
History: http://dcx.smidge.com/ticker/history

How do the next steps & planning look like?

That depends very much on community input. On my todo list is currently:

  • Get as much community input as possible
  • Add more securities to get a broader, more realistic depiction
  • Update more often to make daytrading possible/more effective (this is also a problem of the securities not being traded frequently enough)
  • Update to better charting software
  • Future music: Create sub incides based only on mining, funds etc.; Issue put/call options, create certificates etc.

-------------------------

Thanks 4 reading & please also take a look at my main project Smidge.Com - A virtual, actively managed, multi-asset digital currency fund: https://bitcointalksearch.org/topic/smidgecom-a-virtual-actively-managed-multi-asset-digital-currency-fund-259772
Jump to: