I'm exhausted but I finished up a major code refactoring. Everything is all nice and clean now and multithreaded so it's a bit faster. It also has a manual pre-filter to ignore a ton of junk assets which really helps to speed things up.
I haven't added the asks and probably will not since the last trade price is more meaningful now that liquidity has mildly improved. I have also added in more prudent asset filters, which became a necessary modification to the system given the high risk of GLBSE issues. Additionally, I'm hoping that after the pirate situation is resolved liquidity will improve further as people move more funds into the GLBSE.
Anyhoo, just for fun here's a fresh set of debug outputs from the new/updated version 2 of MOVETO.FUND's backbone:
....updating data/glbse/trades
recent_id: 243047978762383360
[u'trade', u'
[email protected]', u'JTME', u'1346782318']
Count: 1, min_id: 243048779824103424, recent_id: 243047978762383360
....updating data/glbse/index
["BTC","JLP","JLP-BMD","BITCOINTORRENTZ","ENJAN16","BM","BMMO","EN","BIT.INC","TYGRR.BOND-B","TYGRR.TECH","UBTC","CRYPTOL","CC","CIB-SOLUTIONS","MU","COGNITIVE","IBB","M.ETF","MPOE.ETF","BTCSYN","RSM","MERGEDMINING","FPGA.CONTRACT","SATOSHISDAEMON.HORSE","CHEAPERINBITCOINS-STOCKS","PUREMINING","BST","BTCWEB","SS","TYGRR.BOT","FPGA-EU","AA","BITBOND","BFLS","GIGAMINING","BTCMC","YABMC","TCC","BFLS.FUTURES","CANMINE","PPT","PPT.A","BTC-MINING","ABM","MATH","FPGA-IPCORE-DEV","JAH","RUGATU","BDK","PPT.B","ANTI-PIRATE","PPT.C","ZIP.A","ZETA-MINING","TEEK.A","TEEK.B","BDK.BND","GOLD","SILVER","PPT.D","TICKER","PLATINUM","RAREEARTH","DMC","REBATE","TYGRR.BOND-A","BIOETHANOL","GREEN","PPT.DIV","JTGB","IMPACT","PPT.E","HEDGE","BMF","007","MINING","NONVERBA","MOORE","TYGRR.BOND-P","ABSORB.1.4-6.LONG","ABSORB.1.4-6.SHORT","HEDGE.TYGRR.BOND-B.LONG","HEDGE.TYGRR.BOND-B.SHORT","FZB.A","FOO.PPPPT","BIB.PIRATE","HEDGE.TEEK.B.LONG","HEDGE.TEEK.B.SHORT","HEDGE.GIGA.LONG","HEDGE.GIGA.SHORT","MOVETO.FUND","PIMP","USD","OBSI.1MHS","B-FCMC","CPA","BTCASS_BOND_A","SYNERGY","STANDARD.GOLD","STANDARD.FIAT","FUTUREFUND","NASTY","BBBB","UDN","PAJKA.BOND","YXWINE-CARR2010","POLY.10.1","HYDRO.BONDS","BIB.BVPS","OBSI.ABMO","BIF-AG-INDEX","MEI.DEEPBIT.A","ADMINSORTED","POLY.10.-2","METAL","BDT","ASIC.COOP","BFLS.RIG","BITNODES","METAL.SILVER","MINING_B.HEADS.FUT","MINING_B.TAILS.FUT","BIF.BTCST.PPT","BTCS","THUNDERCM.MIF.SHARES","YARR","JTME","ASIC_RUS.SHA","OBSI.HRPT","ARS","DI.BFLSC.FAIL","DI.BFLSC.SUCCEED","PUREASIC","FPGAMINING","BITCOINRS","MEI.DEEPBIT.B","MEI.SLUSH.B","MEI.OZCOIN.B","TEEK.USD","LTC-MINING","CBGB","BTC-BOND","SLV-BUFFALO","BIF.1YR.LOAN","BIF.P2P.LOANS","MAR","MEI.DEEPBIT.A1","MEI.SLUSH.A","CIUCIU.BOND","GMVT-BOT","ASICMINER","BIF.5-10.MININGBOND","TEEK.PPT","GIPPT","NYAN","NYAN.A","NYAN.B","NYAN.C","TYGRR.BOND-D","TYGRR.BOND-PI","PGM","CIUCIU.MINING","YABIF","MMM","BLUECHIP","BITCOINMINV","V.HRL","KRAKEN","GERBITIN.PYRA","FDBF","GSDPT","BAKEWELL"]
....downloading dividends: 2.222222 % complete
accessing
https://www.glbse.com/api/dividends/asset/JLP-BMDaccessing
https://www.glbse.com/api/dividends/asset/BITCOINTORRENTZdownloading dividends: 2.222222 % complete
downloading dividends: 2.222222 % complete
updating data/glbse/dividends/JLP-BMD
....downloading dividends: 97.777778 % complete
accessing
https://www.glbse.com/api/dividends/asset/FDBFdownloading dividends: 98.888889 % complete
updating data/glbse/dividends/GERBITIN.PYRA
accessing
https://www.glbse.com/api/dividends/asset/GSDPT....unpacking bars: 2.222222 % complete
updating data/glbse/bars/BITCOINTORRENTZ
updating data/glbse/bars/JLP-BMD
updating data/glbse/bars/BMMO
updating data/glbse/bars/TYGRR.BOND-B
updating data/glbse/bars/TYGRR.TECH
updating data/glbse/bars/CC
updating data/glbse/bars/MU
....updating data/glbse/bars/YABIF
updating data/glbse/bars/MMM
updating data/glbse/bars/BLUECHIP
updating data/glbse/bars/BITCOINMINV
updating data/glbse/bars/GERBITIN.PYRA
updating data/glbse/bars/FDBF
updating data/glbse/bars/GSDPT
....culling bad data and removing IPO assets...
calculating indicators...
building spreadsheet...
done