Monthly report of what have been done in "dev-updates". To be clear, this is copy/paste from #dev-updates on https://discord.me/dataminenetwork14.07.2020Now that the domain updates are out of the way, I've had some time to go back to the analytics. We've added ability to show all the delegated minters (or self minters) for any address.
So now you can see who is minting for a specific address, how much was locked it and how long this minter is active for (we'll have hour estimates in a future update).
Don't forget that this is all done in realtime so you'll be able to see these minters drop/add as it happens.
Tomorrow I'll start on the running balance of FLUX on per-address basis so you can get a REALTIME LEDGER for any address and see exactly how it got that FLUX balance at any time.
15.07.2020We've had a very strange personal attack from a beginner security auditor regarding a well-known ERC-20 approval exploit. This person chose to completely disregard our existing section on this form of attack within our Whitepaper.
Instead they chose to make it public so we've had to make a response on the audit (which is now part of the whitepaper):
https://github.com/Datamine-Crypto/white-paper/blob/master/docs/audits/librehash.mdGive this audit a read and see why your funds are safe
16.07.2020I've made substantial progress in the per-address realtime ledger for our upcoming Datamine DeFi Network Pro analytics. This means you'll soon be able to get a clear understanding into each address FLUX balances and understand exactly what is happening.
Will be able to have a screenshot of the frontend tomorrow, right now This ledger only records Mints and Burns but we'll also track movements and erc-20 movements as part of the ledger so you can get a complete history of per-address movements in realtime.
17.07.2020Today I want to showcase our new Realtime Running Balance widget. Why look at plain old and boring transactional Ethereum data trying to figure out what is happening in your wallet when you can have Datamine-powered realtime analytics.
We call this process "Realtime Data Enrichment". Let's compare the most popular Ethereum explorer (etherscan) vs our realtime multi-smart contract analytics platform.
In the screenshot below you can see our early progress of converting confusing transaction data into human-readable realtime ledger. This is still work in progress but you can see how we will revolutionize DeFi analytics as our data network is unlike anything else in the world.
We'll be sending out Alpha invites in just two weeks so be sure to stick around Discord as we want you guys to experience the Datamine DeFi Network Pro for yourself.
19.07.2020We've done some more cleanup on the realtime ledger and fixed up a bunch of UI data points. The ledger now has some additional events (such as Received) but we'll also add additional events (such as "Sold on Uniswap (DAM/FLUX)") when we add Uniswap integration.
Tomorrow I'll be jumping on license management for Alpha (each user invited to alpha gets 2 "buddy" links). These invitation links are integral part of the upcoming FLUX use case in our analytics. We'll share more info on how we plan to use FLUX in the network after Alpha is released.
It's time to talk about how we plan to utilize FLUX in Datamine DeFi Network Pro.
First of all we must understand exactly what we're trying to achieve:
- Grant access to core customer base: Users that are utilizing Datamine ecosystem need to be able to access the network free of charge.
- Limit "bad actors" and limit server resource utilization
- Connect core customer base together in realtime.
- Remove any form of registration & provide some form of privacy
Here is how FLUX is to be used in our Analytics platform:
- You MUST have burned any amount of FLUX on the selected address before gaining access
- You are placed in a priority ordered queue, where those that burned the most FLUX get to "skip the line" and are able to login to Network before others.
- You can get "knocked down" the line if someone burned more than you comes online.
- If the server is full you will be placed in priority queue.
- You get 2 buddy passes. These buddy passes have THE SAME priority as your main address
In conclusion:
- If you burn a lot of FLUX you are guaranteed free, no-queue entry to DeFi Network at any time of the day.
- YOU MUST burn FLUX to gain access. In beginning this will be as low as $0.01 to gain access and grow from there as server demand grows.
- We will increase FLUX burn queue as server resources allow. This means we can have a larger network in the future.
Alpha is coming out NEXT WEEK so be sure to check Discord for Alpha invitations.
23.07.2020We are now testing our first version of the MIT-Licensed Fully trustless Realtime Decentralized Dashboard for Datamine (DAM) & FLUX Ecosystem.
This realtime analytics dashboard builds feature:
- FULL PRIVACY MODE: For privacy and decentralization reasons everything is self-contained in this repository.
- No Installation & Version History: Pick and download any previous build of the dashboard.
- Minified: The entire dashboard will take up less than 3 MB in uncompressed form.
- Works in any folder structure. Drop this into a subfolder or a subdomain, all paths are relative.
It is now hosted on Github Pages:
https://datamine-crypto.github.io/realtime-decentralized-dashboard/Alternatively you can access the Github of all future builds:
https://github.com/Datamine-Crypto/realtime-decentralized-dashboardIf there are no issues found we will permanently redirect datamine.network to this decentralized dashboard completing another major step towards a truly decentralized DAM/FLUX Ecosystem
24.07.2020New build 264 of our Realtime Decentralized Dashboard is now available:
https://datamine-crypto.github.io/realtime-decentralized-dashboard/- Updated navigation for those of you with multiple delegated minters, changing dashboard url will now properly change the currently selected address WITHOUT refreshing the page
- Dashboard-specific links will now open up in new page
- Updated core navigation/titles and some page hashes to ensure navigation remains on a single page without refreshes
If there are no issues found, we'll be redirecting domains to this new decentralized dashboard (hosted on Github).
25.07.2020Just a small sneak peek preview at an update coming to the dashboard. Realtime FLUX Known Money Supply
We can break down the known FLUX supply into an easy to understand flow of funds. This will be available on the decentralized dashboard tomorrow.
The new Realtime FLUX Known Money Supply is now available on our decentralized dashboard:
https://datamine-crypto.github.io/realtime-decentralized-dashboard/Let me know if you find any issues, planning on redirecting domains to decentralized dashboard today.
26.07.2020Both
https://damcrypto.com/ and
https://datamine.network/ will now point to:
Our decentralized dashboard hosted on GitHub:
https://datamine-crypto.github.io/realtime-decentralized-dashboard/Please note your old dashboard-specific urls will take you to the homepage of the new decentralized dashboard. This is done to ensure there is no central point of failure.
Please update your links to use the new dashboard (as old links will always take you to the homepage). And just like that another piece of Datamine Network is decentralized.
27.07.2020Wanted to give you a quick update on how you will connect to our Datemine DeFi Pro Analytics.
There will be a new built-in button on all decentralized dashboard builds. By clicking this button you will be prompted to sign a custom message with your address. This does not cost anything but allows the analytics server to verify that you have access to the address that is signing the message.
Once you sign the message you will get unique access links to the dashboard. These links are unique and every time you use them you will kick anyone else out using the same link. (In a future update you will be able to re-generate these links by signing another message).
By using this approach with the burn queue we're able to eliminate registration but also connect core use base together. Don't forget YOU MUST burn FLUX to access the new analytics. The more FLUX that is burned for your address the higher your access priority is to the server.
We'll have more updates as the Alpha is coming in just 5 days.
28.07.2020Fixed some data syncing, check out this updated FLUX mint chart. We'll have more data points after the Alpha launches this week.
Also the biggest mint so far was 5200 FLUX (~20 days of not minting). Talk about delayed gratification
New build 268 of decentralized dashboard is up
https://datamine-crypto.github.io/realtime-decentralized-dashboard/Fixes:
- Uniswap trade links will now go to eth pairs (instead of WETH)
- Fixed some image links
- Updated packages
29.07.2020
New build 269 of decentralized dashboard is up
https://datamine-crypto.github.io/realtime-decentralized-dashboard/- Fixed more image paths
- Fixed Metmask add icons
- Fixed 3x time bonus timer
- Added new "old version" splash if you are somehow caching old index.html version. The button on this screen will reload the current page with current timestamp to avoid cache.
eth_signTypedData or EIP-712 is not supported by Ledger Nano S so in beginning you won't be able to generate Alpha links from these hardware addresses:
https://www.reddit.com/r/ledgerwallet/comments/hn7c6p/ledger_support_for_eth_eip712_signtypeddata/This is going to be my #1 priority tomorrow to find a work-around as we are few days from Alpha launch. Most likely solution will be as follows: Your delegated minter can sign and is counted as the same signature as locked-in DAM address.
Will have to investigate tomorrow but I've been able to get signing to work with Metamask with other addresses just fine. In the future we'll expand the alpha functionality to also consider "burn received amount" as qualification (not just burned amount). So if you are either burning OR someone burned to your address, you will be able to generate alpha links
IF INVITED: The number of links you get is dependent on your burn amount. Alpha dashboard links will function as follows (this will change in the future), the invitation links work as follows:
- Burn or have received burn of ANY FLUX amount: 1 alpha link
- Burn or have received burn of 10 FLUX(~$20) : 2 alpha links (You technically have 2 available spots in the burn queue at beta)
- Burn or have received burn of 20 FLUX (~$40) : 3 alpha links (You technically have 3 available spots in the burn queue at beta)
- Burn or have received burn of 100 FLUX (~$200) : 5 alpha links (You technically have 5 available spots in the burn queue at beta)
- Burn or have received burn of 1000 FLUX (~$2000) : 10 alpha links (You technically have 10 available spots in the burn queue at beta)
1. ETH Automatic syncing is disabled. We'll be running syncs manually to catch up to latest block
2. Alpha is INVITE ONLY, Only MVBs and Community Assistants are invited at the start. These are still very early stages of the network and this is our first network test. We'll send out more invites as the need arises.
30.07.2020Datamine DeFi Network Pro Alpha IS NOW LIVE ON PRODUCTION SERVER
Before we can send out invites we need to finalize the following outstanding tasks:
- Finalize off-chain sign on link generation
- Enable SSL
- Run through a security checklist
For Alpha and Beta everything runs off a single server. The idea behind this is that even though the network is made up of multiple Docker containers we want to see what kind of punishment a single VPS can handle.
So far the Alpha is blazing fast and our custom network communication is fast and efficient. Can't wait for you guys to check it out after these last set of remaining tasks.
I know you guys all want to check it out but we need to get these last of work items done. Our network is unlike any other website in the world and the speed of the UX will amaze you.
31.07.2020SSL Configurations are complete.
This means your connection to the Datamine Network will be performed in a secure manner.
We've had to add ensure the SSL certificates work for our central reservation server. This server is responsible for issuing connections to the network. It also creates unique data points for each user that connects.
Another SSL secured server is our "nchan server". This server is responsible for all realtime communication between the network and your browser.
This means every user that connects to the website can essentially communicate with any other user on the network in realtime. We have not created any "P2P" widgets yet but it's something that's on to-do list.
Next order of business is to finalize the on-chain sign on link generation. This requires some new data points (as we have to consider delegate burn FLUX amount).
Alpha invitations are coming before Tuesday, we're just finalizing the initial version of FLUX burn queue mechanism
1.08.2020Apparently SSL configuration was not completed yesterday. Today I noticed that our Event streams are dropped after ~100 seconds of idle time.
As our analytics are done in realtime these 100 second timeouts were not going to fly. I did a lot of digging round with nchan and nginx configurations trying out various timeouts and configurations.
Turns out the problem was with cloudflare DNS routing for SSL. We were using Cloudflare DNS proxy which made requests HTTP 2.0 and since they are routed through Cloudflare they terminated the streams after this idle time.
Had to get a new certificate and turn off Cloudflare DNS routing but now the connection to the server is persistent. Another advantage of this is that traffic is not routed through cloudflare anymore on pro analytics for another layer of security.
I'll take this extra long weekend time to do some polish before Alpha invites. We're looking really good now, hope to see you guys on alpha soon!
2.08.2020Rewrote the reservation server today. Now each unique link is limited to 1 connection to the server. Additionally when you disconnect you are properly removed from reservation server.
Currently the second connection made to the same dashboard link will display an error saying you are already connected. In the future this will disconnect the other session. Think of this like the Tradingview limits on concurrent connections.
Tomorrow I will work on the login server where you will be able to paste in your invite link. For this initial wave of invites it is likely they will be special one-time codes until the burn queue is ready before Beta.
Currently targeting Monday for the release, The goal of this first set of invites is to make sure the network supports multiple users, you will get 3 login codes each and this will not be tied to the burn queue yet as we're testing network stability first.
3.08.2020Been a super busy day with the analytics network. Here are some changes from Today:
- Split out logger/connection from rendering root object. This will be needed for new login screen as there is a lack of proper connection state managment
- Started work on reservation by "Datamine Pro Key"
- Added "Users In Memory" on stats page that will help monitor resource usage
- Fixed memory leak on context destruction
- Added new global widget disconnect event and now disconnecting will drain dispatch queue. This allows us to do async destructors on per-context
- Fixed realtime events for shared widgets (This will be an example of our realtime events across multiplie users)
- Improved how realtime stats are streamed no longer relying on api/rest context
- Split out shared widgets registration into a separate file and fixed order of event subscriptions
Current big ticket items for tomorrow:
- Fix removing shared widget subscriptions (memory leak)
- Login screen
Etherscan added social & icon for FLUX. Now both DAM & FLUX tokens have proper links & icons.
We're almost at 21,000 transactions for FLUX so we've spent more in transaction fees alone than the current FLUX market cap
4.08.2020Another busy day with Datamine Pro Analytics. I finished the last two remaining tasks but there are some last minute changes that I would like to squeeze in this week.
We need to add basic rate limiting before Alpha. Originally this was scheduled for Beta but after a frontend rewrite today we have a pretty good way to add this. This will ensure Alpha users don't abuse the server.
There are also some reservation server improvements I would like to add. Particularly recycling unused connections.
We also need to update how page routing works. Right now we're using HTML5 url fragments but this needs to be converted to hashes (as the centralized dashboard is also host on github).
Once these core additions are complete I will do another round of checks to see what else is remaining for launch.
5.08.2020This extra week of Alpha polish is really epic. I've finished up the frontend state management updates and will jump to rate limiting tomorrow.
These new frontend updates and Datamine Pro key entry allow me to spin up multiple network connections and are great for testing purposes.
I think the extra time that we spent with the shared widgets is totally worth it. They're really a staple of how powerful the network is. For example in this screenshot we have two unique network connections.
Notice how the active widgets is still 1 even though there are two of the same shared widget. On top of this each shared widget can choose who to send messages to.
Things are coming along nicely, can't wait to show you guys!
6.08.2020Was going to work on the rate limiting but decided to finish up the reservation updates I mentioned before.
Now the reservation server will properly recycle unused connections which means I can sleep better at night knowing the server won't go down due to a bottleneck.
Another security feature I added is privateKey generates a unique user id instead of it being same as privateKey. This means that even if you have the Datamine Pro Key you can't guess what nchan id that user is connected to.
Additionally the alpha keys have been generated and proper alpha key checks are in place now.
Now there is just two items remaining on my list before launch:
- Rate limiting
- URL updates to hashes.
10.08.2020Yesterday we've put up our build of the new Alpha analytics and sent out over 25 invite keys. There is a new build out today with the following features:
- Reworked connection management. Now if you use the same Datamine Pro Key, the other window that was connected gets kicked out. This was the main major issue that happened to two users yesterday so I wanted to make sure that it was addresses as this was an oustanding item. This new connection management works a lot like Tradingview.
- Alpha key is remembered now after login. This will make it easier to test out new features without re-entering the key each time.
- New Docker optimizations to ensure higher uptime and better update rollouts in the future requiring a simple docker restart.
We'll be adding a ton of new features this week and hopefully testing Realtime Ethereum block updates later this week as it's a core feature! Lots to come this week so be sure to stay tuned
11.08.2020Today I've been able to add block syncing to our analytics platform. This means we can now assign dates to all actions instead of block numbers. This makes our running ledger even more powerful as well as being able to get a better idea of lock-in durations.
This adds a bit of overhead to syncing speed but I am hoping there will be better sources of Ethereum log data in the future.
Additionally cache is automatically purged when there is new data to sync. This means we can utilize cache until a new block comes in so data is always fresh. There will be additional improvements to cache in the future.
Current estimate for Alpha is 2 months which will take us into public BETA. By this time we should have all the data points we want, realtime syncing and FLUX burn queue.
Updated roadmap is coming later this week to reflect this upcoming Beta release.
12.08.2020Another analytics update is live! You now get "instant search" navigation so you can finally paste in any address you want to go to.
Tomorrow the plan is to make a couple of updates to our decentralized dashboard. Specifically I want to add automatic retry mechanism for the "Ethereum latency" error that pops up, fix a couple of display bugs and update the roadmap.
So be sure to check that update out in coming days for improved UX.
13.08.2020A couple of updates Today:
- New Build 299 of Datamine Realtime Decentralized Dashboard is now live and available on:
https://github.com/Datamine-Crypto/realtime-decentralized-dashboard- Added silent smart retry mechanism for fetching Ethereum blockchain data. This will mean ~95% less "Ethereum Latency Warnings"
- Updated roadmap to include public Beta
- Improved Alpha Analytics server stability
- Fixed time remaining until 3x Time Bonus label
Update is already live so I hope you enjoy the greatly improved UX without as many latency errors and even faster realtime data updates.
14.08.2020Another build New Build 303 of Datamine Realtime Decentralized Dashboard is now live and available on:
https://github.com/Datamine-Crypto/realtime-decentralized-dashboardThis new build features the long awaited update to the calculator section. Now you can use our realtime FLUX forecasting tool Without Locking-in Datamine (DAM) tokens.
This comes with fair prefilled values of 3x time bonus, 1000 DAM-lock in (~$200 USD) and 3x time bonus for locking-in ~28 days.
This together with the updates from yesterday now provide a cleaner UX especially for new users that are onboarding.
This weekend we'll have some new analytics data views so be sure to stay tuned for updates.
Cheers! 
