Topic: Bitcointalk Merit Dashboard - page 30. (Read 39911 times)

Ok, there are two options without having to create manual weekly lists on my behalf. Let’s see if they are enough:

Option 1- Merit Dashboard:

On the Merit Dashboard, go to the Tab called Rankings and adjust the Date filter to the desired date range. The easiest way is to click on the date shown on the left of the Date Filter slider and chose the date from the calendar. You should also change the time by double clicking the time, and set it to 00:00:00 (date can be entered in the same way).
In the image, I’ve set it to the 21/08/2018 00:00:00. The Merited User Ranking will show you the top merited for the week you selected.

The downside as we’ve talked about, is that you cannot export the list and will need to click on each user and chose "Go to Merited User Profile" to jump to his profile.


Option 2 - Merit Network

Use the  User Merit Network (also launchable from within the Dashboard). Go to the Tab called "Total Received" and add a Filter by converted_date. In the example, I’ve filtered by 21-08-2018 onwards (click on the filter cell to select date from calendar). No need to set the upper limit if you want data to include all TXs from the selected date onwards. Also no need to set time here.
The shown list is simple. I’ve just modified it to include the ToUserId which I did not have there before. "Count" is the number of TXs and "SUM amount" the number of received sMerits (which is sortable).

What may be interesting here is that you can export the list in a sense by selecting the items from the list, and copying them (clipboard) to Excel, and then build the URL there if needed based on the UserId. Copying takes a little getting used to, buy I’ve managed to do it correctly a few times in a row with no issue.

Thanks, I was thinking to make a weekly list of the top merit receivers.

Edit 31/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 216.136
Total Txs:       98.346
From Users:   16.462
To Users:       19.082
minDate:       2018-01-24 22:12:21  
maxDate:      2018-08-31 02:41:54

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard.  

The sMerit awarded on the last entire week (20/08/2018 ..26/08/2018) is nearly exactly the same as the previous week (only a 4 merit difference).

Also congratulations to krogothmanhattan for ranking-up this week to a Hero member of Bitcointalk! (he had the merits a long time ago, but was lacking activity).

Not really on an individual basis, since the exact airdropped sMerit per user has not been disclosed, and it depended on the rank + activity of each user prior to Merit System Kick-off (see further ahead).
You could know it though exactly for users that were Jr. Members, Newbies or Brand New at the time, since their initial airdrop was of 0 sMerits, and thus the calculation is simple (Received sMerit/2 – Sent sMerit). For all other Ranks you can’t know the exact minimum amount.

You can have an estimate overall as I have calculated on some occasions and now update here:

Theymos stated that the initial distributed total sMerits were around 600k (see (Re: Merit & new rank requirements).
Merit Sources generate now a maximum of 19.500 sMerits per 30 days. Of course, these don’t empty their monthly allowance, and also the quantity has increased over time. Let’s say as an hypothesis that the average distribution of Merit Sources has been of 15.000 sMerits per month.

With the above, a safe scenario would be:

+ 600.000 sMerits -> Initial Airdrop
+ 52.500 sMerits -> Merit Sources (15k/month average *7 full months as a safe hypothesis  = 105.000 -> halved -> 52,5K)
- 216.136 Total awarded sMerits (up until this morning)
------------------------------------------------------------
436.364 minimum available sMerits system wide, and that’s not even considering the system generated halved sMerits by means of those awarded sMerits from user to user.

So if the 600K is correct, which I have no doubt, there is almost double the sMerit stocked up in comparison to the total aggregate awarded sMerit. That is what I was on about before, since most of it is from the Initial Airdrop.

Hell yeah he is confusing theymos with Satoshi


That's the main reason as per my observations. I would think if we going to encourage the posters who really contribute to the forum discussions should be awarded with more than 1 or 2 Merits in order to maintain the flow of Merits stable way. Because I don't think Merits should be a barrier for users (not the spammers) whose really deserved to be ranked up. Merits are introduced by theymos to encourage the good posters while discouraging the shitposters and spammers.

This is the second most important factor as you explained. I think there is not enough Merit sources at the present. theymos may consider this issue ASAP and nominate few more sources to balance the flow because there are good members who still willing to sacrifice their time for hunting down posters and award Merits for their posts.

Another thing that I have seen is some of the Merit sources relayed on there personal openion or principles when awarding their sMerits. It's ok if they awarding their earned Merits to some other members, but not the source Merits. I don't know is there any way to distinguish those two types of Merits for Merit sources. Merit sources shouldn't clouded their judgements with their personal openions or even their field of expertise and just look only the quality of the post. I want to know is there any way to find out unused sMerits of users? Because numbers matter.

I think you’re confusing Satoshi with theymos.. or you know something than many don’t ….

The reasons for a decreasing merit weekly aggregate are multiple I’d say, and not related to there being less quality posts around:

-   People have less merit from the initial airdrop, and it may be pretty low now in the big picture for those that do participate in the merit awarding procedures (many do not as we’ve commented on posts around Meta on occasions).

-   People themselves generally never really gained large amounts of merits for their posts, so the half derived dispensable sMerit amount is not too large either. That is also related to the fact that the general amount of sMerit per post and per Tx is mainly in the very low end of the scale (1 or 2 merits).

-   Merit Sources are increasingly more important to maintain the Merit System  running as a result of the above. If a few of them take a break or reduce the time they spend awarding merit, the numbers drop.

-   Many topics a reiterative. The pioneers got merit, but reiterations by other people seldom do (i.e infographics, merit abuse catching, tip for newbies, etc.).

Merit abusers will suffer the same issues (even more so). What I’d say is their golden key for them are those merit awarding “dormant” accounts, that after a time start to award their initially airdropped sMerit, being some of these accounts either hacked accounts or that decided to trade. The proportion of abused merit is probably small though in the big picture, but there is a potential usage of sMerit by some those accounts that have not merited before, which could be set to use wrongly.

Nice work!

I can see in the "Weekly Merit Evolution" section that the amount sent every week is gradually decreasing. Is that because we are getting low on quality posts or that just indicates that Merit abusers are running out of 'em as the time is passing? As theymos said, that they would eventually run out of sMerits if they try to cheat the system and keep sending them between each other.



Oops! I'm not confused but I just unknowingly wrote "satoshi" instead of "theymos". God, he never gets out of my mind! 
I edited the post and changed it to theymos.

Yes, Tableau is a good product, but it still has some issues that have been requested by its users some time ago, but that still have not seen the light. Amongst them are two of the issues you are addressing:

-   Tableau Public does not allow export to flat files or excel files (or even to copy the data to the clipboard) unless the Dashboard is “Open”. I can open the Dashboard to this feature, but the drawback is that then not only is the data exportable (which I would really like), but so is the Dashboard itself. So basically, as absurd as it sounds, in order to allow a minimal export I need to allow for the whole source code Dashboard to be exportable too (which I’m not too keen on really).

-> If you need a specific dataset, I can share that for you on a google spreadsheet as @vphasitha01 mentioned.

-   Tableau is not great at sorting rolled-up numbers. Basically, for some internal design decision, if there is a dimension (the username) and then a rolled-up number (aggregate of merits), the latter is only ordered as a subset of the dimension entry. That is, it orders by name, and then by merits within the name (if there were more than one data entry). So when trying to order by Merits, it does not have the desired effect.
This has also been requested as a change to Tableau, but it’s still a no go.
I could put Merits as the first column, and then it would sort by the value rather than by the name, but I thought name would be a better choice.

-   Tableau Public (the free hosted open to public version I’m using) has a default timeout somewhere in the line of 4 minutes, so an inactivity period of around 4 minutes requires you to reapply your selections. Sometimes, sorting or such can cause that kind of internal error which should be resolved by refreshing the page again (and reapplying the filters). The default timeout cannot be altered by me.

Let me know if you need a specific data selection.

I'll update de Dashboard today with the most recent update.

P.D. The Merit Network on the other hand allows you to export all the contained database (File->Download (csv format)) , so perhaps that could help, but the data is rather raw there (i.e. at TX level) .
Edit: On the Merit Network , you can also copy data from the Tabs via the clipboard (i.e. go to the Summary Received tab, filter there, sort and export).

I don't think there is a way to export the results except downloading the pdf of the selected data. But send a Prayer Message to "DdmrDdmr" and he will surely send you the data in a google spreadsheet

There is an automatic trigger for timeout of a session, unfortunately, I didn't remember the period.

---

Seems like @iasenko might going to changed the path from Spam Buster to Merit Analyzer ( Just kidding mate... )

How can I select all in the list and is it possible to export the results in some format?
This is in Received merit, I see that I can arrange them only when I select them.


BTW after trying to sort them I got an error:

Yes, I remember the recent discussion on the matter in your quote. The Dashboard lets you see Merit Distribution by subsection (i.e. local language or second level within Bitcoin, Alt. Cryptocurrencies, Economy and Other). Going a step further and doing it by topic is really too much overtime for me right now (I’m doing all this in my spare time aside from a regular fulltime job).

You would need to:
1. Study all the thread titles/OPs that you want to take into consideration (you could assume that all posts within the thread are related by content to the OP to simplify). The title does not always say it all, so you need to go into the OP itself. Then you need to classify the thread and related to 1 (or n) topic/s.

2. Perform the above for all threads created or bumped in a certain timeframe (for example, since the Merit System kick-off, or last month). There are thousands of threads to consider, although if the focus were to be merit related, you could cut down quite a bit by performing the classification only on those merited threads.

3. And then cross the above with merits per post/thread.

It would certainly be interesting, but very long to perform for me right now if done properly.


A quick approximation is to look through the most merited threads (aggregate of posts in the thread) on the Merit Dashboard (see tab called “Rankings”) filter the Date Range (i.e. August) and/or subsection, and perform a tentative approximation from the list displayed. For example, if you filter Meta for the Month of August we get:

Seeking Reporter Badge Images  -> 100 Merits in August.
Community generates suggestions to … -> 97.
Merit? This got to be a joke -> 94 Merits in August.
Analysis – Correlation Matrix -> 77 Merits in August.
How recognized are you in the bitcointalk world? -> 69 Merits in August.
[guide] Bitcointalk account security -> 62 Merits in August.


You could create a tentative stat for Meta and other sections by manually classifying each thread (assign each thread one main core topic), and then adding all the Merit by Topic.  Doing so for Meta may not be difficult (Merit, Account, Ideas, Plagiarism, Reporting, etc.), but trying to derive a proper topic on Bitcoin discussion or Ann threads may be rather painful, especially if you are not familiar with the content on the subsection.

Edit: I do encourage you nevertheless to give it a go, trying the dashboard approach I mentioned. Try it out on some subsections with which you are familiar, so that the context is known to you. Derived topics should be no more than 15 or 20 max. and can be categorized into groups to reduce the number. If you give it a go and find something interesting, open an OP to show us your findings.
The only fine-print needed is how topic assumption is derived by from the OP on each thread (not all merits in practice are necessary related to the OP of the thread, but it’s a workable assumption).
As a last note, it’s probably best in this case to limit data to recent months, in order to avoid heavy topic bias by early heavy meriting.

I came across this thread and find this surprising piece of statistics:


I know that it's a bit difficult but I can see you're a master of statistics: can you make an analysis on how merits are awarded among various topics: merit related topics, technical issues or bitcoin related... It'd be very interesting.

Edit 24/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 212.937
Total Txs:      96.592
From Users:  16.337
To Users:      18.915
minDate:      2018-01-24 22:12:21   
maxDate:     2018-08-24 02:46:57

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard. 

The sMerit awarded on the last entire week (13/08/2018 ..19/08/2018) went down 10,29% from the previous week, basically due to merit/tx ratio being lower, since the number of TXs is nearly constant comparing the last two weeks.

Edit 17/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 209.060
Total Txs:       94.624
From Users:  16.229
To Users:      18.738
minDate:      2018-01-24 22:12:21   
maxDate:     2018-08-17 01:56:59

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard. 

The sMerit awarded on the last entire week (06/08/2018 ..12/08/2018) went up 20,34% from the previous week, recovering from the two consecutive drop, and back to the weekly lower 4K zone.

It's also mandatory mentioning that hilariousetc han now joined the Legendary Olympus, and is the second Hero to reach Legendary needing Merits in the process, after Jet Cash. Congrats !

I think you're on a phone device. The Dashboard is really designed for a larger screen, due to the amount of information shown simultaneously. I actually never use it on my phone. Although the platform allows a possible development to be done specifically for phones, I have discarded doing multiple versions of the Dashboard.
I’ve just checked from a laptop with various browsers, and an Ipad with Safari and it’s as responsive as usual.

Just two additional annotation:
-   Dashboard session times out every 4 minutes or so of inactivity. This is something specific to the platform being used in Public mode and cannot be altered.

-   Every now and then, a major problem does happen with the platform which is based on AWS. There’s a link down on the bottom on the page that shows the state of the platform and it’s been OK for quite a while now: https://trust.tableau.com/status/tableau-public


Actually, I don’t download DT data so I haven’t got it merged in the underlying database. I only looked into DT once, and created a DT network similar to the merit network, but never continued that line of work. The trust.txt file really has only a subset of the information that is visible on the profile (i.e. no comments), so I’m not sure that the regular info in the file is all that clarifying baring this in mind.
What I did back in April was this: A picture of what our Trust/Distrust Network looks like. This is derived from the info in the file which really is limited as you can see with basic relations indicating who trusts whom in the file such as :

theymosmos->zvs   theymos   zvs   2
theymos->malevolent   theymos   malevolent   2
theymos-/>Matthew N. Wright   theymos   Matthew N. Wright   1
theymos->Korbman   theymos   Korbman   2
-> 2 is "trusts" and 1 is "does not trust".

I don't think we can build anything near what is shown on the user profile with this file alone.

@DdmrDdmr is possible to see the DT reputation of users with mouseover or coloring with red/green to avoid boring clicks to open profiles here on forum?

Just one question here, the dashboard is not very responsive, right?? Or it's just me :

---

Thanks for answering, yes I'm on a mobile. Not do much time to sit behind a pc

Edit 10/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 205.244
Total Txs:      92.636
From Users:  16.104
To Users:      18.533
minDate:      2018-01-24 22:12:21   
maxDate:     2018-08-10 02:48:47

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard. 

The sMerit awarded on the last entire week (30/07/2018 ..05/08/2018) went down 8,4% from the previous week with a new minimum established of 3.489 sMerits awarded that week. That's a 19,34% decrease in just two weeks!

Yes, the Initial Merits comes off slightly is some cases due to the time-lapse  between the generation of the official Merit.txt file and the process of scraping the user profile data from the Bitcointalk website.
The merit.txt file is generated around 2 am (in my time zone). I download the file at least six hours later, process it, and start to download all the profiles (posts is another issue that I start before). At best, there is something around a 12 hour difference between the merit.txt file and the end of data scarping (roughly 1 profile per 1 or 2 seconds + process data). This means that any merit TXs in that period will create a discrepancy.
For example, if on Friday 2am I have 400 merits, but receive 2 more between then and Friday 2pm, then my merit profile from Bitcointalk will likely state 402 merits (no initial airdrop in my case), but the union of the Merit.txt files will state 400 merits. Those 2 merits are a “tolerable bug” really, and are due to the above.

It’s like taking a photograph with two different cameras placed in the same position but one being instant and the other one a slow one: If you move between the two shots the image will differ a bit between the two cameras.
Of course it could be improved by not recalculating the initial merit every time (week) and only looking for the initial merit in those cases that are either new or are non-consistant (i.e. initial merit distinct to 0,10,100,250,500,1000), but I’ve taken the weekly recalculation path which is aligned with other many calculations I do.


Concerning the odd merit numbers you want to search for (9,99,249,499), you could use the User Summary Tab on the Merit Dashboard to find them. Simply adjust the Merit Received slider (or Merit slider, depending on what you are searching for) to one of those values and the data will adjust to listing the users with that amount of merits. Since the numbers on your list are not correlative, you’ll have to go one by one in this case.
You can adjust the sliders manually by dragging the handles, or type the numbers over the extremes by clicking on the numbers and typing to overwrite with yours.
I figure you are trying to see who is about to rank-up with just 1 sMerit to go. You can also use the "Ranking-up pipeline" Tab to see this, but with a broader view: If you click on a segment on the "Ranking-up pipeline Summary" that starts with a 3 (Soon may rank-up to ...), you will get the list of members that are within 20% of reaching the required Activity and Merit to reach the next rank. Click again to deselect. 


P.D. The initial Merit may be a bit "buggier" this week since I was away for a few days and scraped profiles on Monday (yesterday) instead of last Friday.

Hey...I'm really big fan of your work. I just wanted to know how can get the details of members having 9, 99, 249, 499 Merits?

When I checked my Merit data with your dashboard, it shows that I got 2 initial merits, which actually incorrect. So is there any incorrect details in the raw data or bug in the dashboard? Because LoyceV's Merit data analysis also has the same issue but with a different way.