Topic: Bitcointalk Merit Dashboard - page 31. (Read 39911 times)

To sum it up, the centerpiece is the Merit file which is public and updated every Friday . It can be found at here: https://bitcointalk.org/merit.txt.xz. The file is limited to the last 120 days of data, so all previous records come from my cumulative set of such files.
Any other information not present in the file will need to be pulled down from the Bitcointalk website itself by scrapping data from user profiles and user posts.
Lastly, apply a bit of gray matter to give different information views derived from the raw data obtained. The Dashboard sums it all up and gives us filtering capabilities.

The figures referenced in my previous post on this thread come from the Global Summary tab, by comparing data shown there for the most recent complete weeks.

That’s about it...

How do you find these figures?

Edit 06/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 201.035
Total Txs:      90.737
From Users:  15.980
To Users:      18.292
minDate:      2018-01-24 22:12:21  
maxDate:     2018-08-03 02:41:17

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard.  

The sMerit awarded on the last entire week (23/07/2018 ..29/07/2018) went down 10,94% from the previous week with a new minimum established of 3.809 sMerits awarded that week. It’s likely that the holidays take their toll, but there are nearly 19% less merit TXs, almost 18% less users awarding sMerit and nearly 16% less merited users for the referenced week …

Edit 27/07/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 197.420
Total Txs:       89.116
From Users:  15.829
To Users:      18.078
minDate:      2018-01-24 22:12:21   
maxDate:     2018-07-27 02:51:03

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

The sMerit awarded on the last entire week (16/07/2018 ..22/07/2018) went up 4,09% from the previous week.

Note: Next week's update will be done around the 7th or 8th of August.

Edit 20/07/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 193.706
Total Txs:       87.304
From Users:  15.670
To Users:      17.835
minDate:      2018-01-24 22:12:21   
maxDate:     2018-07-20 02:38:45

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

The sMerit awarded on the last entire week (09/07/2018 ..15/07/2018) went down 5,91% from the previous week (that's 12,28% in two weeks).

Edit 13/07/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 189.052  
Total Txs:       85.276
From Users:  15.485
To Users:      17.588
minDate:      2018-01-24 22:12:21  
maxDate:     2018-07-13 02:41:58

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

The sMerit awarded on the last entire week (02/07/2018 ..08/07/2018) went down nearly 7% from the previous week! Let's hope it doesn't become a new descending trend.

Edit 06/07/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 185.332    
Total Txs:       83.409
From Users:  15.343
To Users:      17.335
minDate:      2018-01-24 22:12:21   
maxDate:     2018-07-06 02:41:02

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

The sMerit awarded on the last entire week (25/06/2018 ..01/07/2018) went up slightly (2,4%) from the previous week. That's an increase running now for two weeks in a row.

I’ve updated the Merit Dashboard to include a Tab called Reciprocal sMerit. The idea behind this Tab is controversial to myself, since I do understand merit abuse tracking down, but rather despise the false positives that come as a side effect of it all. Even so, in favour of transparency I decided to go ahead and add this Tab on to the Dashboard.

1. Objective:
The objective of this Tab is to allow you to see the Total amount of sMerit sent from user A to User B, and how much user B has awarded User A (reciprocal sMerit).
 
This has multiple uses:
-   See one’s own reciprocal sMerit (out of curiosity at least).
-   Search for Injective Merit Abusers (A send to B x amount over time, getting 0 in return).
-   Search for Bijective Merit Abusers (A send to B x amount over time, and gets y amount in return).
 
It is very important not to jump to conclusions of Merit Abuse. Numbers are only an indicator at best, but for those who report Merit Abuse, the actual merited Messages should be studied before bringing forward a case.
 
 
2. Use:
The good thing is that this is all dynamic, meaning we can filter the data by diverse criteria, being the most important one a TX interval.

As an example, I narrowed down the TX Dates to the month of July 2018 (you can either use the slider to adjust the interval, or click on the dates on the extremes to either type them in manually or chose them from a calendar). Having narrowed down the TXs to last month, I then went on to glimpsing through the top cases listed.

The data shows the total amount of sMerit that User A has sent to User B in the timeframe, and how much User B has Sent to User A (I refrain from using the term “back” here, since that suggests a prejudgment which should not take place).

The top cases are all injective (A sends to B 50 sMerits, and is not awarded sMerit from B to A). Going case by case (click on the A->B record, then on the Sent TX to access a shortcut to the original merited Post on a pop-up menu), we can encounter cases that are:

-   Clear merit abuse (have been in the past, tagged on February, and still keeps on at it regardless) – even meriting backtracked one-liner posts with the full 50 sMerit award.

-   Multiple cases of already deleted posts to cover their tracks.

-   Posts what belonging to some of the best posters that are merited for their work (or compensated for their troubles Id say).

-   Etc.

Edit 29/06/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 180.742    
Total Txs:       81.487
From Users:  15.159
To Users:      17.048
minDate:      2018-01-24 22:12:21   
maxDate:     2018-06-29 02:48:45

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Added this week: Post summary (distribution of sMerit per TX and TXs per post).
Added Recently: De-ranked Users, Potential Merit Sources, User Summary, Section/Subsection, Rankings and WordCloud.


The good news sMerit awarded on the last entire week (18..24 June 2018) went up nearly 16% from the previous week (11..17 June 2018), although that was a particular low week.

Edit 22/06/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 175.732    
Total Txs:       79.335
From Users:  14.981
To Users:      16.795
minDate:      2018-01-24 22:12:21   
maxDate:     2018-06-22 02:26:58

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Added this week: De-ranked Users and Potential Merit Sources.
Added Recently: User Summary, Section/Subsection, Rankings and WordCloud.


I can't yet figure out how to easily detect movements from Hero to Legendary (ranking-up) or vice-versa (de-ranking) for those Heroes that started off with an initial airdrop of 1000 Merits, instead of 500 Merits.
For example, I’ve detected comparing last weeks DB to this weeks DB that AmoreJaz has gone from Hero to Legendary this week. Nevertheless, he started off with a 1000 Merit airdrop (not 500) , so his initial rank, while being Hero last week, is not detectable through backtracking the data (unless I start to compare DBs every week and detect cases alike in this manner, but that does seem a bit of an added strain to all the calculations I perform to update the Dashboard).

Actually if I understood your question properly, you can on the BitcoinTalk Merit Dashboard:   



- The 108 are heroes that have activity >=100% and merit >= 100% of their goal. This means that they are just waiting to be "knighted" as Legendary.
Most of those 108 being considered for legendary, seemed to have got their merit in the airdrop, being greater than what corresponds to their rank (500 would have been the normal amount). I guess they were airdropped as if they were legendary although the formally aren't.

- The 247 have enough activity (lower limit of 775 or above), but not enough merit (less than 1.000).
You come out on the list belonging to this segment (click on the dashboard segment number 1 (could have ranked up to Legendary, lacking Merit).
Out of these, 2 are nearly there (segment of merit in the range of [80%..100%), 3 are more than halfway there (segment of merit [60%..80%) from the goal, and 242 have only between [40%..60%) of merit.
- 3 more may soon rank up, being above 80% of their goal met both in terms of activity and merit.

- 667 are below 80% of their goal both on merit and activity.


The dashboard takes the broadest approach possible, since I rather not leave any member out due to the ability to search for a specific user’s data of the dashboard. Besides, the list of exclusions could be long (theymos, nullius, satoshi, first few weeks of merit fiesta, merit sources (unknown officially), etc.). Data is available to all, so other approaches are always welcome.

Thanks. So it's not possible to check if the personal legendary activity limit for a Hero has already been reached, if the Hero don't have 1000 Merits. (If the Hero's current activity is somewhere between 775 and 1030.)

Highly appreciate dedication of  DdmrDdmr to create such informative topic on merit distribution in the forum.
Nevertheless, it might be better if you can give additional analysis on merit distribution on different member rank, for example mean +/- standard deviation, and median (interquartile range) of merits (received, sent).
With unnormal distributions, median and interquartile range should be used instead of mean and standard deviations. Presenting uncorrect statistics might  lead to misunderstandings, mis-interpretation of merit distributions on different groups of member in the forum, and should be avoided.
Additionally, outliers should be stated clearly and truncation approach should be used in some specific cases to present more correct statistics for the whole sample. (For instance, cases like nullius, iasenko, etc. should be truncated  ). After using truncation approach for outliers, mean and median of sample will be almost the same.

Yes, I used the lower Activity limit as you’ve seen. On the dashboard, the Ranking-up pipeline shows us what you’ve asked. If you click on the top left chart on the 247 number associated to "1. Could have ranked up to legendary, lacking merit" item then the user list on the right gives you their user names. From there you can click on any user and follow the "go to user profile" to see the bitcointalk user profile.
The bottom graph tells us how far these users are from their objective broken down by groups of 20%.

How do you determine if a Hero has reached the activity points needed to rank up?
If I understand well, it's not possible to determine if a Hero is not ranking up only because of the lack of Merits or because of the lack of both activity and the Merits, if the Hero has already reached the 775 activity points.

EDIT:
just checked the other topic, and saw that you use the 775 activity point to calculate with for every Hero

Is it possible to check somewhere that a Hero has reached his/her personal limit of the activity points? (and ony waiting for the Merits to come?)

Merit Dashboard

Edit 15/06/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 171.654    
Total Txs:       77.387
From Users:  14.796
To Users:      16.583
minDate:      2018-01-24 22:12:21   
maxDate:     2018-06-15 02:42:15


The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

Added Tabs this week: User Summary, Section/Subsection, Rankings and WordCloud.

Thankyou zentdex for spending some time using the Merit Dashboard and Network. As you say, the dynamics of the tools bare the true value, going from a statical views to dynamical view on the data. The filter features allow us to focus on specific sets of data and derive potential useful information from it, being seeing our own personal records just a minor part to it all. Export to pdf allows us to capture snapshots of data and keep it as a reference for comparison reasons overtime.

My initial idea was to keep building on it, adding features from previous analysis into it.

I don’t believe we’ll find many forums with this level of transparency on some of their key operative features, and even less with public dashboards built around them. Well, we could say that Facebook surpasses this level of transparency without “meaning to” …

Freaking awesome job! And now I see stats that are so dynamic that enable other users to interact with it.
I even spent almost half an hour exploring, filtering, searching, sorting and extracting meaningful information.
Those cool merit network diagrams complete it all. I have fun dragging around the nodes. Thanks for creating this.

Merit Dashboard

Edit 08/06/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 167.409       
Total Txs:      75.332
From Users:  14.548
To Users:      16.303
minDate:      2018-01-24 22:12:21   
maxDate:     2018-06-08 02:48:03.000

Link:  BitcoinTalk Merit Dashboard   

Yes, Thursday is a bit of a bugger as it biases the data as you say. Perhaps the ideal solution would be not to pre-filter data out (so as not to lose the total aggregates), but to include some filters that allows us to narrow down the data (for example, a date interval). That should deal with both of your suggestions in one go.

The dashboard, although everything is based on the same set of data, has some external pre-rolled-up data on some tabs (Global Summary Tab is one of them). That makes it quicker for the dashboard, but limits filtering options. That means I’ll have to change the way things are done internally in order to be able to introduce granular filters by dates, going against the basic merit TXs, and not a rolled-up derived set like I do now.

I’ll add it to my backlog of tasks to do on the dashboard…

EDIT:

Just broke the "thursday is the best day to post" mith!:

I've added a date calendar filter that can now be applied on the first tab (I've a minor issue still with the time which I have to reset to 00:00:00 on the first date of the selection range). If we filter from the 29/01/2018 00:00:00 .. 27/05/2018 23:59:59 (complete weeks, skipping the first and last partial weeks) we now get:

Monday: 15,15%
Tuesday: 15,47%
Wednesday: 15,68%
Thursday: 15,31%
Friday: 14,02%
Saturday: 12,15%
Sunday: 12,21%

We can now see that Thursday is not a thrasher at all ...