[BPIP] Bitcointalk Public Information Project [Back in Action] - page 40.

ibminer

legendary

Activity: 1789

Merit: 2535

Goonies never say die.

^ Ya... I broke it. lol, published a version that didn't have the latest changes from suchmoon and it stopped those badges from appearing. Should be better now. MY BAD!

Quote from: LoyceV on February 09, 2020, 04:46:20 AM

Using "Neutral" theme, I can barely read the text (at least on my low-quality screen).

dt1changes report is now using badges similar to what we're using with the extension to help differentiate them from the text.

If you all like the look of the pill badges, I can change it where DT1/2 status appears in other areas of the site as well.

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

Quote from: examplens on February 09, 2020, 06:27:59 PM

It seems we have a new 2.0.2 version of BPIP addons.
Now, something is wrong, I haven't DT1 and DT2 badge even if enabled in options. Same situation with banned/inactive users badge.
Any idea?

That's what you get for being a guinea pig Wink

Sorry about that, we're looking into it. Might be something on the server side rather than the extension itself.

examplens

legendary

Activity: 3472

Merit: 3507

Crypto Swap Exchange

It seems we have a new 2.0.2 version of BPIP addons.
Now, something is wrong, I haven't DT1 and DT2 badge even if enabled in options. Same situation with banned/inactive users badge.
Any idea?

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

Quote from: ibminer on February 09, 2020, 10:45:36 AM

Thanks, I'll work that out. suchmoon hard-coded some styling in there, which I had seen, but I never went back to adjust for the themes! Embarrassed

Ah yes, my fault. I think all I tried to do was to make the text less bright so DT1/DT2 badges would stand out.

Quote from: ibminer on February 09, 2020, 10:45:36 AM

I'm not sure if suchmoon is parsing the list himself or not but BPIP's parsers don't automatically capture the trust dump or merit dumps just yet.

I set up parsing of the trust file last week but it's not going into the database yet.

Quote from: LoyceV on February 09, 2020, 04:46:20 AM

There are a few users who had a custom Trust list in the past, but not anymore. They're not added to my latest Trust list viewer, but the older versions still exist. If you really want to, you could keep track of them and link them to the last known version, but it's probably not worth the extra work.

How about a separate list of user IDs for each week? Let's say next week you create ~~user_ids_week_57.txt, the week after - user_ids_week_58.txt, etc~~ edit - scratch that, just put user_ids.txt in the appropriate folder as indicated by latestversion.txt and that should be ok. That way we can figure out on our end which week is the latest available for each user.

ibminer

legendary

Activity: 1789

Merit: 2535

Goonies never say die.

Quote from: suchmoon on February 08, 2020, 09:35:20 PM

A few notes about that:

Much better description!

Quote from: LoyceV on February 09, 2020, 04:46:20 AM

Using "Neutral" theme, I can barely read the text (at least on my low-quality screen).

Thanks, I'll work that out. suchmoon hard-coded some styling in there, which I had seen, but I never went back to adjust for the themes! Embarrassed

Quote from: LoyceV on February 09, 2020, 04:46:20 AM

So you only show the link to my archives if the post was deleted when you tried to get the title, right? Isn't it much more likely the post gets deleted much later, so you won't notice it's gone?

The next step in this is to parse the weekly merit file for comparison, which will go back 120 days, so posts moved/deleted within that time-frame will be updated as deleted and provide a link.

Quote from: LoyceV on February 09, 2020, 04:46:20 AM

Did you see I added http://loyce.club/trust/latestversion.txt ? It's the easiest way to find my weekly update.

Indeed, we are capturing that occasionally to get the latest folder path, so it will update those links moving forward with the latest list available.

I'm not sure if suchmoon is parsing the list himself or not but BPIP's parsers don't automatically capture the trust dump or merit dumps just yet.

To cut down on the 404's on the trust viewer, a userID's only version would help if it is not time consuming to create, we could capture that txt as we are with latestversion and do a quick check if the ID exists, before providing the link.

Quote from: LoyceV on February 09, 2020, 04:46:20 AM

I'm also working on archiving all older posts, but this will take at least half a year to complete.

Tis' looking good so far!

Thank you for the data collecting and analysis you are doing!

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Quote from: ibminer on February 08, 2020, 09:03:26 PM

New more robust dt1changes.aspx report.

Using "Neutral" theme, I can barely read the text (at least on my low-quality screen).

Quote from: LoyceV on February 02, 2020, 01:05:42 PM

Added in a new link to LoyceV's trust list viewer for each profile, under the "Trust Feedback Information" area, which links directly to the users trust list.

Did you see I added http://loyce.club/trust/latestversion.txt ? It's the easiest way to find my weekly update.

One more suggestion: you should probably only link to my Trust list viewer if the user has (or is mentioned on) a custom Trust list. So they should be mentioned in theymos' trust data dump, which suchmoon already processes (or my version, I can also create a version with only userIDs if you want to use it). About 99.5% of the profiles don't have a custrom Trust list, so you currently have many links to my 404.
There are a few users who had a custom Trust list in the past, but not anymore. They're not added to my latest Trust list viewer, but the older versions still exist. If you really want to, you could keep track of them and link them to the last known version, but it's probably not worth the extra work.

I forgot to add: I like the updates

Timelord2067

legendary

Activity: 3696

Merit: 2219

💲🏎️💨🚓

Interesting changes - I liked how a person could see at a glance the current value of a person on DT1 (3), (0), (-3) etc.

I suspect there's some back-of-house work at the monthly DT1 roster update which makes it seem this person no longer distrust/trust this person as they slip on or off of DT1, however, I just would like to point out:

I haven't "no longer distrust the person" - it seems to occur randomly to other users as well during a month.

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

Quote from: ibminer on February 08, 2020, 09:03:26 PM

New more robust dt1changes.aspx report

A few notes about that:

We're logging not only DT1 internal changes but also when DT1 members include or exclude other users (DT2 selection).
If you hover on the DT1/DT2 badges you'll see the inclusion/exclusion balance (strength) for each user at the time of the event. So for example in the screenshot below you can see that a particular exclusion caused someone to drop out (strength becomes -1).
The aforementioned new features start from ~ February 1st, old data remains as it was.
There might still be some glitches, for example during the monthly DT1 selection process the DT1 list gets updated earlier than the DT2 list and that causes issues for our scraper. I'll deal with those manually.

Edited 2020-11-30 to fix a broken image

ibminer

legendary

Activity: 1789

Merit: 2535

Goonies never say die.

We've got a few new updates to the site!

New more robust dt1changes.aspx report.
sMerit page is now showing more links; to profile pages, and a "Summary" link to each users Bitcointalk Merit Summary page.
sMerit page also now attempts to link to LoyceV's deleted posts archive. Posts missing in LoyceV's archives may end up as a broken link. It will only attempt to link if the msg ID falls in range of what LoyceV provides (>=5190*). For these that fall in range, the link will show in the post title as "[Deleted Post] Click to check LoyceV's archived posts".
If the a missing msg ID falls out of range, the post title will still appear blank in the list.
Added in a new link to LoyceV's trust list viewer for each profile, under the "Trust Feedback Information" area, which links directly to the users trust list.

And since I enjoy leaving some sort of music in my posts.. boom boom pow! Grin

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

Thank you all for your interest in the extension - just give me a day or two to try some workarounds for the bug reported by Timelord2067 and I'll make an updated version available, probably in a new thread.

Coinbees

jr. member

Activity: 30

Merit: 1

Quote from: bitmover on February 08, 2020, 12:39:15 PM

I Want to test the firefox extension as well.
Do I need the pm to download it?

Same question Does it work on Firefox?

bitmover

legendary

Activity: 2352

Merit: 6089

bitcoindata.science

I Want to test the firefox extension as well.
Do I need the pm to download it?

Timelord2067

legendary

Activity: 3696

Merit: 2219

💲🏎️💨🚓

Quote from: Vod on February 08, 2020, 06:23:44 AM

Did you install the old extension?

No, I only installed it yesterday (Version 2) via the Firefox site via the link provided by suchmoon overnight, so no third party interference.

Quote from: suchmoon on February 08, 2020, 08:10:59 AM

Quote from: Timelord2067 on February 08, 2020, 01:21:39 AM

First error I've found:

Thanks. For some reason the browser decided to run it twice, which in theory shouldn't happen. I think I'll need to add a check to not add those widgets if they already exist.

As a suggestion on a person's profile page, perhaps their ranking could be added? I would imagine that it would be too problematic to add it to every single last page for every last user, but perhaps on a profile page would be the ideal location.

Another suggestion concerning the DT1/DT2 labels, perhaps green/grey/red for each rank depending on a users positive, neutral or negative DT1/DT2 position

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

Quote from: Timelord2067 on February 08, 2020, 01:21:39 AM

First error I've found:

Thanks. For some reason the browser decided to run it twice, which in theory shouldn't happen. I think I'll need to add a check to not add those widgets if they already exist.

Vod

legendary

Activity: 3668

Merit: 3010

Licking my boob since 1970

Quote from: Timelord2067 on February 08, 2020, 01:21:39 AM

First error I've found:

page has been open for a number of hours while I was out and about.

Did you install the old extension?

Timelord2067

legendary

Activity: 3696

Merit: 2219

💲🏎️💨🚓

First error I've found:

page has been open for a number of hours while I was out and about.

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

Quote from: OmegaStarScream on February 07, 2020, 02:25:55 PM

Quote from: suchmoon on February 07, 2020, 02:10:43 PM

Interesting. The lowercase one is this user apparently: https://bitcointalksearch.org/user/murat-252546 and it seems to have been renamed to "murat_" (with underscore at the end) to make way for Murat. BPIP doesn't automatically refresh archived (inactive for a long time or banned) profiles unless they wake up but clicking "Refresh Profile" manually should fix this.

Wouldn't it be better if you access the profiles (on the search list) through the userID[1] instead of the usernames[2]? That should fix the problem as well.

We have no way of knowing which usernames have changed unless we re-fetch all ~3 million profiles. That's the main problem in this case. The link in the search results works fine, just the username is the old one. Once it gets updated, the link will have the new username and will still work.

Quote from: OmegaStarScream on February 07, 2020, 02:25:55 PM

I've also noticed that the search could be optimized a bit (unless this is done on purpose). If I'm not mistaken:

BPIP: WHERE userName LIKE 'StarScream%' (Find all names that starts with StarScream)
Forums: WHERE userName LIKE '%StarScream%' (Find any name that has 'StarScream' in any position)

I find that using the second way is better.

Unfortunately the cheap version of SQL Server that we use would do a full table scan on the '%StarScream%' query. We have some long-term plans to address this.

Quote from: OmegaStarScream on February 07, 2020, 02:25:55 PM

Also, I have a question regarding the banned accounts, are you getting them from the modlog? does that mean that any account that has been banned before BPIP won't show as 'banned'?

That's correct.

OmegaStarScream

staff

Activity: 3500

Merit: 6152

Quote from: suchmoon on February 07, 2020, 02:10:43 PM

Interesting. The lowercase one is this user apparently: https://bitcointalksearch.org/user/murat-252546 and it seems to have been renamed to "murat_" (with underscore at the end) to make way for Murat. BPIP doesn't automatically refresh archived (inactive for a long time or banned) profiles unless they wake up but clicking "Refresh Profile" manually should fix this.

Wouldn't it be better if you access the profiles (on the search list) through the userID[1] instead of the usernames[2]? That should fix the problem as well.

I've also noticed that the search could be optimized a bit (unless this is done on purpose). If I'm not mistaken:

BPIP: WHERE userName LIKE 'StarScream%' (Find all names that starts with StarScream)
Forums: WHERE userName LIKE '%StarScream%' (Find any name that has 'StarScream' in any position)

I find that using the second way is better.

Also, I have a question regarding the banned accounts, are you getting them from the modlog? does that mean that any account that has been banned before BPIP won't show as 'banned'?

[1] https://bpip.org/profile.aspx?id=815246
[2] https://bpip.org/profile.aspx?p=murat

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

Quote from: examplens on February 07, 2020, 01:35:47 PM

I accidentally find this:
Here are two accounts with murat username Murat and murat. Only on BPIP, not on forum search.
I know that user iwantapony (or something like that) changed username to Murat
When a search on bpip, first is there everything regular there is showed this user Hero rank, but when you click on his username going to some newbie account details.

Interesting. The lowercase one is this user apparently: https://bitcointalksearch.org/user/murat-252546 and it seems to have been renamed to "murat_" (with underscore at the end) to make way for Murat. BPIP doesn't automatically refresh archived (inactive for a long time or banned) profiles unless they wake up but clicking "Refresh Profile" manually should fix this.

examplens

legendary

Activity: 3472

Merit: 3507

Crypto Swap Exchange

I am also interested to test Firefox extension.
thanks

I accidentally find this:
Here are two accounts with murat username Murat and murat. Only on BPIP, not on forum search.
I know that user iwantapony (or something like that) changed username to Murat
When a search on bpip, first is there everything regular there is showed this user Hero rank, but when you click on his username going to some newbie account details.

Topic: [BPIP] Bitcointalk Public Information Project [Back in Action] - page 40. (Read 21754 times)