Topic: [BPIP] Bitcointalk Public Information Project [Back in Action] - page 6. (Read 19631 times)

Question: Is it possible to add a username search function to the extension? *(Inbox/Outbox).

FYI, my telegram bot doesn’t rely on BPIP or any third party other than the forum itself.

It's offline for me.
I would say that some other plugins that rely on BPIP also give inaccurate results. Like Telegram bot BitcoinTalk SuperNotifier V2 by TryNinja. For example, calculating merits with a delay also gives an incorrect result.

BPIP is very slow today, and TrustLog isn't working at all. Is it "your turn" to be DDOSsed?

^ BPIP's parsers are good again. Thank you theymos!

Thanks for the alert, there does seem to be a problem here. I'm not caught up on the Cloudflare chaos, but both parsers are currently unable to login to the forum at the moment. I'm not entirely sure why yet, and (unfortunately) have a limited amount of time tonight to look.. but we'll try to figure out ASAP.

Also to note, this is why the BPIP logo has stopped spinning on the site, it stops spinning if the database is up but parsing is not happening for some reason.. and it turns red if the database itself is down.

Haven't had time to address this or figure out why it is inaccurate, but there does seem to be a discrepancy here.

Sorry to both - out of sMerit, I'll get you guys later!


edit: Getting a little caught up now, smh.. there appears to be a forum-wide issue with parsers at the moment apparently being caused by CloudFlare.  

edit #2: Other parsers like TryNinja & LoyceV were whitelisted yesterday... message has been sent to theymos.

There is a rise in the number of accounts still carrying the inactive badge even after they have woken up and posted like
- https://bitcointalksearch.org/user/simnet-2576340
- https://bitcointalksearch.org/user/oxchanger-3427812

Perhaps this is the effect of the recent Cloudflare chaos. Just asking the team to check and see if there is a problem.

OK, /TrustLog should be flowing again and the ranks have been updated for most posts deleted.
To summarize the changes recently:

-Added 2023 option to Most Earned Merit report (by time)
-Adjusted column header for Most Earned Merit report from "Times Merited" to "Merit Received" to clear up confusion.
-Modified UpdateRanks SP to fix deleted posts report & ranks not updating
-Re-seeded one of the trust tables to get the /TrustLog operational again
Enjoy the music.

Long story short, one of the tables involved with the TrustLog has max'd out its identity column.. because, for some reason, the table appears to have started out with a high seed value which has caused it to max out after only ~1.3M 11.3M rows, when it should be able to handle ~2.1B rows as an int. Possibly at some point SM had to wipe this table and the seed started off high at that point, but I'm not 100% sure.

Once I feel comfortable I won't screw anything else up here by resetting these IDs, I'll need to reseed the table, which should get this flowing again.

edit: After re-counting the rows in the latest re-seeded table, I realized I miscounted digits when calculating the original table, which was actually ~11.3M rows, not 1.3M like was in this post, just updating to keep things accurate.

Timelord2067 posted this in my topic, but it belongs here:
The last entry in BPIP's DT Change Log is from May 20.

Deleted posts from mods value & rank:
To provide some follow-up on my prior post:
Looking into the counts & ranks closer here for this particular report, I was able to narrow down what was happening, but still need to fix it.

As it stands now:
a) The profile page is getting its value/count from a table/field which is being updated by parsers.
b) The report page is getting its value/count from a table/field which is not being used or updated by parsers.
c) Both pages are pulling their rank from the same table/field, which unfortunately has not been part of the stored procedure which calculates and updates ranks.

Because of this, the visible result is:
The report page for deleted posts by mods hasn't been updated at all (in terms of value/rank), for some time they've been static.
You can compare an archive from 2020 with a recent archive from the end of March and see the value & ranks haven't changed.

For the profile page, the value has been changing, as can be shown checking the archives of someone like JollyGood (current & archive from Feb 2021 and June 2022).
But the rank has remained static on the profile page as well, again due to the current table not being included in the rank calculations.

All this said, there is a chance for potential small gaps in capturing the modlog/seclog in the past, if there were parser issues or downtime occurring, which occasionally happened more in the earlier days of development then it would now, but I'd expect the count shown on the profile page is close to what it should be, based on what has been collected from the parsing since 2018.

---

Here is what I'm seeing:
Seclog on BPIP goes back to March 16th, 2018.
Modlog on BPIP has ~1.3M saved records with an accurate date/time which ranges from August 3rd, 2018 until today. The modlog also has 177,836 records with a (default) unix timestamp from 1970. Based on the ID's of these records without a timestamp, they were all created (assumingly in order) before the range of time above. I didn't go back and look but the lack of a timestamp on these were likely related to a bug which was ultimately fixed in August of 2018, when it started capturing the date/time correctly.

Currently, you'd only be able to see:
Full sent: https://bpip.org/smerit.aspx?from=Avirunes
Full received: https://bpip.org/smerit.aspx?to=Avirunes

But it might not be a bad idea to have a view showing them merged together for a profile, which shouldn't be too difficult. I'll add this to my TODO list.

Ah LoyceV's tools. That will for sure do. Thanks a lot 

If it helps: LoyceV's seclog log.

There's loyce.club/Merit/history/175302.html.

I've some questions regarding BPIP security/moderator log. Does it shows the full list of security and modlog till date? or is there a point of date? I am checking a profile and just trying to make sure of something.

Also is there a way where I can see full merit history of a profile?

I've seen BPIP overlook deleted posts from modlog, so this counter could be too low.

BPIP only counts posts deleted by Mods, I scrape all posts including the ones you delete by yourself later on. Judging by my own data, I have deleted about 2000 of my own posts (mostly bumps).

Correct.

Hey thanks for that. I had a feeling it was going to be a long shot.

---

---

I see a couple of people have been discussing the disparigy between bpip and other sites' information (in the above example numbers of posts deleted).  I recently had someone suggest I'd only had 33 posts deleted, but the thread was locked before I could point out both loyce and ninja's sites have my post counts hundreds of posts higher than what bpip says with the Forum's user profile page only showing the number of posts that *haven't been* deleted.

The other two sites are much closer to the count, but probably don't include those posts of mine that were deleted in the first four or five years after registration.

Depends on the information you are looking for, but as far as I know. The log kept getting modified over time

The earliest records you will find are of most merited posts daily, and then Changed to Archived status, mostly because data would be displayed on the site even when Vod was still part of the project(I see some info as far as 2018)

When were the first entries recorded by BPIP.org ?

Thanks, I'm seeing inconsistencies for many users as I spot checked, not just MFahad. Some are off by a few (Fredomago, cvm, Alex-007, etc.), some are off by larger amounts (joshy23, Adriano2010, JollyGood, etc), and a lot seem to match up correctly.

Trying to wrap my head around this one as I haven't really looked at this job (and related procedures) recently in the past, but there does appear to be a problem here which will need some troubleshooting which I can't do at the moment, I'll try to take a closer look as soon as I can.

I saw this post:
And indeed, bpip.org/Profile?p=MFahad shows:
However, bpip.org/Report?r=postsdeleted shows:
I checked a few other profiles in the list, and for them, the data is consistent. How did MFahad go from 164 to 372?