Thank you, I'm only seeing 2 out of 11 months the DT shuffle was not on time, the 1st time being in January which you had alerted us on, and the 2nd time being this month.
Probably, that was the first time I appeared on the DT network, and I was checking my profile to see if it was updated. So, I remember that particular moment. Also, this is the first time I was elected as DT1, and I was excited to see an update on BPIP and BPIP delayed this time. I usually do not check every month if it was updated timely. I have checked two times, and it was delayed two out of two. Probably just a coincidence or bad luck. Thank you for the quick fix and for looking at the issues promptly. 
Topic: [BPIP] Bitcointalk Public Information Project [Back in Action] (Read 21752 times)
hero member
Activity: 462
Merit: 767
Instant cryptocurrency exchange with own reserves!
November 11, 2024, 12:01:50 PM
Thank you, I'm only seeing 2 out of 11 months the DT shuffle was not on time, the 1st time being in January which you had alerted us on, and the 2nd time being this month. I'm guessing there must have been a locked job holding up the parsing, I know there were issues with parsing around Oct. 28th due to a DB log file going over its usage, but that was resolved pretty quickly by suchmoon, so I don't believe it would have had any issues on Nov. 1st, but possibly.
I added automatic override if a job remains locked for more than 24 hours, which is what I think happened here, just not sure why it took 4 days, should have been quicker. And not quite clear why it got locked to begin with. I need to research this a bit more.
November 11, 2024, 10:45:34 AM
Nah, not only on extensions. It happens on both the website and the extension. I thought you guys update it manually every month when theymos post the new DT1 members list every month. As LoyceV said, he does it manually for his website as well. I thought you guys did it manually because this is not the first time I saw the DT reshuffle wasn't updated timely. If you check the Trust log page and see the when bpip noticed column, you will see that BPIP updated the list on 4th November, which was right after I wrote in this thread.
Thank you, I'm only seeing 2 out of 11 months the DT shuffle was not on time, the 1st time being in January which you had alerted us on, and the 2nd time being this month. I'm guessing there must have been a locked job holding up the parsing, I know there were issues with parsing around Oct. 28th due to a DB log file going over its usage, but that was resolved pretty quickly by suchmoon, so I don't believe it would have had any issues on Nov. 1st, but possibly.
If you look at the other 9 out of 11 previous months, its been within ~5 minutes of theymos posting.
Keep letting us know if you see any delays in the future!
hero member
Activity: 462
Merit: 767
Instant cryptocurrency exchange with own reserves!
November 10, 2024, 11:18:48 PM
The DT1 job is automatic under normal circumstances, the https://bpip.org/TrustLog on the site should be getting updated every ~5 minutes. Are you seeing these delays on the extension only or the BPIP.org site as well? I ask because there are more troubleshooting variables in play when thinking about the extension. In general, outside of potential temporary parser issues (i.e. locked DT-related jobs), which I haven't seen myself recently, there should never be a 4 day delay on the site itself for DT info.
Nah, not only on extensions. It happens on both the website and the extension. I thought you guys update it manually every month when theymos post the new DT1 members list every month. As LoyceV said, he does it manually for his website as well. I thought you guys did it manually because this is not the first time I saw the DT reshuffle wasn't updated timely. If you check the Trust log page and see the when bpip noticed column, you will see that BPIP updated the list on 4th November, which was right after I wrote in this thread. November 10, 2024, 11:10:30 AM
I don't think it's automatic. Because this is not the first time I saw that the DT1 list wasn't updated timely. Since I always use the BPIP extension on my browser, I often notice that BPIP takes longer to update. Four days is too late, to be honest. Do you update it automatically on your website? If so, then I guess ibminer or suchmoon should find some free time to be in front of their workstation and make some improvement for BPIP.
The DT1 job is automatic under normal circumstances, the https://bpip.org/TrustLog on the site should be getting updated every ~5 minutes. Are you seeing these delays on the extension only or the BPIP.org site as well? I ask because there are more troubleshooting variables in play when thinking about the extension. In general, outside of potential temporary parser issues (i.e. locked DT-related jobs), which I haven't seen myself recently, there should never be a 4 day delay on the site itself for DT info.
~
I thought browsers default to UTF-8 when displaying even if there is nothing specified in the source, but it looks like firefox, at least, is attempting to interpret the encoding based on the content, and picking poorly... definitely best to specify.
November 09, 2024, 04:52:47 AM
This guy for instance is my cryptonite....
Hmm... I see Cøbra instead of Cøbra.Code: (In a Python REPL)
>>> 'Cøbra'.encode('utf-8').decode('iso-8859-1') == 'Cøbra'
True
True
What's happening there, I think, is that you're serving UTF-8 content in the context of a fallback legacy encoding:
HTML requires UTF-8 to be explicitly declared to avoid fallback to a legacy encoding.
I don't see a character encoding in your page's HTTP response:
Code:
$ wget --server-response -qO /dev/null https://loyce.club/trust/2024-11-02_Sat_05.07h/249495.html
HTTP/1.1 200 OK
Content-Type: text/html
Content-Length: 21752
Connection: keep-alive
Date: Sat, 09 Nov 2024 07:03:07 GMT
Server: Apache/2.4.29 (Ubuntu)
Last-Modified: Sat, 09 Nov 2024 05:48:09 GMT
ETag: "54f8-62674698a5840"
Accept-Ranges: bytes
Vary: Accept-Encoding
Access-Control-Allow-Origin: https://bitcoindata.science
X-Cache: Miss from cloudfront
Via: 1.1 57bc54093a2e2c99ca194f2955ba3d1c.cloudfront.net (CloudFront)
X-Amz-Cf-Pop: FRA60-P6
X-Amz-Cf-Id: i-5LtN8UmQj2RVIaKnQC07C_QwHXipW4-ExrP1K1UUMQLqPKFY0K0g==
HTTP/1.1 200 OK
Content-Type: text/html
Content-Length: 21752
Connection: keep-alive
Date: Sat, 09 Nov 2024 07:03:07 GMT
Server: Apache/2.4.29 (Ubuntu)
Last-Modified: Sat, 09 Nov 2024 05:48:09 GMT
ETag: "54f8-62674698a5840"
Accept-Ranges: bytes
Vary: Accept-Encoding
Access-Control-Allow-Origin: https://bitcoindata.science
X-Cache: Miss from cloudfront
Via: 1.1 57bc54093a2e2c99ca194f2955ba3d1c.cloudfront.net (CloudFront)
X-Amz-Cf-Pop: FRA60-P6
X-Amz-Cf-Id: i-5LtN8UmQj2RVIaKnQC07C_QwHXipW4-ExrP1K1UUMQLqPKFY0K0g==
I also don't see anything within the page itself to indicate that it's in UTF-8 (like one of: a , or a , or a BOM).
The other way to go would be to ensure that the content actually is in something like ISO-8859-1 before serving it, but considering that it already looks to be in UTF-8, you may as well just declare that somewhere. ("Explicit is better than implicit.", as a wise coder once said [1].)
[1] I just noticed that that wise coder (Tim Peters) was recently suspended for three months (due to alleged CoC violations). Reading through that (mostly) brain-damaged list of cited objections reminds me why I tend to just work on things by myself and in private these days. I mean, one of those objections mentions, as if it were a bad thing, that he called an old SNL skit "genuinely funny"... So what? He's not allowed to decide on his own what's funny and what's not? I mean, read this post (made before the suspension), and tell me, is that someone who needs to be "educated" on acceptable conduct within a community?
November 05, 2024, 04:50:42 AM
Speaking of twisted usernames, I didn't follow how are handled users like ~DefaultTrust or ~~DefaultTrust?
Didn't they make a mess with the DT lists?
The first one spammed the Trust lists (so I blacklisted him), but it should work:Didn't they make a mess with the DT lists?
Quote from: https://bitcointalk.org/index.php?action=trust
If you want to trust someone whose name begins with a tilde, prefix their name with a backslash.
He only has one inclusion, and adding a backlash isn't an accident. 
November 05, 2024, 04:06:35 AM
This guy for instance is my cryptonite....
Speaking of twisted usernames, I didn't follow how are handled users like ~DefaultTrust or ~~DefaultTrust?Didn't they make a mess with the DT lists?
November 05, 2024, 02:54:42 AM
Well, there are only a few hundred names. I don't know what limitations you are talking about.
This guy for instance is my cryptonite.... hero member
Activity: 462
Merit: 767
Instant cryptocurrency exchange with own reserves!
November 05, 2024, 01:13:20 AM
No, this is one of the few things I still do manually. The reason is that dealing with a list of usernames is always annoying when there are weird characters involved.
Well, there are only a few hundred names. I don't know what limitations you are talking about. But if you want to automate the process and then it bugs something, then it is okay to do it manually. But if you are confident that you may do some troubleshooting and make it automatic, then it will be best for you and the forum members. By the way, BPIP already updated the data yesterday, and it's showing the correct data again.
November 04, 2024, 05:01:34 AM
Do you update it automatically on your website?
No, this is one of the few things I still do manually. The reason is that dealing with a list of usernames is always annoying when there are weird characters involved. hero member
Activity: 462
Merit: 767
Instant cryptocurrency exchange with own reserves!
November 04, 2024, 03:26:01 AM
May I know when we can expect updated data? I would mention @ibminer and @suchmoon.
If it's automated this could be linked to a post scraper and update it within a minute of theymos' post.I don't think it's automatic. Because this is not the first time I saw that the DT1 list wasn't updated timely. Since I always use the BPIP extension on my browser, I often notice that BPIP takes longer to update. Four days is too late, to be honest. Do you update it automatically on your website? If so, then I guess ibminer or suchmoon should find some free time to be in front of their workstation and make some improvement for BPIP.
November 04, 2024, 03:09:31 AM
May I know when we can expect updated data? I would mention @ibminer and @suchmoon.
If it's automated this could be linked to a post scraper and update it within a minute of theymos' post. hero member
Activity: 462
Merit: 767
Instant cryptocurrency exchange with own reserves!
November 04, 2024, 01:02:15 AM
Hi there.
I am curious when BPIP actually updates the Latest DT1 lists. Because theymos reshuffles it on the first day of each month. But it seems BPIP is always updating the list late. It's the 4th of November already but I can see that the both extension and the website showing the wrong data. Also, I often find that the earned merit is not correct which shows via extension. Probably that happens due to unexpected downtime.
May I know when we can expect updated data? I would mention @ibminer and @suchmoon.
I am curious when BPIP actually updates the Latest DT1 lists. Because theymos reshuffles it on the first day of each month. But it seems BPIP is always updating the list late. It's the 4th of November already but I can see that the both extension and the website showing the wrong data. Also, I often find that the earned merit is not correct which shows via extension. Probably that happens due to unexpected downtime.
May I know when we can expect updated data? I would mention @ibminer and @suchmoon.
October 13, 2024, 10:20:27 PM
This was a bit weird - web server seemed to have had a memory leak. Used up all memory and was just sitting there not able to serve any new requests. I have restarted it, should be ok now.
I can confirm that everything works just fine right now 
October 13, 2024, 06:56:12 PM
This was a bit weird - web server seemed to have had a memory leak. Used up all memory and was just sitting there not able to serve any new requests. I have restarted it, should be ok now.
Looks everything is good for now (i guess?). Can you tell if upgrading the server is a solution or just a soft reboot helps a lot? Also, how you able to know this issue, is it only a notification from this thread or the server's service email provider remind you this time.It's the first time I'm seeing this particular issue so I'm not too worried unless it starts happening more often.
I did get a server notification but I appreciate people posting in this thread when there is an issue.
October 13, 2024, 06:43:26 PM
This was a bit weird - web server seemed to have had a memory leak. Used up all memory and was just sitting there not able to serve any new requests. I have restarted it, should be ok now.
Looks everything is good for now (i guess?). Can you tell if upgrading the server is a solution or just a soft reboot helps a lot? Also, how you able to know this issue, is it only a notification from this thread or the server's service email provider remind you this time.
October 13, 2024, 06:10:47 PM
This was a bit weird - web server seemed to have had a memory leak. Used up all memory and was just sitting there not able to serve any new requests. I have restarted it, should be ok now.
Looks everything is good for now (i guess?). Can you tell if upgrading the server is a solution or just a soft reboot helps a lot? Also, how you able to know this issue, is it only a notification from this thread or the server's service email provider remind you this time. October 13, 2024, 05:46:43 PM
This was a bit weird - web server seemed to have had a memory leak. Used up all memory and was just sitting there not able to serve any new requests. I have restarted it, should be ok now.
I can confirm that everything works just fine right now October 13, 2024, 05:24:37 PM
This was a bit weird - web server seemed to have had a memory leak. Used up all memory and was just sitting there not able to serve any new requests. I have restarted it, should be ok now.
Jump to: