I am involved in other personal projects and wasn't able to implement something like LoyceV did.
I didn't really "implement" anything, I just spent a few minutes copy/pasting links into a script, and editing the quote. So if Pmalek wants this to use this, we should come up with a working system that allows updates. 
Topic: [ANN] bitcoindata.science | sponsored by BC.Game - page 3. (Read 4111 times)
I noticed yesterday that the images in my Withdrawal Fees and Withdrawal Amounts on Crypto Casinos thread aren't showing on the forum.
I downloaded the images on a VPS, and changed the URLs inside your quote. This is set to update hourly (with a 1 second delay between images) for the next week as a test. After that, updates stop (images will still be on my server for a while). If it keeps working, and if bitmover is okay with my hourly downloads, I could do this for your thread. But it's going to make updates less convenient for you.That's an elegant solution.
This looks to be a server side problem, which i don't have full access to properly debug.
LoyceV had a great idea. It will work nice, no problem for me
I am involved in other personal projects and wasn't able to implement something like LoyceV did.
Hi bitmover,
I noticed yesterday that the images in my Withdrawal Fees and Withdrawal Amounts on Crypto Casinos thread aren't showing on the forum. Did you make any changes that might have disrupted the images on Bitcointalk or is this a forum-related problem? Have you noticed similar problems with images elsewhere?
Just checking back to see if there has been any development on this particular issue? We discussed it last month but it seems like it's a dead end, and no one can figure out why the images are no longer displaying properly. @PowerGlove you are our forum wizard. Can you shed some light on this? I noticed yesterday that the images in my Withdrawal Fees and Withdrawal Amounts on Crypto Casinos thread aren't showing on the forum. Did you make any changes that might have disrupted the images on Bitcointalk or is this a forum-related problem? Have you noticed similar problems with images elsewhere?
Ir is not , because it was working fine like 3 days ago.
Server response time is the same
Are there issues with any other specific topics in forum, or just the one that you mentioned with 50 images?Server response time is the same
It is a bit strange that TalkImg recently had some serious issues, and your service is also using images, maybe there is some connection.
just this one, when you request up to 5 images it works fine.
This is something related to rate limits, maximum number of requests per second
Ir is not , because it was working fine like 3 days ago.
Server response time is the same
Are there issues with any other specific topics in forum, or just the one that you mentioned with 50 images?Server response time is the same
It is a bit strange that TalkImg recently had some serious issues, and your service is also using images, maybe there is some connection.
It's different, what happened to TalkImg was that it suffered a supposed DDoS attack.
From the looks of it, someone is trying to make money by spreading attacks on services and the like, somehow linked to the forum. I say this based on some feedback I received from other users.
Even so, this will not be the case. It was probably some configuration change, perhaps an update (?), but we still can't understand what it is.
Ir is not , because it was working fine like 3 days ago.
Server response time is the same
Are there issues with any other specific topics in forum, or just the one that you mentioned with 50 images?Server response time is the same
It is a bit strange that TalkImg recently had some serious issues, and your service is also using images, maybe there is some connection.
I still think it's the proxy's waiting time for the server.
Ir is not , because it was working fine like 3 days ago.
Server response time is the same
Could the forum be causing the errors? Perhaps it's time to tag @theymos in the discussion and see if he has any ideas.
It is possible that he changed something in the server recently, which may be blocking too many requests....Yeah, now the imageproxy is under a DDoS. (You may still see some images due to caching in your browser.)
I'm not going to try to fix this.
I'm not going to try to fix this.
Could the forum be causing the errors? Perhaps it's time to tag @theymos in the discussion and see if he has any ideas.
It is possible that he changed something in the server recently, which may be blocking too many requests....I was taking a look at this problem today, I couldn't solve now.
I still think it's the proxy's waiting time for the server.
Maybe @theymos can give the proxies more waiting time for requests to the Bitmover website.
I don't know, it's just an idea.
Could the forum be causing the errors? Perhaps it's time to tag @theymos in the discussion and see if he has any ideas.
It is possible that he changed something in the server recently, which may be blocking too many requests....I was taking a look at this problem today, I couldn't solve now.
I don't think the error is related to the number of images and requests. I just created a topic in the Archival board and added a table with only 10 casinos there. There are problems displaying the images and rates there as well. Sometimes they load just fine, other times there are image errors.
https://bitcointalksearch.org/topic/--5522385
The real questions is, how did it work in the past and what changed in the meantime? Could be server-related, a Cloudflare issue, a new setting that needs to be configured, or some other software-related change.
Could the forum be causing the errors? Perhaps it's time to tag @theymos in the discussion and see if he has any ideas.
https://bitcointalksearch.org/topic/--5522385
The real questions is, how did it work in the past and what changed in the meantime? Could be server-related, a Cloudflare issue, a new setting that needs to be configured, or some other software-related change.
Could the forum be causing the errors? Perhaps it's time to tag @theymos in the discussion and see if he has any ideas.
you could reduce these requests, as the site would present images that were already generated seconds before, by another user.
I cached the price data already, as mentioned above, so I don't request information from third party. But the user need to ask 50 images , one by one, as this the way the forum works
I cached the price data already, as mentioned above, so I don't request information from third party. But the user need to ask 50 images , one by one, as this the way the forum works
Anyway, there are many requests made by pmalek topic, ideally there shoyld be a way to reduce those requests (about 50)
Is it 50 per second?
Have you ever thought about creating a caching system?
It is true that the purpose of the script is to display the price in real time when it is loaded. But, I believe that the objective will not be significantly achieved if the information is updated every x minutes. So, you could reduce these requests, as the site would present images that were already generated seconds before, by another user.
Now, I don't know how you can make this work, and whether you would have to change how the site works a lot. But the idea remains.
Even with a cache system he would also need to request 50 images and that will block the page anyway...
I cached the price data already, as mentioned above, so I don't request information from third party. But the user need to ask 50 images , one by one, as this the way the forum works
Anyway, there are many requests made by pmalek topic, ideally there shoyld be a way to reduce those requests (about 50)
Is it 50 per second?
Have you ever thought about creating a caching system?
It is true that the purpose of the script is to display the price in real time when it is loaded. But, I believe that the objective will not be significantly achieved if the information is updated every x minutes. So, you could reduce these requests, as the site would present images that were already generated seconds before, by another user.
Now, I don't know how you can make this work, and whether you would have to change how the site works a lot. But the idea remains.
What intrigues me is that it was working and suddenly stopped.
Anyway, there are many requests made by pmalek topic, ideally there shoyld be a way to reduce those requests (about 50)
I am working on it Anyway, there are many requests made by pmalek topic, ideally there shoyld be a way to reduce those requests (about 50)
One additional question, does bitcoindata.science, for all the 50+ requests it receives, also make 50+ requests according to CMC or Coingecko (or from where you already get values)
No, I fixed this long ago.
I get the bitcoin price periodically and save it in the database and here:
https://bitcoindata.science/api/priceusd.json
Those images get the price from this json above (if not from the json, they get from the database), not from third party API.
What intrigues me is that it was working and suddenly stopped.
Anyway, there are many requests made by pmalek topic, ideally there shoyld be a way to reduce those requests (about 50)
I am working on it Anyway, there are many requests made by pmalek topic, ideally there shoyld be a way to reduce those requests (about 50)
One additional question, does bitcoindata.science, for all the 50+ requests it receives, also make 50+ requests according to CMC or Coingecko (or from where you already get values)
Have you thought about conceptualizing these requests differently, for example, there is one API request and all other calls at the same time (or a period of a few seconds) use the same information from the first initial request.
For example, the Bitcoin price in a few seconds is always very approximately the same and would not affect the accuracy of the information provided.
It looks like I've caused you guys a lot of work and headache. I am sorry about that. I appreciate the time you are taking in trying to fix the problem which seems much more complex than I initially thought. I also didn't know there were multiple parties involved in the bitcoindata.science project, but it looks like examplens has something to do with it as well. There is also joker_josue who is trying to assist.
I work alone in bitcoindata.science.
Examplens shares his server with me, for free, making all possible.
I appreciate the time you are taking in trying to fix the problem which seems much more complex than I initially thought. I also didn't know there were multiple parties involved
From my experience: it starts simple, and everything works. Then a spammer drops by, followed by a DDoS and protective measures start messing with regular usage. Welcome to the internet, it sucks 
What intrigues me is that it was working and suddenly stopped.
Anyway, there are many requests made by pmalek topic, ideally there shoyld be a way to reduce those requests (about 50)
I appreciate the time you are taking in trying to fix the problem which seems much more complex than I initially thought. I also didn't know there were multiple parties involved
From my experience: it starts simple, and everything works. Then a spammer drops by, followed by a DDoS and protective measures start messing with regular usage. Welcome to the internet, it sucks
It looks like I've caused you guys a lot of work and headache. I am sorry about that. I appreciate the time you are taking in trying to fix the problem which seems much more complex than I initially thought. I also didn't know there were multiple parties involved in the bitcoindata.science project, but it looks like examplens has something to do with it as well. There is also joker_josue who is trying to assist.
Jump to: