Topic: "Show All" on long topics (Read 2369 times)
Bump! Let's see if this still works
Can you see which post got scrapped?
Anything in your unedited post history gets processed.Or easier (and probably the same data): https://ninjastic.space/search?author=Pmalek&content=showall
It looks like you didn't wait long enough, scraping 100 pages takes about half an hour. Unlike my topic details, I didn't implement a place holder while processing data.
Note that posting the same link again on another board triggers a new update.
Bonus link with topic details: https://loyce.club/archive/details/topic_4265795.html
I've upgraded the format from "http" to "https".
@LoyceV
Is there a way for you to find out from which thread the link got scrapped from?
I tried it out a few days ago in the Croatian local forum. I wanted to scrape this: https://bitcointalksearch.org/topic/zbirni-topic-za-davanje-merita-za-kvalitetne-postove-i-za-korisne-informacije-4265795
My post with the link was on page 100. I waited for quite a long time but your scrapper didn't catch it (so I think). After that I made a second post and added the link in a new thread in the Archival sub-board. That one seemed to work, or it was maybe the the one I initially posted in the Croatian local, but it needed more time.
Can you see which post got scrapped?
Is there a way for you to find out from which thread the link got scrapped from?
I tried it out a few days ago in the Croatian local forum. I wanted to scrape this: https://bitcointalksearch.org/topic/zbirni-topic-za-davanje-merita-za-kvalitetne-postove-i-za-korisne-informacije-4265795
My post with the link was on page 100. I waited for quite a long time but your scrapper didn't catch it (so I think). After that I made a second post and added the link in a new thread in the Archival sub-board. That one seemed to work, or it was maybe the the one I initially posted in the Croatian local, but it needed more time.
Can you see which post got scrapped?
wiling to scrape this thread (to find a message I wrote 50 pages ago :
http://loyce.club/showall/1935179.html
cheers
http://loyce.club/showall/1935179.html
cheers
Update:Waited over an hour.. no luck ... 404.
http://loyce.club/showall/4720640.html !
I am following your guide "how to use" and I getting error opened to show all thread http://loyce.club/showall/750446.html
This one is ready now please add a link to : [overview] LoyceV's useful data on Bitcointalk somewhere on the loyce.club website?
Done 
I am following your guide "how to use" and I getting error opened to show all thread http://loyce.club/showall/750446.html
Because I am a newbie here, I want to know about the forum in one page [Q&A] Tanya Jawab Seputar Forum Disini/Ask about this forum here!
Because I am a newbie here, I want to know about the forum in one page [Q&A] Tanya Jawab Seputar Forum Disini/Ask about this forum here!
A frendly bump with a request. I need a "show all" of my Club thread : https://bitcointalksearch.org/topic/clubthe-spambuster3-cases-openover-3000-accounts-reviewed1800-0908-4720640
You're posting the wrong link, it should be http://loyce.club/showall/4720640.html !I haven't tested this in a long time, but it should still work. Wait a few minutes before testing the link.
If it still works: posting a link like this doesn't have to be in this thread only, any topic will do.
Thank you, can I give one suggestion, please add a link to : [overview] LoyceV's useful data on Bitcointalk somewhere on the loyce.club website? I have bookmarked it but it will be much easier for everyone to link it there.
Update:Waited over an hour.. no luck ... 404.
A frendly bump with a request. I need a "show all" of my Club thread : https://bitcointalksearch.org/topic/clubthe-spambuster3-cases-openover-3000-accounts-reviewed1800-0908-4720640
You're posting the wrong link, it should be http://loyce.club/showall/4720640.html !I haven't tested this in a long time, but it should still work. Wait a few minutes before testing the link.
If it still works: posting a link like this doesn't have to be in this thread only, any topic will do.
A frendly bump with a request. I need a "show all" of my Club thread : http://loyce.club/showall/4720640.html
Thank yoU
As usual, didn't read the OP, link updated... I know it's too late now.
Thank yoU
As usual, didn't read the OP, link updated... I know it's too late now.
In case there are still people who love scrolling, hate clicking, and don't yet know that I made this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).
Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
All times are set to Amsterdam time.
I moved it to a new server, and it's back online now All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).
Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
All times are set to Amsterdam time.
If it's not too much work, maybe you can do something like http://loyce.club/show/178336.html?last=10 to help people catch up easier with the last couple of pages (it can be useful exactly for WO) without killing your scrapper or the browser?
And another 80 minutes wasted 
How's this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).
Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
All times are set to Amsterdam time.
Limitations:
Images still go through Bitcointalk's image proxy, and they don't load when there are too many on one page. In Firefox a fix is to go to the URL-bar a few times, and press Enter. Just "Reload" doesn't help.
This is awesome. I have a "sentiment analysis" bot that currently runs on tweets and subreddits but I'll incorporate this feed as well. Thanks!
And another 80 minutes wasted
How's this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).
Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
How's this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).
Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
Wow, thank you very much. I didn't expect it'll take so much time, but on the other hand you've taken quite a different (and much more optimized) approach.
At least one person will use it.
Edit 2019-10-25: and thanks for updating to a more readable font
If it's not too much work, maybe you can do something like http://loyce.club/show/178336.html?last=10 to help people catch up easier with the last couple of pages (it can be useful exactly for WO) without killing your scrapper or the browser?
And another 80 minutes wasted How's this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).
Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
All times are set to Amsterdam time.
Limitations:
Images still go through Bitcointalk's image proxy, and they don't load when there are too many on one page. In Firefox a fix is to go to the URL-bar a few times, and press Enter. Just "Reload" doesn't help.
If it's not too much work, maybe you can do something like http://loyce.club/show/178336.html?last=10 to help people catch up easier with the last couple of pages (it can be useful exactly for WO) without killing your scrapper or the browser?
Quote
You could have just clicked https://bitcointalk.org/index.php?topic=5023605.0;all , this topic is short enough I know, I didn't want to load extra resources for a testing.
Does the script still work?
Yes Quote
You could have just clicked https://bitcointalk.org/index.php?topic=5023605.0;all , this topic is short enough Jump to: