Author

Topic: [project] LoyceV's Profile and Trust Archive site - Active and updated! (Read 1471 times)

legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
@LoyceV, I don't know if I was daydreaming at that time or not, but it's like I saw you had some archiving tool for the forum's seclog after certain time intervals and had a record of the archives somewhere on your website, though I can't see any link?
See: LoyceV's seclog log.

Quote
Any pointers?
Use Search topics > CTRL-F > "seclog" Smiley
copper member
Activity: 2198
Merit: 1837
🌀 Cosmic Casino
Sorry for bumping this topic... it happens to talk about some archives.


@LoyceV, I don't know if I was daydreaming at that time or not, but it's like I saw you had some archiving tool for the forum's seclog after certain time intervals and had a record of the archives somewhere on your website, though I can't see any link?
Any pointers?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
This project is still offline, and my time restraints are only getting worse so don't expect it any time soon. Sorry Sad
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Bump

f*ck

This is disabled until I remove session keys.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=459836;page=sent;offset=0

The above command results in this: http://loyce.club/archive/trust_459836_sent_0_2019-08-16_Fri_17.37h.html

Update
As of today, all Trust pages can be archived. Just copy the URL you want to archive.
Without offset, only the first 50 pages are shown. The default initial offset starts at "50", and shows feedback 51-550. In many cases uses have less than 500 feedbacks in total. If you change the offset to 0, it shows feedback 0-500.
Note that you'll have to archive "trusted", "untrusted" and "sent" separately.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Just one note, the results can be arranged by date by default. Now they are arranged by name and you have to ether scroll to your name or search for you ID.
I was in doubt what to do: short-term, arranging by date makes it easier to find back your new archive, but long term, the current sorting shows all archives from the same profile on different dates together:
Code:
[HTM] profile_1291828_2019-04-23_Tue_23.40h.html                                       23-Apr-2019 21:40      48k      
[HTM] profile_1291828_2019-04-24_Wed_09.52h.html                                       24-Apr-2019 07:52      48k      
The real solution would be a GUI with search field, but that's for later.



Update:
Even better: it's possible by default to sort by date: just click Last modified on top Smiley
legendary
Activity: 2240
Merit: 3150
₿uy / $ell ..oeleo ;(
Yeah, I got both archives pretty fast. Just one note, the results can be arranged by date by default. Now they are arranged by name and you have to ether scroll to your name or search for you ID. Sure the 3rd option is to arrange them by date manually, as what I did. Wink
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
http://loyce.club/archive/profile_1291828_2019-04-23_Tue_23.40h.html

Quote
As I understand I cannot archive both trust and profile in the same post, right?
Correct. I took the lazy approach to stop searching after the first hit. I hope to one day get a nice user interface instead of scraping the forum for entries.

Quote
Let's see what happens with trust.
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=1291828
http://loyce.club/archive/trust_1291828_2019-04-23_Tue_23.49h.html

Quote
... I feel like a spammer here . With two consecutive posts.. ill remove one as soon as I see the result.
I used a thread in archival for testing, but I had to move the entire thread before I could delete the posts. It shouldn't take long though, you can delete your post after at most 8 seconds.
legendary
Activity: 2240
Merit: 3150
₿uy / $ell ..oeleo ;(
What a lovely project you have here Smiley
Let me test it too.
LoyceClubArchive https://bitcointalksearch.org/user/thebeardedbaby-1291828

As I understand I cannot archive both trust and profile in the same post, right?

I need to have two separate posts then.
Let's see what happens with trust.
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=1291828

... I feel like a spammer here . With two consecutive posts.. ill remove one as soon as I see the result.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Is there any reason why you don't save the full page with all the css, js and images? If you need some help, I might be able to help you, though I only work with node.js.
For the purpose of archiving evidence, I have the most important part covered. I wouldn't know how to archive all the extras, and I currently don't have the time to figure it out. I'd appreciate the help, but I know nothing about node.js.

Quote
In the profile page avatars seem to be the only image with relative link, so you can just save them to /useravatars.
Saving the avatar shouldn't be that difficult. When I have some time to kill, I'll move to a VPS and continue there.
legendary
Activity: 3038
Merit: 2162
Is there any reason why you don't save the full page with all the css, js and images? If you need some help, I might be able to help you, though I only work with node.js.


I don't archive images (yet), so the avatar doesn't show in the archive.


In the profile page avatars seem to be the only image with relative link, so you can just save them to /useravatars.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
maybe sending a PM may not be a bad idea (to notify of URL). Unsure if posting a reply as the bot may work as well (but may get a tad bit spammy)
Spam wouldn't be a problem, the user would have to add a "PM" tag to his post. But I don't have a bot that can post or PM.
hero member
Activity: 1582
Merit: 759
Might as well give er' a shot:

LoyceClubArchive https://bitcointalksearch.org/user/initscri-186520



Yep, seems to work well! If future, maybe sending a PM may not be a bad idea (to notify of URL). Unsure if posting a reply as the bot may work as well (but may get a tad bit spammy)
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Can I steal your idea to play around with it a little bit? Tongue
Your interface looks better already Cheesy

does your bot captures IP address of members other than profile & trust page?
The forum doesn't show IP addresses from users. My hosting keeps normal webserver logs (from users who visit loyce.club).
hero member
Activity: 1498
Merit: 596
Nice work again Loyce... Keep going!

I want to ask a silly question, not sure if it is relevant or not, does your bot captures IP address of members other than profile & trust page?
legendary
Activity: 2758
Merit: 6830
Can I steal your idea to play around with it a little bit? Tongue

http://192.241.131.99/archive/

The code is pretty much in spaghetti mode but I thought it would be fun to try this.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
@Loyce which shared hosting do you use?
https://www.kayhosting.com/ They turned into a scam

Now I am curious why it did not work first time? @LoyceV
I had added a big red "offline" to the OP for testing.

Interesting. So it's basically the LoyceBot user LOL
Correct. I need a user account to see Trust.

Let me try
I was expecting people to archive Trust-pages, not profiles.

Quote
As lazy hobbyist, i'd recommend water.css or tacit.
Thanks Smiley I'll keep this for when I have loads to time to figure it out.



*I have much more work on my TODO list: archive pages including images, and a hidden section for archiving Investigations, but don't expect this anytime soon.
copper member
Activity: 630
Merit: 420
We are Bitcoin!
Interesting. So it's basically the LoyceBot user LOL



By the way, people say you are AI, bot blab blab. I think you are a good data analyst and a developer who is interested in developing tools to read their data.

Another good work and this is impressive to me than anything else you have done in the past.

Keep up the good work mate.
copper member
Activity: 630
Merit: 420
We are Bitcoin!
LoyceClubArchive https://bitcointalksearch.org/user/mdayonliner-1432468

Trying again LOL after seeing TryNinja.

Update:
Worked this time  Smiley

Now I am curious why it did not work first time? @LoyceV
legendary
Activity: 2758
Merit: 6830
LoyceClubArchive https://bitcointalksearch.org/user/tryninja-557798

edit: Mine worked. See: http://loyce.club/archive/profile_557798_2019-04-21_Sun_18.46h.html

@Loyce which shared hosting do you use? If you don't mind...
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
So it's basically LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=
?
Yes, or LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=

But only one archive request per post, and by quoting mine within code tags, it won't work.

mdayonliner made me add a few more checks, it should work again Smiley

For example:
LoyceClubArchive https://bitcointalksearch.org/user/mdayonliner-1432468
Which will archive my profile?
This should work, but it should be the first "LoyceClubArchive" in your new post.
copper member
Activity: 630
Merit: 420
We are Bitcoin!
~How to use it
Post this anywhere on the forum (on a public board) without code-tags, and substitute the profile or trust page you need:
Code:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=459836
It has to be a new post, I don't detect edits. You can delete or edit the post after a short period of time.
After about 10 seconds, go to http://loyce.club/archive/ for the result.

So it's basically LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=
?

For example:
LoyceClubArchive https://bitcointalksearch.org/user/mdayonliner-1432468
Which will archive my profile?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
I'm testing my own little version of "archive.is", exclusively for Bitcointalk (see the reason why). There's one crucial difference: I save pages logged in, showing trust on DT2.

The current version only allows archiving of profiles and trust pages.

How to use it
Post LoyceClubArchive followed by the URL anywhere on the forum (on a public board) without code-tags, and substitute the profile or trust page you need. Post one line like this (it's okay if it's part of a bigger post):
Code:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=459836
or
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=459836
or
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=459836;page=sent;offset=0
It has to be a new post, I don't detect editing. You can delete or edit the post after a short period of time.
After about 10 seconds, go to http://loyce.club/archive/ for the result. If the list becomes long: use CTRL-F (until I create a search feature). To sort files by date, use http://loyce.club/archive/?MD (newest first).

Update
As of today, all (paginated) Trust pages can be archived. Just copy the URL you want to archive.
Without offset, only the first 50 pages are shown. The default initial offset starts at "50", and shows feedback 51-550. In many cases users have less than 500 feedbacks in total. If you change the offset to 0, it shows feedback 0-500.
Note that you'll have to archive "trusted", "untrusted" and "sent" separately.

Trust me?
To use this as an archived backup, you'll have to trust I don't edit the data. Before uploading, I add tags to stop search engines from indexing and to point search engines to the original location. Example:
Code:

I use shared hosting, but keep local backups of all files. You can use any other archive website to archive http://loyce.club/archive/ again.

Disclaimer
I'm still testing this, if something fails, I might delete files.

Limitations
Only 1 URL per post.
I use Amsterdam time, not forum time.
Quotes are not ignored: if you quote a post with an archive link, it will be archived again.
It should work most of the time, but if my scraper doesn't catch your request within a few seconds, my computer might be offline. In that case: just try again later.
I don't archive images (yet), so the avatar doesn't show in the archive.
I don't have the skills to create an nice GUI such as archive.is has. If someone wants to help that's much appreciated, until then, it's all about the data Smiley
There's a 10 minutes delay before the same page can be archived again.
Old versions will not be overwritten when the same page is archived again.
You can't archive LoyceBot (this would expose it's email address).
Theymos made some Trust changes. Until I improve things, only the first Trust page can be archived. As of today, all Trust pages can be archived.

Test it!
Really, test it Cheesy

No spam
Please Smiley I said please Cheesy



See [overview] LoyceV's useful data on Bitcointalk for more of my forum-related topics
Jump to: