Pages:
Author

Topic: LoyceV's seclog log - page 2. (Read 1465 times)

legendary
Activity: 2380
Merit: 5213
May 19, 2020, 03:43:29 PM
#9
Why don't you separate it into different months? Then there will be no loading problem.
Perhaps, you are trying to make it easy to find a certain user by using CTRL+F? But we have BPIP for that. Also, for that purpose, you may consider creating a separate seclog page for every user. (I don't know how time consuming creating that is.)
legendary
Activity: 2968
Merit: 3406
Crypto Swap Exchange
May 19, 2020, 12:43:26 PM
#8
I know Firefox can handles large HTML pages better than Chrome.
As LoyceV stated, Firefox handles it slightly better, and that's what I tested it on.
Just tried testing it on Firefox and the difference was night and day [quite responsive].

I've added a compressed file. If it's slow after downloading, you have your own computer to blame Tongue
I have a beefy computer but the improvement wasn't that significant in Chrome Tongue
- Perhaps as you said earlier, it has to do with browser limitations.

I disabled "hardware acceleration" in Chrome and noticed some improvements...
copper member
Activity: 1624
Merit: 1899
Amazon Prime Member #7
May 19, 2020, 11:26:51 AM
#7


LoyceV's seclog log
See loyce.club/seclog/! (Warning: current size 115 MB)
Or loyce.club/seclog/index.html.gz (Recommended, currently 12 MB)

This is probably too large for most web browsers. I found this stack overflow question where someone claims that browsers tend to die after loading a 60 MB text file.

I think a better solution might be to use a search function that would allow for someone to search if/when a username had a security event.

Sending 100+ MB of data to the internet is also expensive. Sending a 100 MB file to the internet will cost about 0.9 cents, or US$0.009 and this can add up if you send this file many times.
legendary
Activity: 2366
Merit: 1512
#1 VIP Crypto Casino
May 19, 2020, 11:12:18 AM
#6
The file is way too big, I've tried to use CTRL F or scrolling up and down but got a white page for loading.
I have a 200MB connection that should be faster.

What about splitting the page in alphabetic order?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
May 19, 2020, 11:01:33 AM
#5
Is it worth considering implementing pagination with the option of displaying all data on one singular page if desired?
I kinda expect the people who use this, to want to search the whole thing at once: wait for it to load, then CTRL-F and open links in a New Tab. I've added a compressed file. If it's slow after downloading, you have your own computer to blame Tongue
staff
Activity: 3248
Merit: 4110
May 19, 2020, 10:28:09 AM
#4
Not sure if it's my internet speed or it really loads slowly [it took me a very long time just to be able to load the data for the previous day and scroll down without having lags]...
  • Highlighting a certain part seems to contribute to its lag.
  • After a certain time, it stops loading the data (I waited for 5 minutes but it doesn't load any data past may 16th, on my side).
    - I was able to replicate this issue twice (tested in Chrome).
Its slow because as far as I can tell it continuously loads the data on the page. However, I made it to November 2019 fairly quickly, and the slow loading is partly because of the way its designed to load data, your client, and connection speed. As LoyceV stated, Firefox handles it slightly better, and that's what I tested it on.

I'll add a compressed file in a bit, it might work better from local storage.
Is it worth considering implementing pagination with the option of displaying all data on one singular page if desired?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
May 19, 2020, 10:26:14 AM
#3
(tested in Chrome)
From my Trust list viewer, I know Firefox can handles large HTML pages better than Chrome. The page has 638000+ entries, browsers don't really like it, but if I'd make it a text file the links won't work.

I'll add a compressed file in a bit, it might work better from local storage.
legendary
Activity: 2968
Merit: 3406
Crypto Swap Exchange
May 19, 2020, 10:17:46 AM
#2
LoyceV's seclog log
See loyce.club/seclog/! (Warning: current size 115 MB)

~Snipped~

Bugs
Please post if there is any problem with the data.
Not sure if it's my internet speed or it really loads slowly [it took me a very long time just to be able to load the data for the previous day and scroll down without having lags]...
  • Highlighting a certain part seems to contribute to its lag.
  • After a certain time, it stops loading the data (I waited for 5 minutes but it doesn't load any data past may 16th, on my side).
    - I was able to replicate this issue twice (tested in Chrome).
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
May 19, 2020, 08:02:53 AM
#1
Bitcointalk's Security log only shows data from the last 30 days. At actmyname's request, I've just started keeping longer records. I expected to be done quickly, but sorting out archived data and converting it back to the same format turned out to be a lot of work and took several days.

LoyceV's seclog log
See loyce.club/seclog/! (Warning: current size 168 MB, Firefox works better than Chrome)
Or loyce.club/seclog/index.html.gz (Recommended, currently 18 MB)
Machine readable: seclog.txt (32 MB) or seclog.txt.gz (7.3 MB)

This contains all data I could find from seclog, archived posts and data provided by a user.

I don't think this has much discussion value, I just leave it here for whoever can use it.

Incomplete
I show what I have, but this data is not complete because I started scraping 10 years too late. From now on it should include all new seclog-entries.

Updates
Once a day. This isn't meant to be real-time.
For more recent data, see seclog.

Bugs
Please post if there is any problem with the data.

No spam
Please Smiley



See [overview] LoyceV's useful data on Bitcointalk for more of my forum-related topics
Pages:
Jump to: