LoyceV's seclog log - page 2. | Bitcointalksearch.org

SFR10

legendary

Activity: 2968

Merit: 3406

Crypto Swap Exchange

Quote from: LoyceV on May 19, 2020, 09:26:14 AM

I know Firefox can handles large HTML pages better than Chrome.

Quote from: Welsh on May 19, 2020, 09:28:09 AM

As LoyceV stated, Firefox handles it slightly better, and that's what I tested it on.

Just tried testing it on Firefox and the difference was night and day ^{[quite responsive]}.

Quote from: LoyceV on May 19, 2020, 10:01:33 AM

I've added a compressed file. If it's slow after downloading, you have your own computer to blame Tongue

I have a beefy computer but the improvement wasn't that significant in Chrome Tongue

^{- Perhaps as you said earlier, it has to do with browser limitations.}

I disabled "hardware acceleration" in Chrome and noticed some improvements...

PrimeNumber7

copper member

Activity: 1652

Merit: 1901

Amazon Prime Member #7

Quote from: LoyceV on May 19, 2020, 07:02:53 AM

LoyceV's seclog log
See loyce.club/seclog/! (Warning: current size 115 MB)
Or loyce.club/seclog/index.html.gz (Recommended, currently 12 MB)

This is probably too large for most web browsers. I found this stack overflow question where someone claims that browsers tend to die after loading a 60 MB text file.

I think a better solution might be to use a search function that would allow for someone to search if/when a username had a security event.

Sending 100+ MB of data to the internet is also expensive. Sending a 100 MB file to the internet will cost about 0.9 cents, or US$0.009 and this can add up if you send this file many times.

coinlocket$

legendary

Activity: 2534

Merit: 1517

#1 VIP Crypto Casino

The file is way too big, I've tried to use CTRL F or scrolling up and down but got a white page for loading.
I have a 200MB connection that should be faster.

What about splitting the page in alphabetic order?

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Quote from: Welsh on May 19, 2020, 09:28:09 AM

Is it worth considering implementing pagination with the option of displaying all data on one singular page if desired?

I kinda expect the people who use this, to want to search the whole thing at once: wait for it to load, then CTRL-F and open links in a New Tab. I've added a compressed file. If it's slow after downloading, you have your own computer to blame Tongue

Welsh

staff

Activity: 3304

Merit: 4115

Quote from: SFR10 on May 19, 2020, 09:17:46 AM

Not sure if it's my internet speed or it really loads slowly ^{[it took me a very long time just to be able to load the data for the previous day and scroll down without having lags]}...

Highlighting a certain part seems to contribute to its lag.
After a certain time, it stops loading the data (I waited for 5 minutes but it doesn't load any data past may 16^th, on my side).
^{- I was able to replicate this issue twice (tested in Chrome).}

Its slow because as far as I can tell it continuously loads the data on the page. However, I made it to November 2019 fairly quickly, and the slow loading is partly because of the way its designed to load data, your client, and connection speed. As LoyceV stated, Firefox handles it slightly better, and that's what I tested it on.

Quote from: LoyceV on May 19, 2020, 09:26:14 AM

I'll add a compressed file in a bit, it might work better from local storage.

Is it worth considering implementing pagination with the option of displaying all data on one singular page if desired?

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Quote from: SFR10 on May 19, 2020, 09:17:46 AM

(tested in Chrome)

From my Trust list viewer, I know Firefox can handles large HTML pages better than Chrome. The page has 638000+ entries, browsers don't really like it, but if I'd make it a text file the links won't work.

I'll add a compressed file in a bit, it might work better from local storage.

SFR10

legendary

Activity: 2968

Merit: 3406

Crypto Swap Exchange

Quote from: LoyceV on May 19, 2020, 07:02:53 AM

LoyceV's seclog log
See loyce.club/seclog/! (Warning: current size 115 MB)

~Snipped~

Bugs
Please post if there is any problem with the data.

Not sure if it's my internet speed or it really loads slowly ^{[it took me a very long time just to be able to load the data for the previous day and scroll down without having lags]}...

Highlighting a certain part seems to contribute to its lag.
After a certain time, it stops loading the data (I waited for 5 minutes but it doesn't load any data past may 16^th, on my side).
^{- I was able to replicate this issue twice (tested in Chrome).}

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Bitcointalk's Security log only shows data from the last 30 days. At actmyname's request, I've just started keeping longer records. I expected to be done quickly, but sorting out archived data and converting it back to the same format turned out to be a lot of work and took several days.

LoyceV's seclog log
See loyce.club/seclog/! (Warning: current size 168 MB, Firefox works better than Chrome)
Or loyce.club/seclog/index.html.gz (Recommended, currently 18 MB)
Machine readable: seclog.txt (32 MB) or seclog.txt.gz (7.3 MB)

This contains all data I could find from seclog, archived posts and data provided by a user.

I don't think this has much discussion value, I just leave it here for whoever can use it.

Incomplete
I show what I have, but this data is not complete because I started scraping 10 years too late. From now on it should include all new seclog-entries.

Updates
Once a day. This isn't meant to be real-time.
For more recent data, see seclog.

Bugs
Please post if there is any problem with the data.

No spam
Please

See [overview] LoyceV's useful data on Bitcointalk for more of my forum-related topics

Topic: LoyceV's seclog log - page 2. (Read 1475 times)