I don't know how heavily your site is used, but my guess is 95%+ of your HTML files are never accessed by anyone. If someone accesses a particular page n times, your server would need to generate the HTML n times.
I know I should switch to some database, and it's been suggested many times, but I simply don't have the time to learn how to do it and change
everything. I don't really mind the 6 hours computation time, because it doesn't take much of
my time. Currently, my
Merit data analysis takes much more processing time, and that would be the next thing to make more manageable, but there too, I need the time.
Meanwhile, I just started another project dealing with 50 million files, for which I'm taking a slightly different approach. And I have another project I want to start. It would probably be good to start using a database at least for new projects, but realistically, it probably won't happen.
Let's see how long it takes for the navigation bar to update
It's done already, not bad
The previous weeks will be updated in the coming hours.