Topic: [Windows] Automate downloading TalkImg backup files (Read 231 times)

Thank you both. I've edited the OP and managed to add both of your suggestions to it. Here's hoping we're able to cover more users and increase the reach of TalkImg backups.

Same for me.

Of course, quoting public posts is always allowed.

Just tested this and it does redownload everything that is on the folder, without making any check if previous files (with the same name) were downloaded before. I'll add that argument in the original code to prevent this. Thank you!

It's Windows, what can I do ¯\_(ツ)_/¯.

Ahah I didn't assumed anything. It's just that I use Windows and I wouldn't feel comfortable typing a guide for any other OS that I couldn't try it before.

If both of you allow me, can I add these entries in the OP? @LoyceV would cover Linux users and @TryNinja is great alternative for those that are comfortable with cmd.

To whoever prefers using the command line, you can also create the task with this command:


Just make sure to change the path to where wget.exe is located and also where to save the files (i.e D:\TalkImg Backup\).

I'm assuming you didn't assume he may be assuming Linux users don't need a tutorial I mean: 2 lines vs 4 pages

So you are just assuming most of the people are using wInD0ws 0S?  How about tutorials for Mac and Linux users? 
Luckily LoyceV already posted above how this can be done with Linux, and there is also GUI for everyone who prefers that.

I assumed nothing less It's just me being thorough: always make sure a new backup can't accidentally overwrite your old backup and destroy your only copy.

But my system doesn't rewrite an existing zip. It always creates a new one, with the new name, containing the new images since the last execution of the task (7 days).

If you run the same wget command again right after downloading, does it redownload everything? If so, you should add the "-c" option:

I use this on Linux in a cronjob:
There's one flaw: if joker_josue would replace an old .zip by something else with the same name, it would overwrite my local file. But my local "Time Machine" backups make sure I won't lose files that way.
I use a random time to spread server bandwidth. It takes only a second to run again, so it doesn't matter to use daily checks for new data.

---

---

Lol@Windows task scheduler. So much more complicated than a cronjob

Just a note: Backup zip files are only available for 15 days.
That is, today's zip, 15 days later will be deleted. And each new backup only has images from the last week.
Therefore, someone who wants to keep all the backups should copy the first zip by this weekend. For he must be eliminated.

The system is all automatic, so I recommend that attention.

I may be wrong, but joker_josue always updates all 3 links,you can see that from the filenames (they have the date of when the backup is made). In that case you will always have new files with new information. Since the backups include the new images from the previous week, you will always have to download the new .zip files that are posted on the url provided.
backup_20230527103002.zip -> 3,94 GB
backup_20230528000001.zip -> 106 MB
backup_20230604000002.zip -> 5560 MB

Good job RickDeckard 

I have 2 questions:
1 - In this case of making the weekly backup, it will make the complete backup everytime, right? Would it be possible to backup only the new files of that week, or do you have to download everything again every week?
2 - Has anyone already done the backup? How many GBs of pictures are there?

Thank you for the words. Sure you can, I appreciate your efforts. Any way that we can show awareness to other forum users about ways to backup the files on your server is always a great advantage from my perspective.

Thanks for making this tutorial.
If that's okay, I'll share it in the OP of the TalkImg thread.

After some failed attempts in using Powershell to make a backup of the files (I'm bad I know), I managed to get a working setup in Windows using a combination of wget and Task Scheduler. If anyone is interested in making regular backups of the files provided by @joker_josue (and isn't very tech savy) you can use the following guide for Windows (thank you TryNinja for an alternative path) and Linux (thank you @LoyceV!):

WINDOWS

Prerequisites: Grab wget.exe from here[1].

The code that I'll be using for creating the task can be one of these:
Resuming each command:

• --progress=bar:force : Displays a progress bar for each file that you will eventually download;
• -r : Recursive downloading. This option is responsible for downloading each file from the given URL;
• -c : Checks if the files already exist on the folder. If they do, they aren't downloaded again. If they exist, the download continues from where it ended;
• -nd : Prevents creating subfolders in the directory where the files are being saved;
• -A.zip : Will only look for files ending in ".zip";
• -np : Wget won't go up in the directory that is currently browsing/using;

If you'd like to have a different output folder for your files, there's a slightly variation of the code that you may use:
The new argument (-P) will force wget to download the files to the directory that is provided by you.

As for creating the task:

Open Task Scheduler

This can be done by pressing the Windows Key and typing "Task Scheduler"

Creating and setting up the task

Click in "Create Basic Task" in the main window that opens as soon as you complete the previous step:


In the new menu that appears, name your task. I've named it "TalkImg Backup" and didn't provided an optional description (which is fine). Click "Next":


In this new menu you're free to choose how often this task will trigger. Considering that the website makes weekly backups (of the previous week), I've selected "Weekly". Click "Next":


I'm assuming that the backups will always be updated on a Sunday (as per last updated package). As such, select "Monday". You can also choose at which time the download occurs (for this example I've selected 08:00 (am)). When you're done setting up, click "Next":


On the next menu click on "Start a program" and then "Next":


On this new menu you get two important fields that need to be filled out:

• Program/script: This is where you should type the path to the wget executable provided earlier[1]. As an example I've added "D:\wget.exe"
• Add arguments (optional): This will be the command line that you'll "feed" to wget shared previously[1]. Since I want the output files to be downloaded to a different directory, I've chosen the following command line:

When you're done, press "Next".

In the next menu you'll be able to review your task settings. For this example, the script will run "Weekly; At 08:00 every Monday of every week, starting 08/06/2023". If everything looks OK, just go ahead and click on "Finish":


TryNinja CMD method


LINUX

Congratulations! You've created you task and you are now acting as a backup agent for the images hosted on TalkImg. Horray!

CHANGELOG

• 10/06/2023: Added "-c" argument in the command.
• 11/06/2023: Added Linux guide and alternative method for Windows. Thank you both LoyceV and TryNinja!

---

[1]https://eternallybored.org/misc/wget/