I wonder if it could look for `${currentAddress%$filename}md5sums.txt` (or similar) as that's often where an md5sum for a file is, and then comparing that, rather than downloading the whole file and hoping for the best?
eg.
User wants file.tar.gz:aaaaaa...
wget-finder finds http://downloadable.com/file/file.tar.gz
wget-finder checks for (and downloads if present) http://downloadable.com/file/md5sums.txt
wget-finder compares the md5sum in md5sums.txt to the aaaaaa...
If it's good, it downloads the file (and still does the final check) and if it isn't it keeps searching, having not downloaded the file unnecessarily.
Seems like it could be neat for large files (to avoid downloading the wrong file as often).
(Could also check for md5sum.txt or md5sums or md5.txt etc)
I wonder if it could look for `${currentAddress%$filename}md5sums.txt` (or similar) as that's often where an md5sum for a file is, and then comparing that, rather than downloading the whole file and hoping for the best?
eg.
User wants file.tar.gz:aaaaaa...
wget-finder finds http://downloadable.com/file/file.tar.gz
wget-finder checks for (and downloads if present) http://downloadable.com/file/md5sums.txt
wget-finder compares the md5sum in md5sums.txt to the aaaaaa...
If it's good, it downloads the file (and still does the final check) and if it isn't it keeps searching, having not downloaded the file unnecessarily.
Seems like it could be neat for large files (to avoid downloading the wrong file as often).
(Could also check for md5sum.txt or md5sums or md5.txt etc)