Ever since i started hosting a few of the boards here i kept an rsync backup of the webserver to my webserver going whenever i remembered to run it...
Fast forward a year or so and the backup archive on my home server is taking ludicrous levels of diskspace ^_^
16.9GB space, 180k files
I tried running a few duplicate image detectors on it to delete all the repeated images, but the only one i found that seems to work properly (dupdetector) i cannot get to automatically delete files... i can't be arsed to push 'ok' individually on several thousand files :P
Any suggestions for programs to try? preferably command-line if possible, windows or Linux is fine: server is Linux and the archive directory is mapped to my XP machine...
HALP :D