CAPS LIKE WHOA (jc) wrote,

  • Mood:

Camgrab 2005 continued

Okay, so I messed up coding my new camgrab script. That is to say, ten instances of the script still managed to fetch ten sets of images every few seconds, but I still ended up with a lot of duplicate images because my computer's clock was out of sync with the remote server's clock, meaning the script would always think it was accessing a new image. I think I amassed a total of 100,000 new files in the space of 18 hours. Bugger.

After spending hours manually removing duplicate images, I thought there had to be a better way. And I found it in the form of File Buddy's duplicate files checker; comparing the data fork size and contents of 20,000 images in the one folder took a matter of minutes. The next challenge was to find a way to, in each group of duplicates (of which there were routinely about 4,000), select all but one file and trash the actual duplicates.

I didn't actually find a way of doing this until I'd manually selected and trashed over 22,000 files in "page view" groups of 25-30 (5 hours' work), when in sheer desperation I went to Google and found a solution in - duhh - File Buddy's FAQ. I needed to customise the list window toolbar to add the Duplicates button menu, from which I could have File Buddy do exactly what I'd been doing manually, in about three minutes compared to my five hours. Curses. It took about ten minutes, in total, to find and trash 15,000 duplicates.

I still have to manually go through the remaining unique files from each cam and sort them into individual folders, one for each camera angle, but it's much more fun without having to worry about checking for duplicates at the same time.

  • It's a mad, mad, mad, mad world...

    You don't have to be insane to work in support, but it helps. I am forever in debt to Charles M. Schultz.

  • KARMA.

    It's official: I'm a contributor! I'm almost lost for words, but this ties in with what I've been doing lately. LJ's new style system, S2, is a…

  • More FAQ goodness

    Before I forget, I have two more FAQ achievements I'd like to report, both of which may be of interest to some of my friends. *eyes…

  • Post a new comment


    default userpic

    Your reply will be screened

    Your IP address will be recorded 

    When you submit the form an invisible reCAPTCHA check will be performed.
    You must follow the Privacy Policy and Google Terms of use.