Finding Duplicate Images In Your Lightroom Catalog
March 11, 2014
9 comment

Last week, I showed you how you can use Lightroom to find duplicate images on your hard drive and to create a new, duplicate-free folder of images. In this tutorial, I will show you how to use the Duplicate Finder Lightroom plug-in to find duplicate images inside of your Lightroom catalog.

During the import process, Lightroom will allow you to not import suspected duplicates. While that is a great feature, it doesn’t do much for duplicate images that are already in your catalog, or when Lightroom doesn’t see an image coming in as a duplicate. This happened to me a few times when I got a new iPhone that I restored with all the images from its predecessor. Lightroom didn’t flag any of the images coming in from the new phone as duplicates, even though they had already been imported in to the catalog.

Lightroom doesn’t have a mechanism to easily find duplicate images that are already in the catalog, but there is a plug-in available that does a pretty good job. The Lightroom Duplicate Finder plug-in uses the EXIF data contained in your files, comparing model, serial number, lens, ISO, and other attributes, to flag images in your catalog that it suspects are duplicates. The plug-in isn’t free (although it does offer a free trial), but the £8.50 is a tiny investment for something that solves such a huge problem for many Lightroom users.

Installing The Plug-in

Download the plug-in from the developer’s website here: http://www.lightroom-plugins.com/DupesIndex.php. You can either download a Windows installer, or a zip file for Windows or Mac that contains the .lrplugin plug-in file and an instruction guide. Since I’m on a Mac, I downloaded the zip file, extracted it, and moved the .lrplugin file in to my Dropbox folder where I store my plug-ins to make them accessible from all of my computers.

From there, open up the Plug-in Manager, click Add to install the new plug-in, locate the .lrplugin file and click Open. When I installed the plug-in, I was prompted by Lightroom that I needed to update my catalog, which I did by clicking Update Catalog.

Update catalog for Find Duplicates Plug-in

Lightroom Fanatic – Update Catalog

If you’ve already purchased the plug-in, you can put in your e-mail and license number on the plug-in screen, or exit the Plug-in Manager to give the plug-in a test run with the trial license. The trial license simply limits the number of duplicates that it will identify.

Duplicate Finder Plug-in Installed

Lightroom Fanatic – Duplicate Finder Plug-in Installed

Finding Your Duplicates

Once you have the plug-in installed, you can run it by navigating to Library > Plug-in Extras > Find Duplicates 2.

Launch Duplicate Finder Plug-in

Lightroom Fanatic – Launch Duplicate Finder Plug-in

Find Duplicates dialog will appear that allows you to select the criteria that you would like to use to identify suspected duplicates.

Find Duplicates Options

Lightroom Fanatic – Find Duplicates Options

The plug-in will allow you to search for duplicates in all of your photos, in selected photos, or even to select photos and to search the rest of the catalog to see if only those photos have duplicates. You can also include or ignore virtual copies, ignore files with specific keywords, or ignore certain image types. This last option is useful if your catalog includes the original images and an exported JPG, for example. While they are the same image and have the same EXIF criteria, I don’t want to flag my JPG exports as duplicates for the exercise of cleaning up my catalog.

Once you’ve got your options selected, click OK and let the plug-in go to work.

Searching for Duplicates

Lightroom Fanatic – Searching for Duplicates

When the plug-in finishes, it creates a Duplicate Photos collection which will have all the copies of the duplicate images that it found conveniently grouped next to each other.

Duplicate Photos Collection

Lightroom Fanatic – Duplicate Photos Collection

The plug-in simply identifies duplicates. It up to you to make the decision as to which images you want to keep and which you want to delete. At this point, you can use Lightroom’s filtering to figure out which images you want to keep. You can also just scroll through each image and use the Metadata tab to compare the data about each one of the duplicates and Reject (X) the ones you want to delete. Once you have all of your duplicates rejected, you can delete the images by navigating to Photo > Delete Rejected Photos.

Now you’re duplicate-free!

My Results

I ran the plug-in on my working catalog that included some raw files, exported JPG, and my iPhone backup folder. It took just over 30 seconds to go through just under 20,000 images and it found 4,968 matches.

Duplicate Search Complete

Lightroom Fanatic – Duplicate Search Complete

I found that I had a lot of web versions of images (600px wide) and print versions (3000px wide) of the same images or multiple exports for the web in different folders, so I rejected the duplicate web services and removed them from my catalog.

Overall, the plug-in provides a much-needed bit of functionality that is missing from Lightroom. If your catalog has duplicates and you have been struggling to clean them up, grab this plug-in!

P.S. If you decide to buy this plug-in, the developer makes it easy to also donate to MAG. MAG basically goes in to places and removes mines and unexploded ordinance, saving lives and generally making the world a better, safer place. Kick in a few shekels if you are so inclined and help clear up some real-world explosives while you clean up your Lightroom catalog.







 

, , , , ,

How To Automatically Launch Lightroom By Inserting A Media Card

FacebookTwitterGoogle+PinterestLinkedIn Last week,...

Read more

Multiple Computer Lightroom Workflow Using Catalog Export

FacebookTwitterGoogle+PinterestLinkedIn Last week,...

Read more

How To Find Your TIFF (or PSD) Files In Your Lightroom Catalog

FacebookTwitterGoogle+PinterestLinkedIn Last week,...

Read more

There are 9 comments

  • raden adams says:

    Hello David, I finally got over to your site about 2 am this morning and downloaded your duplicate finder and when I added it to my cart, the cart just disappeared never to be seen or found again because I wanted to pay for the plugin at at this time. So, it was late and I haven’t even installed it yet so I may get to it tomorrow or the next day and would like to go ahead and pay you for it. If you would please reply I would appreciate it very much. Thank you.

  • dave says:

    Hi, Raden. The duplicate finder isn’t mine, I just found it and wrote up the tutorial on how to use it.

  • Frank says:

    Hi Dave

    I am new to your site found it when I was looking for information on duplicate photos, I had already found the plug in site you explain but see that you talk about telling people how to find duplicates within LR and I would like to read what you have and cannot find it. If you could please tell me how to get to it I would appreciate it.

    Thank you

    Frank

  • Hudsonsedge says:

    Dave,

    For some reason, the LR5 grid shows (inside the All Duplicates smart folder) two copies of some files with the exact same filename and size. When I open the folder in either explorer or LR5, it shows what I know to be true – there is only one. What am I doing wrong?

  • PeterY says:

    Took your advice, purchased the plugin. It works just fine, finding about 2600 duplicates out of about 46000 pictures. The only problem is that when I mark them as “rejected” and then try to delete them I get a message “…you can’t delete photos from a collection set.”

    I’m using LR 5.7 on a Mac.

    Can you suggest a way of deleting these duplicates (leaving one copy only) without my doing so manually, which I was doing before I purchased the plugin?

    Thanks.

    • dave says:

      If you want to delete an image in Lightroom, you need to do it from a folder. The collection is to reject the images, then click use a filter to find the rejected images in the folders. Hope that helps!