Jun 262011
 


Every camera manufacturer has its own way of storing the raw data that comes from the sensor. Several manufacturers even develop different formats for different cameras (or create a new format and abandon an older one). It sometimes seems that each new model introduces some wrinkle into the manufacturer’s raw format. We see the effect of this in a lag between the release of a new camera and Lightroom’s ability to interpret and render images from these new raw formats. While Adobe is rather good at deciphering new raw formats and providing support in a timely manner, they saw room for a new and open standard to store raw data. Enter the DNG, or Digital Negative, raw format.

Some may argue that DNG in not an open standard since it is controlled by Adobe. However, the standard is fully documented and has been submitted for consideration as the open standard for raw data. Several manufacturers are now offering DNG as the native format on their cameras. Adobe offers several ways to make the conversion of your proprietary raw formats to DNG. In fact, Adobe provides a free DNG converter. The free DNG Converter is available for both Windows and Mac OSX.

There are several excellent sources to learn about what DNG is and why it is a great addition to your workflow. dpBestflow.org (an absolutely indispensable resource for photographers in this digital age) has several articles on DNG. DNG is the recommended format for archival use and for PIE application such as Lightroom. (PIE – Parametric Image Editing) Richard Anderson’s article is a great place to start. Julieanne Kost also has an excellent episode on Adobe TV that explains the DNG format.

So what are some of the advantages to converting your proprietary raw format files into DNG format? There are several:

  • DNG is an openly documented format, allowing more and more developers and camera manufacturers to create compatible software and hardware.
  • No information is lost in the conversion to DNG
  • DNG files are, with few exceptions, smaller than their proprietary raw counterparts.
  • DNG does away with the need to create, update, and keep track of XMP sidecar files. All information in XMP files can be written to the DNG file directly.
  • DNG files have MD5 hashes built in that can detect corruption in the original image data or the entire DNG file.

Lightroom offers several ways to convert to DNG. The first is available when you import our images into the catalog. Look at the top of the import dialog and you will see several options.

Click for full size image

If you choose Copy as DNG then Lightroom will read the file, make the conversion to DNG, and then add the DNG files to your catalog. This method will take time and make your import process longer. I’ve used this method on smaller imports but I don’t recommend it for extensive shoots. I prefer to review the shots first, weed out those I won’t keep, and then convert the winners to DNG.

The method I prefer is to convert to DNG after the images are in the catalog. Lightroom does this quite nicely and even removes the old raw image from the catalog and replaces it with the DNG version for you. Select the images you want to convert in the grid.

Click for full size image

Here we can see three different proprietary raw files. (Thanks to X-Rite ColorChecker Passport for the NEF file!) Select the files and go to the Library menu and choose Convert Photos to DNG…

Click for full size image

This will bring up a dialog where you have a few choices to make.

Click for full size image

Let’s examine each of these options. In the Source Files section there are two checkboxes. Only convert Raw files, when checked, tells Lightroom to ignore files that are not raw formats when doing the conversion. (Yes. Lightroom does allow you to convert files like TIFF and JPEG to DNG but the reason for this is a different subject for another article). I recommend you check this.

The next option, Delete originals after successful conversion, instructs Lightroom to delete your original files once they are converted. Personally, I prefer to archive the proprietary raw files so I leave this unchecked. Lightroom will still swap the DNG files for the original raw files in your catalog but with this option unchecked it leaves the original files on your hard drive.

The DNG Creation section’s first option simply let’s you decide whether the file extension will be dng or DNG. You can choose your compatibility level in the next option. If you are using an earlier version of Photoshop or Camera Raw this becomes important. The next option is where you will choose the size of the JPEG preview that is stored in the DNG file. The larger the preview the less space you’ll save.

The last option, Embed Original Raw File, may seem like a good idea but be warned. Embedding the entire original raw file will double your file sizes. I prefer to archive the originals as another form of backup allowing me to save some space after the conversion.

Once you are done click OK and Lightroom will begin converting the files. If you are doing a large number of files it is best to let this run overnight. When you are done the grid looks the same but now you will see that all the files are DNG files.

Click for full size image

The last method we’ll cover is converting to DNG on export. Choose your files as before and then click export to bring up the export dialog. You will see a preset called Export to DNG.

Click for full size image

There are more choices here that allow you to add the DNG files to the catalog and stack them (or not) with the original raw files. You can rename them if you like. The File Settings section compares to the DNG Creation section from the previous dialog we covered. The Image Sizing, Output Sharpening, and Watermarking sections are shown but they have no selectable options since nothing here applies to DNG files. Since keywords are included inside DNG files you do have the option of having them written in Lightroom Hierarchy. Click Export when you are done and Lightroom will perform the conversion and complete the export.

Stacked together in the Grid we can see no appreciable difference between the proprietary formats and the DNG from in catalog conversions or export conversions.

Click for full size image

So experiment with DNG. Read the background articles. Watch Julieanne Kosts’s episode. Have fun. I really recommend the DNG format. Some of you will disagree but that’s what makes Lightroom great – flexibility of workflow!

Line Break

About the Author:
Contact Gene


Gene is an Adobe Community Professional, an Adobe Certified Expert in Photoshop Lightroom, Photoshop, and InDesign, and an avid Lightroom fan. He has written several feature articles for Photoshop User Magazine and is the author of Explore Lightroom 4: A Roadmap for Photographers.

He belongs to the Professional Photographers of America (PPA) and the National Association of Photoshop Professionals (NAPP). Gene is the Co-Founder, Manager and a frequent blogger for the Dallas Fort Worth Adobe User Group (DFWAUG).

In addition to running Lightroom Secrets, Gene also contributes to O'Reilly's media blog, moderates on the Adobe forums, and helps out on lightroomforums.net.

  • Chmoss

    There is a downside to converting to DNG. Programs like DxO and Nikon NX2 which use their own magic sauce on original RAW files do not work or do not use the sauce on DNG files. Of course, if you keep the originals as backup, this is not a major problem – but it gets away from one advantage of DNG – it seems to create smaller files than the original NEF or RW2 files – and even for the Leica M8 which records DNGs natively, they get smaller when imported with convert to DNG on – or at least they did so when I last checked.

  • http://lightroomsecrets.com Gene McCullagh

    That’s true, Chmoss. As DNG becomes more prevalent then these programs may eventually come around. If one or more of them are in your workflow then switching completely to DNG does present an issue.

    I understand Nikon’s program not supporting DNG since they have their own proprietary format. But DxO has always perplexed me. Especially since they have DNG as an output option. I don’t get the thinking behind that.

  • Pingback: Raw Resource | Lightroom Secrets

  • http://twitter.com/dmaterialized D.M. Cook

    DxO support is pretty unlikely. From what I understand, they claim that a DNG (by converting RAW data into a new, common format) means the image is already “processed” and therefore all their careful measurements of camera response — distortion, aberration, sensitivity, etc. — are no longer useful as a way to correct for these issues. Now, I’d imagine that knowing what camera/lens combo was used to shoot something should, in theory, be all the info a program like DxO needed in order to work its magic, but apparently they disagree.

    Here’s hoping that they’ll change that someday, but I’m not going to hold my breath.

  • http://www.PhotographingTennis.com/ Chris Nicholson

    What is the reason for recommending not to convert TIFF to DNG?

    The reason I ask is because I’ve seen several knowledgeable people
    writing the same advice. But I still don’t see the disadvantage, at
    least in terms of why I want to do it.

    I’ve done high-res scans of all my old slide work, which I’ve been
    integrating into my Lightroom catalog. The problem I’ve run into is
    that the scans are stored as TIFFs; because LR doesn’t write sidecar
    files for TIFFs, every time I make even minor global changes (to copyright info
    in metadata, for example), LR takes forever to save those changes into
    thousands of 100mb TIFFs, rather than the fraction of a second it would
    take to update a 15kb XMP. I thought that by converting to DNG, I would
    realize huge time savings during global saves. (Not to mention just the time savings involved in making a local change to one TIFF.)

    If there is a tangible downside to converting TIFFs to DNG, then my Plan
    B is to convert the TIFFs to NEF (I shoot Nikon) and re-import to LR.

    –Chris

  • http://lightroomsecrets.com Gene McCullagh

    Hi Chris!

    Lightroom doesn’t create XMP files for DNG either. I suggest you turn off automatic write to file in the preferences while you are working on these large sets of scans. When you are done for the day you can save all the changes at once and leave Lightroom to work while you do other things.

    Once you are past the initial stages you can turn that back on so you don’t forget to save the changes out dring a regular workflow.