Mar 062012
 

What’s a DNG?

For those of you not familiar with Adobe’s DNG image format (short for Digital Negative), it was introduced back during the Photoshop CS era, as a means of standardizing and simplifying the process of editing raw picture data. The need for this format stems from the fact that -to this day- camera manufacturers have eschewed a standardized raw file format, in favor of proprietary formats like NEF and CR2.

The problem with these formats is that over time, as the camera makers’ software evolves, they sometimes “orphan” support for files created by older cameras. Unlike a real film negative which can be scanned at any time, a proprietary raw file, absent some 3rd party solution like Lightroom or ACR, can be made obsolete at the whim of the company. You might stand to lose a large segment of your photo library in that case, were you to rely solely on the manufacturer’s format. DNG helps to ensure that if you convert your raw files from today’s cameras, those same files will be accessible and editable for you, years down the road. There are of course other dynamics involved in this equation, but this is the core of the matter — making sure your raw picture data lasts as long as you need it to.

Lightroom has always supported DNG, and with the release of Lightroom 4, its status as a first-class DNG citizen has been reinforced.

New DNG Options in Lightroom 4

Typically there are two ways to convert your raw files to DNG format. You can either use a special, freely downloadable utility from Adobe called the DNG Converter, and follow its instructions for batch-conversion. Or within Lightroom, you can export raw files as DNG files. If you choose a series of files in your Library module and click the Export button (bottom-left portion of the window), you’ll be greeted with the Export dialog. Within that there is a “File Settings” group that looks like this:

Within these settings you have an Image Format menu, and the DNG format is included as one of the options. What’s new in Lightroom 4 is that while DNG is traditionally a lossless format (and therefore tends to generate larger file sizes for the same reason raw files do), you now have the option to create a “Lossy DNG” file on export. This will significantly reduce the size of the DNG files, while having only a slight impact on quality in most cases, as compared to the original raw file. You can expect that a Lossy DNG will typically produce file quality on par with a max quality JPEG, but which stands up to further post-export editing better than a JPEG file. (Thank you to Lightroom Queen Victoria Bampton for her expertise on file conversions and quality settings in this area… she helped yours truly -a “raw purist”- to see the light, if you’ll pardon the pun.)

You also have the option to embed the original raw file into the DNG, in case you need to extract it later. This will greatly increase the file size for obvious reasons, but it’s worth discussing. There are a number of reasons why you might do this, but one of the more common reasons is that some photographers prefer to have a single archival file for each shot, that they can then back up in multiple places. Rather than throw the original raw file away, some find it useful to keep a copy of the raw data inside the DNG file, which can later be extracted with the DNG converter, if necessary (for example if you wanted to try new conversion settings with the original data). The DNG Converter window is shown below, along with the Raw File Extractor dialog. As you can see this process looks and works a lot like the Photoshop Image Processor; it’s very simple to set up.

(Just click the “Extract” button to get the dialog box below and choose your target and destination folders. Simple!)

Managing DNGs with Smart Collections

Another new DNG feature in Lightroom 4 is that you can use Smart Collections to keep track of which of your DNGs were created using the Lossy compression scheme, and which are Lossless. This can be very important over time, as it’s not always easy to remember how different batches of files were converted. And depending on how you converted them, you will want to optimize (and possibly limit the extent of) your edits, based on that information. To create a Smart Collection that tracks the DNG files in your Catalog, click the pop-out menu on the Collections panel and choose Create Smart Collection.

Next give your collection a name and then choose File Type, Is, “Digital Negative / Lossy Compressed”. Add other criteria if necessary and then click “Create”. When you’re done you should have a collection in the panel that automatically detects the Lossy DNG file type, so that you can make your edits in a targeted way when the time comes. Hopefully you’ll find that it’s worth experimenting with the DNG format, as a way of protecting your archives for future use! To learn more about the new features available in Lightroom 4, you can visit Colortrails.com.

Line Break

About the Author:
Contact Dan


Dan Moughamian is an experienced photographer and educator, and has worked with Adobe Photoshop since the early 1990s. He also has extensive experience with Photoshop Lightroom, Photoshop Elements, plugins from Nik software, and many other digital imaging products. As a long-time member of their testing programs, Dan has collaborated with Adobe Systems to help enhance many of the core functions in Photoshop, Lightroom, and Elements.

As an educator, Dan's focus is to help photographers at all levels get the most from their digital workflows. Tips on raw editing, layer masking, alpha channels, image adjustments, HDR photography, focus and lighting effects, and perspective correction, are just a few examples of the topics he covers. To learn more, you can visit Colortrails.com, and follow Dan on Twitter @Colortrails and on Google Plus.

  • Larry

    Is there a way to create the DNG files in the new lossy format when importing from a CF card straight from the camera?

  • Dan Moughamian

    Hi Larry. Great question!

    That may be an option (in Preferences under File Handling) that’s coming down the road, but as things stand know I believe the only option in the Import dialog is the standard Copy as DNG mode, which is lossless. 

    It makes sense to default things this way as you can always export a lossy variation later, but if you start out lossy you can’t “go back” without re-importing things.

    Hope that helps. 

    Dan

  • Pingback: Lightroom 4.0 Resources « Lightroom Journal

  • Norbert75

    Sorry but for me it doesn’t make sens to shoot in RAW and then to use a lossy pseudo-raw format !
    If I shoot RAW I wish to have a maximum of informations in my file, if not then I shall shoot in JPEG mode !

  • Larry

    I like to shoot RAW so I can have maximum flexibility in post processing and “developing” the images.  Once I’ve got it the way I want it, I currently then save them as JPGs because I have no use for the original RAW files and want to save the space.  I’m not a professional so it’s not like I’m constantly tweaking my photos.  I’ve never felt the need to go back to an original RAW image.  Once I’ve processed it in LR/PS, I’m done with it.

    I was looking at the new lossy DNG format as an alternative to JPG but I’ll probably just continue with my current workflow.
     

  • Pingback: Lightroom Wednesday! » Heninger Fotographik

  • Dan Moughamian

    Norbert, Larry:
    You both make valid points. Truly there’s no one “right way” to handle file formats in workflow and archiving.

    The way I’ve approached DNG is not as an alternative to a raw workflow, but as an alternative to raw-only storage. With Lossy DNG the same alternative now applies to JPEG storage, and to any workflows that include performing edits on JPEG files. 

    But it is easy -given enough storage capacity- to go with “shoot raw, edit raw, back-up raw, always”… The Lightroom and ACR teams have done such a fantastic job of building up support for new cameras as they become available… we take it for granted that all our cameras’ raw files will always be supported. But we don’t really know what the future holds, if you look 5-10 years down the line. Things can change.

    DNG is a way to hedge your bets -by having your most prized files in two uncompressed data formats- that should the software landscape change, you’ll have at least one version that will “translate” no matter what. Lossy DNG adds another layer to that, by providing a potentially better option than storing edited files as JPEGs. As mentioned, some cameras have fantastic, low noise JPEG output, and so that will suffice in many cases for those photographers.

    Another “angle” is that for some people their cameras may produce acceptable quality raw files, but less acceptable JPEG quality. This somewhat common in the prosumer space between compacts and more expensive DSLRs. In that case if you wanted to store some snapshots or non-critical images in a smaller format, you could shoot everything raw (capturing the best quality), but back up some of the edited files as Lossy DNGs (saving drive space). Consider also the ever-increasing file size of DSLRs (D800 now 36MP!) and storage space has to be considered.

    The hope way back when this started, was that camera companies would adopt lossless DNG as their raw format (directly out of camera) but few if any of them want to give up the perceived control they have by staying proprietary. IMHO, that’s pretty much wishful thinking on their part, given how quickly Adobe adds support for new camera types within their raw workflows. Maybe one day our only worry will be “Do I shoot this next series of shots as a Lossless DNG or a Lossy DNG”?

  • Dan

    So I watched the lightroom4 video promoting dng files and I am sold on it.  In the video she only showed selecting the setting in a conversion of a file.  For files I am converting on import, I am not given an option to select “enable fast load data.”  She said it is automatically turned on but I want to double check because the main reason why I am switching to dng is for the quicker load time in the develop module.

  • Hulasweets

    Thank you. I get a clearer picture of what and why I’m doing what I’m doing. I import and convert automatically to DNG files. But when I go to edit I can’t seem to use Camera Calibration and other items only available to RAW files. What do I need to do to fix this?