Named as one of CB Insights
100 Most Promising AI Startups

Understanding HDR: The Bright and Dark Sides of Imaging

31/10/24

HDR, or High Dynamic Range, has transformed how we capture images and videos, making it possible to capture an impressive range of tones—from deep shadows to brilliant highlights—in one cohesive image. HDR combines multiple exposures of the same scene to produce an image that mimics what the human eye naturally perceives, capturing details across a wide tonal range. Although HDR can create visually stunning results, it also presents challenges, particularly when used in videography, where constant motion and changing lighting add complexity to the HDR process. This article will explore the essentials of HDR, the unique challenges it poses for both photography and videography, and the solutions that help overcome these hurdles, including the latest AI-based approaches.

Defining HDR: What is High Dynamic Range?

Dynamic range refers to the difference between the darkest and brightest parts of an image. Most digital cameras have a limited range, which often results in either blown-out highlights or underexposed shadows in high-contrast scenes. HDR aims to balance these extremes by taking multiple exposures—typically an underexposed, overexposed, and balanced shot—and combining them to retain detail in both shadows and highlights.

In photography, HDR can help achieve well-balanced images in high-contrast environments, like bright landscapes or dimly lit interiors. In videography, the concept is similar, but HDR becomes more complex since exposure adjustments must be continuous across every frame. The potential for high-quality, immersive visuals is immense, but achieving smooth, realistic results with HDR in video requires skill and careful planning.

The Challenges of HDR in Photography and Videography

HDR’s benefits come with unique challenges, especially when capturing video. Here are some common difficulties faced in HDR photography and videography:

  1. Unnatural Colors and Halos A common issue in HDR images and videos is the appearance of unnatural colors and halos. HDR merges different exposures, and if not done carefully, colors can look overly saturated or inaccurately rendered. Halos, bright outlines around objects, appear frequently in high-contrast areas, like the edges of mountains against the sky. These artifacts can make images look artificial and distract from the scene's intended realism.
  2. Overprocessing and the “Grunge” Effect HDR has a reputation for producing “grunge” effects, where contrast and detail are exaggerated, making the image look harsh or stylized. This effect is often the result of overprocessing and can be appealing for artistic projects but may look unnatural or overly detailed in other contexts, especially if the goal is realism.
  3. Ghosting and Motion Artifacts in Videography HDR requires multiple exposures to be blended together, but in videography, this can be problematic due to motion. Moving elements like people, animals, or even leaves in the wind can create ghosting—blurry or duplicated outlines that appear as artifacts in the video. This issue is amplified in video, where movement between frames is continuous and challenging to manage in real time.
  4. Rapid Changes in Lighting Videography with HDR can become difficult in situations with rapidly changing light, such as outdoor scenes with variable clouds or indoor scenes with flickering artificial lights. For example, filming a concert or a sports event in HDR can result in inconsistent exposure due to sudden light shifts, which may cause distracting brightness fluctuations.
  5. Compression and File Size Constraints HDR video files are substantially larger due to the detailed color and brightness information they contain. While HDR can produce striking results, large files make it difficult to work with in post-production, storage, and distribution. Compression is necessary but can reduce quality, potentially negating the benefits HDR offers in the first place.

When can HDR be most challenging

  1. Landscape Photography and Videography HDR is popular in landscapes, where bright skies and darker foregrounds often present a high dynamic range. For instance, capturing a sunset over a valley requires balancing bright sky details with the shadowed land. In videography, changes in sunlight or moving clouds can make it hard to maintain this balance across frames, often resulting in flickering brightness or halos around high-contrast elements like mountain edges.
  2. Urban Scenes and Cityscapes HDR is valuable in capturing the vibrant lighting in cityscapes, especially at night, when artificial lights contrast sharply with dark shadows. However, videographers capturing urban scenes often face ghosting issues due to movement in the scene, such as cars or people. HDR processing can struggle to keep up, causing blurred or duplicated objects, which detracts from the video’s quality and realism.
  3. Concerts and Events with Dynamic Lighting HDR can enhance the experience of live events, capturing the full intensity of stage lights and darkened audience areas. However, concerts with rapidly shifting lights and colors can overload HDR settings, creating inconsistent brightness and unwanted visual artifacts. This challenge is significant for videographers, as each frame needs to adjust to changing lighting conditions seamlessly.
  4. Sports Broadcasting HDR can elevate sports footage, enhancing the contrast between the field and bright stadium lights. However, the rapid movement in sports poses significant challenges for HDR processing, as cameras need to maintain sharp focus and balanced exposure on fast-moving subjects like athletes. This can lead to abrupt changes in brightness or motion artifacts that can interfere with the viewer’s experience.
  5. Portrait Photography and Videography In portrait photography, HDR can reveal rich details in clothing and skin tones. However, this can sometimes lead to exaggerated textures, highlighting imperfections in the skin that might not be desirable. In videography, HDR in close-ups can similarly emphasize small details in a way that feels unnatural or unflattering, making it challenging to use HDR effectively in these scenarios.

Common Solutions to HDR Challenges

While HDR can be demanding, several techniques and tools help address these challenges:

  1. Use Specialized HDR Software with Adjustable Settings Advanced HDR software, such as Adobe Lightroom or Photomatix, provides tools that allow for precise adjustments, reducing halos, controlling color saturation, and minimizing the risk of overprocessing. Many of these programs also offer specific tone-mapping tools that help balance exposure without creating a grunge effect, which is beneficial for both photography and videography.
  2. Implement Tone Mapping in Post-Production Tone mapping adjusts brightness and contrast to create a more natural look by balancing the extreme tones that HDR captures. Videographers use tone mapping to avoid flickering exposure changes or light shifts in high-motion scenes. This technique allows them to smooth out lighting transitions in real time and maintain a consistent look across all frames, particularly in dynamic lighting environments.
  3. De-Ghosting and Motion Tracking in Software De-ghosting features available in programs like Adobe Lightroom or Premiere Pro help align moving objects across frames to reduce ghosting. Some video editing tools also have motion tracking options, allowing you to select and stabilize moving objects or areas within frames, which is useful for managing complex movement in HDR videos.
  4. Choose Dual ISO Cameras for Versatile Lighting Many HDR-capable cameras, like the Sony A7S series, offer dual ISO functionality, allowing filmmakers to handle both low-light and high-contrast scenes within the same shot. By adjusting ISO based on lighting, dual ISO helps keep exposure levels consistent without introducing grain or noise, making it an ideal choice for dynamic scenes like concerts, sports, or outdoor events.
  5. Consider Using Fewer Exposures in Dynamic Environments In scenes with constant movement or changing light, it may be best to reduce the number of exposures used. Taking only two exposures (instead of three or more) can help capture an appropriate balance without overwhelming the scene with too much detail, reducing the risk of ghosting and artifact creation. This technique is especially effective in fast-paced environments like sports or live events.
  6. Optimize Compression for HDR Content Compression is crucial for handling HDR’s large file sizes, particularly in video. Using codecs designed for HDR, like HEVC (H.265) or AV1, helps maintain quality while reducing file sizes, making HDR more manageable in post-production and for streaming purposes. These codecs allow HDR content to retain rich detail without compromising quality, ensuring that the end result remains visually immersive.
  7. Visionary.ai software takes a different approach, solving HDR with advanced AI algorithms running on the edge. The state-of-the-art software employs techniques such as denoising darker and shadowy areas in order to optimize HDR performance. Temporal denoising in the RAW domain enhances HDR imaging by improving single exposure frames without needing multiple exposures. This method uses information from consecutive frames, distinguishing between noise and signal to reduce noise and recover dynamic range. By leveraging motion estimation, it preserves important details while minimizing artifacts, especially useful in high-ISO or low-light scenarios. The result is a clearer, more detailed image with effective tonal mapping, ideal for HDR in video and fast-moving scenes where multiple exposures are impractical.

To learn more about Visionary.ai, get in touch here to book a demo.

Conclusion

HDR photography and videography are invaluable tools for creating vivid, detailed visuals that capture the full range of light and color in a scene. However, HDR also presents challenges, such as ghosting, overprocessing, and maintaining smooth exposure across frames, especially in videography. By using advanced software, optimizing tone mapping, and selecting the right tools and settings, photographers and videographers can create polished HDR content that meets their creative vision. As HDR technology evolves, so do the solutions that make it easier to manage HDR’s complexities, paving the way for even more immersive, realistic visual experiences.