HOW TO MANAGE THE MOIRÉ EFFECT FOR LIVE PRODUCTIONS

Live events have rapidly grown since the end of 2020. Live sports, comedy shows, concerts, and other events held in large spaces have been met with an eager audience, especially after the pandemic when people turned to consuming movies and series at home through streaming services. Fortunately, a series of new display technologies are now available at a lower budget than in previous years, but some of them, particularly LED wall panels, present new challenges such as the Moiré Effect in their artifacts.

Scroll down

What is the Moiré Effect?

Moiré is the result of an optical distortion caused by the overlay of two grids of lines that have different sizes or angles. This interference pattern creates a visual distortion effect. 

A common question is why Moiré is more prevalent in video cameras than in film. The grains in a film emulsion frame are randomly arranged, while all the photosites in video cameras are in a regular grid pattern. Regardless of whether it’s a rolling shutter, global shutter, CMOS, CCD, single-chip, or three-chip, the photosites form a grid, much like a screen. Thus, capturing it through another screen or a series of parallel lines that resolve at a similar frequency introduces the possibility of the Moiré Effect appearing. 

Why don’t we see this effect in video images? The reason is simple: it’s due to optical low-pass filters (OLPFs) used in cameras. These filters, also known as anti-aliasing filters, are part of the image generator and must be at a specific distance. Their function is to slightly blur small points so that they reach more photosites, making a black screen in the frame covering a white background appear as a gray field, much like how it would look if someone stood too far from the screen to distinguish individual holes. 

To eliminate Moiré, the OLPF needs to filter frequencies higher than half the “pixel pitch” of the image generator. Mathematically, the image frequency must be half that of the image generator, known as the Nyquist limit in signal processing; any small point must cover at least 2 pixels in any direction to avoid acting like two screens. Most cameras have this type of OLPF in front of them, although 8K cameras do not need them since their lenses cannot resolve such small points.

Why are LED walls more prone to the Moiré Effect?

Camera systems rely on the fact that as frequencies increase, regular patterns like fences, screens, stripes, bricks, tiles, and fabrics become smaller and tend to lose contrast (measuring contrast from dark to light is modulation depth, and the modulation depth vs. frequency graph is the modulation transfer function of an optical system like a lens). Modulation depth usually decreases as patterns become smaller (frequencies increase) and tends to zero when intricate details are no longer resolved. Lens defects or fog in the air add to the abruptness of the modulation depth decrease. 

LED walls have properties that make them bright and sharp, presenting a challenge for Moiré. Individual LEDs are point sources that do not blend with each other. They are emitters, meaning a dark pixel can be completely turned off, and often there is a black matrix between LEDs (like another screen). The contrast between pixels is extreme (high modulation depth) and very robust as pixels become smaller since each LED generates its own bright light, resulting in minimal loss of modulation depth. Therefore, LEDs appear smaller as they approach the pixel frequencies of the image generator. 

The black matrix between bright pixels means the effective pattern frequency is double that of the pixels alone. Instead of Pixel 1, Pixel 2, and Pixel 3, the camera sees Pixel 1, Black Pixel; Pixel 2, Black Pixel; Pixel 3, Black Pixel. This effectively doubles the frequency, and this doubled frequency arrives with unusual sharpness: the contrast can “slip” past the OLPF causing the Moiré Effect when interacting with the image generator. In other words, those bright LED points can create super small points on the camera, especially when outlined in black.

How to manage the Moiré Effect?

When pixels are resolved in an image, they are just small points covering many photosites in the image generator, and there is no Moiré. When pixels are not resolved at all, they appear as a flat color, and there is no Moiré. Problems occur in the middle, at nodes where the camera resolution is a small multiple of the pixel size or vice versa, close enough to interfere with each other. These nodes can be easily observed during zoom. To avoid the Moiré Effect, the OLPF creates a boundary where pixels are blurred. This boundary is reached more quickly when the LED wall is out of focus. Lens depth-of-focus properties can greatly help in this case. Depth-of-focus is the range of distance within which an object will appear in focus. Cinematic-style shooting takes advantage of reduced depth-of-focus to focus between subjects with sharp or soft focus. Larger image generators along with longer focal lengths and open apertures lead to a smaller depth-of-focus. Zooming to longer focal lengths (closer) increases the resolution of LED pixels but simultaneously decreases the depth-of-focus, causing the LED wall to blur when a lens zooms in, provided the lens is focused on a plane far from the LED wall.

Tips to avoid Moiré when shooting

  • Place the focused subject as far as possible from the LED wall; this will make the LED wall appear softer and prevent individual pixels from resolving.
  • Use the tightest pixel size you can afford.
  • Open the iris to decrease depth-of-focus; most cameras have ND filters to compensate if the image is too bright.
  • Keep the lens as far back as possible and use a longer lens. The longer focal length will reduce depth-of-focus.

Camera features to manage the Moiré Effect

ND Filter Wheel

Broadcast system cameras usually have ND filter wheels, which are important for using a wide aperture to reduce depth-of-field. All Panasonic studio cameras (HC3900, UC3300, PLV100, and UC4000) use motorized ND filter wheels for quick access to ND filter adjustments in the control room.

Large Format Camera

The Panasonic PLV100 studio camera features a Super 35 mm camera and PL mount based on Panasonic’s historic Cinema VariCam camcorders. Unlike Cinema camcorders, the PLV100 is a broadcast system camera in every way, allowing operators and engineers to operate the PLV100 similarly and in conjunction with other broadcast system cameras. Remote control, intercom, return video, and other functions are the same, including the motorized ND filter wheel. The only difference is the large format camera with PL mount and 35 mm lenses that provide a reduced depth-of-field, significantly reducing the risk of Moiré.

Adjustable Optical Low-Pass Filter (OLPF)

The Panasonic UC4000 has a dual filter wheel. The first is the motorized ND filter wheel, and the second is known as the effects filter wheel, traditionally including color correction filters, a cross or star effect filter, and a diffusion filter. Panasonic offers a modification where the diffusion filter is replaced with a custom OLPF that, when activated, adds an additional high-frequency screen before the image sensor, reducing the chances of Moiré. This OLPF causes a slight reduction in sharpness in UHD images but almost no change when recording in HD. The modified camera model designation is MOD5AK-UC4000, and it can be custom-ordered from Panasonic.

Built-in Aggressive OLPF

The Panasonic PTZ camera UE160 lens is specially designed to limit high frequencies and exhibit a sharp modulation depth drop-off while maintaining UHD resolution. Released amid a proliferation of LED walls, the UE160 is optimized for LED lighting and LED walls in every way, including internally optimized LED-specific color gels. Similarly, the Panasonic AK-HC3900 studio camera is sold as an HD camera system with a 4K image generator, making the HD OLPF extremely aggressive when used with the 4K image generator to minimize the Moiré Effect. The OLPF can be changed for UHD applications that require maximum sharpness where Moiré is less concerning. The Panasonic UC3300, similar to the UC4000 but with only one filter wheel, can be switched to the HC3900 OLPF by requesting a MOD5AK-UC3300 to modify the camera.

Electronic Moiré Reduction

The Panasonic AK-UC4000 and AK-UC3300 studio cameras produce raw image data sent to the Camera Control Unit (CCU) for processing. This CCU has a more powerful FPGA that can reduce the Moiré Effect or make it less noticeable. Electronic Moiré reduction is limited because, as mentioned earlier, Moiré is an optical phenomenon.

Reduced Moiré LED Walls

As LED walls develop tighter pixel pitches, Moiré will be less frequent. Some panels are designed to diffuse the pixels, but this can reduce brightness; others have minimized the space between pixels, which also helps. In the future, these issues may resolve themselves, but existing installations and rental inventories indicate that Moiré management will continue for a while.