Segmentation with invisible keying signal

TLDR

Chroma keying segments objects from images and video using color cues, typically with a blue or green screen behind the object that is later replaced by a different background. The study introduces an automatic keying method that uses an invisible signal. The method employs a novel catadioptric camera design and a single‑chip sensor for keying. The approach offers unlimited color range, eliminates foreground contamination, improves performance under non‑uniform lighting, supports refraction and reflection of dynamic objects, operates in real time, and requires no user assistance.

Abstract

Chroma keying is the process of segmenting objects from images and video using color cues. A blue (or green) screen placed behind an object during recording is used in special effects and in virtual studios. The blue color is later replaced by a different background. A new method for automatic keying using invisible signal is presented. The advantages of the new approach over conventional chroma keying include: (i) Unlimited color range for foreground objects. (ii) No foreground contamination by background color. (iii) Better performance in non uniform illumination. (iv) Features for generating refraction and reflection of dynamic objects. The method can be used in real-time and no user assistance is required. New design of Catadioptric camera and a single chip sensor for keying is also presented.