ETH Zurich - D-INFK - IVC - CVG - Research - Green-Screen Keying

Interactive High-Quality Green-Screen Keying via Color Unmixing

Yagiz Aksoy (1,2), Tunc Ozan Aydin (1), Marc Pollefeys (2) and Aljoscha Smolic (1)
(1) Disney Research (2) ETH Zürich, Switzerland

Major steps of our method. First, parameters of a global color model are obtained from a key frame via a simple scribble interface (a). For a different query frame (b), the global color model is refined into local color models (c) which are utilized for extracting multiple color layers via color unmixing (d). A subset of layers is then combined to get the final keying result (e). The layers can be used for compositing as well as color editing (f).


Due to the widespread use of compositing in contemporary feature films, green-screen keying has become an essential part of post-production workflows. To comply with the ever-increasing quality requirements of the industry, specialized compositing artists spend countless hours using multiple commercial software tools, while eventually having to resort to manual painting because of the many shortcomings of these tools. Due to the sheer amount of manual labor involved in the process, new green-screen keying approaches that produce better keying results with less user interaction are welcome additions to the compositing artist's arsenal. We found that --- contrary to the common belief in the research community --- production-quality green-screen keying is still an unresolved problem with its unique challenges. In this paper, we propose a novel green-screen keying method utilizing a new energy minimization-based color unmixing algorithm. We present comprehensive comparisons with commercial software packages and relevant methods in literature, which show that the quality of our results is superior to any other currently available green-screen keying solution. Importantly, using the proposed method, these high-quality results can be generated using only one-tenth of the manual editing time that a professional compositing artist requires to process the same content having all previous state-of-the-art tools at his disposal.




Input sequences (780MB)
Keying results (255MB)