Google Play icon

Researchers develop fast, economical method for high-definition video compositing

Posted May 21, 2013


Video compositing to create special effects, replace backgrounds or combine multiple takes of an actor’s performance is an integral, but highly labor-intensive, part of modern film making. Researchers at Disney Research, Zürich, however, have found an innovative way to create these composite videos that is simple, fast, and easy to use.


Rather than perform a painstaking segmentation of elements that are to be added or subtracted from a video, the Disney system, called DuctTake, uses computer algorithms to find a spatiotemporal “seam” through the video frame that enables two or more videos to be joined together.

These seams can be highly irregular, following the contours of people, furniture and other objects that are common in each take of the scene. Because it can only combine scenes that have overlapping content, DuctTake isn’t useful for combining arbitrary video clips. But it works like a charm when combining multiple takes of the same shot.

The Disney Research, Zürich researchers showed the technique can be used across a wide range of video composites. For example, it can combine the best performances by actors from several different takes into a single seamless output, reducing the number of on-set takes that are required to be filmed. Furthermore, the same technique can be used to make a cut seamless, allowing the first half of one take to be combined into a second take. In another case, the researchers eliminated unwanted cars from a street scene by offsetting the vehicle with empty street imagery from the same video take. Hard-to-shoot scenes involving animals, they demonstrated, become a bit easier when an animal trainer can be easily removed from the shot, or other actors can be added at the moment of time when the animal does the right thing.

“The most delicate component is alignment,” said Oliver Wang, post doctoral researcher at Disney Research, Zürich. “But given properly aligned views, we can almost always generate good composites with minimal work.”

The findings by Wang and his Disney Research, Zürich team of Jan Rüegg, Aljoscha Smolic and Markus Gross were presented at Eurographics 2013, the European Association for Computer Graphics conference.

Most video compositing is accomplished now by the digital equivalent of “cut-and-paste.” Rotoscoping is the process by which elements can be added by drawing segmentation outlines. Chroma-keying, familiar to viewers of TV weathercasts in which news announcers appear to stand in front of large, animated maps, separates actors from backgrounds based on color hues; it’s cheap and robust, but restricts filming to studio environments, and can require challenging color balancing in post-production.

“Our approach solves a simpler problem,” Gross acknowledged, “but as a result it is robust, fast to compute and easy for artists to use, enabling compositing techniques to be used on lower budget shots and productions.”

Read more at:

Featured news from related categories:

Technology Org App
Google Play icon
87,043 science & technology articles

Most Popular Articles

  1. You Might Not Need a Hybrid Car If This Invention Works (January 11, 2020)
  2. Toyota Raize a new cool compact SUV that we will not see in this part of the world (November 24, 2019)
  3. An 18 carat gold nugget made of plastic (January 13, 2020)
  4. Human body temperature has decreased in United States, study finds (January 10, 2020)
  5. Donkeys actually prefer living in hot climate zones (January 6, 2020)

Follow us

Facebook   Twitter   Pinterest   Tumblr   RSS   Newsletter via Email