Modern Approaches to Media Retargeting

Wednesday, 28 November 09:00-12:45 | Peridot 201

In recent years, many content aware methods for media manipulations have gained popularity. Images and videos are analyzed; segmented and semantic information is extracted to assist many manipulation algorithms. One of the problems that drew much attention in recent years is media retargeting. Due to the increase in variety of commonly used display devices, and the prevalent use of mobile devices as available means for media intake, media needs to be adapted to different resolutions and aspect ratios. The goal of this course is to present the basic problem of media retargeting and detail the different methods devised recently to solve it. We will start with a short overview of image and video representation and concentrate on the different view points of media as a discrete entity (pixels, graphs) or as a sampling of a continuous entity (signal). We will then present the common pipeline for retargeting, used in both discrete and continuous methods. This includes first extracting some importance or saliency maps from the media, and then using this information while applying the different retargeting operators. We will present several ways to define importance maps and saliency that use spatial information in images and also temporal information in video. Then we will present different discrete approaches (seam carving, shift maps) and continuous approaches (warping). Lastly, we will present newer methods that combine several operators to achieve better results.


Intended Audience

Basic understanding of math and computer graphics or image processing at a graduate level.

Ariel Shamir, IDC The Interdisciplinary Center, Israel
Olga Sorkine, ETH Zurich
Alexander Hornung, Disney Research Zurich

Ariel Shamir is an associate Professor at the school of Computer Science at the
Interdisciplinary Center in Israel. Prof. Shamir received his Ph.D.
in computer science in 2000 from the Hebrew University in Jerusalem.
He spent two years at the center for computational visualization at
the University of Texas in Austin. During 2006 he held the position
of visiting scientist at Mitsubishi Electric Research Labs in Cambridge MA.
Prof. Shamir has numerous publications in journals and international
refereed conferences, and a broad commercial experience working with, and
consulting numerous companies. His research interests include computer graphics,
visualization, geometric modeling, virtual reality and machine learning.
He is a member of the ACM SIGGRAPH, IEEE Computer and Eurographics societies.

Olga Sorkine is an Assistant Professor of Computer Science at ETH Zurich, where she leads the Interactive Geometry Group at the Institute of Visual Computing. Prior to joining ETH she was an Assistant Professor at the Courant Institute of Mathematical Sciences, New York University (2008-2011). She earned her BSc in Mathematics and Computer Science and PhD in Computer Science from Tel Aviv University (2000, 2006). Following her studies, she received the Alexander von Humboldt Foundation Fellowship and spent two years as a postdoc at the Technical University of Berlin. Olga is interested in theoretical foundations and practical algorithms for digital content creation tasks, such as shape representation and editing, visual media editing, computer animation and digital image manipulation. She also works on fundamental problems in digital geometry processing, including parameterization of discrete surfaces and compression of geometric data. Olga received the EUROGRAPHICS Young Researcher Award (2008) and the ACM SIGGRAPH Significant New Researcher Award (2011).

Alexander Hornung is a Research Scientist at Disney Research Zurich,
heading the group for imaging and video processing. He is also an
adjunct lecturer at ETH Zurich. Before his time at Disney he was a
Postdoc at the Computer Graphics Laboratory at ETH Zurich. He received
his Diplom (2003) and PhD (2008) in Computer Science at RWTH Aachen.
Alexander’s research interests lie in computer graphics and vision. In
particular, he is interested in the fields of video and light field
processing, stereoscopy, image-based rendering and 3D reconstruction,
and 2D animation and games. Alexander received the EUROGRAPHICS Young
Researcher Award (2012).