Constrained Texture Synthesis via Energy Minimization

Ganesh Ramanarayanan and Kavita Bala

IEEE Transactions on Visualization and Computer Graphics, January / February 2007 (Vol. 13, No. 1)


Abstract: This paper describes CMS (constrained minimization synthesis), a fast, robust texture synthesis algorithm that creates output textures while satisfying constraints. We show that constrained texture synthesis can be posed in a principled way as an energy minimization problem that requires balancing two measures of quality: constraint satisfaction and texture seamlessness. We then present an efficient algorithm for finding good solutions to this problem using an adaptation of graphcut energy minimization. CMS is particularly well suited to detail synthesis, the process of adding high-resolution detail to low-resolution images. It also supports the full Image Analogies framework, while providing superior image quality and performance. CMS is easily extended to handle multiple constraints on a single output, thus enabling novel applications that combine both user-specified and image-based control.
Download (pdf)
Original '05 tech report (pdf) (Cornell University TR2005-1995)
Poster (pdf) (presented at SCPV 2005, Symposium on Computational Photography and Video, MIT CSAIL, May 23-25 2005)