Semantic photosynthesis

Matthew Johnson; G. J. Brostow; J. Shotton; V. Kwatra; R. Cipolla

doi:10.1117/12.720851

12 February 2007 Semantic photo synthesis

Matthew Johnson, G. J. Brostow, J. Shotton, V. Kwatra, R. Cipolla

Proceedings Volume 6492, Human Vision and Electronic Imaging XII; 64920X (2007) https://doi.org/10.1117/12.720851
Event: Electronic Imaging 2007, 2007, San Jose, CA, United States

Abstract

Composite images are synthesized from existing photographs by artists who make concept art, e.g. storyboards for movies or architectural planning. Current techniques allow an artist to fabricate such an image by digitally splicing parts of stock photographs. While these images serve mainly to "quickly" convey how a scene should look, their production is laborious. We propose a technique that allows a person to design a new photograph with substantially less effort. This paper presents a method that generates a composite image when a user types in nouns, such as "boat" and "sand." The artist can optionally design an intended image by specifying other constraints. Our algorithm formulates the constraints as queries to search an automatically annotated image database. The desired photograph, not a collage, is then synthesized using graph-cut optimization, optionally allowing for further user interaction to edit or choose among alternative generated photos. Our results demonstrate our contributions of (1) a method of creating specific images with minimal human effort, and (2) a combined algorithm for automatically building an image library with semantic annotations from any photo collection.

Citation Download Citation

Matthew Johnson, G. J. Brostow, J. Shotton, V. Kwatra, and R. Cipolla "Semantic photo synthesis", Proc. SPIE 6492, Human Vision and Electronic Imaging XII, 64920X (12 February 2007); https://doi.org/10.1117/12.720851

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available