EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling (2006) Thomas Stahovich and Mario Costa Sousa (Editors) © The Eurographics Association 2006. Parts, Image, and Sketch based 3D Modeling Method Jun Murakawa, Ilmi Yoon, Tracie Hong 1 and Edward Lank 2 1 Computer Science Department, San Francisco State University, 1600 Holloway Ave., San Francisco, CA, 94132 2 David R. Cheriton School of Computer Science, University of Waterloo, Waterloo, ON, Canada, N2L 3G1 junmura@gmail.com , yoon@cs.sfsu.edu , traciely@sfsu.edu , lank@cs.uwaterloo.ca Abstract Despite their many benefits, challenges exist in the creation of 3D models, particularly for individual not currently skilled with 3D modeling software. To address this, we explore the creation of 3D modeling software for non-domain experts that uses a hierarchical parts database of generic 3D models, and deforms models into specific related target objects using image guided 3D model morphing. A human-in-the-loop sketching interface supports image registration and constrains our geometrical transformation to support real time morphing of generic models into accurate representations of new objects for which users wish a 3D model. Applying the application to the study of insects in biology, we find that the application supports the creation of realistic 3D models, and that the application is of value to educators and researchers in entomology. Categories and Subject Descriptors (according to ACM CCS): I.3.3 [Computer Graphics]: Line and Curve Generation, H5.m [Information interfaces and presentation] (e.g., HCI): Miscellaneous. 1. Introduction 3D models allow an enhanced representation of the structure of an object in various fields, including engineering (CAD), design (architecture), and art (sculpture). One factor inhibiting more extensive use of 3D models is the relatively complex and time-consuming process associated with generating these models. Typical 3D modeling software requires significant expertise. As well, the time-consuming, pedantic nature of 3D model construction makes these software applications ill-suited to exploratory processes by end users. The time investment required to create 3D models argues, instead, for their use at later, rather than earlier stages of object construction or analysis. In our work, we explore the design of 3D modeling tools to support researchers and students in the biological sciences. In particular, our goal was to design 3D model creation tools that would be useful for biological researchers or biological students during the early stage of structure object examination. Our first target domain in biology is entomologists, and we explore the creation of 3D models of various insects for education and early analysis of physical characteristics. Current 3D modeling applications require a significant time investment to create 3D models, and users with a new insect specimen have few simple options for creating a 3D model of an insect they are studying. Recent research in 3D modeling software seeks to address the shortcomings the modeling software in two ways. The first is the design of systems that allow simplified creation of 3D objects, based on techniques such as suggestive geometries and other informal drawing methods that are augmented with computational intelligence. Two challenges exist with this method of 3D model creation. First, systems that support the creation of 3D models of objects do allow users to create simple 3D models, but complex objects are more difficult to model, requiring extensive, painstaking drawing of physical structure. Consider using pen-based sketches and suggestive geometries to create a 3D model of an ant. A user would need to extensively sketch all parts of the ant, adjusting geometries as needed. While this is possible for simple mechanical systems, the complex surface deformations of living organisms make this process