Reproduction of Gloss, Color and Relief of Paintings using 3D Scanning and 3D Printing W.S. Elkhuizen 1 , T.T.W. Essers 1 , B. Lenseigne 2 , C. Weijkamp 3 , Y. Song 1 , S.C. Pont 1 , J.M.P. Geraedts 1,3 , and J. Dik 4 1 Delft University of Technology, Design Engineering, The Netherlands 2 Delft University of Technology, Biomechanical Engineering, The Netherlands 3 Océ Technologies BV,Canon PPP System Development, The Netherlands 4 Delft University of Technology, Materials Science and Engineering, The Netherlands Figure 1: Scans of part of a painting, showing (a) color, (b) height map and (c) gloss map, describing the appearance of the surface Abstract High fidelity reproductions of paintings provide new opportunities to museums in preserving and providing access to cultural heritage. This paper presents an integrated system which is able to capture and fabricate color, relief and gloss of a painting’s surface, emphasizing on gloss capturing. To measure the spatially varying gloss, the specular reflection of the center of the scanned area is sampled at the Brewster angle, utilizing the effect of reflectance polarization at this angle. The off-center gloss measurements are corrected using the perpendicular and parallel reflectance coefficients, relative to the center measurement. Shadows in the gloss map, which are caused by 3D relief of the surface, are masked based on the height map and then filled by interpolating surrounding gloss information. The captured color image, height map and gloss map are inputs for the 3D printer. A painting "Two wrestling figures in the style of Van Gogh" was reproduced to verify the effectiveness and efficiency of the proposed system. Experiment results indicate that the proposed system gives accurate enough gloss measurement of the painting’s surface for the purpose of gloss fabrication. CCS Concepts •Computing methodologies → Reflectance modeling; •Applied computing → Fine arts; 1. Introduction Increased capabilities of 3D-scanning and -printing systems pro- vide new opportunities to create high-fidelity physical reproduc- tions of artworks. Reproductions, in addition to the original art- work, can play an important role in museums’ mission of preserv- ing and providing public access to cultural heritage. Typical ap- plications which support their mission include: Showing an art- work outside a museum, showing reconstructions of the original state of an artwork (e.g. [ELW * 16]), creating records of an artwork in different stages of a restoration process, or selling high-end re- productions. All these applications require high-fidelity reproduc- tions that closely resemble the artwork’s appearance. In previous work [ZJLD14] a system was presented which is able to repro- duce the color and relief (three dimensional height variations) of a painting’s surface using 3D scanning and 3D printing technology. However, spatially varying gloss of the surface, which is a crucial component in the appearance of the painting, was still missing in these reproductions [EZV * 14]. In this paper, we present an integrated system which is able to capture and fabricate color, relief and gloss of paintings, with the emphasis on gloss capturing. The paper is arranged as follows: in section 2, literature is briefly reviewed regarding appearance mea- surement and fabrication. Section 3 presents the system and the approach that is deployed to measure and fabricate color, relief and EUROGRAPHICS Workshop on Graphics and Cultural Heritage (2017) Short Paper R. Sablatnig and B. Štular (Editors) c 2017 The Author(s) Eurographics Proceedings c 2017 The Eurographics Association. DOI: 10.2312/gch.20171312