| 摘要(英) |
Nowadays 3D model scanning is widely used for many purposes. This kind of technique is used extensively in many applications such as entertainment industry in the production of movies and video games, industrial design or prototyping. Before scanning technique was invented, even common object like vase needed to be used in virtual environment; digital artists had to draw the entire model from scratch. With scanning technique, artists now can use scanned model as blueprint and beautify the details of model, then the model is available to be used.
Although scanning technique has become much advanced then earliest, users may still obtain damaged model due to unfamiliar with scan technique. Unfortunately, the reasons of causing incomplete scanned result are neither obvious nor simple. There are so many factors in real environment such as surface properties, occlusions or light pollution that can cause the result model to be incomplete or damaged. Then we need to repair the model by doing hole-filling and surface reconstruction.
In this paper, we introduce an approach to fill holes in 3D mesh by using 2D Image inpainting technique. Image inpainting is the process of reconstructing lost or deteriorated parts of image. Traditionally, inpainting has been done by professional restorers. However, image inpainting has become an automatic process that is performed on digital images. There are also different inpainting methods for different purpose. Structural inpainting uses geometric approaches for filling in the missing information in the region, which should be inpainted. Texture inpainting fills inpainted region with patches from known region in order to recreate texture.
By rendering model on screen, we can obtain depth and color image of the model. The value of depth image is actually the z distance between vertices and near plane in orthographic projection, we render z distance in vector form to create depth image. We create image of depth value to represent depth information and image of color to represent color of surfaces, then inpaint those images and use information of result images to reconstruct holes of model, then we inpaint these images and do 2D to 3D transformation of new added pixels back to 3D space.
This work can use any inpaint algorithms without modified. In this paper we use both structural inpainting and textural inpainting, structural inpainting is used for reconstructing depth values and textural inpainting is used for reconstructing texture of surface. |
| 參考文獻 |
[1] M. Bertalm´ıo, A. L. Bertozzi and G. Sapiro, “Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting”, in Computer Vision and Pattern Recognition, 2001. CVPR 2001.
[2] Alexandru Telea, “An Image Inpainting Technique Based on the Fast Marching Method”, in journal of graphics tools, Vol. 9, No. 1: 25—36, accepted in May 21, 2003.
[3] A. Criminisi*, P. Perez and K. Toyama, “Region Filling and Object Removal by Exemplar-Based Image Inpainting”, in IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 13, NO. 9, SEP 2004
[4] Wei Zhao, Shuming Gao, Hongwei Lin, “A robust hole-filling algorithm for triangular mesh”, in The Visual Computer, December 2007, Volume 23, Issue 12, pp 987–997, 2007
[5] James Davis, Stephen R. Marschner, Matt Garr, and Marc Levoy, “Filling holes in complex surfaces using volumetric diffusion”, on 3D Data Processing, Visualization, and Transmission Padua, Italy, June 19-21, 2002
[6] Jianning Wang, Manuel M. Oliveira, “A Hole-Filling Strategy for Reconstruction of Smooth Surfaces in Range Images”, on Computer Graphics and Image Processing, 2003. SIBGRAPI 2003. XVI Brazilian Symposium.
[7] Marcelo Bertalmio ,Guillermo Sapiro, Vicent Caselles and Coloma Ballester, “Image Inpainting ”, in Electrical and Computer Engineering, University of Minnesota, Minneapolis, MN 55455, USA
[8] Michael Ashikhmin, “Synthesizing Natural Textures”, in Proc. ACM Symposium on Interactive 3D Graphics, pages 217–226, Research Triangle Park, NC, March 2001.
[9] Michael Kazhdan, Hugues Hoppe, “Screened Poisson Surface Reconstruction”, ACM Trans. Graphics, 32(3), 2013, SIGGRAPH 2013
[10] P. Alliez, D. Cohen-Steiner, Y. Tong and M. Desbrun2, “Voronoi-based Variational Reconstruction of Unoriented Point Sets”, in Eurographics Symposium on Geometry Processing, 2007
[11] Hugues Hoppe, Tony DeRose, Tom Duchampy, John McDonaldz, Werner Stuetzlez, “Surface Reconstruction from Unorganized Points”, in ACM SIGGRAPH 1992 Proceedings, 71-78.
[12] Michael Kazhdan, Matthew Bolitho and Hugues Hoppe, “Poisson Surface Reconstruction”, in Eurographics Symposium on Geometry Processing, 2006
[13] Michael Kazhdan, “Reconstruction of Solid Models from Oriented Point Sets”, in Eurographics Symposium on Geometry Processing, 2005 |
[Endnote RIS 格式]
[相關文章]
[文章引用]
[完整記錄]
[館藏目錄]
[檢視]
plurk
funp
live
udn
HD
myshare
netvibes
friend
youpush
delicious
baidu
Google bookmarks
del.icio.us
hemidemi
facebook
twitter
google
reddit