基於2D影像修補技術之3D掃描模型修補;Hole Filling in 3D Scanned Models base on 2D Image Inpainting

NCU Institutional Repository > 資訊電機學院 > 資訊工程研究所 > 博碩士論文 > Item 987654321/74634

請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/74634

題名:	基於2D影像修補技術之3D掃描模型修補;Hole Filling in 3D Scanned Models base on 2D Image Inpainting
作者:	林書勤;Lin, Shu-Chin
貢獻者:	資訊工程學系
關鍵詞:	電腦視覺;表面重建;破洞修補;影像修補;Computer Graphics;surface reconstruction;hole filling;image inpainting
日期:	2017-07-13
上傳時間:	2017-10-27 14:34:29 (UTC+8)
出版者:	國立中央大學
摘要:	在這個科技日新月異的時代，3D模型掃描技術已經被廣泛使用於各行各業中。像是電影工業利用掃描技術將演員或道具掃瞄並美化之後放入特效場景、電玩遊戲掃描演員並放入遊戲中並製造成可操控的遊戲角色。在掃描技術尚未問世的時代，即使是日常生活中常見的物件，美術人員依然需要手工繪畫出完整的3D模型才能在虛擬環境中使用。掃描技術提供了數位娛樂產業一個新的選擇。美術人員不再需要從零開始人工建出完整的3D模型，只需要將掃描的3D模型作為藍圖進行細部美化即可使用。除了娛樂產業之外，工業設計也會利用掃描技術製造並修改產品原型。雖然現在的掃描技術已經比以前發達許多，使用者掃描3D模型的結果仍然會受到許多因素影響。像是掃描的環境就十分重要，若掃描環境的光線不均或是明亮度不足皆可能無法掃描出與掃描物件一樣的外觀。而掃描物件本身也有許多會造成影響的因素。像是掃描物件本身的幾何性質，若掃描物件的結構較複雜即有可能存在不容易掃描的區域。物件表面的材質也可能造成影響，若是容易反光的材質就會容易被環境光影響。使用者操作掃描裝置的方式也是個容易造成影響的因素，使用者掃描時晃動裝置或是沒有涵蓋物件的所有面積皆會造成影響。這時我們需要藉由破洞修補與表面重建將模型修補完成。在這篇論文中，我們提出了基於2D影像修補技術進行3D模型修補的方法。我們所提出的方法可以使用任何的影像修補方法並不需要做任何修改。影像修補是一門重建影像中失去或受損區域的技術，我們擷取模型的深度與彩色影像並使用不同種類的影像修補方法進行修補並分析資料。我們以紋理合成的方式進行彩色影像修補，目的是為了要重建模型的表面紋理。而深度影像是利用構造重建的方法修補，藉此保證修補的資訊與修補區域的邊界有連續的關係。為了得到模型彩色與深度影像，我們實作了模型的觀察器並使用特定的渲染器與投影方法。在彩色與深度影像修補完後，我們利用修補的資訊進行2D到3D空間的投影並產生出3D空間的頂點，接著再進行表面重建產生表面網格。我們使用Kinect v2掃描了7組模型當作實驗樣本，在本篇論文的結果段落會提供原始模型與修補過後的結果模型的對照圖以供參考。 ;Nowadays 3D model scanning is widely used for many purposes. This kind of technique is used extensively in many applications such as entertainment industry in the production of movies and video games, industrial design or prototyping. Before scanning technique was invented, even common object like vase needed to be used in virtual environment; digital artists had to draw the entire model from scratch. With scanning technique, artists now can use scanned model as blueprint and beautify the details of model, then the model is available to be used. Although scanning technique has become much advanced then earliest, users may still obtain damaged model due to unfamiliar with scan technique. Unfortunately, the reasons of causing incomplete scanned result are neither obvious nor simple. There are so many factors in real environment such as surface properties, occlusions or light pollution that can cause the result model to be incomplete or damaged. Then we need to repair the model by doing hole-filling and surface reconstruction. In this paper, we introduce an approach to fill holes in 3D mesh by using 2D Image inpainting technique. Image inpainting is the process of reconstructing lost or deteriorated parts of image. Traditionally, inpainting has been done by professional restorers. However, image inpainting has become an automatic process that is performed on digital images. There are also different inpainting methods for different purpose. Structural inpainting uses geometric approaches for filling in the missing information in the region, which should be inpainted. Texture inpainting fills inpainted region with patches from known region in order to recreate texture. By rendering model on screen, we can obtain depth and color image of the model. The value of depth image is actually the z distance between vertices and near plane in orthographic projection, we render z distance in vector form to create depth image. We create image of depth value to represent depth information and image of color to represent color of surfaces, then inpaint those images and use information of result images to reconstruct holes of model, then we inpaint these images and do 2D to 3D transformation of new added pixels back to 3D space. This work can use any inpaint algorithms without modified. In this paper we use both structural inpainting and textural inpainting, structural inpainting is used for reconstructing depth values and textural inpainting is used for reconstructing texture of surface.
顯示於類別:	[資訊工程研究所] 博碩士論文

文件中的檔案:

檔案	描述	大小	格式	瀏覽次數
index.html		0Kb	HTML	246	檢視/開啟

在NCUIR中所有的資料項目都受到原著作權保護.

社群 sharing

資料載入中.....