深度學習計算成像系統於生物醫學顯微影像之重建與分析;Deep Learning-based Computational Imaging System for Reconstruction and Analysis of Biomedical Microscopy Image

NCUIR > college of Health Sciences and Technology > Institute of Biomedical Engineering > Electronic Thesis & Dissertation > Item 987654321/85821

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/85821

Title:	深度學習計算成像系統於生物醫學顯微影像之重建與分析;Deep Learning-based Computational Imaging System for Reconstruction and Analysis of Biomedical Microscopy Image
Authors:	雷翔宇;Lei, Hsiang-Yu
Contributors:	生醫科學與工程學系
Keywords:	深度學習;物件偵測;例項分割;計算成像系統;血液;鼻咽癌細胞;deep learning;object detection;instance segmentation;computational imaging system;human blood;Nasopharyngeal Carcinoma cancer cell
Date:	2021-08-09
Issue Date:	2021-12-07 11:30:07 (UTC+8)
Publisher:	國立中央大學
Abstract:	本研究使用深度學習神經網路方式建立影像重建與自動辨識功能，在基於編碼與解碼(Encoder-Decoder)框架下搭建一平行式深度學習神經網路模型，將所記錄的光學繞射訊號進行影像之重建，達到具傳統光學顯微鏡20倍物鏡下影像解析度，並透過遮罩區域卷積神經網路進行物件偵測，利用邊界框鎖定目標偵測物進行定位與搭配遮罩描繪出物體的輪廓實現例項分割，再加以對目標偵測物進行分類分析。本光學繞射訊號經由建立一套新型計算成像系統所獲取，具有顯微系統微型化與大幅提升影像視野之功能，此無透鏡光學影像還原系統與演算方法利用純量繞射理論簡化了光學成像設備，免除龐大複雜的光學元件，只需由非同調光與影像傳感器組成，透過控制光源的空間相干性在傳感器上記錄光學繞射訊號，重建之顯微影像解析度在0.6um狀態下，視場範圍可高達30mm2。最終我們使用人體血液檢體與鼻咽癌細胞進行實際細胞影像還原與辨識以驗證本研究所研製之系統與重建模型的效果。透過細胞的表徵分析、分類、定位以及自動計數，證實本研究所建立具自動辨識分析之計算成像系統將有機會取代傳統顯微鏡進行更快速有效的影像辨識與分析。 ;In this study, deep learning is used to reconstruct image and implement the object detection. A parallel deep learning neural network model, which is based on the Encoder-Decoder framework, is built to reconstruct the recorded diffraction patterns back to the images taken by a traditional microscope with a 20x objective lens. Then, Mask Region-based Convolutional Neural Network (Mask R-CNN) is used to not only implement the object detection for the reconstruction images through bounding boxes and achieve instance segmentation by generating mask but also classify each object. The diffraction patterns are recorded by a new computational imaging system which miniaturizes the microscopy system and greatly expands the field of view. This lens-free computational imaging system and calculation method simplify the optical imaging equipment through scalar diffraction theory. It eliminates the need for large and complex optical components and is only composed of light source and image sensor. By controlling the spatial coherence of the light source, the diffraction patterns are recorded at 0.6um resolution, and the field of view can be up to 30mm2. In the end, we take human blood and Nasopharyngeal Carcinoma cancer cells as samples of reconstruction and object detection to verify the effect of the system and reconstruction model built in this study. Through implementing of cell characterization analysis, classification, detection and automatic counting, the computational imaging system of this study can be supposed to have the opportunity to replace traditional microscopes by fast and effective image identification and analysis.
Appears in Collections:	[Institute of Biomedical Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	121	View/Open

社群 sharing

Loading...