基於卷積神經網路於光學衛星影像進行跨衛星之雲偵測

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：27

、訪客IP：3.138.116.20

姓名

萬泓顯(Hung-Hsien Wan) 查詢紙本館藏

畢業系所

土木工程學系

論文名稱

基於卷積神經網路於光學衛星影像進行跨衛星之雲偵測
(Cloud detection for cross-optical-satellite image based on CNN)

相關論文

★ 結合多種遙測衛星數據觀測湄公河水資源變化	★ 利用多時期之衛星影像改進孟加拉地區之地表水量化
★ 利用ALOS SAR影像觀測2008當雄地震同震及震後形變量	★ 利用衛星影像觀測2004年印度洋地震震後之海岸地形垂直變化
★ 利用綜合遙測資訊建置之高程模型觀測近岸地形時序變遷	★ 整合Sentinel-1與TerraSAR-X 永久散射體雷達差干涉法以監測地表變形
★ 利用區域電離層模式校正Sentinel-1差分干涉以偵測臺灣地表變形	★ 利用衛星影像間接建立全台海岸地形模型
★ 應用Sentinel-1衛星TOPS合成孔徑雷達及最小基線長分析技術監測越南河內的地層下陷	★ Sentinel-1 Radar Interferometry Decomposes Land Subsidence in Taiwan
★ 以自相似算法進行衛星影像融合和水線判釋	★ 利用衛星遙測資訊於稻米產量預測
★ 利用ICESat-2及Sentinel-2反演南海近岸水深	★ 利用行動測深系統產製淺水區深度模型
★ 以多元衛星影像監測青藏高原湖泊長期水量變化	★ 使用動態門檻值選取對衛星影像進行非監督式變遷偵測

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 (2025-1-10以後開放)

摘要(中)

雲偵測對於光學衛星影像前處理是一項非常重要的議題，但於實務上，傳統的專家系統(決策樹)往往無法提供泛用且高準確度的模型，另由於該類模型所需之波段數也較多，這對於目前主流的高空間解析但僅搭載3~5波段的商用衛星而言，該類專家系統將無法適用。
　　對此本報告嘗試僅以可見光和近紅外配合捲積神經網路進行雲偵測之任務，然而由於衛星影像與傳統影像視覺上所使用的影像特性差異非常的大，無論是多了一個數量級的影像尺寸，又或是極端的灰度值分布，和較少標記數據等均將增加訓練上的難度。對此除了對於結果的分析呈現，本報告更會提供一設計該類神經網路模型的策略，並對神經網路標準化和影像前處理及影像大小等進行探討，同時也嘗試結合了傳統的專家系統對預測結果進行校正。
　　於資料集的應用中，本報告運用了Landsat-8 和Sentinel-2 兩顆衛星，並於Landsat-8的Cloud Cover Assessment (CCA)資料集上進行訓練，並於Landsat-8的Spatial Procedures for Automated Removal of Cloud and Shadow (SPARCS)和Sentinel-2的資料集上測試。
　　根據測試結果，目前於Landsat-8的預估的準確率可至 95.7%，且僅有16% 的誤授誤差。另外經由短波紅外線的校正後準確率可至97.4% 並且誤授誤差降至7.5%。對於 Sentinel-2其對於非捲雲的雲體之漏授誤差僅有 2% ~ 3% 此外誤授誤差於陸地和水上皆遠小於1%。更重要的是該模型對於原始無降解析的Sentinel-2影像也有不錯的分析能力，而這也意味著對於其他更高解析度的商用衛星如SPOT，該模型確有其可行性。

摘要(英)

Cloud detection is an important yet difficult task for optical satellites especially for those images having limited bands in visible to near infrared (VNIR). Some approaches using expert systems that exploit the optical properties of cloud are commonly adopted. However, sufficient spectral bands are still needed to recognize a variety of cloud types for this approach. For high spatial resolution missions, most of them provide only 4 bands in VNIR.
Thanks for the rapid development of computer technique, machine learning (ML) nowadays is another choice for cloud detection. This study aims to build a model based on the Convolutional Neural Networks (CNN), and treat this issue as a binary semantic segmentation problem. Different from traditional computer vision applications on CNN, the huge image size, worse histogram distribution, insufficient data quantity with poor labeling quality, and large variety of cloud formations are the major challenges. Thus, except for accuracy analysis, we focus on the analysis of the relationship between input image size, the selection of normalize method, image preprocess, and the strategy of tone mapping.
In this research, we firstly split multiple satellite imageries and validation datasets into training and testing subsets. To assess the transferability of CNN model, especially for other satellites with higher spatial resolutions but lack of cloud flags, a workflow is designed to first train CNN by Landsat-8 Cloud Cover Assessment (CCA) dataset and then tests the detectability on both Landsat-8 Spatial Procedures for Automated Removal of Cloud and Shadow (SPARCS) and Sentinel-2 dataset.
Based on our results, the current workflow is stable for Landsat-8 and transferable to Sentinel-2 data products. The overall accuracy for Landsat-8 is 95.7% with only 16% of commission error. After a calibration from short-wave infrared (SWIR), the accuracy could reach up to 97.4% with only 7.5% commission error. For Sentinel -2, the omission error for cloud class, exclude thin cirrus, could lower to 3% with the commission error below 1% on land and water area.

關鍵字(中)

★ 雲偵測
★ 衛星影像校正
★ 跨衛星
★ 卷積神經網路

關鍵字(英)

★ cloud detection
★ satellite image calibration
★ cross-satellite
★ CNN

論文目次

摘要 I
Abstract III
致謝 V
1. Introduction 1
2. Related Work 6
2.1 Traditional Expert System for Cloud Detection 6
2.1.1 Thermal Band Method 6
2.1.2 Multispectral Method 7
2.1.3 Temporal Information Method 10
2.2 Neural Network (NN) Method 11
2.2.1 The Advantage of Cloud Masking by NN 12
2.2.2 Combination of CNN with Unsupervised Learning Method 13
2.2.3 Encode and Decode Architecture in CNN 13
3. Methodology 15
3.1 Dataset 15
3.1.1 Landsat-8 Dataset 15
3.1.2 Sentinel-2 Dataset 17
3.2 Preprocessing Steps 18
3.2.1 Geometric Adjustment 18
3.2.2 Top of Atmosphere (TOA) Reflectance Value calibration 21
3.3 Model Design 21
3.3.1 CNN architecture 21
3.3.2 The Difficulty for Cloud Detection in CNN 25
3.3.3 Image Enhance (Tone Mapping) 27
3.3.4 CNN Model Training Stage 32
3.4 Cloud Mask Generation and Short-Wave Infrared (SWIR) Calibration 34
4. Results and Discussion 37
4.1 Landsat-8 test 37
4.1.1 Cloud Outline Pixel Removal 37
4.1.2 Ground truth Cover Mask 38
4.1.3 Landsat-8 Result Analysis 38
4.2 Sentinel-2 Test 42
4.2.1 Definition of Valid Pixels for Comparison 42
4.2.2 Examination of Transferability to Sentinel-2 43
4.3 Loss Decay Comparison 47
5. Conclusions 48
6. Future work 49
References 50
Appendix 1: Landsat-8 Cloud Mask 54
Appendix 2: Sentinel-2 Cloud Mask 70

參考文獻

Ackerman, S. A., K. I. Strabala, W. P. Menzel, R. A. Frey, C. C. Moeller and L. E. Gumley (1998). ”Discriminating clear sky from clouds with MODIS.” Journal of Geophysical Research: Atmospheres 103(D24): 32141-32157.
Anyamba, A. and C. J. Tucker (2012). ”Historical perspective of AVHRR NDVI and vegetation drought monitoring.” Remote sensing of drought: innovative monitoring approaches 23.
Ba, J. L., J. R. Kiros and G. E. Hinton (2016). ”Layer normalization.” arXiv preprint arXiv:1607.06450.
Bessho, K., K. Date, M. Hayashi, A. Ikeda, T. Imai, H. Inoue, Y. Kumagai, T. Miyakawa, H. Murata and T. Ohno (2016). ”An introduction to Himawari-8/9—Japan’s new-generation geostationary meteorological satellites.” Journal of the Meteorological Society of Japan. Ser. II 94(2): 151-183.
Derrien, M., B. Farki, L. Harang, H. LeGleau, A. Noyalet, D. Pochic and A. Sairouni (1993). ”Automatic cloud detection applied to NOAA-11/AVHRR imagery.” Remote Sensing of Environment 46(3): 246-267.
Fischler, M. A. and R. C. Bolles (1981). ”Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography.” Communications of the ACM 24(6): 381-395.
Foga, S., P. L. Scaramuzza, S. Guo, Z. Zhu, R. D. Dilley Jr, T. Beckmann, G. L. Schmidt, J. L. Dwyer, M. J. Hughes and B. Laue (2017). ”Cloud detection algorithm comparison and validation for operational Landsat data products.” Remote sensing of environment 194: 379-390.
Gómez-Chova, L., G. Camps-Valls, J. Calpe-Maravilla, L. Guanter and J. Moreno (2007). ”Cloud-screening algorithm for ENVISAT/MERIS multispectral images.” IEEE Transactions on Geoscience and Remote Sensing 45(12): 4105-4118.
Gao, B.-C. (1996). ”NDWI—A normalized difference water index for remote sensing of vegetation liquid water from space.” Remote sensing of environment 58(3): 257-266.
Gao, B.-C. and R.-R. Li (2017). ”Removal of thin cirrus scattering effects in Landsat-8 OLI images using the cirrus detecting channel.” Remote Sensing 9(8): 834.
Hall, D. K., G. A. Riggs and V. V. Salomonson (1995). ”Development of methods for mapping global snow cover using moderate resolution imaging spectroradiometer data.” Remote sensing of Environment 54(2): 127-140.
He, K., X. Zhang, S. Ren and J. Sun (2016). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition.
He, K., X. Zhang, S. Ren and J. Sun (2016). Identity mappings in deep residual networks. European conference on computer vision, Springer.
Holben, B. N. (1986). ”Characteristics of maximum-value composite images from temporal AVHRR data.” International journal of remote sensing 7(11): 1417-1434.
Hollingsworth, B. V., L. Chen, S. E. Reichenbach and R. R. Irish (1996). Automated cloud cover assessment for Landsat TM images. Imaging Spectrometry II, International Society for Optics and Photonics.
Hollstein, A., K. Segl, L. Guanter, M. Brell and M. Enesco (2016). ”Ready-to-use methods for the detection of clouds, cirrus, snow, shadow, water and clear sky pixels in Sentinel-2 MSI images.” Remote Sensing 8(8): 666.
Hughes, M. and D. Hayes (2014). ”Automated detection of cloud and cloud shadow in single-date Landsat imagery using neural networks and spatial post-processing.” Remote Sensing 6(6): 4907-4926.
Ioffe, S. and C. Szegedy (2015). ”Batch normalization: Accelerating deep network training by reducing internal covariate shift.” arXiv preprint arXiv:1502.03167.
Irish, R. R. (2000). Landsat 7 automatic cloud cover assessment. Algorithms for Multispectral, Hyperspectral, and Ultraspectral Imagery VI, International Society for Optics and Photonics.
Irish, R. R., J. L. Barker, S. N. Goward and T. Arvidson (2006). ”Characterization of the Landsat-7 ETM+ automated cloud-cover assessment (ACCA) algorithm.” Photogrammetric engineering & remote sensing 72(10): 1179-1188.
Ju, J. and D. P. Roy (2008). ”The availability of cloud-free Landsat ETM+ data over the conterminous United States and globally.” Remote Sensing of Environment 112(3): 1196-1211.
Julien, Y., J. A. Sobrino and W. Verhoef (2006). ”Changes in land surface temperatures and NDVI values over Europe between 1982 and 1999.” Remote Sensing of Environment 103(1): 43-55.
Karlsson, K.-G. and A. Devasthale (2018). ”Inter-comparison and evaluation of the four longest satellite-derived cloud climate data records: CLARA-A2, ESA Cloud CCI V3, ISCCP-HGM, and PATMOS-x.” Remote Sensing 10(10): 1567.
Lewis, J. (2010). Fast normalized cross-correlation, 1995. Vision Interface.
Li, Z., H. Shen, Q. Cheng, Y. Liu, S. You and Z. He (2019). ”Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors.” ISPRS Journal of Photogrammetry and Remote Sensing 150: 197-212.
Lin, T.-Y., P. Dollár, R. Girshick, K. He, B. Hariharan and S. Belongie (2017). Feature pyramid networks for object detection. Proceedings of the IEEE conference on computer vision and pattern recognition.
Long, J., E. Shelhamer and T. Darrell (2015). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition.
Mohajerani, S., T. A. Krammer and P. Saeedi (2018). ”Cloud Detection Algorithm for Remote Sensing Images Using Fully Convolutional Neural Networks.” arXiv preprint arXiv:1810.05782.
Mueller-Wilm, U., O. Devignot and L. Pessiot (2017). S2 MPC Sen2Cor configuration and user manual, European Space Agency: Paris, France.
Nixon, P. R., C. Wiegand, A. Richardson and M. Johnson (1982). ”Methods of editing cloud and atmospheric layer affected pixels from satellite data.”
Ozkan, S., M. Efendioglu and C. Demirpolat (2018). Cloud Detection From RGB Color Remote Sensing Images With Deep Pyramid Networks. IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, IEEE.
Qiu, S., Zhu, Z., & He, B. (2019). Fmask 4.0: Improved cloud and cloud shadow detection in Landsats 4–8 and Sentinel-2 imagery. Remote Sensing of Environment, 231, 111205.
Rajitha, K., P. M. MM and M. R. Varma (2015). Effect of cirrus cloud on normalized difference vegetation index (NDVI) and aerosol free vegetation index (AFRI): a study based on LANDSAT 8 images. 2015 Eighth International Conference on Advances in Pattern Recognition (ICAPR), IEEE.
Ronneberger, O., P. Fischer and T. Brox (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention, Springer.
Rossow, W. B. and R. A. Schiffer (1999). ”Advances in understanding clouds from ISCCP.” Bulletin of the American Meteorological Society 80(11): 2261-2288.
Rossow, W. B., A. W. Walker and L. C. Garder (1993). ”Comparison of ISCCP and other cloud amounts.” Journal of Climate 6(12): 2394-2418.
Rouse Jr, J. W., R. Haas, J. Schell and D. Deering (1974). ”Monitoring vegetation systems in the Great Plains with ERTS.”
Scaramuzza, P. L., M. A. Bouchard and J. L. Dwyer (2011). ”Development of the Landsat data continuity mission cloud-cover assessment algorithms.” IEEE Transactions on Geoscience and Remote Sensing 50(4): 1140-1154.
Simpson, J. J. and C. Humphrey (1990). ”An automated cloud screening algorithm for daytime Advanced Very High Resolution Radiometer imagery.” Journal of Geophysical Research: Oceans 95(C8): 13459-13481.
Strabala, K. I. (2005). MODIS cloud mask user′s guide, University of Wisconsin--Madison.
Suzue, H., T. Imai and K. Mouri (2016). ”High-resolution cloud analysis information derived from Himawari-8 data.” Meteorological Satellite Center Technical Note 61: 43-51.
Team, M. C. M., S. Ackerman, K. Strabala, P. Menzel, R. Frey, C. Moeller, L. Gumley, B. Baum, C. Schaaf and G. Riggs (2010). Discriminating clear-sky from cloud with modis algorithm theoretical basis document (mod35), Citeseer.
Tucker, C., J. Gatlin, S. Schneider and M. Kuchinos (1984). ”Monitoring vegetation in the Nile Delta with NOAA-6 and NOAA-7 AVHRR imagery.”
Ulyanov, D., A. Vedaldi and V. Lempitsky (2016). ”Instance normalization: The missing ingredient for fast stylization.” arXiv preprint arXiv:1607.08022.
Vermote, E., S. Kotchenova and J. Ray (2011). ”MODIS surface reflectance user’s guide.” MODIS Land Surface Reflectance Science Computing Facility, version 1.
Wang, B., A. Ono, K. Muramatsu and N. Fujiwara (1999). ”Automated detection and removal of clouds and their shadows from Landsat TM images.” IEICE Transactions on information and systems 82(2): 453-460.
Warren, S. and C. Hahn (2002). Clouds/Climatology. Encyclopedia of Atmospheric Sciences, J. Holton, J. Pyle and J. Curry Eds, Academic Press, San Diego.
Wu, Y. and K. He (2018). Group normalization. Proceedings of the European Conference on Computer Vision (ECCV).
Xie, F., M. Shi, Z. Shi, J. Yin and D. Zhao (2017). ”Multilevel cloud detection in remote sensing images based on deep learning.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10(8): 3631-3640.
Yang, L., C. Huang, C. G. Homer, B. K. Wylie and M. J. Coan (2003). ”An approach for mapping large-area impervious surfaces: synergistic use of Landsat-7 ETM+ and high spatial resolution imagery.” Canadian journal of remote sensing 29(2): 230-240.
Yhann, S. R. and J. J. Simpson (1995). ”Application of neural networks to AVHRR cloud segmentation.” IEEE transactions on geoscience and remote sensing 33(3): 590-604.
Zanter, K. (2016). ”Landsat-8 (L8) data users handbook.” Landsat Science Official Website.
Zhang, H. K., D. P. Roy, L. Yan, Z. Li, H. Huang, E. Vermote, S. Skakun and J.-C. Roger (2018). ”Characterization of Sentinel-2A and Landsat-8 top of atmosphere, surface, and nadir BRDF adjusted reflectance and NDVI differences.” Remote sensing of environment 215: 482-494.
Zhu, Z., S. Wang and C. E. Woodcock (2015). ”Improvement and expansion of the Fmask algorithm: Cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 images.” Remote Sensing of Environment 159: 269-277.
Zhu, Z. and C. E. Woodcock (2012). ”Object-based cloud and cloud shadow detection in Landsat imagery.” Remote sensing of environment 118: 83-94.

指導教授

曾國欣(Kuo-Hsin Tseng)

審核日期

2020-1-22

推文