雲端服務下自動化部署及監控系統之管理架構

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：23

、訪客IP：18.191.195.105

姓名

陸俊廷(Chun-Ting Lu) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

雲端服務下自動化部署及監控系統之管理架構
(Automatic Monitoring and Deployment of Cloud Services)

相關論文

★ 以伸展樹為基礎的Android Binder Driver	★ 應用增量式學習於多種農作物判釋之研究
★ 應用分類重建學習偵測航照圖幅中的新穎坵塊	★ 用於輔助工業零件辨識之尺寸估算系統
★ 使用無紋理之3D CAD工業零件模型結合長度檢測實現細粒度真實工業零件影像分類	★ 一個建立在平行工作系統上的動態全球計算平台
★ 用權重參照計數演算法執行主動物件垃圾收集	★ 一個動態負載平衡之最大可能性估算計算架構
★ 利用多項系統負載資訊進行動態P2P系統重組的策略研究	★ 基於Hadoop系統的雲端應用程式特徵擷取與計算監測架構
★ 適用於大型動態分散式系統的調適性計算模型	★ 一個提供彈性虛擬資料中心的雲端服務平台
★ 雲端彈性虛擬機房服務平台之資源控管中心	★ 一個適用於自動供應雲端系統的動態調適計算架構
★ 線性相關工作與非相關工作的探索式排程策略	★ 適用於大資料集高效率的分散式階層分群演算法

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

Hadoop為常見Platform as a Service中常見的雲端工具，並為終端使用者提供運算平台。在大部分情況下，安裝Hadoop集群需要在大量的計算主機安裝不同的軟體資源。傳統的軟體安裝方式，管理者需要在不同的主機下重覆相同的安裝步驟，對於管理者而言是相當沒效率及花費時間的。除此之外，分散於這些主機上的不同軟體其更新的需求也不盡相同。近幾年來，許多部署的工具即為解決此類問題而推出，其一名為Puppet，其不但可解決軟體部署問題同時亦可應用在Hadoop的安裝上。它使用了伺服器驅動的方式部署軟體在不同的計算主機上，換句話說，Puppet主機定期接收到客戶端的部署報告並從其中資訊判斷是否有軟體資源需要更新。儘管其解決了關於軟體部署的複雜性及問題，但仍面臨到關於擴充性的問題，當客戶端規模龐大時，大量的訊息回傳，伺服器的處理效率將會成為服務效率中的瓶頸。為了解決此項問題，我們提出了一自動化的部署工具，它基於Puppet部署Hadoop集群並採取了客戶端驅動的方式避免了上述問題。在部署過程中，我們提出的部署工具首先在伺服器端發送不同的部署條件，接著客戶端定期從伺服器端接收到的訊息判斷何種軟體需要安裝或軟體是否需要更新。當此部署工具與一般部署工具針對在Hadoop的安裝上比較，我們可以發現在大規模的集群下使用此部署工具效率較為優秀，其部署彈性也是較其他工具優秀。

摘要(英)

Hadoop is a common cloud tool to build a cloud platform that can be accessed by end-users. In most cases, installation of a Hadoop platform requires installation of different software packages on tens to thousands of computing machines. With a traditional software deployment strategy, the administrators need to repeat similar installation procedures on different computing machines, which is inefficient and time-consuming. In addition, different software components that are distributed among the computing hosts may need to be upgraded. Recently, a popular software deployment tool called Puppet is developed to solve the problem of software deployment, and can apply to Hadoop installation. It uses a server-driven model to install and update various software packages on many computing machines. That is, the Puppet deployment server periodically receives reports from the deployment clients (targets), and computes what software packages are required by what deployment clients. Although it simplifies the problem of software deployment, it still suffers the scalability problem --- the server becomes an obvious performance bottleneck when the number of deployment clients is large. To overcome the problem, we have developed an automatic, client-driven deployment tool for Hadoop based on Puppet. At first, the proposed deployment tool dispatch different installation rules from the deployment server to the client (target) machines. Then, the client periodically checks the server for what versions of software packages are required, and installs software packages if necessary. When compared with similar deployment tools for Hadoop, the proposed deployment tool works better when the number of deployment clients is relatively large.

關鍵字(中)

★ 雲端服務
★ Hadoop
★ 自動化部署
★ 監控
★ Puppet

關鍵字(英)

★ cloud services
★ Hadoop
★ automatic deployment
★ monitoring
★ Puppet

論文目次

摘要.................................... I
Abstract...............................II
目錄....................................III
圖目錄...................................V
表目錄................................... VI
第一章緒論................................1
1-1研究背景................................1
1-2研究動機................................5
1-3實作目標與研究貢獻........................6
1-4論文架構................................7
第二章背景知識.............................8
2-1 Amazon Web Services................8
2-1 Crowbar............................8
2-2 Physical Resource Management.......12
2-3 Puppet.............................14
2-4分析比較..............................16
第三章系統架構.............................18
3-1系統模型..............................18
3-2部署系統實作細節.......................22
3-3部署系統運作流程.......................24
3-4版本控制系統實作細節....................26
3-5版本控制系統運作流程....................29
第四章實驗測量與環境........................31
4-1實驗比較..............................31
4-2系統環境..............................37
4-3實驗結果..............................37
第五章結論................................42
參考文獻..................................43

參考文獻

[1]M. Armbrust, I. Stoica, M. Zaharia, A. Fox, R. Griffith,
A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D.
Patterson, and A. Rabkin, “A view of cloud computing,”
Commun. Acm, vol. 53, no. 4, pp. 50–58, Apr. 2010.
[2]Ian Foster, Yong Zhao, Ioan Raicu, and Shiyong Lu, “Cloud
Computing and Grid Computing 360-Degree Compared,” p.
P.1–P.10, Nov. 2008.
[3]Michael Armbrust, Armando Fox, Rean Griffith, Anthony
D.Joseph, Randy Katz, Andy Konwinski, Gunho Lee, David
Patterson, Ariel Rabkin, Ion Stoica, and Matei Zaharia,
“Above the Clouds: A Berkeley View of Cloud Computing,”
Uc Berkeley Reliab. Adapt. Distrib. Syst. Lab., Feb.
2009.
[4]B. Furht and A. Escalante, “Handbook of Cloud Computing -
Springer,” 2010.
[5]National Institute of Standards and Technology, “The NIST
Definition of Cloud Computing,” 2011.
[6]“Welcome to ApacheTM Hadoop®!” [Online]. Available:
http://hadoop.apache.org/.
[7]Tom White, Hadoop 技術手冊第二版 Hadoop: The Definitive
Guide, Second Edition. 歐萊禮, 2011.
[8]董西成, Hadoop技術內幕(深入解析MapReduce架構設計與實現原理). 機械
工業, 2013.
[9]“About AWS.” [Online]. Available:
http://aws.amazon.com/about-aws/. [Accessed: 04-Jun-
2013].
[10]“AWS OpsWorks - Flexible Application Management in the
Cloud Using Chef.” [Online]. Available:
http://aws.typepad.com/aws/2013/02/aws-opsworks-
flexible-application-management-in-the-cloud.html.
[11]“AWS Elastic Beanstalk.” [Online]. Available:
http://aws.amazon.com/elasticbeanstalk/.
[12]“Free the cloud with Dell Crowbar,” Dell. [Online].
Available: http://www.dell.com/learn/us/en/555/cloud-
computing/crowbar-software-framework?c=us&l=en&s=biz.
[Accessed: 04-Jun-2013].
[13]Yue-Shan Chang, Wei-Jen Wang, Yu-Sheng Wu, Jun-Ting Lu,
Lee Shu-Teng Chen, and Chilung Wang, “Software
Deployment and Management on a Large-Scale Cloud Data
Center,” 2013 Symp. Cloud Serv. Comput. Natl. Cheng K.
Univ. Taiwan, Mar. 2013.
[14]Itri Today, “The World’s First 『All-in-One』 Cloud
Computing System,” Nov. 2011.
[15]“Preboot Execution Environment (PXE) Specification -
Version 2.1,” Intel Corp., Sep. 1999.
[16]Puppet Labs, “What is Puppet?” [Online]. Available:
https://puppetlabs.com/puppet/what-is-puppet/.
[17]James Turnbull and Jeffrey McCune, Pro Puppet. Apress,
2011.
[18]D. Bode and N. Liu, Puppet Types and Providers. Oreilly
& Associates Inc, 2012.

指導教授

王尉任(Wei-Jen Wang)

審核日期

2013-8-27

推文