Prophet’s Insight: Unleashing Deduplication System Performance in Multi-tier Storage Systems

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Computer Science and Information Engineering > Electronic Thesis & Dissertation > Item 987654321/93282

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/93282

Title:	Prophet’s Insight: Unleashing Deduplication System Performance in Multi-tier Storage Systems
Authors:	拾以兆;Shih, Yi-Chao
Contributors:	資訊工程學系
Keywords:	快閃記憶體;多層式儲存系統;重複資料刪除技術;NAND Flash;Multi-tier Storage System;Data Deduplication
Date:	2023-07-26
Issue Date:	2024-09-19 16:52:27 (UTC+8)
Publisher:	國立中央大學
Abstract:	隨著巨量資料的增加，多層式儲存系統 (Multi-tier Storage System) 如傳統硬碟(Hard Disk Drive, HDD) 與固態硬碟 (Solid State Drive, SSD) 的組合被廣泛利用來增加成本效益。即使 SSD 的高速的讀寫特性能提高整體系統的效能，但 SSD 仍需面對其有限壽命、耐用程度的問題。為了解決這些問題，重複資料刪除 (Data Deduplication) 技術被提出，並且其可以有效減少 SSD 的寫入量。然而，隨著 SSD存儲媒介 NAND Flash 的基本單位 page 變大，會造成去重率 (Deduplication Rate)下降。本文提出了一種在 HDD-SSD 結合的儲存系統上的實施多粒度去重方法(Multi-grained Deduplication)。我們將 SSD 僅用作 read cache，並利用更細的粒度(例如: HDD 的基本單位，sector) 來進行去重。透過對 page 間的內容檢測，對於相似的 page 實施細粒度的去重，進而提高去重率、去重效能以及 I/O 效能。依據實驗結果顯示，與傳統方法 CAFTL 比較，多粒度去重在去重率上提高最多 69.4%，去重時間減少最多 4.8 倍。;As the volume of data continues to increase, multi-tier storage systems such as HDD-SSD combination are commonly adopted to achieve cost-effectiveness. Although SSDs can greatly benefit the overall system with their high perfor mance, they still face challenges related to limited lifespan and durability. To address these problems, data deduplication has been proposed as an effective technique to reduce the amount of data written to SSDs. However, as the size of NAND flash pages continues to grow, the deduplication rate with fixed-size chunking decreases. In this paper, we propose a multi-grained deduplication approach on the HDD-SSD combination storage system. We utilize SSD as solely a read cache and leveraging finer-granularity (i.e., sector) in deduplica tion. Specifically, our proposed solution minimizes computational overhead and achieves efficient detection on similar page content which contributes to fine-grained deduplication. By doing so, we can improve the deduplication rate, deduplication performance, and I/O performance. Our experimental re sults demonstrate that our multi-grained deduplication improves up to 69.4% in deduplication rate and reduces computational latency by up to 4.8 times with the compared baseline.
Appears in Collections:	[Graduate Institute of Computer Science and Information Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	6	View/Open

社群 sharing

Loading...