File Repair with Cluster Based Distributed Storage System


Haytaoglu E., DALKILIÇ M. E.

25th Signal Processing and Communications Applications Conference (SIU), Antalya, Turkey, 15 - 18 May 2017 identifier identifier

Abstract

Heteregenous distributed storage systems consists of nodes which have different CPU powers and communication bandwiths while erasure codes that are commonly used on them significantly vary in their use of these resources. Clustering the nodes of a distributed storage system based on the resource costs and assigning appropriate erasure codes to each cluster can improve the performance of file repair operations. A simulaton study shows that this approach can reduce file repair costs somewhere between 6 percent to 44 percent by dividing nodes in three clusters and using HSRC, EMBR and HMBR erasure codes on these clusters.