• Complex
  • Title
  • Author
  • Keyword
  • Abstract
  • Scholars
Search

Author:

Luo, Xiangyu (Luo, Xiangyu.) | Xin, Gang (Xin, Gang.) | Gui, Xiaolin (Gui, Xiaolin.)

Indexed by:

SCIE EI

Abstract:

Data placement considerably affects the I/O performance of distributed storage systems such as HDFS. An ideal placement algorithm should keep the I/O load evenly distributed among different storage nodes. Most of the existing placement algorithms with I/O load balance guarantee depend on the information of data popularity to make the placement decisions. However, the popularity information is typically not available in the data placement phase. Furthermore, it usually varies during the data lifecycle. In this paper, we propose a new placement algorithm called Balanced Distribution for Each Age Group (BEAG), which makes data placement decisions in the absence of the popularity information. This algorithm maintains multiple counters for each storage node, with each counter representing the amount of data belonging to a certain age group. It ensures that the data in each age group are equally scattered among the different storage nodes. As the popularity variance of the data belonging to the same age group is considerably smaller than that of the entire data, BEAG significantly improves the I/O load balance. Experimental results show that compared to other popularity independent algorithms, BEAG decreases the I/O load standard deviation by 11.6% to 30.4%.

Keyword:

Author Community:

  • [ 1 ] [Luo, Xiangyu] Xian Univ Sci & Technol, Coll Comp Sci & Technol, Xian 710054, Shaanxi, Peoples R China
  • [ 2 ] [Luo, Xiangyu; Gui, Xiaolin] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
  • [ 3 ] [Xin, Gang] AVIC Comp Tech Res Inst, Xian, Shaanxi, Peoples R China

Reprint Author's Address:

  • Xian Univ Sci & Technol, Coll Comp Sci & Technol, Xian 710054, Shaanxi, Peoples R China.; Luo, XY (reprint author), Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China.

Show more details

Related Keywords:

Related Article:

Source :

MATHEMATICAL PROBLEMS IN ENGINEERING

ISSN: 1024-123X

Year: 2019

Volume: 2019

1 . 0 0 9

JCR@2019

1 . 3 0 5

JCR@2020

ESI Discipline: ENGINEERING;

ESI HC Threshold:83

JCR Journal Grade:2

CAS Journal Grade:4

Cited Count:

WoS CC Cited Count: 2

SCOPUS Cited Count: 4

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

FAQ| About| Online/Total:218/168345045
Address:XI'AN JIAOTONG UNIVERSITY LIBRARY(No.28, Xianning West Road, Xi'an, Shaanxi Post Code:710049) Contact Us:029-82667865
Copyright:XI'AN JIAOTONG UNIVERSITY LIBRARY Technical Support:Beijing Aegean Software Co., Ltd.