版权说明 操作指南
首页 > 成果 > 详情

CSRA: An Efficient Resource Allocation Algorithm in MapReduce Considering Data Skewness

认领
导出
下载 Link by DOI
反馈
分享
QQ微信 微博
成果类型:
会议论文
作者:
CSRA: An Efficient Resource Allocation Algorithm in MapReduce Considering Data Skewness
作者机构:
湖南大学
语种:
英文
关键词:
MapReduce;Data skew;Splitting
期刊:
International Conference on Knowledge
年:
2015
卷:
9403
页码:
651-662
会议名称:
8th International Conference on Knowledge Science, Engineering and Management (KSEM)
会议时间:
2015-12-28至2015-12-30
会议地点:
重庆
摘要:
MapReduce offers a promising programming model for big data processing. One significant issue in practical applications is data skew, its an important reason for the emergence of stragglers which makes the data assigned to each reducer imbalance. This paper presents CSRA, an efficient resource allocation algorithm in MapReduce considering data skew. CSRA aims at reducing the running time and coefficient of variation by reordering the task list and splitting the big clusters. Through thinking over the actual status of tasks, this method largely squares up the resource utilization. After we impl...

反馈

验证码:
看不清楚,换一个
确定
取消

成果认领

标题:
用户 作者 通讯作者
请选择
请选择
确定
取消

提示

该栏目需要登录且有访问权限才可以访问

如果您有访问权限,请直接 登录访问

如果您没有访问权限,请联系管理员申请开通

管理员联系邮箱:yun@hnwdkj.com