Improved efficient skyline algorithm based on Mapreduce

LIU Jian-bang; LIU Xu-min

doi:10.13873/J.1000-9787(2016)11-0116-04

Chinese

您当前的位置：

首页 >

文章列表页 >

Improved efficient skyline algorithm based on Mapreduce

更新时间：2025-09-11

- Improved efficient skyline algorithm based on Mapreduce
- Vol. 35, Issue 11, Pages: 116-119(2016)
- 作者机构：
  
  首都师范大学信息工程学院
- 作者简介：
- 基金信息：
- DOI：10.13873/J.1000-9787(2016)11-0116-04
  CLC： TP311.13
- Published：2016
- 稿件说明：
移动端阅览
[1]刘建邦,刘旭敏.Mapreduce下改进Skyline的高效算法[J].传感器与微系统,2016,35(11):116-119.

LIU Jian-bang, LIU Xu-min. Improved efficient skyline algorithm based on Mapreduce[J]. 2016, 35(11): 116-119.
[1]刘建邦,刘旭敏.Mapreduce下改进Skyline的高效算法[J].传感器与微系统,2016,35(11):116-119. DOI： 10.13873/J.1000-9787(2016)11-0116-04.

LIU Jian-bang, LIU Xu-min. Improved efficient skyline algorithm based on Mapreduce[J]. 2016, 35(11): 116-119. DOI： 10.13873/J.1000-9787(2016)11-0116-04.

摘要

目前基于MapReduce的Skyline算法随着维度增大会陷入维度灾难

不能高效地解决大数据条件下的计算问题。提出高效算法MRBPS

利用数据间的互不支配特性

通过一个优化轴点对数据集建立区域标识

在Map和Reduce阶段优先比较每个点的区域标识

将多维比较简化为一维比较

提高了计算效率

通过系统实验证明:此算法在大数据量时能够明显提高计算效率

与现有算法相比具有高效性和可靠性。

Abstract

Existing Mapreduce-based Skyline algorithms is inefficient facing large scale database

to solve this problem

an MapReduce with balanced point skyline（ MRBPS） algorithm is proposed

using incomparability of dataset

map points to different regions with a computed balanced point

simplified multi-dimensional comparison to one dimensional comparison

reduce number of tests in Map and Reduce Task. Systematic experiments prove that the algorithm is efficient in large scale database

and more efficient and reliable than existing algorithms.

关键词

Keywords

references

基于MapReduce的预处理高效Skyline算法 [J]. 李文俊,张大方,李玮. 计算机应用与软件 . 2015(03)

基于Map-Reduce的海量数据高效Skyline查询处理 [J]. 丁琳琳,信俊昌,王国仁,黄山. 计算机学报 . 2011(10)

MapReduce框架下的Skyline计算 [J]. 张波良,周水庚,关佶红. 计算机科学与探索 . 2011(05)

Scalable skyline computation using a balanced pivot selection technique [J] . Jongwuk Lee,Seung-won Hwang. Information Systems . 2014

Efficient sort-based skyline evaluation [J] . Ilaria Bartolini,Paolo Ciaccia,Marco Patella. ACM Transactions on Database Systems （TODS） . 2008 (4)

Progressive skyline computation in database systems [J] . Dimitris Papadias,Yufei Tao,Greg Fu,Bernhard Seeger. ACM Transactions on Database Systems （TODS） . 2005 (1)

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Skyline result optimization algorithm based on MapReduce framework

Improved speculative task scheduling algorithm on Hadoop platform

Related Author

MA Xue-sen

WANG Xiao-jie

HAN Jiang-hong

WANG Ying-guan

CHEN Ming-li

LIU Xu-min

Related Institution

School of Computer & Information,Hefei University of Technology

Key Laboratory of Wireless Sensor Networks & Communication,Shanghai Institute of Microsystem and Information Technology,Chinese Academy of Sciences

⁰