Multi-objective scheduling of MapReduce jobs in big data processing
dc.contributor.author | Hashem, I .A. T. | |
dc.contributor.author | Anuar, N. B. | |
dc.contributor.author | Marjani, M. | |
dc.contributor.author | Gani, A. | |
dc.contributor.author | Sangaiah, A. K. | |
dc.contributor.author | Adewole, K. S. | |
dc.date.accessioned | 2017-11-23T16:24:15Z | |
dc.date.available | 2017-11-23T16:24:15Z | |
dc.date.issued | 2017 | |
dc.description.abstract | Data generation has increased drastically over the past few years due to the rapid development of Internet-based technologies. This period has been called the big data era. Big data offer an emerging paradigm shift in data exploration and utilization. The MapReduce computational paradigm is a well-known framework and is considered the main enabler for the distributed and scalable processing of a large amount of data. However, despite recent efforts toward improving the performance of MapReduce, scheduling MapReduce jobs across multiple nodes has been considered a multi-objective optimization problem. This problem can become increasingly complex when virtualized clusters in cloud computing are used to execute a large number of tasks. This study aims to optimize MapReduce job scheduling based on the completion time and cost of cloud service models. First, the problem is formulated as a multi-objective model. The model consists of two objective functions, namely, (i) completion time and (ii) cost minimization. Second, a scheduling algorithm using earliest finish time scheduling that considers resource allocation and job scheduling in the cloud is proposed. Lastly, experimental results show that the proposed scheduler exhibits better performance than other well-known schedulers, such as FIFO and Fair. | en_US |
dc.identifier.uri | http://hdl.handle.net/123456789/44 | |
dc.language.iso | en | en_US |
dc.publisher | Multimedia Tools and Applications | en_US |
dc.subject | Hadoop; MapReduce; Cloud computing; Big data; Scheduling algorithms | en_US |
dc.title | Multi-objective scheduling of MapReduce jobs in big data processing | en_US |
dc.type | Article | en_US |
Files
Original bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- Paper on Multiobjective MapReduce_Page_03.jpg
- Size:
- 206.92 KB
- Format:
- Joint Photographic Experts Group/JPEG File Interchange Format (JFIF)
- Description:
- Abstract Only
License bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- license.txt
- Size:
- 1.71 KB
- Format:
- Item-specific license agreed upon to submission
- Description: