IJRTI
International Journal for Research Trends and Innovation
International Peer Reviewed & Refereed Journals, Open Access Journal
ISSN Approved Journal No: 2456-3315 | Impact factor: 8.14 | ESTD Year: 2016
Scholarly open access journals, Peer-reviewed, and Refereed Journals, Impact factor 8.14 (Calculate by google scholar and Semantic Scholar | AI-Powered Research Tool) , Multidisciplinary, Monthly, Indexing in all major database & Metadata, Citation Generator, Digital Object Identifier(DOI)

Call For Paper

For Authors

Forms / Download

Published Issue Details

Editorial Board

Other IMP Links

Facts & Figure

Impact Factor : 8.14

Issue per Year : 12

Volume Published : 10

Issue Published : 115

Article Submitted : 19440

Article Published : 8041

Total Authors : 21252

Total Reviewer : 769

Total Countries : 144

Indexing Partner

Licence

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Published Paper Details
Paper Title: Dynamic Resource-Aware Scheduling for Enhanced Performance in Heterogeneous Hadoop Clusters
Authors Name: Sunkari Mahesh , Dr K Ram Mohan Rao
Download E-Certificate: Download
Author Reg. ID:
IJRTI_188772
Published Paper Id: IJRTI2312085
Published In: Volume 8 Issue 12, December-2023
DOI:
Abstract: — In the realm of big data processing, Hadoop clusters play a pivotal role. However, the increasing energy demand and the need for efficient resource utilization in these clusters remain a challenge. This research introduces a novel resource-aware scheduling algorithm aimed at enhancing the performance and energy efficiency of heterogeneous Hadoop clusters. Unlike conventional scheduling algorithms that overlook the varied capabilities of individual nodes, our algorithm dynamically assigns tasks based on real-time resource availability and node-specific performance metrics. The algorithm profiles each node for CPU, memory, disk, and network capabilities, and tasks are characterized by their resource demands to ensure a precise match during scheduling. Experimental results, derived from a series of benchmarks on a simulated Hadoop environment, indicate a significant improvement in resource utilization and energy efficiency. The proposed algorithm not only reduces the overall energy consumption by optimizing task allocation but also decreases the task completion time, thereby increasing throughput. These advancements contribute to a sustainable and cost-effective operation of Hadoop clusters, which is crucial for energy-intensive big data processes. The implications of this research are profound, offering a scalable solution that can adapt to the evolving landscape of data analytics infrastructure.
Keywords: Hadoop Clusters, Big Data Processing, Resource-Aware Scheduling, Heterogeneous Computing, Energy Efficiency, Performance Optimization, Task Allocation, Node Profiling.
Cite Article: "Dynamic Resource-Aware Scheduling for Enhanced Performance in Heterogeneous Hadoop Clusters", International Journal of Science & Engineering Development Research (www.ijrti.org), ISSN:2455-2631, Vol.8, Issue 12, page no.601 - 610, December-2023, Available :http://www.ijrti.org/papers/IJRTI2312085.pdf
Downloads: 000205256
ISSN: 2456-3315 | IMPACT FACTOR: 8.14 Calculated By Google Scholar| ESTD YEAR: 2016
An International Scholarly Open Access Journal, Peer-Reviewed, Refereed Journal Impact Factor 8.14 Calculate by Google Scholar and Semantic Scholar | AI-Powered Research Tool, Multidisciplinary, Monthly, Multilanguage Journal Indexing in All Major Database & Metadata, Citation Generator
Publication Details: Published Paper ID: IJRTI2312085
Registration ID:188772
Published In: Volume 8 Issue 12, December-2023
DOI (Digital Object Identifier):
Page No: 601 - 610
Country: R R District, Telangana, India
Research Area: Engineering
Publisher : IJ Publication
Published Paper URL : https://www.ijrti.org/viewpaperforall?paper=IJRTI2312085
Published Paper PDF: https://www.ijrti.org/papers/IJRTI2312085
Share Article:

Click Here to Download This Article

Article Preview
Click Here to Download This Article

Major Indexing from www.ijrti.org
Google Scholar ResearcherID Thomson Reuters Mendeley : reference manager Academia.edu
arXiv.org : cornell university library Research Gate CiteSeerX DOAJ : Directory of Open Access Journals
DRJI Index Copernicus International Scribd DocStoc

ISSN Details

ISSN: 2456-3315
Impact Factor: 8.14 and ISSN APPROVED, Journal Starting Year (ESTD) : 2016

DOI (A digital object identifier)


Providing A digital object identifier by DOI.ONE
How to Get DOI?

Conference

Open Access License Policy

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License

Creative Commons License This material is Open Knowledge This material is Open Data This material is Open Content

Important Details

Join RMS/Earn 300

IJRTI

WhatsApp
Click Here

Indexing Partner