Revolutionizing Security and Storage Efficiency: An Innovative Approach for HDFS Enhancement

Abstract

Our research is centered on enhancing the efficiency of the HDFS by incorporating intelligent agents that can dynamically assign storage tasks to nodes based on their performance characteristics. Utilizing a decentralized decision-making framework, the suggested approach based on MAS considers the real-time performance of nodes and allocates storage tasks adaptively. Hadoop is capable of handling the commodity hardware and it is efficient for storage and processing of data but it has certain security issues. This paper proposes Hadoop based data centre which stores big data.