A Unified Framework For Data Integrity And Security In Big Data: Leveraging Clustbigfim And Blockchain

Authors: V. Vincent Arokiam Arul Raja, C. Senthamarai

DOI: https://doi.org/10.37082/IJIRMPS.v13.i6.232778

Short DOI: https://doi.org/g98vc9

Country: India

Full-text Research PDF File:   View   |   Download

Abstract: Large datasets from various fields raise concerns about security, reliability, and consistency. While centralized databases facilitate data storage, transmission, processing, and access, ensuring security and safe storage is crucial to prevent malicious attacks. Blockchain technology is increasingly being utilized to enhance data security in big data systems. As a distributed digital ledger, it addresses the issues of data duplication and vulnerabilities across networks. Blockchain offers fault tolerance, ensuring secure data handling. It also allows for controlled access without compromising data integrity in distributed systems. Specifically, the technology focuses on agreement, authentication, and auditing of data access. To improve data processing, techniques such as collaborative filtering (CF) and MapReduce with Frequent Itemset Mining (FIM) are employed. CF identifies relationships and similarities among frequently occurring items, thereby enhancing processing accuracy and efficiency.
MapReduce streamlines the FIM process by distributing the workload, which reduces processing time. FIM helps manage combinatorial complexity and mitigates risks associated with vulnerabilities and data manipulation. Throughout these processes, security is prioritized at every stage. Techniques like classifier algorithms, class balancing, and filter association algorithms are utilized to ensure robust security throughout the data handling pipeline. Together, these methods aim to provide strong security for big data through the use of consensus and distributed ledger technology.

Keywords: BlockChain Algorithm (BCA), Collaborative Filtering (CF), Map Reduce Function (MRF), Frequent Itemset Mining (FIM), ClustBigFim (Cluster Bigdata FIM), Classifier algorithm, Class balancer, and Filter Association Techniques.

Paper Id: 232778

Published On: 2025-11-02

Published In: Volume 13, Issue 6, November-December 2025

Share this