A Blockchain-Based Fraud Detection and Vehicle Damage Assessment System Using Machine Learning and Computer Vision

Wafa Ben Slama Souei, N’Gouari Gana Abdou Bachir, Raoudha Ben Djemaa

2025

Abstract

Car insurance is a cornerstone of modern society, offering crucial financial protection in the event of accidents and vehicle-related damage. However, this intricate system is now grappling with a significant challenge: fraud manifesting in various forms, including staged accidents, fraudulent claims, and collusion between indi-viduals, and it poses a serious threat to the integrity and long-term viability of car insurance. In this paper, we will propose an innovative approach to fraud detection in car insurance and reimbursement estimation. The proposed approach makes significant contributions to the field by introducing a new dataset of 5,483 images with corresponding labels. Fraud detection is performed using the XGBoost Classifier, which is known for its robustness in handling complex classification tasks. Damage detection is carried out using the Mask R-CNN model, enabling precise identification and segmentation of vehicle damages. The system integrates structured data fraud detection with image-based damage assessment, where Mask R-CNN results serve as an additional validation factor. This end-to-end approach enhances fraud detection accuracy by combining data-driven insights with visual evidence for more reliable claim verification. These advancements contribute to improving the accuracy and efficiency of automated fraud detection and reimbursement estimation systems.

Paper Citation

in Harvard Style

Souei W., Bachir N. and Ben Djemaa R. (2025). A Blockchain-Based Fraud Detection and Vehicle Damage Assessment System Using Machine Learning and Computer Vision. In Proceedings of the 27th International Conference on Enterprise Information Systems - Volume 1: BEST; ISBN 978-989-758-749-8, SciTePress, pages 1123-1130. DOI: 10.5220/0013500800003929

in Bibtex Style

@conference{best25,
author={Wafa Souei and N’Gouari Bachir and Raoudha Ben Djemaa},
title={A Blockchain-Based Fraud Detection and Vehicle Damage Assessment System Using Machine Learning and Computer Vision},
booktitle={Proceedings of the 27th International Conference on Enterprise Information Systems - Volume 1: BEST},
year={2025},
pages={1123-1130},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013500800003929},
isbn={978-989-758-749-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 27th International Conference on Enterprise Information Systems - Volume 1: BEST
TI - A Blockchain-Based Fraud Detection and Vehicle Damage Assessment System Using Machine Learning and Computer Vision
SN - 978-989-758-749-8
AU - Souei W.
AU - Bachir N.
AU - Ben Djemaa R.
PY - 2025
SP - 1123
EP - 1130
DO - 10.5220/0013500800003929
PB - SciTePress