Automated Handwriting Pattern Recognition for Multi-Level Personality Classification Using Transformer OCR (TrOCR)

Marzieh Adeli Shamsabad, Ching Suen

2025

Abstract

Automated personality trait assessment from handwriting analysis offers applications in psychology, human-computer interaction, and personal profiling. However, accurately classifying different levels of personality traits remains challenging due to class imbalances in real-world datasets. This study addresses the issue by comparing multi-class and multi-label binary classification methods to predict levels of the Big Five personality traits: Extraversion, Neuroticism, Agreeableness, Conscientiousness, and Openness, each categorized as low, average, and high in an imbalanced dataset of 873 French handwriting samples. A new approach is introduced by adapting the TrOCR pre-trained model for feature extraction, modifying its encoder to capture local and global handwriting features relevant to personality classification. This model is compared with three other pre-trained models: ResNet50 and Vision Transformer base 16 with input resolutions of 224 and 384. Results demonstrate that multi-label binary classification, which treats each trait level as an independent binary task, effectively addresses data imbalance, enhancing accuracy and generalization. The proposed TrOCR model achieves the highest performance, with an accuracy of 84.26%, an F1-score of 83.26%, and an AUROC of 91% on the test set. These findings emphasize the effectiveness of the presented framework for automated multi-level personality trait classification from handwriting in imbalanced datasets.

Paper Citation

in Harvard Style

Adeli Shamsabad M. and Suen C. (2025). Automated Handwriting Pattern Recognition for Multi-Level Personality Classification Using Transformer OCR (TrOCR). In Proceedings of the 14th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM; ISBN 978-989-758-730-6, SciTePress, pages 141-150. DOI: 10.5220/0013318800003905

in Bibtex Style

@conference{icpram25,
author={Marzieh Adeli Shamsabad and Ching Suen},
title={Automated Handwriting Pattern Recognition for Multi-Level Personality Classification Using Transformer OCR (TrOCR)},
booktitle={Proceedings of the 14th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM},
year={2025},
pages={141-150},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013318800003905},
isbn={978-989-758-730-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM
TI - Automated Handwriting Pattern Recognition for Multi-Level Personality Classification Using Transformer OCR (TrOCR)
SN - 978-989-758-730-6
AU - Adeli Shamsabad M.
AU - Suen C.
PY - 2025
SP - 141
EP - 150
DO - 10.5220/0013318800003905
PB - SciTePress