
5 CONCLUSIONS
Palimpsests, historical manuscripts repurposed
through scraping or washing, hold significant value
for humanities scholars. Scholars commonly use
multispectral imaging to reveal obscured undertext
in these manuscripts. However, this method often
falls short in making the undertext readable due to
occlusion by overtext and various artefacts. This
paper proposes a novel approach to enhance undertext
readability in palimpsests through generative image
inpainting. We introduced a method to generate
the Synthetic MSI Images of Georgian Palimpsests
(SGP) dataset, publicly available. Additionally, we
fine-tuned a pre-trained Mask-Aware Transformer
(MAT) model using this dataset to improve its
performance. The resulting model was quantitatively
evaluated using FID and SSIM metrics on both
synthetic SGP dataset images and real palimpsest
images. Qualitative evaluation illustrated the prac-
ticality of our approach in enhancing undertext
readability for manuscript research. The results
clearly demonstrate the effectiveness of our approach
in both quantitative and qualitative measures.
ACKNOWLEDGEMENTS
The research for this work was funded by the
Deutsche Forschungsgemeinschaft (DFG, German
Research Foundation) under Germany’s Excellence
Strategy – EXC 2176 ‘Understanding Written Arte-
facts: Material, Interaction and Transmission in
Manuscript Cultures’, project no. 390893796. The
research was conducted within the scope of the Cen-
tre for the Study of Manuscript Cultures (CSMC) at
Universit
¨
at Hamburg.
In addition, we thank St Catherine’s Monastery
on Mt Sinai, the Early Manuscripts Electronic Li-
brary and the members of the Sinai Palimpsest Project
(http://sinaipalimpsests.org/), esp. Michael Phelps,
Claudia Rapp and Keith Knox, for providing the MSI
images.
REFERENCES
Abdulla, A. and Ahmed, M. (2021). An improved image
quality algorithm for exemplar-based image inpaint-
ing. Multimed Tools Appl, 80:13143–13156.
Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C.
(2000). Image inpainting. In Proceedings of the 27th
Annual Conference on Computer Graphics and Inter-
active Techniques, SIGGRAPH ’00, page 417–424.
ACM Press/Addison-Wesley Publishing Co.
Easton, R. L., Christens-Barry, W. A., and Knox, K. T.
(2011). Spectral image processing and analysis of the
archimedes palimpsest. In 2011 19th European Signal
Processing Conference, pages 1440–1444.
Gippert, J. and Dum-Tragut, J. (2023). Caucasian Albania:
An International Handbook. De Gruyter.
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and
Hochreiter, S. (2017). Gans trained by a two time-
scale update rule converge to a local nash equilibrium.
In Proceedings of the 31st International Conference
on Neural Information Processing Systems, NIPS’17,
page 6629–6640. Curran Associates Inc.
Jampour, M., Li, C., Yu, L.-F., Zhou, K., Lin, S., and
Bischof, H. (2017). Face inpainting based on high-
level facial attributes. Computer Vision and Image
Understanding, 161:29–41.
Jampour, M., Mohammed, H., and Gippert, J. (2023a).
Synthetic MSI Images of Georgian Palimpsests (SGP
Dataset).
Jampour, M., Zare, M., and Javidi, M. (2023b). Ad-
vanced multi-gans towards near to real image and
video colorization. J Ambient Intell Human Comput,
14:12857–12874.
Li, W., Lin, Z., Zhou, K., Qi, L., Wang, Y., and Jia, J.
(2022). Mat: Mask-aware transformer for large hole
image inpainting. In 2022 IEEE/CVF Conference on
Computer Vision and Pattern Recognition (CVPR),
pages 10748–10758. IEEE Computer Society.
Lucic, M., Kurach, K., Michalski, M., Bousquet, O., and
Gelly, S. (2018). Are gans created equal? a large-scale
study. In Proceedings of the 32nd International Con-
ference on Neural Information Processing Systems,
NIPS’18, page 698–707. Curran Associates Inc.
Obukhova, N. A., Baranov, P. S., Motyko, A. A.,
Chirkunova, A. A., and Pozdeev, A. A. (2023).
Palimpsest research based on hyperspectral informa-
tion. In 2023 25th International Conference on Digital
Signal Processing and its Applications (DSPA), pages
1–4.
Ru
ˇ
zi
´
c, T. and Pi
ˇ
zurica, A. (2015). Context-aware patch-
based image inpainting using markov random field
modeling. IEEE Transactions on Image Processing,
24(1):444–456.
Salerno, E., Tonazzini, A., and Bedini, L. (2007). Digi-
tal image analysis to enhance underwritten text in the
archimedes palimpsest. IJDAR, 9:79–87.
Seitzer, M. (2020). pytorch-fid: FID Score for PyTorch.
https://github.com/mseitzer/pytorch- fid. Version
0.3.0.
Starynska, A., Messinger, D., and Kong, Y. (2021). Reveal-
ing a history: palimpsest text separation with genera-
tive networks. IJDAR, 24:181–195.
Xiang, H., Zou, Q., Nawaz, M. A., Huang, X., Zhang, F.,
and Yu, H. (2023). Deep learning for image inpaint-
ing: A survey. Pattern Recognition, 134:109046.
Zare, M., Lari, K. B., Jampour, M., and Shamsinejad, P.
(2019). Multi-gans and its application for pseudo-
coloring. In 2019 4th International Conference on
Pattern Recognition and Image Analysis (IPRIA),
pages 1–6.
Zhang, N., Ji, H., and et al., L. L. (2019). Exemplar-based
image inpainting using angle-aware patch matching. J
Image Video Proc, 70:1.
ICPRAM 2024 - 13th International Conference on Pattern Recognition Applications and Methods
694