Generative Adversarial Network for Image Reconstruction from Human Brain Activity

Tim Tanner, Vassilis Cutsuridis, Vassilis Cutsuridis

2025

Abstract

Decoding of brain activity with machine learning has enabled the reconstruction of thoughts, memories and dreams. In this study, we designed a methodology for reconstructing visual stimuli (digits) from human brain activity recorded during passive visual viewing. Using the MindBigData EEG dataset, we preprocessed the signals and cleaned them from noise, muscular artifacts and eye blinks. Using the Common Average Reference (CAR) method and past studies’ results we reduced the available electrodes from 14 to 4 keeping only those containing discriminative features associated with the visual stimulus. A convolutional neural network (CNN) was then trained to encode the signals and classify the images. A 92% classification performance was achieved post-CAR. Three variations of an auxiliary conditional generative adversarial network (AC-GAN) were evaluated for decoding the latent feature vector with its class embedding and generating black-and-white images of digits. Our objective was to create an image similar to the presented stimulus through the previously trained GANs. An average 65% reconstruction score was achieved by the AC-GAN without a modulation layer, a 60% by the AC-GAN with modulation layer and multiplication, and a 63% by the AC-GAN with modulation and concatenation. Rapid advances in generative modeling promise further improvements in reconstruction performance.

Paper Citation

in Harvard Style

Tanner T. and Cutsuridis V. (2025). Generative Adversarial Network for Image Reconstruction from Human Brain Activity. In Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 1: BIOSIGNALS; ISBN 978-989-758-731-3, SciTePress, pages 868-877. DOI: 10.5220/0013149300003911

in Bibtex Style

@conference{biosignals25,
author={Tim Tanner and Vassilis Cutsuridis},
title={Generative Adversarial Network for Image Reconstruction from Human Brain Activity},
booktitle={Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 1: BIOSIGNALS},
year={2025},
pages={868-877},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013149300003911},
isbn={978-989-758-731-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 1: BIOSIGNALS
TI - Generative Adversarial Network for Image Reconstruction from Human Brain Activity
SN - 978-989-758-731-3
AU - Tanner T.
AU - Cutsuridis V.
PY - 2025
SP - 868
EP - 877
DO - 10.5220/0013149300003911
PB - SciTePress