Other methods are based on ”deep features ex-
traction” where the deep pre-trained models have
been widely used as feature extractors, in which
the last convolutional layers or the fully connected
layers are used to feed a machine learning clas-
sifier. For example, (Ismael and S¸eng
¨
ur, 2021)
applied five pre-trained models including VGG-16,
ResNet18, ResNet50, ResNet101, and VGG19 to
train an SVM classifier. Different kernel functions are
then used in the SVM classification stage such as Lin-
ear, Quadratic, Cubic, and Gaussian kernels. An other
method used AlexNet-based features to feed an SVM
classifier is introduced in (Turkoglu, 2021). In this
work, the deep features are extracted from the fully-
connected and convolution layers. Another method
proposed by (Rahimzadeh and Attar, 2020) aims to
combine the deep extracted features from Xception
(Chollet, 2017) and ResNet50V2 (He et al., 2016b)
networks. A global feature vector is then generated
to train a classifier. From another point of view, to
be able to make a real time detection of COVID-19,
training a deep model from scratch has many prob-
lems, especially the insufficiency of representative
data and also it is time-consuming and requires high
performance machines. In this case ”transfer learn-
ing (TL)” were the most useful technique to figure
out train time and data troubles. TL is one of the
deep learning approaches that consists of reusing a
pre-trained model for one job to accomplish another
one in the same domain of missions. By way of ex-
ample, (Vaid et al., 2020) applied a transfer learn-
ing method using VGG-16 pre-trained model. They
used a labeled frontal X-ray images dataset of patients
from different countries around the word. The partic-
ularity of the used dataset lies in the additional infor-
mation of each patient such as location, old and gen-
der. (Das et al., 2020), however, used the extreme
version of Inception (Xception) model, in order to
develop an automated deep transfer learning to de-
tect COVID-19 pneumonia in X-ray images. Trans-
fer learning has also been used to classify the CT
scans of lungs into COVID-19 or NORMAL cases as
presented in (Ahuja et al., 2021). Four pre-trained
models are then used including ResNet18, ResNet50,
ResNet101, and SqueezeNet. A different transfer
learning-based method using the DetRaC model is
presented in (Abbas et al., 2021). The combination
of TL and the DetRaC model makes the proposed
method able to deal with any irregularities in the im-
age dataset by investigating its class boundaries us-
ing a class decomposition mechanism. Authors in
(Nayak et al., 2020) used eight pre-trained models
namely, AlexNet, VGG-16, GoogleNet, MobileNet-
V2, Squeezenet, ResNet34, ResNet50 and Incep-
tionV3. They evaluated the pre-trained models with
X-ray illustration taken from covid-chestxray-dataset
(Cohen et al., 2020). Similar method has been pro-
posed in (Kumar and Mallik, 2022). After fine-tuning
several CNN models, the authors proposed to train
the output each models using another deep neural
network to enhance the performance. To deal with
the lack of grand amount of labeled datasets, ”gen-
erative models” have been widely used to generate
new images using the existing ones. Many strate-
gies have been carried out such as flipping the im-
age horizontally of vertically, zooming in or out.
For example, (Loey et al., 2020) proposed a model
of two axes, the first one about the data augmen-
tation using common techniques across Conditional
generative adversarial network (CGAN), the second
axe is about deep TL model, which is formed of
five model, named as following: AlexNet, VGG-16,
VGG-19, GoogleNet and ResNet50. All of these
models are fine-tuned with COVID-19 CT-image
dataset. Another data-augmentation-based method
using X-ray and CT Chest Images has been pro-
posed in (Bargshady et al., 2022). It consists of cou-
pling GANs with with trained, semi-supervised Cy-
cleGAN. Inception V3 is then fine-tuned to detect
COVID-19.
3 CONTRIBUTION OF THE
PAPER
A transfer learning-based technique is applied in
this paper to detect COVID-19 virus using labeled
datasets of X-ray images. To avoid training a deep
CNN from scratch on a limited labeled dataset, we
propose in this paper to carry out a transfer learning
technique using five pre-trained models and acquired
data only to fine-tune them. This is very useful when
the data is abound for an auxiliary domain, but very
limited labeled data is available for the domain of ex-
periment. Figure 1 presents our proposal overview.
We opted for the following pre-trained models:
VGG-16, ResNet50, InceptionV3, ResNet101 and
Inception-ResNetV2. This choice is based on the di-
versity of these models, the difference of their archi-
tecture as well as their structure. A comparative study
is then conducted between these models in terms of
training accuracy, loss accuracy, validation accuracy
and validation loss during the training stage. A con-
fusion matrix is then generated after the classifica-
tion of test samples. Other performance measures
are computed to show the efficiency of each model
(e.g. recall, precision, F-score). The difference be-
tween the applied models can be useful in our sec-
VISAPP 2023 - 18th International Conference on Computer Vision Theory and Applications
356