examination using CNN, and classification of four
classes is realized. Based on the obtained learning
result and the gradient of the feature obtained by Grad
Cam, a bounding box is generated at the image’s part
with the largest gradient. The trajectory of the center
of the bounding box in each image is obtained as the
position of the fetus. Experimental results are as
follows.
The fetal four class recall ratios were 99.6% for
head, 99.4% for body, 99.8% for legs, 72.6% for legs.
The trajectories obtained from the fetus present in
“left”, “center”, “right” in the images show the above-
mentioned geometrical relationship.
In the estimation of the depth of the fetus,
although the problem remains in estimating the depth
of the head part, the accuracy of estimating the depth
of the fetal body and the leg part is high. In the future,
it is necessary to improve accuracy by using other
deep learning networks and previous and latter
relative frames.
These results indicate that the estimated fetal
position coincides with the actual position very well,
which can be used as the first step for automatic fetal
examination by robotic systems.
ACKNOWLEDGEMENTS
This research is a collaborative study with Ikeda and
Rattan in Iwata laboratory at Waseda University.
Iwata and colleagues are developing TENANG robot
for pregnant women's ultrasound examination.
REFERENCES
Christian F, Konstantinos K, Jacqueline M, Tara P, et. al.
2017, Sononet: real-time detection and localisation of
fetal standard scan planes in freehand ultrasound. IEEE
Transactions on Medical Imaging, 36(11):2204{2215.
Gull I, Fait G, Har-Toov J, et al. 2002, Prediction of Fetal
Weight by Ultrasound: the Contribution of Additional
Examiners. Ultrasound in Obstetrics and Gynecology,
vol. 20, no. 1, pp. 57-60.
Hadlock F. P, Deter R.L, Harrist R.B, Park S.K. 1983,
Computer Assisted Analysis of Fetal Age in the Third
Trimester Using Multiple Fetal Growth Parameters. J
Clin Ultrasound, vol. 11, pp. 313-316.
Hadlock F. P, Deter R., Carpenter R, et.al. 1981, Estimating
Fetal Age: Effect of Head Shape on BPD, American
Journal of Roentgenology. vol. 137, no. 1, pp. 83-85.
Karen S and Andrew Z. 2014, Very deep convolutional
networks for large-scale image recognition. In ICLR,
International Conference on Learning Representations
2015.
Leon. B.199, Stochastic gradient learning in neural
networks. In Proceedings of Neuro-Nˆımes. EC2.
Namburete A, Xie W, Yaqub M, Zisserman A. 2018, Fully-
automated alignment of 3D fetal brain ultrasound to a
canonical reference space using multi-task learning.
Med Image Analysis, vol46, pp.1-14.
Nicolas T, Bishesh K. et al, 2018, Weakly Supervised
Localisation for Fetal Ultrasound Images, 4th
International Workshop, DLMIA 2018, and 8th
International Workshop, ML-CDS 2018, pp.192-200.
Oquab, M., Bottou L, Laptev, I,(2014) Learning and
transferring mid-level image representations using
convolutional neural networks, Proc. CVPR, pp. 1717-
1724.
Razavian, A., Azizpour, H. and Sullivan, 2014, J.: CNN
features off-the-shelf: An astounding baseline for
recognition, Proc. CVPR, pp. 512-519.
Shinzi. T. 2014, Sanka Chouonpa Kensa (Obstetric
ultrasound examination). Japan: Igaku shyoin, p.58.
Suzuki, S, Abe, K., 1985. Topological Structural Analysis
of Digitized Binary Images by Border Following.
CVGIP 30 1, pp 32-46.
Ramprasaath R. Selvaraju, Michael C, et al. 2017, Grad-
CAM: Visual Explanations from Deep Networks via
Gradient-based Localization. IEEE International
Conference on Computer Vision (ICCV), pp. 618-626.
Yuanwei Li, Bishesh K, Benjamin H, 2018, Standard Plane
Detection in 3D Fetal Ultrasound Using an Iterative
Transformation Network. MICCAI 2018: Medical
Image Computing and Computer Assisted Intervention
– MICCAI, vol11070, pp 392-400.
Detecting a Fetus in Ultrasound Images using Grad CAM and Locating the Fetus in the Uterus
189