![](bg8.png)
Bellman, R. et al. (1954). The theory of dynamic program-
ming. Bulletin of the American Mathematical Society,
60(6):503–515.
Bengio, Y., Louradour, J., Collobert, R., and Weston, J.
(2009). Curriculum learning. In Proceedings of
the 26th annual international conference on machine
learning, pages 41–48. ACM.
Espeholt, L., Soyer, H., Munos, R., Simonyan, K., Mnih, V.,
Ward, T., Doron, Y., Firoiu, V., Harley, T., Dunning,
I., et al. (2018). Impala: Scalable distributed deep-rl
with importance weighted actor-learner architectures.
arXiv preprint arXiv:1802.01561.
Ghesu, F. C., Georgescu, B., Grbic, S., Maier, A. K.,
Hornegger, J., and Comaniciu, D. (2017a). Robust
multi-scale anatomical landmark detection in incom-
plete 3d-ct data. In International Conference on Med-
ical Image Computing and Computer-Assisted Inter-
vention, pages 194–202. Springer.
Ghesu, F. C., Georgescu, B., Mansi, T., Neumann, D.,
Hornegger, J., and Comaniciu, D. (2016). An artificial
agent for anatomical landmark detection in medical
images. In International Conference on Medical Im-
age Computing and Computer-Assisted Intervention,
pages 229–237. Springer.
Ghesu, F.-C., Georgescu, B., Zheng, Y., Grbic, S., Maier,
A., Hornegger, J., and Comaniciu, D. (2017b). Multi-
scale deep reinforcement learning for real-time 3d-
landmark detection in ct scans. IEEE transactions on
pattern analysis and machine intelligence, 41(1):176–
189.
Hamdan, A., Guetta, V., Klempfner, R., Konen, E.,
Raanani, E., Glikson, M., Goitein, O., Segev, A., Bar-
bash, I., Fefer, P., et al. (2015). Inverse relationship
between membranous septal length and the risk of at-
rioventricular block in patients undergoing transcath-
eter aortic valve implantation. JACC: Cardiovascular
Interventions, 8(9):1218–1228.
Kingma, D. P. and Ba, J. (2014). Adam: A
method for stochastic optimization. arXiv preprint
arXiv:1412.6980.
Leon, M. B., Smith, C. R., Mack, M. J., Makkar, R. R.,
Svensson, L. G., Kodali, S. K., Thourani, V. H.,
Tuzcu, E. M., Miller, D. C., Herrmann, H. C., et al.
(2016). Transcatheter or surgical aortic-valve re-
placement in intermediate-risk patients. New England
Journal of Medicine, 374(17):1609–1620.
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A.,
Ciompi, F., Ghafoorian, M., Van Der Laak, J. A.,
Van Ginneken, B., and S
´
anchez, C. I. (2017). A survey
on deep learning in medical image analysis. Medical
image analysis, 42:60–88.
Mack, M. J., Leon, M. B., Thourani, V. H., Makkar, R.,
Kodali, S. K., Russo, M., Kapadia, S. R., Malaisrie,
S. C., Cohen, D. J., Pibarot, P., et al. (2019). Tran-
scatheter aortic-valve replacement with a balloon-
expandable valve in low-risk patients. New England
Journal of Medicine, 380(18):1695–1705.
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T.,
Harley, T., Silver, D., and Kavukcuoglu, K. (2016).
Asynchronous methods for deep reinforcement learn-
ing. In International conference on machine learning,
pages 1928–1937.
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness,
J., Bellemare, M. G., Graves, A., Riedmiller, M., Fid-
jeland, A. K., Ostrovski, G., et al. (2015). Human-
level control through deep reinforcement learning.
Nature, 518(7540):529.
O’Neil, A. Q., Kascenas, A., Henry, J., Wyeth, D., Shep-
herd, M., Beveridge, E., Clunie, L., Sansom, C., Se-
duikyte Keith Muir, E., and Poole, I. (2018). Attaining
human-level performance with atlas location autocon-
text for anatomical landmark detection in 3d ct data.
In Proceedings of the European Conference on Com-
puter Vision (ECCV), pages 0–0.
Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E.,
DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., and
Lerer, A. (2017). Automatic differentiation in pytorch.
Payer, C.,
ˇ
Stern, D., Bischof, H., and Urschler, M. (2016).
Regressing heatmaps for multiple landmark localiza-
tion using cnns. In International Conference on Med-
ical Image Computing and Computer-Assisted Inter-
vention, pages 230–238. Springer.
Popma, J. J., Deeb, G. M., Yakubov, S. J., Mumtaz, M.,
Gada, H., O’Hair, D., Bajwa, T., Heiser, J. C., Merhi,
W., Kleiman, N. S., et al. (2019). Transcatheter aortic-
valve replacement with a self-expanding valve in low-
risk patients. New England Journal of Medicine,
380(18):1706–1715.
Reardon, M. J., Van Mieghem, N. M., Popma, J. J., Klei-
man, N. S., Søndergaard, L., Mumtaz, M., Adams,
D. H., Deeb, G. M., Maini, B., Gada, H., et al. (2017).
Surgical or transcatheter aortic-valve replacement in
intermediate-risk patients. New England journal of
medicine, 376(14):1321–1331.
Rocatello, G., El Faquir, N., De Santis, G., Iannaccone, F.,
Bosmans, J., De Backer, O., Sondergaard, L., Segers,
P., De Beule, M., de Jaegere, P., et al. (2018). Patient-
specific computer simulation to elucidate the role of
contact pressure in the development of new conduc-
tion abnormalities after catheter-based implantation of
a self-expanding aortic valve. Circulation: Cardiovas-
cular Interventions, 11(2):e005344.
Sahiner, B., Pezeshk, A., Hadjiiski, L. M., Wang, X., Druk-
ker, K., Cha, K. H., Summers, R. M., and Giger, M. L.
(2019). Deep learning in medical imaging and radi-
ation therapy. Medical physics, 46(1):e1–e36.
Saxe, A. M., McClelland, J. L., and Ganguli, S. (2013).
Exact solutions to the nonlinear dynamics of learn-
ing in deep linear neural networks. arXiv preprint
arXiv:1312.6120.
Schaul, T., Quan, J., Antonoglou, I., and Silver, D.
(2015). Prioritized experience replay. arXiv preprint
arXiv:1511.05952.
Smith, C. R., Leon, M. B., Mack, M. J., Miller, D. C.,
Moses, J. W., Svensson, L. G., Tuzcu, E. M., Webb,
J. G., Fontana, G. P., Makkar, R. R., et al. (2011).
Transcatheter versus surgical aortic-valve replacement
in high-risk patients. New England Journal of Medi-
cine, 364(23):2187–2198.
BIOIMAGING 2020 - 7th International Conference on Bioimaging
44