A Hierarchical Loss for Semantic Segmentation

Bruce R. Muller, William A. P. Smith

2020

Abstract

We exploit knowledge of class hierarchies to aid the training of semantic segmentation convolutional neural networks. We do not modify the architecture of the network itself, but rather propose to compute a loss that is a summation of classification losses at different levels of class abstraction. This allows the network to differentiate serious errors (the wrong superclass) from minor errors (correct superclass but incorrect finescale class) and to learn visual features that are shared between classes that belong to the same superclass. The method is straightforward to implement (we provide a PyTorch implementation that can be used with any existing semantic segmentation network) and we show that it yields performance improvements (faster convergence, better mean Intersection over Union) relative to training with a flat class hierarchy and the same network architecture. We provide results for the Helen facial and Mapillary Vistas road-scene segmentation datasets.

Paper Citation

in Harvard Style

Muller B. and Smith W. (2020). A Hierarchical Loss for Semantic Segmentation. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 260-267. DOI: 10.5220/0008946002600267

in Bibtex Style

@conference{visapp20,
author={Bruce R. Muller and William A. P. Smith},
title={A Hierarchical Loss for Semantic Segmentation},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP},
year={2020},
pages={260-267},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008946002600267},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP
TI - A Hierarchical Loss for Semantic Segmentation
SN - 978-989-758-402-2
AU - Muller B.
AU - Smith W.
PY - 2020
SP - 260
EP - 267
DO - 10.5220/0008946002600267
PB - SciTePress