Segmentation of Dashboard Screen Images: Preparation of Inputs for Object-based Metrics of UI Quality

Jiří Hynek, Tomáš Hruška

2019

Abstract

Using object-based metrics to analyze design aspects of user interfaces (UI) is a suitable approach for the quantitative evaluation of the visual quality of user interfaces. Balance or Symmetry are examples of such metrics. On the other hand, we need to deal with the problem of a detection of objects within a user interface screen which represent the inputs for the object-based metrics. Today’s user interfaces (e. g., dashboards) are complex. They consist of several color layers, and it is complicated to segment them by well-known page segmentation methods which are usually used for the segmentation of printed documents. We also need to consider the subjective perception of users and principles of objects grouping (as Gestalt laws). Users usually group simple objects (graphical elements and shapes) into coherent visually dominant objects. We analyzed the experience of 251 users manually segmenting dashboard screens and designed a novel method for the automatic segmentation of dashboard screen images. The method initially focuses on the reduction of image colors which represents image layers. Then, it detects the primitives which makes a screen layout. Finally, the method processes the screen layout using the combination of the top-down and bottom-up segmentation strategy and detects visually dominant regions.

Paper Citation

in Harvard Style

Hynek J. and Hruška T. (2019). Segmentation of Dashboard Screen Images: Preparation of Inputs for Object-based Metrics of UI Quality. In Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 3: IVAPP; ISBN 978-989-758-354-4, SciTePress, pages 199-207. DOI: 10.5220/0007312301990207

in Bibtex Style

@conference{ivapp19,
author={Jiří Hynek and Tomáš Hruška},
title={Segmentation of Dashboard Screen Images: Preparation of Inputs for Object-based Metrics of UI Quality},
booktitle={Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 3: IVAPP},
year={2019},
pages={199-207},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007312301990207},
isbn={978-989-758-354-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 3: IVAPP
TI - Segmentation of Dashboard Screen Images: Preparation of Inputs for Object-based Metrics of UI Quality
SN - 978-989-758-354-4
AU - Hynek J.
AU - Hruška T.
PY - 2019
SP - 199
EP - 207
DO - 10.5220/0007312301990207
PB - SciTePress