influence the interpretability and generalizability of
our results. Firstly, the scope of our research was con-
fined to collaboration tools exclusively, therefore lim-
iting the broad applicability of our findings across all
software systems or technological domains.
Secondly, our study population comprised only
students, potentially introducing a bias in our results.
Given the distinct demographics, usage patterns, and
expectations of this specific group, caution must be
exercised when extending the results to a broader,
more heterogeneous user base.
Thirdly, a bias towards the importance of factors
may be given, as steps one and two of the study were
performed by the same group of individuals: UX
factors identified as being of relevance in step one
may be more likely rated as relevant in step two of
the study. This may be prevented by conducting the
named steps in a single-blind manner, where partici-
pants of step two did not preselect potentially relevant
factors.
Lastly, the set of User Experience (UX) factors
we considered may not be exhaustive. Though we
endeavored to encompass a comprehensive array of
factors, there may still be critical, yet overlooked as-
pects that could influence users’ perceptions and ex-
periences with collaboration tools.
6 CONCLUSIONS AND FUTURE
WORK
In our study of collaboration tools from a User Expe-
rience (UX) perspective, we sought to discern the rel-
ative significance of UX factors in various usage con-
texts. The study used a three-step approach to iden-
tify, evaluate, and ascertain distinctive UX factors and
their perceived importance across collaboration tools.
Significant variations were observed in the per-
ceived importance of several UX factors across dif-
ferent collaboration tool types, underscoring the intri-
cate role of professional and leisure context in such
evaluations. For instance, certain UX factors like De-
pendability and Efficiency, contrary to being univer-
sally applicable "hygiene factors," exhibited signif-
icant variations, illuminating the nuanced nature of
these evaluations. Similarly, more hedonic elements
like novelty and stimulation emerged as motivators,
thereby refuting the established notion that pragmatic
qualities primarily dominate the leisure context.
However, our study also identifies certain UX fac-
tors that remain universally important, regardless of
the tool type or context, such as accessibility, adapt-
ability, clarity, interaction, intuitive use, perspicuity,
and self-presentation. This discovery suggests an en-
during baseline of factors pertinent to any successful
UX design across contexts.
The findings highlight the need for a differenti-
ated, context-specific approach in assessing the im-
portance of UX factors. A homogeneous evalua-
tion or universal statement about the importance of
UX factors appears untenable given the diverse out-
comes. Consequently, our study emphasizes the in-
tricate complexity of UX evaluations and the impor-
tant necessity of considering specific contexts and re-
quirements when designing and evaluating collabora-
tion tools.
These findings do not only underscore the impact
of context on the significance of UX factors but also
generate new research avenues exploring the role and
importance of such factors in different settings. Fu-
ture work could strive to expand these initial findings
and continue to unravel the complexities of UX in
a world increasingly dependent on digital collabora-
tion.
REFERENCES
Boy, G. A. (2017). The Handbook of Human-Machine
Interaction: A Human-Centered Design Approach.
CRC Press, Milton, 1st ed. edition.
Hassenzahl, M. (2001). The effect of perceived he-
donic quality on product appealingness. Inter-
national Journal of Human-Computer Interaction,
2001(13(4)):481–499.
Hassenzahl, M., Diefenbach, S., and Göritz, A. (2010).
Needs, affect, and interactive products – facets of user
experience. Interacting with Computers, 22(5):353–
362. Modelling user experience - An agenda for re-
search and practice.
Hinderks, A., Winter, D., Schrepp, M., and
Thomaschewski, J. (2020). Applicability of user
experience and usability questionnaires. Journal of
Universal Computer Science, (25):1717–1735.
ISO9241-210 (2020). Ergonomics of human-system inter-
action - part 210: Human-centred design for interac-
tive systems.
Meiners, A.-L., Kollmorgen, J., Schrepp, M., and
Thomaschewski, J. (2021). Which UX Aspects Are
Important for a Software Product?: Importance Rat-
ings of UX Aspects for Software Products for Mea-
surement with the UEQ+. In Mensch und Computer
2021, pages 136–139, Ingolstadt Germany. ACM.
Norman, D. A. (2007). Emotional Design: Why We Love
(or Hate) Everyday Things. Basic Books, New York.
Rogers, Y., Sharp, H., and Preece, J. (2023). Interaction
design: Beyond human-computer interaction. Wiley,
Chichester, 6. ed. edition.
Schrepp, M., Kollmorgen, J., Meiners, A.-L., Hinderks, A.,
Winter, D., and Thomaschewski, J. (2023). On the Im-
portance of UX Quality Aspects for Different Product
Pragmatic versus Hedonic: Determining the Dominant Quality in User Experience for Professional and Leisure Collaboration Tools
397