Analysis of Research Activities of University Teachers as Part of the

Education Quality Assurance System

Nataliia Morze

, Oksana Buinytska

, Valeriia Smirnova

and Bohdan Hrytseliak

Borys Grinchenko Kyiv University, 18/2 Bulvarno-Kudriavska Str, Kyiv, 04053, Ukraine

Keywords:

Publishing Activity, Scientist Proﬁle, Scientometric Databases, Transparency Rating, Rating System,

Research Activity, Quality Assurance of Education.

Abstract:

The rapid development of digital technologies is changing the role of the university in the digital society.

An important aspect of increasing the level of competitiveness of the university in the market of educational

services is to ensure the quality of results of all higher education institution activities, especially research, so to

analyze the university is important to develop and implement internal university rankings. The article analyzes

the international and Ukrainian experience of presenting the results of research activities of university teachers

to ensure the quality of education, ways to design systems for analyzing research activities of teachers, tools

and components for evaluating the effectiveness of research. The model and stages of designing a rating

system for evaluating research activities of teachers are described, which allows for systematic monitoring of

openness, transparency, and efﬁciency of the research component of teachers’ professional activities. The key

indicators for evaluating the effectiveness of scientiﬁc research are identiﬁed – citation indicators of the three

most important scientometric databases – Scopus, Web of Science, Google Scholar: number of publications,

number of bibliographic references, h-index, i10-index. The article presents one of the stages of the model

implementation, namely the development of transparency rating by citation indicators in Google Scholar.

According to the results of the study, the positive impact of the rating system is identiﬁed, the main measures

to increase visibility, presence, dissemination of research results are identiﬁed, the systematic implementation

of which provides effective representation of the scientist in domestic and international rankings.

1 INTRODUCTION

The main priority of each university is to provide

quality educational services and increase competitive-

ness to attract the most promising applicants for edu-

cation. The rapid development of digital technologies

is leading to the transformation of education, chang-

ing the role of the university in the digital society.

The inﬂuence and authority of the university in the

European Higher Education Area is signiﬁcantly in-

ﬂuenced by the openness and transparency of all ac-

tivities. Key areas of educational transformation for

global sustainability were discussed at the UNESCO

World Higher Education Conference, which include

cooperation and diversity, interdisciplinarity, ﬂexible

approaches to lifelong learning and knowledge that

meet today’s societal needs, support for research, etc.

https://orcid.org/0000-0003-3477-9254

https://orcid.org/0000-0002-3611-2114

https://orcid.org/0000-0001-9965-6373

https://orcid.org/0000-0003-2953-8560

(WHEC, 2022). Therefore, an important aspect of in-

creasing the level of competitiveness of the university

in the market of educational services is to ensure the

quality of results of all types of educational activities

of higher education institution, especially scientiﬁc.

The deﬁning documents regulating the function-

ing of the internal quality assurance system of higher

education at the university are the requirements of

the Laws of Ukraine “On Higher Education”, “On

Education” and Standards and Recommendations for

Quality Assurance in the European Higher Educa-

tion Area (ESG 2015). According to the Standards

and Guidelines for Quality Assurance in the Euro-

pean Higher Education Area (ENQA, 2015), the key

aspects of quality assurance in education are: inter-

nal and external quality assurance systems of edu-

cation and quality assurance institutions. The main

components of the university’s internal quality assur-

ance system include the introduction of internal reg-

ulations on the implementation of education quality

assurance policy, periodic review and improvement

236

Morze, N., Buinytska, O., Smirnova, V. and Hrytseliak, B.

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System.

DOI: 10.5220/0012063300003431

In Proceedings of the 2nd Myroslav I. Zhaldak Symposium on Advances in Educational Technology (AET 2021), pages 236-252

ISBN: 978-989-758-662-0

 2023 by SCITEPRESS – Science and Technology Publications, Lda. Under CC license (CC BY-NC-ND 4.0)

of educational programs in accordance with mod-

ern labor market needs and state standards, chang-

ing paradigms of higher education, including student-

centered teaching and learning, monitoring the level

of professional competence of teaching staff and cre-

ating conditions for continuous professional devel-

opment and improvement of teachers, availability of

educational resources, transparent enrollment proce-

dures, achievements, certiﬁcation of students based

on learning outcomes, introduction of effective infor-

mation management technologies, transparent cover-

age of accurate, objective, accessible information in

the public domain on various aspects of university,

periodic external monitoring of quality assurance. An

important component of the internal quality assurance

system of education is to increase the openness of uni-

versity, ensuring transparent evaluation of teachers’

professional activities, open access to results, profes-

sional and scientiﬁc achievements.

One of the tools for measuring the competitive-

ness of the university is its participation in interna-

tional and domestic educational rankings. To ensure

a complete and objective assessment of the method-

ology of the most authoritative rankings are based on

indicators covering various areas of university activ-

ity. Such key indicators are indicators of academic

reputation and reputation among employers; teach-

ing quality indicators – the ratio of teachers and stu-

dents, PhD and academic staff, etc.; indicators of the

quality of scientiﬁc research – the number of publi-

cations and citations in publications included in in-

ﬂuential scientometric databases; indicators of inter-

national cooperation – the percentage of foreign stu-

dents and teachers; indicators of visibility and inﬂu-

ence of sites, etc. The quality and transparency of

research activities of universities is assessed by indi-

cators of publishing activity of teachers. Indicators of

the quality of scientiﬁc citations according to Google

Scholar citations and citations in inﬂuential scientiﬁc

journals are taken into account in international rank-

ings – “Academic Ranking of World Universities”

(ARWU), “QS Top University Ranking”, webometric

ranking of world universities “Webometrics”, “Trans-

parent ranking: Top Universities by Google Scholar

Citations” and Ukrainian ones – “University rankings

according to Scopus indicators”, “Top-200 Ukraine”,

“Consolidated rating of higher education institutions

of Ukraine”, “Bibliometrics of Ukrainian science”

(Buinytska et al., 2018). Comparison of the weight of

research indicators in the methodologies of the most

authoritative ratings are presented in table 1.

Periodic monitoring of methodologies and key in-

dicators of the most inﬂuential ratings is important

for the analysis of the effectiveness of the univer-

sity’s performance in the rankings. An effective tool

for analyzing university performance is the introduc-

tion of internal university rankings. For a compre-

hensive and complete assessment, it is important that

the methodologies of internal university rankings are

based on key performance indicators that are taken

into account in the methodologies of the most author-

itative international and Ukrainian educational rank-

ings. Therefore, to ensure optimal presentation of the

research component of the university in the rankings

and ensure openness, transparency of the university,

it is necessary to develop and implement a rating sys-

tem for evaluating the research activities of teachers

to monitor the effectiveness of research activities and

create an appropriate system to increase its openness,

transparency international scientiﬁc networking com-

munities in order to promote and communicate.

The purpose of the study is to develop a rating as-

sessment of research activities of university teachers

as part of the internal system of quality assurance of

education for openness and transparency of the uni-

versity.

2 RESEARCH OF THE

EXPERIENCE OF THE

ANALYSIS OF RESEARCH

ACTIVITY OF TEACHERS IN

THE EUROPEAN SPACE OF

HIGHER EDUCATION

Delgado L

opez-C

ozar et al. (Delgado L

opez-C

ozar

et al., 2019), Mart

ın-Mart

ın et al. (Mart

ın-Mart

ın

et al., 2018b), Bykov and Spirin (Bykov and Spirin,

2016), Bykov et al. (Bykov et al., 2020), Semerikov

et al. (Semerikov et al., 2018), Kuzminska et al.

(Kuzminska et al., 2022), Vakarenko (Vakarenko,

2018) studied the features of the analysis of research

results using open scientometric and bibliometric sys-

tems.

Theoretical bases of rating estimation of activity

of teachers of universities of Ukraine are described

in (Dzoba, 2019; Reheilo, 2020; Yaroshenko, 2020).

Reheilo (Reheilo, 2020) identiﬁed the basic concep-

tual principles of evaluating the effectiveness of re-

search activities of teachers, identiﬁed the principles,

structural components and indicators of evaluation of

research activities of teachers in the European Higher

Education Area. Yaroshenko (Yaroshenko, 2020) em-

phasized the need to modernize indicators of research

activities of teachers, in accordance with the mod-

ern realities of university education, summarized the

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System

237

Table 1: Comparative table of the weight of research indicators in the methodologies of the most authoritative ratings.

Rating name

The weight of

research indicators

Academic Ranking of World Universities 60%

QS Top University Ranking 20%

Webometrics 50%

Transparent ranking: Top Universities by Google Scholar Citations 100%

University rankings according to Scopus indicators 100%

Top-200 Ukraine 40%

Consolidated rating of higher education institutions of Ukraine 45%

Bibliometrics of Ukrainian science 100%

main characteristics of rating evaluation of teachers:

goals, objectives, functions, principles of ranking.

Kostenko et al. (Kostenko et al., 2019), Shynenko

et al. (Shynenko et al., 2021), Gasparyan et al. (Gas-

paryan et al., 2018) presented features of quality as-

sessment of research results.

Bykov et al. (Bykov et al., 2021), Tkachuk et al.

(Tkachuk et al., 2017), Morze et al. (Morze et al.,

2022a), Morze and Buinytska (Morze and Buinytska,

2017), Buinytska (Buinytska, 2021) considered the

evaluation of the results of research activities of teach-

ers to increase the competitiveness of the university in

general and the results of the participation of univer-

sities in international and Ukrainian rankings.

The use by scientists their proﬁles in Google

Scholar, ORCID, Mendeley, Academia, Research-

Gate increases the visibility of publications in the in-

formation space and has a positive effect on increas-

ing citation rates, as noted in (Hohunskyi et al., 2016).

Nazarovets (Nazarovets, 2019) investigated the

search engine and database of scientiﬁc citations,

which contains metadata of all publications that use

the Cited-by service from Crossref and support the

Initiative for Open Citations – Open Ukrainian Cita-

tion Index (OUCI), developed by the State Research

Technical Library of Ukraine (OUCI, 2021). The

OUCI database contains metadata of scientiﬁc pub-

lications that receive DOI from Crossref and takes

into account citations between scientiﬁc publications.

OUCI is designed to simplify the search and anal-

ysis of research results and expand the presentation

of information about Ukrainian scientiﬁc publications

in international search engines such as Dimensions,

Lens.org, 1ﬁndr, Scilit, etc. The implemented analyt-

ical tool allows to assess the state and dynamics of

development of scientiﬁc potential of scientiﬁc insti-

tutions and researchers in terms of ﬁelds of knowl-

edge, years, to select appropriate scientiﬁc journals

for publication.

In (Kostenko et al., 2019) the information-

analytical system “Bibliometrics of Ukrainian Sci-

ence”, developed by the Social communication re-

search center, which is a single register of biblio-

metric proﬁles of researchers and research teams in

the most authoritative scientometric databases Sco-

pus, Web of Science and Google Scholar system. The

system allows to analyze the domestic scientiﬁc po-

tential, to carry out a comparative analysis of the

effectiveness of research activities of Ukrainian sci-

entists in the ﬁelds of knowledge, cities, afﬁliation,

agencies, etc. by building rankings on the value of h-

index in Scopus, Web of Science or Google Scholar

(Bibliometrics, 2022). The presentation of a scientist

in the “Bibliometrics of Ukrainian Science” is a pass-

port of a scientist in the educational space, which re-

ﬂects his authority and inﬂuence on the development

of a particular scientiﬁc ﬁeld.

3 INTERNATIONAL AND

UKRAINIAN EXPERIENCE IN

PRESENTING THE RESULTS

OF TEACHERS’ RESEARCH

ACTIVITIES TO ENSURE THE

QUALITY OF EDUCATION AT

THE UNIVERSITY

During the digitalization of education, traditional

tools for managing and organizing the educational

process no longer meet the educational needs of dif-

ferent categories of participants – students, teachers,

administration, etc., so the quality of information and

educational environment of the university acquires

special importance (Buinytska, 2021), which will en-

sure transparency and openness of the organization of

the educational process, management, research, inter-

nationalization, etc. and will allow participants to ac-

cess it from anywhere and at a convenient time. One

of the components of such an informational and edu-

cational environment is the e-portfolio system, which

AET 2021 - Myroslav I. Zhaldak Symposium on Advances in Educational Technology

238

is used to analyze various aspects of teachers’ ac-

tivities: scientiﬁc, international, teaching activities

and professional development. Therefore, to ensure

monitoring of the level of teacher competence, trans-

parency and openness of data, the issue of implement-

ing open systems for research analysis is relevant for

the university, which will have a positive impact on

the presentation of professional results of university

teachers in ranking.

An analysis of the ofﬁcial websites of leading

Ukrainian and international universities on the format

of presenting the results of research activities of uni-

versity teachers in open access showed the lack of im-

plemented tools to ensure transparency, openness of

key indicators of research activities of teachers.

The National Technical University of Ukraine

“Igor Sikorsky Kyiv Polytechnic Institute” has imple-

mented the “Information System Intellect” (Intellect,

2023), which is designed to present the results of the

university scientists. The system contains personal

pages of scientiﬁc and pedagogical, research staff of

the university, graduate students, which contains a list

of their scientiﬁc publications, results of research and

development work, reports at scientiﬁc conferences,

seminars, including international, identiﬁers of sci-

entometric databases – Scopus Author ID, ORCID,

Google Scholar.

At the Taras Shevchenko National University of

Kyiv are formed rating tables of publication activity

of employees within the university and rating of pub-

lication activity of structural subdivisions. Summary

ranking tables within the general reports on scientiﬁc

work in the form of ﬁles are published on the ofﬁ-

cial website of the University (Research department

of KNU, 2023). The calculation of the rating takes

into account the number of monographs, textbooks,

scientiﬁc articles, citations and the number of articles

indexed by the scientometric database Scopus.

At the National Pedagogical Dragomanov Univer-

sity has been introduced a rating system for evaluating

the activities of research and teaching staff, but access

to it is limited (Rating system of NPDU, 2022).

Lviv Polytechnic National University has intro-

duced an e-portfolio of teachers based on wiki tech-

nologies (LPNU, 2023). In addition to personal in-

formation, pages of teacher’s present areas of study,

research interests, a list of selected publications, but

there are no links to open access publications and re-

searcher proﬁles and citation rates in scientometric

databases.

The personal pages of teachers of Kryvyi Rih

State Pedagogical University contain basic personal

information – position, degree, academic title, re-

search interests, etc., as well as links to the teacher’s

proﬁle in scientometric databases, published scientiﬁc

papers in the Institutional Repository. The university

also formed and published in the form of a ﬁle a rating

of scientiﬁc activities of departments on the main in-

dicators of scientiﬁc activity – the number of articles

in databases Scopus, Web of Science, Index Coperni-

cus, articles in professional journals, published mono-

graphs, defended dissertations, etc (KRSPU, 2023).

The website of the National Aviation Univer-

sity publishes ratings of teachers on the indicators

of scientometric databases Scopus, Web of Science,

Google Scholar, Russian Science Citation Index (Sci-

entiﬁc library of NAU, 2023). The ranking is based on

the value of the h-index, as well as the number of pub-

lications and citations in the relevant databases. Data

for the ranking are obtained from personal pages of

teachers, which contain links to the proﬁle of the sci-

entist in scientometric databases with citation rates –

number of publications, number of citations, h-index,

direction of scientiﬁc interests, English transcription

of the scientist’s name, links to published papers in

scientiﬁc journals, conference proceedings, publica-

tions placed in the institutional repository, etc.

On the ofﬁcial websites of leading foreign uni-

versities, employees’ pages are published in the form

of an e-portfolio with basic contact information and

performance indicators. No open ranking rating sys-

tems were identiﬁed during the study. For example,

on the websites of Harvard University, Stanford Uni-

versity, University of Washington, Massachusetts In-

stitute of Technology, published pages of employees

contain mostly general contact information, informa-

tion about education, work experience, research in-

terests, awards, list of selected publications and more

(Harvard, 2023; Stanford, 2023; Washington, 2023;

MIT, 2022).

The study (Spivakovsky et al., 2019) highlights

the experience of designing an information system for

the analysis of research activities of university teach-

ers, which is tested on the basis of Kherson State Uni-

versity and Kherson State Maritime Academy. The

system implements tools for building ratings of teach-

ers on the main indicators of scientiﬁc citation in

databases Scopus, Web of Science, Google Scholar,

Semantic Scholar, Tutor Network. Ratings are built

in terms of structural units, departments, scientiﬁc

journals on the maximum value of quoting proﬁles of

employees in the unit (Rating of KSU departments,

2023). Data for the ranking are obtained from per-

sonal pages of employees, which presents the main

citation indicators in scientometric databases – re-

searcher identiﬁers, citation indicators (number of

documents, citations, h-index), list of indexed pub-

lications, list of co-authors. The system allows to an-

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System

239

alyze the publishing activity of university scientists in

terms of years in a visualized form, to determine the

priority areas of research, to build a network of co-

authors.

Borys Grinchenko Kyiv University has imple-

mented an “E-portfolio” system, which reﬂects a

holistic picture of the teacher’s activities with cer-

tain quantitative and qualitative indicators. The sys-

tem allows not only to create an e-portfolio of the

teacher, but also to form rating tables of indicators of

evaluation of the main activities of each teacher and

structural units (Morze and Buinytska, 2017). Borys

Grinchenko Kyiv University has implemented Corpo-

rate Standards for Teachers, in particular the Corpo-

rate Standard of Research Activity and the Corporate

Standard for Digital Competence of Teachers, which

take into account and correlate indicators of teachers’

research results and corresponding indicators of digi-

tal competence levels of teachers. One of the indica-

tors of compliance of the teacher’s research activities

with the requirements of the Corporate Standard of

Research Activity of Borys Grinchenko Kyiv Univer-

sity (Corporate Standard of Research Activity, 2018)

is the indicator of scientiﬁc recognition, which is de-

termined by the values of citation indices in Scopus,

Web of Science, Google Scholar databases. The key

to the optimal presentation of the teacher’s research

activities in scientometric databases is a sufﬁcient

level of digital competence of the scientist (Bykov

et al., 2021), which is the ability to effectively use

open digital systems in their own research, create, up-

date, supplement articles proﬁles of scientists in sci-

entometric databases, disseminate research results in

scientiﬁc web communities and social networks (Cor-

porate Standard of Digital Competence, 2021).

Analysis of ofﬁcial university websites shows that

modern universities use a variety of technologies to

present the results of research activities of teachers,

including Wiki-technologies, published pages on of-

ﬁcial websites, developed information systems. The

main technologies used in the construction of ratings

of research activities of teachers are the publication

of rating tables in the form of ﬁles, the introduction

of information systems with tools for rating. The in-

troduction of information systems has a number of ad-

vantages, such as rapid data updates, the formation of

a single database of employees, automation of rank-

ing, reviewing the details of the indicators, the ability

to generate reports, present information in a conve-

nient visualized form.

Analysis of the experience in developing rating

systems for evaluating the research activities of teach-

ers determines the most common quantitative indi-

cators of evaluation of research activities: publica-

tions included in inﬂuential scientometric databases,

including Scopus and Web of Science; values of cita-

tion indices in scientometric databases – Scopus, Web

of Science, Google Scholar, etc. (Morze and Buinyt-

ska, 2017).

4 TOOLS FOR DETERMINING

THE PUBLICATION ACTIVITY

OF TEACHERS

The main indicators of assessing the publishing ac-

tivity of teachers are the number and quality of pub-

lished scientiﬁc works, namely the number of indi-

vidual and collective monographs, articles in publica-

tions included in scientometric databases Scopus and

Web of Science, articles in publications included in

other scientometric databases, articles in professional

scientiﬁc publications included in the approved list

of the Ministry of Education and Science of Ukraine,

citation indices in scientometric databases, the num-

ber of published publications on the results of sci-

entiﬁc conferences and seminars, including interna-

tional, etc.

The most common tools for assessing the pub-

lishing activity of teachers are the determination of

citation indices in scientometric databases. Scopus

and Web of Science databases allow scientometric

analysis of a scientist’s productivity by analyzing the

dynamics of the number of publications in inﬂuen-

tial international journals, the impact and demand

for scientiﬁc publications, analyzing the dynamics of

bibliographic references and citation indices by year

(Smirnova, 2020).

Scopus and Web of Science have powerful analyt-

ical tools SciVal and InCites, respectively. The tools

allow for a comprehensive analysis of the effective-

ness of research on a wide range of indicators: im-

pact, productivity, collaboration, open access, inﬂu-

ence of journals, etc. in a visual rendered form; iden-

tify promising areas of research, expand the range of

scientiﬁc collaboration and cooperation.

An alternative to commercial systems is the free

Google Scholar system, which indexes full-text sci-

entiﬁc publications from many disciplines in various

databases. The main advantage of Google Scholar is

its freeness and the fact that its index is not limited

to a list of journals, unlike commercial scientomet-

ric databases like Scopus, Web of Science, but more

broadly covers the web space, it indexes publications

on electronic journals, repositories, electronic confer-

ences, personal blogs of scientists, etc. For efﬁcient

indexing, web resources should be based on platforms

AET 2021 - Myroslav I. Zhaldak Symposium on Advances in Educational Technology

240

with special meta tags (EPrints, DSpace, Open Con-

ference System) (Luparenko, 2020), from which the

Google Scholar system receives basic meta data of the

publication or publication ﬁles designed according to

certain formatting requirements of document – design

of titles, personal data of the authors, the main content

of the article, the list of sources used, etc. (Bykov and

Spirin, 2016). The Google Scholar system allows a

researcher to create a personal proﬁle and add system-

indexed publications to it. The Google Scholar proﬁle

has a toolkit for analyzing citation statistics by year,

tracking total citations, h-index and i10 index, which

are calculated on the basis of the total number of pub-

lications and the number of citations by individual in-

dicators for the entire period of scientiﬁc work and

for the last 5 years in digital form and in the form of

a comparative histogram (Smirnova, 2020).

On the basis of scientometric indicators of teach-

ers in scientometric databases the proﬁle of the uni-

versity is formed, which reﬂects the main direction of

scientiﬁc research and the productivity of the research

component of the university in general. Figures 1-3

presents the proﬁles of Borys Grinchenko Kyiv Uni-

versity in open scientiﬁc systems and databases: Sco-

pus (ﬁgure 1), Open Ukrainian Citation Index (ﬁg-

ure 2), Google Scholar (ﬁgure 3).

The analysis of indicators conﬁrms that a set of in-

dicators of important scientometric databases should

be used for a full comprehensive assessment of the

effectiveness of research in various areas.

5 RESEARCH RESULTS

5.1 Model of Rating System of

Evaluation of Teachers’ Research

Activity

In building the model of the rating system for evaluat-

ing the research activities of the teacher used indica-

tors of key scientometric databases that demonstrate

the effectiveness of research activities of the teacher –

Scopus, Web of Science and Google Scholar, quanti-

tative indicators of evaluation and analysis using bib-

liographic citations. At the same time, it is impor-

tant for university professors to adhere to the Cor-

porate Standards of Scientiﬁc Activity and the Cor-

porate Standard of Digital Competence approved by

Grinchenko University, as the level of scientiﬁc and

digital competence directly affects the quality of re-

search and therefore the university’s international and

domestic rankings.

The following principles were guided in develop-

ing the methodology of the rating system for eval-

uating research activities of teachers: objectivity,

measurability and transparency, so the indicators of

citations of scientiﬁc publications in open proﬁles

of teachers in Scopus, Web of Science and Google

Scholar were chosen as indicators of research perfor-

mance of teachers easy to get and check – number of

bibliographic references, h-index and i10-index.

The main functions to be performed by the rating

system of analysis of the research component of the

university teachers are presented in table 2.

The implementation of certain functions is possi-

ble in the presence of such structural components of

the rating system for evaluating research activities as

the organizational component, the component of ob-

taining personal data of teachers, technological com-

ponent and performance component.

The organizational component provides for the

delimitation of access rights to the rating system –

administrator, teacher, guest. Administrator rights in-

clude starting the formation of the rating, marking in-

correctly ﬁlled proﬁles, exporting reports. Rating is

available only for viewing and analysis for teachers

and unauthorized users.

Component of obtaining personal data of teach-

ers. A personal page in the “E-portfolio” system is

automatically generated for each lecturer of the Bo-

rys Grinchenko Kyiv University. On the personal

page of the e-portfolio the teacher can independently

establish the afﬁliation to the structural unit, depart-

ment, indicate the degree, academic title, links to the

proﬁle of the scientist in Scopus, Web of Science,

Google Scholar and ORCID, as well as other per-

sonal data and links to pages in social networks Face-

book, LinkedIn and on the Wiki-portal of the univer-

sity. Data from the proﬁle of the e-portfolio of the

teacher on the afﬁliation to the structural unit, depart-

ment and indicators of scientiﬁc citation in Scopus,

Web of Science and Google Scholar are obtained dur-

ing the formation of the rating.

The technological component provides sciento-

metric indicators from Scopus databases, Web of Sci-

ence, Google Scholar system and personal data of

teachers. The structural model of the technological

component of the model of the rating system of anal-

ysis of research activities of teachers is presented in

ﬁgure 4. The E-portfolio system of Borys Grinchenko

Kyiv University automatically synchronizes the val-

ues of bibliographic references, h-index and i10-index

for the last 5 years from the bibliographic proﬁle of a

scientist in the Google Scholar system, a link to which

the teacher can add to his portfolio.

In addition, the “E-portfolio” system automati-

cally synchronizes scientometric indicators from the

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System

241

Figure 1: Proﬁle of Borys Grinchenko Kyiv University in the Scopus scientometric database.

Figure 2: Proﬁle of Borys Grinchenko Kyiv University in the Open Ukrainian Citation Index database.

teacher’s proﬁle in Scopus and Web of Science us-

ing API-interfaces. The main scientometric indica-

tors are automatically synchronized to the teacher’s

e-portfolio page – the number of publications indexed

by scientometric databases under the university afﬁl-

iation, the number of citations and the h-index. Data

are obtained from the Scopus Author Identiﬁer and

the Web of Science ResearcherID, which the teacher

can add to their own e-portfolio proﬁle. The proﬁle

values of scientometric indicators from Scopus, Web

of Science and Google Scholar databases are obtained

during the formation of the “Transparency Rating”,

which is one of the results of the designed model and

allows to assess the scientiﬁc achievements of a par-

ticular teacher and the university in general.

To reﬂect the importance of the teacher’s research

AET 2021 - Myroslav I. Zhaldak Symposium on Advances in Educational Technology

242

Figure 3: Proﬁle of Borys Grinchenko Kyiv University in the Google Scholar database.

Table 2: Functions of the rating system of analysis of the research component of the university teachers’ activity.

Function Description

Informational Formation of a single information base of research performance indicators of university

teachers for quality assessment

Visualization Presentation of information in a visualized form to improve perception, reporting

Motivational Creating an atmosphere of healthy competition, activating the scientiﬁc potential of the

university

Competence Encouraging teachers to create, update information in their own proﬁles in scientometric

databases

Analytical Analysis of the current state of the research component of the activities of departments,

chairs and the university in general, identiﬁcation of factors inﬂuencing the effectiveness

of research activities of teachers, identiﬁcation and analysis of relationships

Prognostice Forecasting of perspective trajectories of university development, development of system

measures for increase of indicators of efﬁciency of research activity of university teachers

Management Information basis for making management decisions

activity in a certain scientiﬁc ﬁeld, it is planned to ex-

pand the technological component of the rating with

a new indicator of the Web of Science system – Au-

thor Impact Beamplots. The indicator is a normalized

indicator of a scientist’s citation, reﬂects the effective-

ness of citing the publication and allows to provide a

qualitative assessment of the effectiveness of research

activities.

Effective component – on the basis of collected

data on the afﬁliation and scientometric indicators of

teachers are formed ranking tables of research perfor-

mance at the university in general and in terms of de-

partments and chairs, based on which the ability to

export reports.

Structurally functional model of the rating system

for the analysis of research activities of teachers is de-

scribed in detail in the study (Morze et al., 2022b) and

has the following view (ﬁgure 5).

5.2 Transparency Rating Methodology

and Design

Taking into account the model of the rating system

for the analysis of research activities of teachers, a

transparency rating has been designed, the indicators

of which are system performance indicators.

The rating system model was implemented as a

web-based client-server architecture. The PHP pro-

gramming language was used in the development of

the server software. The web interface is imple-

mented using HTML, CSS and JavaScript.

As a result of experimental implementation, a

Google Scholar citation rating was developed, which

ranks teachers according to their indicators of pub-

lishing activity (ﬁgure 6).

All teachers of the Borys Grinchenko Kyiv Uni-

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System

243

Figure 4: Technological component of the model of the rating system for evaluating the research activities of teachers.

versity take part in the “Transparency Rating of Struc-

tural Units”. In the ranking, the list of teachers is

ranked in descending order of the value of the total

number of bibliographic references according to the

Google Scholar system. The detailed table of research

indicators contains the values of the total number of

bibliographic references, h-index, i10-index and links

to the teacher’s proﬁle in Google Scholar. Also, the

page of the rating of teachers reﬂects the dynamics of

citation indicators compared to the previous issue of

the rating, which allows teachers to monitor and ana-

lyze the effectiveness of their own research activities.

The increase in the total number of citations of

both the h-index and the i10-index in the teacher’s

proﬁle may be due to the indexing by Google Scholar

of new publications by other authors that contain di-

rect citations of articles of the teacher; supplementing

Google Scholar’s teacher proﬁle with previously un-

stated publications that are already cited in research

by other Google Scholar-indexed researchers. On the

other hand, a decrease in citation rates may be due to

a change in the ﬁve-year citation period. When the

ﬁve-year citation period changes, the publication may

no longer be included in the calculation, which neg-

atively affects the total number of citations and the

value of the indexes. Another possible reason may be

the disappearance from the Google Scholar index or

open access to a publication that contains a citation of

the relevant article by the teacher.

Creating a database of scientiﬁc proﬁles of teach-

ers in Google Scholar allowed to implement the desig-

nation of incorrectly conﬁgured proﬁles in one place.

In addition, the presence of this database of sci-

entiﬁc proﬁles of teachers ensured the implementa-

tion of the formation of scientiﬁc proﬁles of structural

units with the deﬁnition of citations per teacher of the

unit (ﬁgure 7).

To design the rating of structural units and depart-

ments, the average citation rate per 1 teacher was de-

termined as the ratio of the sum of the total number

of citations to the number of full-time employees of

the structural unit. This approach reﬂects the con-

AET 2021 - Myroslav I. Zhaldak Symposium on Advances in Educational Technology

244

Figure 5: Structurally functional model of the rating system for the analysis of research activities of teachers (Morze et al.,

2022b).

tribution of each individual teacher in the scientiﬁc

achievement of the structural unit and the effective-

ness of the research team in general. In the case of the

same values, the units in the “Transparency Rating”

are ranked by the total number of citations, which is

deﬁned as the sum of the number of citations accord-

ing to Google Scholar for a ﬁve-year period of all staff

members of the structural unit.

The ranking of structural units and chairs in the

“Transparency Rating” is carried out in descending

order of the average citation rate per 1 teacher. In

the case of the same average citation rates, the struc-

tural units are ranked in descending order of the total

number of citations of teacher proﬁles. The choice of

the Google Scholar system is due to the fact that, un-

like the scientometric databases Scopus and Web of

Science, it has a wider coverage and includes pub-

lications from these databases and has a high level

of correlation in citation values with Scopus, Web of

Science, which is conﬁrmed by the results research

(Mart

ın-Mart

ın et al., 2018a,b) and provides a greater

presence of teachers in the ranking.

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System

245

Figure 6: Ranking of teachers by citation indicators in Google Scholar.

Figure 7: Transparency Rating of Structural Units according to citations in Google Scholar.

To analyze the effectiveness of research activities

of the unit on the page of the rating of units and chairs

realized the dynamics of citation rates per 1 teacher

and the total number of citations compared to the pre-

vious issue of the rating. Increasing the value of ci-

tations per 1 teacher in the rating of the chair or de-

partment can occur both by increasing the number of

citations of teachers and by increasing the proportion

of highly cited employees in the structural unit.

Visibility and transparency indicators of the uni-

versity are inﬂuenced not only by the activities of

teachers, but also by chairs in general, including

the dissemination of information on social networks

about the main activities, announcements of scientiﬁc

events, videos, research results and more.

Monitoring of key indicators of research activities

of structural subdivisions of the Borys Grinchenko

Kyiv University is carried out monthly due to the de-

veloped internal rating of structural units, the method-

ology of which is based on the indicators of the inter-

national Webometrics rating. Analyzing the internal

rating for research activities, attention is paid to the

Quality indicator, namely, the rate of uploading sci-

entiﬁc papers to the Institutional Repository, citation

rates according to Google Scholar (ﬁgure 8).

To monitor the representation of chairs in the In-

ternet space at the Borys Grinchenko Kyiv University,

the frequency of updating the ofﬁcial pages of depart-

ments in social networks and Google Scholar is peri-

odically analyzed, the results of which are reﬂected in

a specially developed information resource (ﬁgure 9).

The resource contains a database of ofﬁcial pages of

the chairs on social networks Facebook, YouTube and

proﬁles in the Google Scholar system, for which the

period of the last update of the proﬁle is marked with

special marks, such as week, month, three months,

etc.

Periodic monitoring of the period of updating the

pages of chairs on the Internet is a motivating factor

for updating, ﬁlling pages on social networks, dissem-

inating information about current research activities,

research results, updating proﬁles of chairs in Google

Scholar, thus increasing visibility, openness and dis-

semination information about the scientiﬁc activity of

the departments and the university in general.

To further analyze the ranking positions and indi-

cators of research activities of teachers, build visual-

ized reports on the effectiveness of research activities,

AET 2021 - Myroslav I. Zhaldak Symposium on Advances in Educational Technology

246

Figure 8: Internal rating of structural subdivisions of Borys Grinchenko Kyiv University.

Figure 9: Representation of University Chairs in the Internet space.

it is planned to implement 2 stages of research – ex-

panding the “Transparency Rating” for other indica-

tors presented in the model – the number of publica-

tions in databases Scopus and Web of Science with

university afﬁliation, establishing relationships to in-

crease the publishing activity of teachers.

5.3 Inﬂuence of Rating Indicators on

the Improvement of Research

Activities at the University

The research took place in several stages: preparatory,

design, experimental (implementation).

At the preparatory level the theoretical bases of

rating estimation of research activity of research and

pedagogical workers were investigated. At the design

stage, a structural-functional model of the rating sys-

tem for evaluating teachers’ research activities was

designed, a “Google Scholar Citation Transparency

Rating of Structural Units” was developed, and an ex-

perimental rating was built. For two months, the ad-

ministration and faculty of the university had the op-

portunity to review and analyze the data of the exper-

imental rating, after which the ﬁrst issue of the rating

was built in June 2021. The second issue of the rating

was built in January 2022.

The analysis of the experimental, ﬁrst issue and

second issues of the rating, built with an interval of

2 and 6 months, respectively, conﬁrmed the positive

dynamics of research performance (ﬁgure 10).

There is an increase in the total number of cita-

tions and the value of citations per 1 research and

teaching staff for all units. The largest increase in ci-

tations is the Institute of Philology, which increased

the total number of citations by 2648 (+117%) and

citations per teacher increased by 15,01 (+109%)

and the Institute of Human, whose total citations in-

creased by 2948 (+79%) and citations per 1 teacher

increased by 69,19 (+108%), which indicates the ac-

tive work of teachers in these departments to update

and supplement their research proﬁles in the Google

Scholar system.

A negative factor in evaluating the results of re-

search of university teachers is the possible cases

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System

247

Figure 10: Diagram of citations of the experimental, ﬁrst issue and second issues of the rating.

of intentional inﬂuence on citation rates to increase

them, in particular by violating the principles of aca-

demic integrity, increasing the percentage of self-

citation, etc. (Recommendations NAQA, 2022). In

order to reduce the possibility of intentional inﬂuence

on increasing citation rates, the rating system uses a

set of indicators of various scientometric databases,

including important international databases Scopus

and Web of Science, which make high demands on

the quality of scientiﬁc publications in the included

publications, which reﬂects the quality and demand

for research results on the accumulation of the num-

ber and volume of publications and citations.

Having a system and rating is an incentive for

teachers to update their e-portfolio proﬁles, create

proﬁles in scientometric databases, in the absence,

update information in proﬁles, including Google

Scholar, supplement indexed publications, dissemi-

nate research results, discuss them in the interna-

tional networked scientiﬁc community, thus develop-

ing skills in the use of digital technologies in the or-

ganization of research and dissemination of research

results.

The active work of university teachers on updat-

ing their own proﬁles in the Google Scholar system

and the positive impact of the rating system of anal-

ysis of research activities of university teachers on

visibility, transparency is also conﬁrmed by the dy-

namics of Grinchenko University in the international

ranking “Transparent Ranking: Top Universities by

Google Scholar Citations” during 2020-2022 years.

The rating methodology is based on the importance of

citing proﬁles of university employees in the Google

Scholar system.

Analyzing the indicators of the university in the

ranking of 2022, we note that the value of the to-

tal number of citations of employee proﬁles in the

Google Scholar system increased by 10921, which

is almost 4 times more than the increase in citations

from the previous year (+2735). However, the overall

position of the university in the ranking of Ukrainian

universities decreased by 4 positions, as other univer-

sities are also actively working to increase the open-

ness and transparency of research results (ﬁgure 11).

Figure 11: Dynamics of university indicators in the rating

“Transparent Ranking: Top Universities by Google Scholar

Citations” for the period 2020 – 2022.

According to the results of the study, it was de-

termined that the optimal presentation of the results

AET 2021 - Myroslav I. Zhaldak Symposium on Advances in Educational Technology

248

of research activities of teachers in the ranking con-

tributes to (Smirnova, 2021):

• implementation of measures to ensure open ac-

cess, transparency, openness of research results;

• use of open journal systems when publishing re-

search results (Open Journal Systems, Open Con-

ference System, DPubS, OpenACS, etc.) (Lu-

parenko, 2020);

• giving preference to publications that give articles

a unique DOI that simpliﬁes publication identiﬁ-

cation and provides a permanent link to the pub-

lication, regardless of the change in the publica-

tion’s web address;

• use of the international identiﬁer of the ORCID

scientist to correctly determine the afﬁliation of

the article to the author’s proﬁle. ORCID In-

ternational Scientist Identiﬁer is designed to un-

ambiguously identify the author of an article,

which is especially relevant in the case of differ-

ent spellings of the name of the scientist, scientists

with the same names and surnames, etc.;

• placement of publications in open institutional

repositories, electronic libraries to increase the

visibility of scientiﬁc achievements in the net-

work;

• systematic updating of scientist proﬁles in scien-

tometric databases to increase visibility and up-

date citation indexes such as Google Scholar, Re-

searchGate, Mendeley, etc.;

• placement of researcher IDs and proﬁle links in

scientometric and bibliometric databases on the e-

portfolio page (Scopus Author ID, Researcher ID,

Google Scholar, ResearchGate, etc.);

• implementation of measures to disseminate re-

search results to increase visibility and presence

in the international scientiﬁc community.

Currently, work is underway to reﬁne and expand

the rating on other indicators Scopus, Web of Science,

presented in the model to obtain a full-ﬂedged rating

system; systems of analytics and statistics with the

formation of dynamic visualization of the effective-

ness of the scientiﬁc potential of the university.

6 CONCLUSIONS

One of the tools for measuring the competitiveness

of universities is participation in international and do-

mestic educational rankings. Full and objective as-

sessment in the most authoritative international and

Ukrainian rankings is provided by a set of indicators

covering various areas of university activities, includ-

ing research. To monitor the university’s indicators

in the rankings, it is important to implement internal

university rankings, the methodologies of which are

based on key performance indicators that are taken

into account in international and Ukrainian educa-

tional rankings. One of the key indicators of educa-

tional ratings are indicators of research activities of

university teachers, so for the implementation of sys-

tematic monitoring of openness, transparency of the

effectiveness of research activities of teachers is an

effective tool to develop and implement a rating sys-

tem for research analysis. Ensuring transparent eval-

uation of teachers’ professional activities, increasing

openness, transparency of university activities, open

access to results, professional and scientiﬁc achieve-

ments of teachers are fundamental components of the

internal quality assurance system of education. Also,

the placement of open identiﬁers of scientists in sci-

entometric databases, research results, contact data of

the scientist promotes the dissemination of knowledge

in the scientiﬁc information space and allows to ex-

pand the possibilities of scientiﬁc cooperation.

The rating system for research analysis is based

on the indicators of the three most important sciento-

metric databases – Scopus, Web of Science, Google

Scholar and provides the main functions – informa-

tional, visualization, motivational, competence, ana-

lytical, prognostic and management. The rating sys-

tem is implemented as a web-oriented client-server

architecture. One of the components implemented in

the system at the 1st stage of the study is the “Google

Scholar Transparent Rating”. Based on the results

of the research were developed recommendations for

improving the quality of teachers’ research activities.

The formation of the rating conﬁrmed the importance

of designing a system of research analysis that im-

proves the quality of research, dissemination of re-

search results in the international educational space,

analysis of teachers’ own development, monitoring

the scientiﬁc growth of university faculty and obtain-

ing visualized analytics in real time. Prospects for

further research are seen in supplementing the rank-

ing with other indicators of research, implementing

real-time rating system updates, integration of mod-

ern business intelligence systems to build visualized

statistics to analyze the effectiveness of the research

component of the university.

Systematic implementation of measures to ensure

open access to own research results, increase visibil-

ity, transparency and dissemination of research results

on the Internet contributes to the optimal representa-

tion of the scientist in the rating of the research com-

ponent of professional activities of university teach-

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System

249

ers, improving professional competence of teachers

and positively inﬂuences on the indicators of the qual-

ity of research work of higher education institutions in

domestic and international rankings.

REFERENCES

Bibliometrics (2022). Bibliometryka ukrainskoi nauky

[Bibliometrics of Ukrainian Science]. http://nbuviap.

gov.ua/bpnu/.

Buinytska, O. (2021). Systema pedahohichnoho proiek-

tuvannia informatsiino-osvitnoho seredovyshcha dlia

zdiisnennia pidhotovky maibutnikh sotsialnykh peda-

hohiv [The system of pedagogical design of infor-

mation and educational environment for the training

of future social educators]. Instytut informatsiinykh

tekhnolohii i zasobiv navchannia NAPN Ukrainy,

Kyiv. https://elibrary.kubg.edu.ua/id/eprint/40182/.

Buinytska, O., Hrytseliak, B., and Smirnova, V. (2018).

Rating as assessment tool of quality and competitive-

ness of university. Open educational e-environment

of modern University, 4:16–32. https://doi.org/10.

28925/2414-0325.2018.1632.

Bykov, V. and Spirin, O. (2016). Informatsiino-analitychna

pidtrymka naukovo-pedahohichnykh doslidzhen na

osnovi elektronnykh bibliometrychnykh system [In-

formation and analytical support of scientiﬁc and

pedagogical research based on electronic bibliomet-

ric systems]. In Zvitna naukov-praktychna konfer-

entsiia Instytutu informatsiinykh tekhnolohii i zasobiv

navchannia NAPN Ukrainy Instytut informatsiinykh

tekhnolohii i zasobiv navchannia NAPN Ukrainy,

pages 1–3. https://lib.iitta.gov.ua/106914/.

Bykov, V., Spirin, O., Biloshchytskyi, A., Kuchansky, O.,

Dikhtiarenko, O., and Novytskyi, O. (2020). Vidkryti

tsyfrovi systemy v otsiniuvanni rezultativ naukovo-

pedahohichnykh doslidzhen [Open digital systems for

assessment of pedagogical research results]. Informa-

tion Technologies and Learning Tools, 75(1):294–315.

https://doi.org/10.33407/itlt.v75i1.3589.

Bykov, V. Y., Spirin, O. M., Ivanova, S. M., Vakaliuk, T. A.,

Mintii, I. S., and Kilchenko, A. V. (2021). Sciento-

metric indicators for evaluating the effectiveness of

pedagogical research of scientiﬁc institutions and ed-

ucational institutions. Information Technologies and

Learning Tools, 86(6):289–312. https://doi.org/10.

33407/itlt.v86i6.4656.

Corporate Standard of Digital Competence (2021).

Korporatyvnyi standart tsyfrovoi kompetentnosti

vykladachiv Universytetu Grinchenka [Corpo-

rate Standard of Digital Competence of Teach-

ers of Borys Grinchenko Kyiv University].

https://kubg.edu.ua/images/stories/Departaments/

vdd/nakaz 421 11.06.21.pdf.

Corporate Standard of Research Activity (2018). Ko-

rporatyvnyi standart naukovoi diialnosti spivro-

bitnykiv universytetu [Corporate Standard of

Research Activity of the staff of University].

https://kubg.edu.ua/images/stories/Departaments/

vdd/documenty/rozdil 8/nakaz 212 02.04.2018.pdf.

Delgado L

opez-C

ozar, E., Ordu

na-Malea, E., and Mart

ın-

Mart

ın, A. (2019). Google Scholar as a Data Source

for Research Assessment, pages 95–127. Springer

International Publishing, Cham. https://doi.org/10.

1007/978-3-030-02511-3 4.

Dzoba, O. H. (2019). Teoretyko-metodychni aspekty

reitynhovoho otsiniuvannia naukovo-pedahohichnykh

pratsivnykiv: rynkovyi pidkhid [Rating assessment

of scientiﬁc and pedagogical workers: theoreti-

cal and methodical aspects within a market ap-

proach]. Naukovyi visnyk Ivano-Frankivskoho nat-

sionalnoho tekhnichnoho universytetu nafty i hazu

(seriia “Ekonomika ta upravlinnia v naftovii i ha-

zovii promyslovosti”), 1(19):84–95. 10.31471/

2409-0948-2019-1(19)-84-95.

ENQA (2015). Standards and Guidelines for Quality Assur-

ance in the European Higher Education Area (ESG).

https://www.britishcouncil.org.ua/sites/default/ﬁles/

standards-and-guidelines for qa in the ehea 2015.

pdf.

Gasparyan, A. Y., Yessirkepov, M., Duisenova, A.,

Trukhachev, V. I., Kostyukova, E. I., and Kitas, G. D.

(2018). Researcher and Author Impact Metrics: Va-

riety, Value, and Context. Journal of Korean Med-

ical Science, 33. https://doi.org/10.3346/jkms.2018.

33.e139.

Harvard (2023). Harvard University. https://harvard.edu/.

Hohunskyi, V. D., Yakovenko, V. O., Liashchenko, T. O.,

and Otradska, T. V. (2016). Zahalni mekha-

nizmy formuvannia systemy tsytuvannia naukovykh

statei [General mechanisms of citation system of

scientiﬁc articles]. Visnyk NTU “KhPI”. Seriia:

Strateh. upr., upr. portfeliamy, prohramamy ta proek-

tamy, 1173:14–18. http://dspace.opu.ua/jspui/handle/

123456789/1774.

Intellect (2023). Intellect — National Technical Univer-

sity of Ukraine “Igor Sikorsky Kyiv Polytechnic In-

stitute”. https://intellect.kpi.ua.

Kostenko, L., Symonenko, T., and Zhabin, O. (2019).

Proekt “Bibliometryka ukrainskoi nauky”: ideia, real-

izatsiia, zadumy [Project “Bibliometrics of Ukrainian

Science”: Idea, Realization, Plans]. Visnyk knyzhkovoi

palaty, 5:30–33. http://nbuv.gov.ua/UJRN/vkp 2019

5 10.

KRSPU (2023). Kryvorizkyi derzhavnyi pedahohichnyi

universytet [Kryvyi Rih State Pedagogical Univer-

sity]. https://kdpu.edu.ua/.

Kuzminska, O., Morze, N., and Smyrnova-Trybulska, E.

(2022). Artiﬁcial Intelligence in Education: A Study

on Using Bibliometric Systems. In The 14th Inter-

national Scientiﬁc Conference on Distance Learning

in Applied Informatics, volume 4631, pages 393–403.

https://www.divai.sk/assets/divai2022.pdf.

LPNU (2023). Natsionalnyi Universytet ”Lvivska Po-

litekhnika” [Lviv Polytechnic National University].

http://wiki.lp.edu.ua/.

Luparenko, L. (2020). The Use of Electronic Open Journal

Systems in Scientiﬁc and Pedagogic Research: Re-

sults of Experiment. In Sokolov, O., Zholtkevych, G.,

AET 2021 - Myroslav I. Zhaldak Symposium on Advances in Educational Technology

250

Yakovyna, V., Tarasich, Y., Kharchenko, V., Kobets,

V., Burov, O., Semerikov, S., and Kravtsov, H., edi-

tors, Proceedings of the 16th International Conference

on ICT in Education, Research and Industrial Appli-

cations. Integration, Harmonization and Knowledge

Transfer. Volume II: Workshops, Kharkiv, Ukraine,

October 06-10, 2020, volume 2732 of CEUR Work-

shop Proceedings, pages 1113–1128. CEUR-WS.org.

http://ceur-ws.org/Vol-2732/20201113.pdf.

Mart

ın-Mart

ın, A., Orduna-Malea, E., and Delgado L

opez-

ozar, E. (2018a). Coverage of highly-cited doc-

uments in Google Scholar, Web of Science, and

Scopus: a multidisciplinary comparison. Sciento-

metrics, 116(3):2175–2188. https://doi.org/10.1007/

s11192-018-2820-9.

Mart

ın-Mart

ın, A., Orduna-Malea, E., Thelwall, M., and

Delgado L

opez-C

ozar, E. (2018b). Google Scholar,

Web of Science, and Scopus: A systematic compar-

ison of citations in 252 subject categories. Journal

of Informetrics, 12(4):1160–1177. https://doi.org/10.

1016/j.joi.2018.09.002.

MIT (2022). Massachusetts Institute of Technology. https:

//mit.edu/.

Morze, N. and Buinytska, O. (2017). Systema re-

itynhovykh pokaznykiv otsiniuvannia diialnosti vyk-

ladachiv suchasnykh universytetiv [Rating indicators

system of evaluation teacher’s activities in mod-

ern universities]. Naukovyi chasopys Natsional-

noho pedahohichnoho universytetu imeni M. P. Dra-

homanova. Seriia 02: Kompiuterno-oriientovani sys-

temy navchannia, 26(19):34–44. http://enpuir.npu.

edu.ua/handle/123456789/19082.

Morze, N., Buinytska, O., Varchenko-Trotsenko, L.,

Vasylenko, S., Nastas, D., Tiutiunnyk, A., and

Lytvynova, S. (2022a). System for digital profes-

sional development of university teachers. Educa-

tional Technology Quarterly, 2022(2):152–168. https:

//doi.org/10.55056/etq.6.

Morze, N. V., Buinytska, O. P., and Smirnova, V. A.

(2022b). Designing a rating system based on com-

petencies for the analysis of the university teach-

ers’ research activities. CTE Workshop Proceedings,

9:139–153. https://doi.org/10.55056/cte.109.

Nazarovets, S. (2019). Proekt Open Ukrainian Citation In-

dex (OUCI): ideia, pryntsyp roboty ta perspektyvy

rozvytku [Open Ukrainian Citation Index (OUCI)

project: idea, working principle and development

prospects]. Intelektualna vlasnist v Ukraini, 3:10–13.

http://eprints.rclis.org/34365/.

OUCI (2021). Open Ukrainian Citation Index. https://ouci.

dntb.gov.ua/.

Rating of KSU departments (2023). Reitynh kafedr.

Khersonskyi derzhavnyi universytet [Rating of de-

partments of Kherson State University]. http://

publication.kspu.edu/rating/departments/.

Rating system of NPDU (2022). Reitynhova systema Nat-

sionalnoho pedahohichnoho universytetu imeni M.P.

Drahomanova [Rating System of National Pedagog-

ical Dragomanov University]. https://npu.edu.ua/

resursy/reitynhy/vykladachi/reitynhova-systema-2.

Recommendations NAQA (2022). Rekomendatsii dlia

ekspertiv iz rozghliadu vnutrishnoi polityky i protse-

dur zabezpechennia akademichnoi dobrochesnosti ta

zovnishnoi otsinky yikh yakosti [Recommendations

for experts to review internal policies and procedures

for ensuring academic integrity and external evalua-

tion of their quality]. https://cutt.ly/7KOJR7L.

Reheilo, I. (2020). Teoretychni osnovy otsiniuvannia ta

rozvytku naukovo-pedahohichnykh pratsivnykiv uni-

versytetiv u konteksti realizatsii naukovoi diialnosti

[Theoretical bases of estimation and development

of scientiﬁc and pedagogical workers of universi-

ties in the context of realization of scientiﬁc ac-

tivity]. In Skyba, Y., editor, Teoretychni osnovy

rozvytku naukovo-pedahohichnoho potentsialu uni-

versytetiv Ukrainy u konteksti rozshyrennia insty-

tutsiinoi avtonomii: preprynt (analitychni materi-

aly) (I chastyna), pages 72—-103. Instytut vyshchoi

osvity NAPN Ukrainy, Kyiv. https://doi.org/10.31874/

978-617-7486-40-3-2020.

Research department of KNU (2023). Naukovo-

doslidna chastyna Kyivskoho Natsionalnoho Univer-

sytetu imeni Tarasa Shevchenka [Research depart-

ment of Taras Shevchenko National University of

Kyiv]. https://science.knu.ua/.

Scientiﬁc library of NAU (2023). Naukovo-tekhnichna

bibiloteka Natsionalnoho Aviatsiinoho Universytetu

[Scientiﬁc and technical library of the National Avia-

tion University]. http://www.lib.nau.edu.ua/profesors/

default.aspx.

Semerikov, S. O., Pototskyi, V. S., Slovak, K. I.,

Hryshchenko, S. M., and Kiv, A. E. (2018). Au-

tomation of the Export Data from Open Journal Sys-

tems to the Russian Science Citation Index. In Kiv,

A. E. and Soloviev, V. N., editors, Proceedings of

the 1st International Workshop on Augmented Real-

ity in Education, Kryvyi Rih, Ukraine, October 2,

2018, volume 2257 of CEUR Workshop Proceedings,

pages 215–226. CEUR-WS.org. http://ceur-ws.org/

Vol-2257/paper21.pdf.

Shynenko, M. A., Kilchenko, A. V., and Tukalo,

S. M. (2021). Zastosuvannia naukometrych-

nykh pokaznykiv dlia otsiniuvannia rezultatyvnosti

naukovo-pedahohichnykh doslidzhen [Application of

Scientiﬁc Metric Indicators to Evaluate the Perfor-

mance of Scientiﬁc and Pedagogical Research]. In

Zvitna naukovo-praktychna konferentsiia Instytutu in-

formatsiinykh tekhnolohii i zasobiv navchannia NAPN

Ukrainy, prysviachena 20-richchiu Instytutu Insty-

tut informatsiinykh tekhnolohii i zasobiv navchannia

NAPN Ukrainy, pages 89–93, Kyiv, Ukraine. https:

//lib.iitta.gov.ua/724336/.

Smirnova, V. (2020). Doslidzhennia vidkrytykh tsyfrovykh

informatsiinykh system dlia analizu rezultativ doslid-

nytskoi diialnosti naukovo-pedahohichnykh prat-

sivnykiv zakladiv vyshchoi osvity [Research on open

digital information systems for analysis of research

activity results of higher education institutions aca-

demic staff]. Open educational e-environment of mod-

ern university, 9:134–144. https://doi.org/10.28925/

2414-0325.2020.9.11.

Analysis of Research Activities of University Teachers as Part of the Education Quality Assurance System

251

Smirnova, V. (2021). Otsiniuvannia doslidnytskoi diial-

nosti naukovo-pedahohichnykh pratsivnykiv zakladu

vyshchoi osvity yak skladova systemy zabezpechen-

nia yakosti osvity [Evaluation of research activi-

ties of higher education institutions academic staff

as part of the system of education quality assur-

ance]. Open educational e-environment of mod-

ern university, 11:146–157. https://doi.org/10.28925/

2414-0325.2021.1113.

Spivakovsky, A., Vinnik, M., Poltoratskiy, M., Tarasich,

Y., Spivakovska, Y., Gardner, G., and Panova, K.

(2019). Information System of Scientiﬁc Activity

Indicators of Scientiﬁc Organizations: Development

Status and Prospects. In Ermolayev, V., Mallet, F.,

Yakovyna, V., Kharchenko, V. S., Kobets, V., Ko-

rnilowicz, A., Kravtsov, H., Nikitchenko, M. S., Se-

merikov, S., and Spivakovsky, A., editors, Proceed-

ings of the 15th International Conference on ICT in

Education, Research and Industrial Applications. In-

tegration, Harmonization and Knowledge Transfer.

Volume II: Workshops, Kherson, Ukraine, June 12-

15, 2019, volume 2393 of CEUR Workshop Proceed-

ings, pages 220–228. CEUR-WS.org. http://ceur-ws.

org/Vol-2393/paper 260.pdf.

Stanford (2023). Stanford University. https://stanford.edu/.

Tkachuk, V. V., Semerikov, S. O., and Yechkalo, Y. V.

(2017). Reitynh suchasnoho naukovtsia yak sklad-

nyk reitynhu universytetu [Rating of a Modern Sci-

entist as a Component of the University Rating]. In

Materialy Mizhnarodnoi naukovo-tekhnichnoi konfer-

entsii “Rozvytok promyslovosti ta suspilstva”, page

405. https://doi.org/10.31812/0564/723.

Vakarenko, O. (2018). Naukometrychni bazy danykh:

vid systemy otrymannia informatsii do instrumentu

otsiniuvannia naukovykh doslidzhen [Scientometric

databases: from system of obtaining information to

instrument for evaluating scientiﬁc research]. Nauka

Ukrainy v svitovomu informatsiinomu prostori, 15:9–

15. https://doi.org/10.15407/akademperiodyka.372.

009.

Washington (2023). University of Washington. https://uw.

edu/.

WHEC (2022). Call for transformation runs through UN-

ESCO World Higher Education Conference. https:

//cutt.ly/nXpmAV6.

Yaroshenko, O. (2020). Teoretychni osnovy reitynhuvan-

nia yak instrumentu otsiniuvannia diialnosti naukovo-

pedahohichnykh pratsivnykiv universytetiv ukrainy

[Theoretical Bases of Rating as a Tool for Evaluat-

ing the Activities of Scientiﬁc and Pedagogical Staff

of Ukrainian Universities]. In Skyba, Y., editor, Teore-

tychni osnovy rozvytku naukovo-pedahohichnoho po-

tentsialu universytetiv Ukrainy u konteksti rozshyren-

nia instytutsiinoi avtonomii: preprynt (analitychni

materialy) (I chastyna), pages 57—-71. Instytut vysh-

choi osvity NAPN Ukrainy, Kyiv. https://doi.org/10.

31874/978-617-7486-40-3-2020.

AET 2021 - Myroslav I. Zhaldak Symposium on Advances in Educational Technology

252