Evaluation of Scientific Research Work
The evaluation of scientific research work in accordance with the principles of open science encourages qualitative evaluation of research work, which is based on the evaluation of the quality of the content. There is still a large focus on quantitative evaluation based on the impact factor of serial publications (JCR – Journal Citation Reports or SNIP – Source Normalized Impact per Paper) and the number of published articles, which is encouraging the hyperproduction of articles.
The evaluation and assessment of researchers, research organisations, research programs and projects in accordance with the principles of open science is determined in the Decree on the Implementation of Scientific Research in Accordance with the Principles of Open Science with Article10 and Article 11. The decree determines the evaluation based on the substantive achievements of the scientific research work and not the place of publication or its impact factor (or other journal metrics) or the publisher. It also provides for the evaluation of open research results, the data of which comply with the FAIR principles and are equipped with persistent identifiers of digital and non-digital objects (PID), when available.
Action plan for Open Science for the implementation of Objective 6.2: Open Science to improve the research quality, efficiency, and responsiveness of the Resolution on the Slovenian Scientific Research and Innovation Strategy 2030 includes a measure M6.2.2 Evaluation of scientific research activities in accordance with the principles of Open Science in the framework of which they are planned:
- changes and amendments to ARIS (Slovenian Research and Innovation Agency) regulations;
- changes and amendments to NAKVIS (Slovenian Quality Assurance Agency for Higher Education) regulations;
- changes and amendments to the regulations/criteria of JROs
- (public research organisations);
- incentives for engagement in Open Science and
- engagement in ERA (European Research Area) and EHEA (European Higher Education Area) activities, related to the reform of research assessment in accordance with the principles of Open Science.
The introduction of modern approaches to the evaluation of scientific research activity in accordance with the principles of Open Science in Slovenia is inspired by other international initiatives to change the evaluation of research activity, such as:
- DORA (San Francisco Declaration on Research Assessment) advocates the qualitative evaluation of research and moves away from quantitative methods of research assessment;
- Leiden Manifesto for Research Metrics proposes 10 principles for measurement of research performance, which also promotes evaluation based on substantive assessment and research quality;
- ERA guidelines (European Research Area and Innovation Committee).
Other initiatives to increase the quality and impact of research in the evaluation of scientific research work:
- CoARA (Coalition for Advancing Research Assessment) encourages changes in the evaluation of research, the evaluation of which is based on a qualitative evaluation;
- Hong Kong Principles for Assessing Researchers: Fostering Research Integrity consist of 5 principles that promote research integrity in the system of evaluating, evaluating and rewarding researchers;
- Agreement on Reforming Research Assessment was prepared in 2022 with the support of the European Commission by European University Association (EUA), Science Europe, the European Commission, and Dr Karen Stroobants. Their main goal are changes in the field of evaluation of scientific research work, which would improve the quality and impact of research.
Subpage Open Science at UP UK is funded by the Government of the Republic of Slovenia, Ministry of Higher Education, Science and Innovation within the framework of the Action Plan for the Open Science (Objective 6.2 ReZrIS30).