Conference Agenda

To read the abstracts of submissions, click on the title of the session at the top of the cell, not on the title of the submission.  

 
 
Session Overview
Session
1.1: Oral Presentations - Resources and Metrics (1)
Time:
Wednesday, 01/June/2022:
10:45am - 12:00pm

Session Chair: Robin Filippus Ottjes
Location: Willem Burgerzaal


Show help for 'Increase or decrease the abstract text size'
Presentations
10:45am - 11:00am
ID: 128 / 1.1: 1
Oral Presentation
Topics: Resources and metrics

Maximise the research impact of your institution: a use case of Ghent University Hospital

Greet Wieme1, Muguet Koobasi1, Ann De Meulemeester1, Anniek Toye2, Renaat R. Peleman1, Nele S. Pauwels1

1Knowledge Centre for Health Ghent, Ghent University, Ghent University Hospital, Ghent, Belgium; 2Ghent University, Ghent, Belgium

Aim: Healthcare professionals and hospital policy makers are providing the best possible care on a daily basis, ensuring sustainable hospital performance and effectively managing costs. Next to healthcare analytics, key performance indicators reflecting the scientific output and impact are crucial for academic hospitals. Research metrics - traditional and next-generation - drive policy decisions and allocation of funds.

Methods: A bibliometric analysis of the impact and output of Ghent University Hospital was performed using InCites and Altmetric Explorer. The analysis was performed for the hospital and for each of the approximately 60 medical departments. The results of these analyses were presented to various policy-making bodies of the hospital and Ghent University that is the hospitals’ parent organisation. To optimise our analysis, we formulated actions on the level of the analysis tool and actions towards researchers.

Results: Thanks to the recruitment of a new member on our team, an awareness campaign for our researchers was rolled out. As a result of information sessions, workshops, an infographic, an interactive Power BI presentation and personal assistance, we made our researchers aware of how to correctly affiliate to our hospital and to create, use and update their ORCID iDs. Additionally, medical departments were encouraged to standardise their affiliation to their department. We started to contact Ghent University Hospital employees with an ORCID iD to connect their ORCID iD to their Ghent University profile. Over a 7 week period, we had a success rate of 44% (38/86), but this is continuously evolving.

Furthermore, we analysed articles published by our researchers that were not automatically linked to our hospital in Web of Science. We identified synonyms and variants that were used for our institution. By adding these synonyms and variants in Web of Science, more than 2000 publications (>600 publications in 2016-2020) were additionally assigned to our institution. This resulted in an increase of 8% of publications correctly linked with Ghent University Hospital and in an important gain of analytical information in InCites.

Conclusion: Generally speaking for researchers, the availability of metrics depends on their research output being available online. Research that is openly available, will be accessible to more people and will, therefore, have a greater impact. Recently, xxxx initiated a project to increase the visibility of research being conducted at Ghent University Hospital, which is the cornerstone of research metrics. Thanks to our two-sided approach – on the level of the researcher and the analysis tool – analyses conducted for our institution are more accurate and will be increasingly more accurate in the future. Research performed at Ghent University (Hospital) will thus become more visible to the public and the government for policy decisions and financial support. During this session, experiences and lessons learnt will be shared to inspire others who perform bibliometric analyses

Human touch of your submission in your abstract: We note that despite all the information campaigns and sessions, personal support on bibliometrics is vital. We will, therefore, continue to work on this aspect.



11:00am - 11:15am
ID: 139 / 1.1: 2
Oral Presentation
Topics: Resources and metrics

The use of Handle System on institutional repositories and their connection with alternative metrics

Elena Pastor-ramon1, Lluís Codina2, Cristòfol Rovira2

1Virtual Health Sciences of the Balearic Islands, University Pompeu Fabra, Spain; 2University Pompeu Fabra, Spain

Introduction

There are about 164 institutional repositories (IR) from EAHIL countries registered in OpenDoar. Many of these repositories are not using the Handle System (HS) as a persistent identifier (PI).

Also, they are not showing the altmetrics offered by Altmetric and PlumX, and many have not installed the API that allows to measure the altmetrics of the documents in these IR.

PI with which the altmetrics work take into account the DOI, if the document does not have it, PMID or the ArxiV identifier are detected. The HS, although the instructions offered by the providers of these metrics tell us that it works as a PI, the reality is that the only way to see the impact in a document with just HS assigned is to put the badge of one of these tools or installing their APIs.

Aims

To show how many IR from EAHIL member countries are assigning handles to their records, as well as to know if these repositories are collecting information from Altmetric and PlumX.

Also, we want to provide a checklist with those characteristics that an IR should have to provide as much information as possible on these metrics to be efficient and give value to the documents deposited in it.

Method

A search was carried out in OpenDoar limiting to IR, which had journal articles and limiting to the subjects "Health and Medicine" and Psychology, then we searched limited to each country with EAHIL partners. An Excel document was created in which we added the fields of the institution, URL of the repository, if it had a handle, if it had other persistent identifiers, if it had information on alternative metrics and if it did not have this information if it could at least be tracked by these bibliometric tools.

Results

Many of the European repositories are not assigning a HS to their records, they give generic URLs that could mean that if that repository changed domains its records could no longer be found and all the information for that record would have to be provided again. By not providing a handle, the different social impact measurement tools may not be able to detect this information. Furthermore, although these repositories do assign the HS, by not having installed the API or not having notified Altmetric or PlumX so that they can be tracked by them, they do not allow these metrics to detect the information of the repository's records, which means that the impact they may be having is not known.

Conclusion

Although great advances have been made in the creation of IR, many of them are still in elementary stages. Our analysis provides an insight into the current situation of institutional repositories in health, medicine, and psychology from EAHIL partners in terms of the use of PI, especially the HS. We also show a picture of how altmetrics are being used by country, we want to show if they are being given the importance that Altmetric and PlumX seem to have in theory.

Biography and Bibliography
Elena Pastor-Ramon, a librarian from the Virtual Health Sciences Library (Bibliosalut) since 2003 and Ph.D. student from the University Pompeu Fabra since 2020.

Pastor-Ramon, Elena; Páez, Virgili (2021). «Mejora del impacto mediante difusión de la investigación en redes sociales: #PublicaSalutIB». Investigación Bibliotecológica: archivonomía, bibliotecología e información, v. 35, n. 88, p. 29.
https://doi.org/10.22201/iibi.24488321xe.2021.88.58355

Pastor-Ramon, Elena; Codina, Lluís; Rovira, Cristòfol (2021). «Value of Digital Object Identifier in Academic Journals and Its Influence on Social and Academic Impact: Nursing Journals Experience». En: Abstract Book Workshop Proceedings Abstract Book,

García-puente, María; Pastor-ramon, Elena; Agirre, Oskia; Morán, José-maría; García-puente, María; Pastor-ramon, Elena (2020). «Research note. Open letter to the users of the new PubMed: a critical appraisal», pp. 1-5.

Dr. Lluís Codina and Dr. Cristòfol Rovira, are professors from the University Pompeu Fabra.


11:15am - 11:30am
ID: 229 / 1.1: 3
Oral Presentation
Topics: Resources and metrics

Innovations in preprint peer review - What new forms of peer review does preprinting facilitate?

Susana Oliveira Henriques1,2,3, Ludo Waltman1,2, Stephen Pinfield1,4, Naemin Rzayeva1,2

1Research on Research Institute; 2Centre for Science and Technology Studies, Leiden University; 3School of Medicine, University of Lisbon; 4University of Sheffield

Introduction

The coronavirus pandemic has highlighted the importance of an effective scholarly communication system. Traditional scholarly communication channels, particularly peer-reviewed journals, have been put under pressure to deal with Covid-19-related research in a timely way. At the same time, there was an unprecedented rise in the use of preprints by the biomedical scientific community. Preprint servers make work available rapidly (albeit usually in a form before peer review) and openly, meaning they can be accessed in a timely way by scientists, policymakers, medical practitioners, journalists, and citizens in general. Although preprints have played an essential role in the dissemination of research about Covid-19, concerns remain about quality assurance and misinformation as potential risks to public health.

Aim

We provide an overview of recent innovative projects that enable evaluative peer interactions (e.g., comments, recommendations, reviews), addressing the need for more transparent and responsible use of preprints. Also, we identify future trends and provide recommendations. Finally, we aim to promote discussion about the role of preprint peer review in the scholarly communication system and the contributions that different actors in the system can make to these developments.

Method/ Program Description

Based on the ReimagineReview registry developed by ASAPbio, we collected information on 44 projects that provide innovation in peer review, particularly peer review of preprints. Detailed information on each project was collected through online research and organised into four main categories: i) general description; ii) peer review process; iii) sustainability; and iv) maturity.

Results/ Evaluation

Globally, data show us that different groups (e.g., individuals, publishers, and professional societies), from various disciplinary fields, with different aims and needs, are involved in the development of innovative projects to increase speed, quality, transparency, incentivisation, or fairness of peer review. Also, we observe the emergence of different types of quality assessment (e.g., free-form commenting, badges, and quantitative scores), new patterns of communication (e.g., interaction between authors, reviewers and the public in general) and innovative approaches to peer review (e.g., pre or post-publication peer review, public commenting, public recommendation, quantitative scores or summaries of the evidence). As this is an ongoing project, we can only present provisional results mainly from the first two categories listed above.

Conclusion

It is too early to assess the long-term sustainability and impact of the various projects and the way in which these projects fit the aims and needs of different stakeholders. Nevertheless, our work does show that several valuable services are being provided. It also shows how these services could potentially improve trust in research reporting, and it highlights future trends in scholarly communication and peer review.

Human Touch (Recommended)

The scientific peer review system is overburdened, and there appears to be a growing dissatisfaction among authors, reviewers and journal editors. Our work suggests improvements that could make the system more informal, collaborative, rapid, open, public and transparent, which will hopefully help to turn peer review into a more rewarding experience for all stakeholders involved.

Biography and Bibliography
Susana Oliveira Henriques is an External PhD candidate at the Centre for Science and Technology Studies, Leiden University. Susana’s research interests include innovation in scholarly communication and peer review, with a special focus on dissemination and quality control of biomedical research. She is also interested in research management, science policy and responsible use of metrics. Susana holds a degree in History and a Master in Library Sciences. She is head of the Central Library - Center for Information and Documentation of the University of Lisbon School of Medicine, where she is also a guest teacher of Evidence Based Medicine, Preventive Medicine and Public Health.
ORCID: 0000-0002-0947-5083

Recent publication:
Waltman, Ludo; Pinfield, Stephen; Rzayeva, Narmin; Oliveira Henriques, Susana; Fang, Zhichao; Brumberg, Johanna; et al. (2021): Scholarly communication in times of crisis: The response of the scholarly communication system to the COVID-19 pandemic. Research on Research Institute. Report.https://doi.org/10.6084/m9.figshare.17125394.v1


11:30am - 11:45am
ID: 145 / 1.1: 4
Oral Presentation
Topics: Resources and metrics

Effective training to enhance author tracking citations to boost research evaluation

Elisabetta Poltronieri, Cristina Mancini, Giuse Ardita, Donatella Gentili, Maria Salvatorina Graziani, Paola Pecci, Filippo Santoro, Monica Zedda, Paola De Castro

Istituto Superiore di Sanità, Italy

Introduction
Author disambiguation (variants of author name) stands for a crucial point for information professionals committed to updating authors' profile in citation databases of multidisciplinary, peer-reviewed literature (Web of Science and Scopus).

By implementing the training of the internal research staff on how measuring impact of scientific papers, the Istituto Superiore di Sanità (ISS, Italian National Institute of Health) is committed to fully comply with the internal policy on archiving procedures and promoting open access publications, recently signed by the ISS President.

Aim
ISS has recently set up an internal task force aiming at supporting internal research staff (about 1000 people) in the daily practice of checking paper lists under their profile, to avoid misidentification and to get effective metrics score (H index etc.). This is a central objective of research evaluation process and reporting of annual activities to obtain funding. The constant effort is that of providing current training and continuing educational tools to enable researchers managing their own profiles on the platforms devoted to host citations and metrics.
Method/ Program Description

A methodological approach has been developed to help researchers to become more familiar in building on their unique identifiers (ResearcherID, ScopusID and ORCID), thus mantaining accurate accounts.

Further efforts for improving quality of scientific communication and transparency of research results (publications and data) are being undertaken within a recently set ISS working group on Integrity of research.

In this perspective, the ISS institutional repository OAI – PMH compliant, PublISS (https://publ.iss.it), is planning to implement the ORCID API aimed at linking authors and all their name variants with their publications. Interconnecting PublISS with ORCID Registry can help populating author profiles, thus improving search and retrieval of biomedical literature to support networking and collaboration.

Results/ Evaluation

Critical issues linked to changing platforms interfaces, level of author’s autonomy in managing their accounts, number of researchers equipped with unique identifiers and testing of users' navigation skills will be analysed and evaluated.
Conclusion

Deeply inspiring activities for assessing research effectiveness were those carried on under the umbrella of DORA (Declaration of Research Assessment) and TARA (Advance Research Assessment) project. Both initiatives aim at re-affirming the importance of best practises for the evaluation of scholarly research based on a responsible use of metrics, thus avoiding inappropriate manipulation of quantitative research impact, in view of adopting criteria and standards to reform research assessment.

Human Touch (Recommended)

This work is intended to strenghten close collobaration and networking culture among colleagues dealing with different tasks within the same Instituion (IT expert, librarians, scientific information professionals, researchers) in order to improve the whole institutional performance.

All the above-described components of the scholarly communication system accelerate the process of a virtuous engagement of all stakeholders acting within the scientific research community.

Biography and Bibliography
Elisabetta Poltronieri, is working at the Scientific Communication Service of the Italian Institute of Health, the leading research body in Italy in the field of public health.
Her main responsibilities include bibliographic editing and the diffusion of scientific work published by the Institute research staff.


11:45am - 12:00pm
ID: 134 / 1.1: 5
Oral Presentation
Topics: Resources and metrics

Library Challenges in Promoting Open Access at University

Inga Znotina, Eliza Anna Actina, Signe Riekstina-Pala

Rigas Stradins university, Latvia

Preparation

During the last two years, one of the main challenges of the Library has been the provision and promotion of open access at Rīga Stradiņš University (RSU), as the Library played a leading role in organising all processes:

- preparation of open access and Institutional e-resource repository policy and guideline documents;

- development of the RSU Research Information System (RIS) Pure and the RSU Institutional open access e-resource repository;

- training for Library and teaching staff;

- addition of the Support for Research section to the University Library website.

Within this very short period, the Library had to identify the resources and actions needed to ensure the provision of open access at Rīga Stradiņš University, as such an action policy has not yet been approved at the national level in Latvia.

Implementation

RSU Library drew up three important documents: RSU open access policy; policy for RSU Institutional open access e-resource repository; guidelines for RSU Institutional open access e-resource repository.

The Library staff participated in the initial research, testing and evaluation to select the most appropriate RIS tool between Elsevier Pure and Thomson Reuters Converis, eventually creating a proposal about the benefits of Elsevier Pure. 6 Library staff members participated in remote Pure training, conducted by a representative of Elsevier. Since then, the Library has developed 5 instructions on adding different publications to Pure, a coordinating process description and a video instruction on importing publications from online databases (e.g. Scopus, Web of Science).

From 2006 to June 2020, the metadata of RSU staff publications (for 2005-2019) was entered into the Library Information System (LIS) ALEPH500, constructing an electronic bibliographic database. In November 2020, the Library staff started entering that year’s publications into RIS Pure, adding full-text links for open access publications. By the end of 2021, all available RSU staff publications from Scopus and Web of Science have been added to Pure. Together with the Research Department, Library staff members also provide training to RSU staff about contributing to RIS Pure.

RIS Pure has been linked to the RSU Institutional open access e-resource repository – validated publications are imported and compiled. An RSU Institutional repository work group of departmental representatives and guided by the Library was set up in 2019, allowing to start adding digitised historical dissertations. Since 2020, the Library has been collaborating and actively developing the repository: planning resource communities; establishing metadata standards; defining resource access levels and user rights; and adding digitised historical monographs. Development of the Study material repository also continues in order to accumulate open access educational resources.

The new Support for Research section of the Library webpage was developed to provide researchers with RSU open access documents, links to data sources and various guides.

Conclusion

Our experience shows that the Library can implement an open access policy within its University without a joint national policy and in a short period of time, by developing close cooperation with all the participating departments of Rīga Stradiņš University.



 
Contact and Legal Notice · Contact Address:
Privacy Statement · Conference: EAHIL 2022
Conference Software - ConfTool Pro 2.6.144
© 2001–2022 by Dr. H. Weinreich, Hamburg, Germany