Opening keynote for PUBMET 2024 is @MsPhelps. Can we broaden & widen research assessment?
-
Opening keynote for PUBMET 2024 is @MsPhelps. Can we broaden & widen research assessment?
DORA promotes widening RA from journal articles & narrow metrics. All activities, not only outcomes, should be assessed. Look at research lines, design, process, & knowledge dissemination, & judge how they meet strategic goals. Allows collective decisions & safeguards good practice.
https://tinyurl.com/pubmet-2024-kramer
🧵
#ResearchAssessment #PUBMET2024 #OpenScience #OpenInformation #OpenInfrastructure #OpenResearch
-
Matt Hodgkinsonreplied to Matt Hodgkinson last edited by
Example: Dutch Strategy Evaluation Protocol (SEP). Allows a narrative supported by data, with a free choice of indicators - which is a balancing act of relevance of metrics to a specific setting and comparability to other settings. Agency for researchers can clash with standardisation of assessment.
Open and Universal Science (OPUS) Project, Pathos, and GraspOS are all working on this.
-
Matt Hodgkinsonreplied to Matt Hodgkinson last edited by
Trust markers for research assessment may matter: both scientific trust and metadata trust. How is it done and who decides what is trustworthy? See Paolo Manghi's article, https://direct.mit.edu/qss/article/doi/10.1162/qss_a_00322/123928/Challenges-in-building-scholarly-knowledge-graphs
An example: In Eastern Europe, diamond OA and non-DOAJ APC OA journals are higher than in Western Europe. Therefore, assessment only using DOAJ may misrepresent publishing outputs from Eastern Europe.
-
Matt Hodgkinsonreplied to Matt Hodgkinson last edited by
Bianca calls for open and inclusive information and infrastructures. In the Netherlands, Dutch universities combined publishing deals with open science services with Elsevier, helping them develop their products.
In contrast, some universities are unsubscribing from WoS and investing in OpenAlex and Leiden is developing open metrics for university rankings.
-
Matt Hodgkinsonreplied to Matt Hodgkinson last edited by
Barcelona Declaration on Open Research Information calls on universities to support open data and open infrastructure. With open infrastructure, need to ask about accountability, business model, Interoperability, and governance.