WG Experiments in Assessment – Idea generation, co-creation, and piloting

WG Experiments in Assessment – Idea generation, co-creation, and piloting

WG Objectives

The mission of this group is to form an incubator for experimental ideas in research assessment. We aim to establish a process to enable change: collecting, refining, and piloting new initiatives. The group will be a ‘safe space’ for collaboration and brainstorming of unconventional ideas that will shift assessment in line with the goals of CoARA. We will consider a wide variety of approaches, including those that might consider the recognition and rewarding of under-represented and under-rewarded scholarly practices and alternative methodologies and values in the evaluation decision-making processes

This group involves funders, institutions, academies, and the Research on Research Institute, allowing us to approach this challenge in a holistic manner, engaging different stakeholders and perspectives to develop innovative ideas. Many of the institutions that are in the working group are committed to either pilot an initiative that comes out of our work, or to start the process to have pilots run in their institution.

Throughout the WG’s activities, we strive to ensure a diverse and inclusive scope of contribution, and we will make every effort to ensure that what comes out of this WG will reach the worldwide R&I community. In addition, we will constantly exchange with other ongoing initiatives and institutions active in this space through our networks, to align and make sure that learnings are
shared.

Events

Updated 4 September 2024:

The CoARA working group on Experiments in Assessment organised a workshop to collect and develop new ideas for research assessment on different levels, e. g. individual researchers, research groups, projects.  Workshops were held on 26 September 2024 and 15 October 2024.

Break-out sessions covered the following themes:
  • Assessment/appraisal of individual researchers
  • Assessment/evaluation of research units (inside a larger institution, e.g. institutes, departments, groups etc)
  • Assessment of projects and project proposals (e.g. for funding agencies)
  • Assessment at national level / system wide with respect to output and impact

Affiliated Organisations

  • ELKH (Eötvös Loránd Research Network)
  • Fundação para a Ciência e a Tecnologia (FCT Portugal)
  • Ghent University
  • Hasselt University
  • HuMetricsHSS Initiative
  • Luxembourg National Research Fund
  • Politecnico di Torino
  • Research on Research Institute
  • Science Foundation Ireland
  • St. Pölten University of Applied Sciences
  • Swedish Research Council
  • UK Research and Innovation
  • University of Humanistic Studies
  • Young Academy of Sweden

Activities

In October 2024, the WG launched a short survey to collect ideas and experiments on new ways of assessing research and/or researchers, as well as measuring and recognizing quality and excellence.

Find out more!

Contact

Sean Sapcariu
FNR

sean.sapcariu@fnr.lu