WG Improving practices in the assessment of research proposals

WG Improving practices in the assessment of research proposals

WG Mission

Open research information is crucial for responsible research assessment, which needs data, tools, infrastructures that secure transparency, reproducibility, geographic-discipline-output coverage in data and indicators. Their sustainability, interoperability, openness, and community-based accountability are key to the reform.

This working group’s mission is to enable institutions to move from proprietary infrastructure and research information, to open (interoperable) alternatives–in support of the transition to responsible research assessment practices. This effort will take into consideration the wide range of research outputs and open science practices, and address the diversity of the global research
community.

WG Objectives

The overall objective of the Working Group is to improve practices in the assessment of research proposals, ultimately supporting higher quality and more impactful projects, in line with the principles and commitments of the Agreement on Reforming Research Assessment, while respecting the autonomy of each member.

This will include work on:

  1. Criteria for the selection of research projects and innovative approaches to review processes. The Working Group will exchange information and learn mutually on how quality is understood and operationalised by research funding and other organisations through their assessment criteria. It will share experiences and lessons learnt and will identify general trends and evolutions. It will also aim at discussing innovative approaches to the selection, including approaches beyond peer review, and the challenge of focusing on quality and impact, at scale.
  2. Selection of and guidance to reviewers on responsible research assessment practices. The Working Group will support exchange of experiences and good practices as regards selection of and guidance to experts and associated materials and their effectiveness. It will address how appropriate reviewers can be selected and provided with adequate, high-quality training on the selection criteria and processes, how to use indicators appropriately, and how to apply high standards of ethics and integrity in their decision-making. It will also address how appropriately recognise and support the work of peer-reviewers.
  3. Information requested from applicants. The Working Group will exchange practices on the information requested to applicants, how to balance quantitative and qualitative information, as well as how to recognise a diversity of outputs, tasks, practices, skills and competences. It will also explore aspects such as when information should be requested.

Affiliated Organisations

  • AERG – Association of the ERC Grantees, Europe
  • AKA – Academy of Finland, Finland
  • ANR – The French National Research Agency, France
  • ANRS|MIE – ANRS|Emerging infectious diseases, France
  • ANVUR – Italian National Agency for the Evaluation of Universities and Research Institutes, Italy
  • ARRS – Slovenian Research Agency, Slovenia
  • COST Association – European Cooperation in Science and Technology, Europe
  • DFG – German Research Foundation, Germany
  • DORA – San Francisco Declaration on Research Assessment
  • ELKH – Eötvös Loránd Research Network, Hungary
  • ETAG – Estonian Research Council, Estonia
  • EURODOC – European Council of Doctoral Candidates and Junior Researchers, Europe
    European Commission, Europe
  • FCT – Foundation for Science and Technology, Portugal
  • FNP – Foundation for Polish Science, Poland
  • FNR – Luxembourg National Research Fund, Luxembourg
  • FORTE – Swedish Research Council for Health, Working Life and Welfare
  • FWF – Austrian Science Fund, Austria
  • FWO – Research Foundation Flanders, Belgium
  • GYA – Global Young Academy, Global
  • HRB – Health Research Board, Ireland
  • INCa – French National Cancer Institute, France
  • IRFD – Independent Research Fund Denmark, Denmark
  • ISEP – Paris Institute of Digital Technology
  • KKS Sweden – Knowledge Foundation, Sweden
    Lundbeck Foundation, Denmark
  • NRFU – National Research Foundation of Ukraine, Ukraine
  • NWO – The Dutch Research Council, The Netherlands
  • Rannís – The Icelandic Centre for Research, Iceland
  • RCL – Research Council of Lithuania, Lithuania
  • RCN – The Research Council of Norway, Norway
  • Science Europe, Europe
  • SFI – Science Foundation Ireland, Ireland
  • Swedish Research Council, Sweden
  • UEFISCDI – the Executive Agency for Higher Education, Research, Development and Innovation
    Funding, Romania
  • VINNOVA – Swedish Governmental Agency for Innovation Systems, Sweden
  • YAE – Young Academy of Europe, Europe
  • ZonMw – Netherlands Organisation for Health Research and Development, The Netherlands

Join the Working Group!

Interested in joining the Working Group?
Do you have any questions?

Please contact:

Georgios Papanagnou
European Commission

Yvonne Fors
KKS Sweden (Knowledge Foundation, Sweden)

Javier Lopez-Albacete
European Commission

Matthias Kiesselbach / Anna Christa
DFG (German Research Foundation, Germany)