Infrastructure grants

Resources

GEN1: General

These notes are intended to provide reviewers with specific guidance for the completion of the reviewer form. They should be read in conjunction with the reviewer Principles

Specific guidance is available for each individual section of the report you are completing. A full justification for your assessment of the application should be provided. The prompts are given as a reminder of those issues that are likely to be most significant in determining the overall merit of an application. Please provide as full a response as you believe you are qualified to. You should note that your review will be sent back, unattributed, to the investigator, who will then be allowed the opportunity to comment on any factual errors and answer any specific queries you have raised.

We are committed to support the recommendations and principles set out by the San Francisco Declaration on Research Assessment  You should not use journal-based metrics, such as journal impact factors, as a surrogate measure of the quality of individual research articles, to assess an investigator’s contributions, or to make funding decisions.

For the purpose of research assessment, please consider the value and impact of all research outputs (including datasets, software, inventions, patents, preprints, other commercial activities, etc.) in addition to research publications. You should consider a broad range of impact measures including qualitative indicators of research impact, such as influence on policy and practice.

The content of a paper is more important than publication metrics, or the identity of the journal, in which it was published, especially for early-stage investigators. Therefore, you should not use journal impact factor (or any hierarchy of journals), conference rankings and metrics such as the H-index or i10-index when assessing UKRI grants.

GEN2: Assessment methodology

You are asked to assess the application/report against a number of criteria. These criteria may vary according to the scheme or call that the application has been submitted to. Prompts are provided as a reminder of those issues that are likely to be most significant in determining the overall merit of an application. A full justification for your assessment of the application should be included in each section: please provide as full a response as you believe you are qualified to.

You are asked throughout to assess “the application” but please be clear that this means the ideas, concepts and approaches contained therein not the specific form of the document itself. The clarity of presentation may help or hinder your ability to review an application, so a comment to this effect would be appropriate, but this should not become in any form a competition in stylish writing. Elegance of presentation is not of itself an assessment criterion for an EPSRC grant!

There is no set way for answering questions on the form. However, prioritisation meetings generally find reviews most useful where they explicitly identify the main strengths and weaknesses in the application, while also giving a clear view on which should be accorded the greater significance and why. It is also a helpful technique to raise issues or concerns with the application in the form of explicit questions for the applicants. This makes it easier for the panel to assess how complete and convincing the applicants responses are.

GEN3: Ethics

It is important that EPSRC funds are used ethically and responsibly but this is mainly assured by requiring that universities have in place and operate appropriate ethical approval processes. Ethical considerations should not therefore normally be an assessment criterion and you should not take these into account when making your assessment.

If the application is in a subject or area that causes you serious personal concern, to the extent that you feel you cannot provide an objective review, then you should decline to review the application giving the reason as other, and stating “ethical issues” in the comment box. If you have a concern that the application raises ethical issues that have not been clearly identified or addressed, then you should raise this directly with EPSRC who will need to make a policy decision on how the application should be treated.

GEN4: Linked proposals

Where two or more applications have been formally linked to form a single research project, you are
requested to submit a single review covering the project as a whole.

EXC5: Quality and breadth of the Research to be Enabled

Primary Criterion

The applicants must articulate an overall vision for the requested equipment and provide details of the novel science enabled by the equipment. It should be clearly stated where the capability of the equipment could lead to new science, taking into consideration the key scientific questions and research that the applicants and userbase cannot currently achieve with existing equipment.

The expected outputs from the research enabled by the equipment should result in a significant step change, with major impact on the research area beyond the immediate team, and appreciably raise the UK's international profile.

The reviewer form asks reviewers to:

Please comment on the quality and breadth of the engineering and physical sciences research that the requested equipment will enable, making reference to:

  • The novelty, timeliness and relevance to identified stakeholders including users;
  • The transformative aspects or potential outcomes that will be enabled;
  • The suitability of the proposed methodology and the appropriateness of the approach to achieving impact.

(For multi-disciplinary proposals please state which aspects of the proposal you feel qualified to assess.)

IMP4: Strategic Importance

Secondary Major Criterion

Applicants should present evidence that the requested equipment is strategically important to and will benefit a diverse user base. A discussion should be provided setting out how the infrastructure fits into the regional/national landscape of similar equipment. The applicant should articulate the university’s strategy for capital investment and how the requested equipment aligns to this vision.

The reviewer form asks reviewers to:

Please comment on the strength of the strategic case made in terms of both national and institutional needs, making reference to how the equipment sought:

  • Meets national needs by establishing/maintaining a unique and/or world leading activity;
  • Complements and enhances regional and/or national research capability, including relationships to the EPSRC equipment and research portfolio.

Please comment on the appropriateness of:

  • The evidence of strong demand and community needs from a diverse and inclusive user base;
  • The proposed alternative approaches to how the research would be achieved should the equipment not be funded.

APP12: Applicant and Host Institution

Secondary Criterion

The applicant should provide details of why the team have the appropriate skills to procure and manage the requested equipment. The applicant should also articulate why the institution is appropriate to host the equipment, including the added value from existing equipment, technical support or infrastructure.

The reviewer form asks reviewers to:

Please comment on the applicants' ability to effectively operate the requested equipment making reference to:

  • The appropriateness of the track record of the applicant(s);
  • The balance of skills of the team, including collaborators;
  • Why the host institution provides the most appropriate location and how use of existing inventory is effectively complemented.

MAN4: Management of the Equipment

Secondary Criterion

You are asked to comment on the arrangements for managing the proposed equipment. These should be proportionate to the scale and complexity of the activity to be undertaken. In addition to the more general management issues you should also comment on the effectiveness of the operational arrangements for the proposed equipment.

The reviewer form asks reviewers to:

Please comment on the effectiveness of the proposed planning and management, making reference to:

  • The workplan and associated risks
  • Plans for prioritising access and maximising usage of the equipment;
  • Data management and accessibility.

 

RES3: Resources 

Secondary Criterion

Applicants are required to identify on the application form all resources required to undertake the project, and to clearly explain the need for these in the justification of resources appended to the case for support. You should comment on how well this has been done, on the appropriateness of the resources requested, and on how sensible and justified the quoted equipment costs are. You should draw attention to anything in your view that has been requested but not justified or conversely needed but not identified. With the exception of the equipment quotes your assessment should be based on the resources sought and not on the costs derived from them.

The reviewer form asks reviewers to:

Please comment on whether the requested equipment and resources are appropriate and have been fully justified, making reference to:

  • The appropriateness and justification of costs for the equipment;
  • The appropriateness and justification of resource costs (staff, maintenance etc);
  • The appropriateness of any contributions from the host and any collaborators;
  • Any resources requested for activities to either expand the user base, increase impact, for public engagement or to support responsible innovation.

 

 

 

INF2: Sustainability

Secondary Major Criterion

The applicant should articulate appropriate plans for ensuring the future sustainability of the infrastructure. Plans should cover all aspects of sustainability including staff and the userbase, not just that of the equipment.

The reviewer form asks reviewers to:

Please comment on the appropriateness of the proposed plans towards making the equipment/facility sustainable. Consider how realistic the plans are for:

  • The recovery of running costs (maintenance, repairs, consumables, staff time) during and beyond the lifetime of the grant;
  • The appropriateness of the charging model;
  • The support and development of the specialist technical staff beyond the lifetime of the grant period;
  • Sustaining and evolving a diverse and inclusive user base beyond the lifetime of the grant and any "free-at-point-of-access" period.

 

 

ASS2: Overall Assessment - Part assessment

It may be that you feel you can only comment with authority on some specific part or component of an application, for example with a multidisciplinary project, or perhaps where there is a strong user-led element. In such a case you should identify those aspects that you are able to comment on, and then give your review on just those aspects. Different reviewers will have been asked to cover those aspects you cannot and the panel will then have the job of integrating these different comments. It is particularly important therefore that the panel have clear advice on the merits of each component. Your comments, scores and confidence level should explicitly reflect your views on those aspects you can assess, and you are asked not to moderate these in any way to reflect those areas you feel you cannot comment on.

A risk with part assessment is that it will miss the added value of the overall project (the whole ideally being greater than the sum of the parts) so even where you can only comment with authority on one aspect it will be helpful to the panel to have your views on how compelling the arguments for the overall application are. Other issues you might also comment on are the uniqueness (or otherwise) of the collaboration, the value of the contribution of the component you can judge, and the significance of this in terms of future potential development in your own field.

ASS3: Overall Assessment - Overall score

You should assign a score using the six point scale provided. This should reflect your overall conclusion, and should be consistent with your comments on the individual sections of your review taking account of all the assessment criteria and the various weightings you applied.

The reviewer form asks the reviewer to score the application:

1 - This application is scientifically or technically flawed

2 - This application does not meet one or more of the assessment criteria

3 - This application meets all assessment criteria but with clear weaknesses

4 - This is a good application that meets all assessment criteria but with minor weaknesses

5 - This is a strong application that broadly meets all assessment criteria

6 - This is a very strong application that fully meets all assessment criteria

ASS4: Level of confidence

To assist the prioritisation panel in reaching their overall conclusion on the application, and to help EPSRC in monitoring the effectiveness of its reviewer selection procedures, you are asked to indicate your confidence with regard to this review. This should report your own confidence, or otherwise, in being able to make your assessment, not your confidence in the success of the application if it were funded. If, for any reason, you feel that you are not able to assess the application, please advise EPSRC accordingly.

The reviewer form asks reviewers to score their confidence as low, medium or high.

ASS6: Overall Assessment

You should provide your overall assessment of the application. Think of this as your report to the prioritisation panel, highlighting the strengths and weaknesses you identified in the individual questions and then making a clear and explicit recommendation about whether or not you believe the application warrants funding.

Not all questions carry equal weighting. Research Quality (excellence) will always be pre-eminent and no application can be funded without clearly demonstrating this aspect. Strategic Importance and Sustainability should also be major considerations in making your assessment. The weighting between the remaining aspects will depend on the specific nature of the particular application. You should indicate those aspects that you accorded higher or lower priority and why.

The reviewer form asks reviewers to summarise their view of the application.