NIH grants changes
Proposed changes to NIH grants processes (to better align with health priorities, like giving everyone measles...)
If you submit proposals to the NIH, you will want to know about the proposed changes to NIH review. Deadline for comment is October 13 at this url: https://rfi.grants.nih.gov/?s=6a2b1c22c3fcfda46e0badd2
Here's the part of the RFI that I found concerning in the context of all the other proposed changes to grant policies across the federal government:
Reporting categorization as "most competitive," "competitive," and "not discussed" in lieu of final overall impact score aligns with the Unified Funding Strategy which encourages ICOs to actively balance many competing and dynamic factors, including peer review, health priorities, scientific opportunities, the workforce, availability of funds, and the wider research portfolio when determining the most meritorious research ideas to support. Categorizing proposals in this way conveys valuable information about the assessed scientific merit from peer review of without providing over-emphasis on overall impact scores. Omitting a final overall impact score from what is reported will empower program officials to utilize their substantial expertise, portfolio analyses, and good judgment to make award recommendations that better incorporate ICO strategic plans and NIH priorities. The removal of final overall impact scores also supports a focus on substantive comments from the assigned reviewers and the panel, elevating the role of scientific peer review. Finally, this change would align NIH practices with those followed by other major funders such as the National Science Foundation, Department of Energy, and U.S. Department of Agriculture.
I am not an NIH frequent flyer, but it looks to me like the changes will make it harder to understand how competitive your proposal was. Plus, NIH priorities are, what, measles for everyone with a side of polio? Hiding the peer review scores from proposers just seems like an obfuscatory tactic that gives partisans another opportunity to mess with science funding.
The notice describes the current process:
NIH uses a two-stage system of review in developing extramural funding recommendations. In the first stage, scientific experts (peer reviewers) evaluate the scientific and technical merit of grant applications. Each proposal is assigned to a peer review group and is assigned to a minimum of three peer reviewers from that group to prepare written critiques. Each written critique addresses the likely overall impact of the proposed work, as well as strengths and weaknesses guided by the review criteria in Section V of the relevant Notice of Funding Opportunity. The assigned reviewers enter their individual scores from 1-9 reflecting their preliminary assessment of the overall impact of the proposal and criterion/factor scores for the review criteria. Generally, applications with average preliminary overall impact scores in the top 50% of applications assigned to the review group are discussed. After discussion, all reviewers–assigned and not–enter their final individual overall impact scores, which gets averaged into one final overall impact score.
The review outcome is currently reported as a summary statement which includes a resume of discussion for discussed applications, the written critiques of the assigned reviewers, criterion/factor scores from assigned reviewers, and a final overall impact score averaged from all voting members of the panel. The principal investigator(s), applicant institution, NIH program staff, and the members of the funding ICO's advisory council have access to these review outcomes.
NIH program staff examine proposals and consider the final overall impact scores given during the peer review process, percentile rankings (if applicable), and the summary statements, in consideration of the ICO's priorities. Program staff then provide a proposed funding plan to ICO leadership for award decisions.
And the proposed new process:
Proposed Changes:
The first-level peer review process is proposed to be modified to place an application in one of three overall impact categories:
"Most competitive" (based on the top 25% of final overall impact scores),
"Competitive" (based on the 26-50% of final overall impact scores), or
"Not discussed" (scores >50%, or ND)
With the exception of the reporting of final overall impact scores and percentiles, all other initial review group procedures would be retained. As happens currently, all voting members of a peer review group would continue to enter individual overall impact scores for each application discussed. A final overall impact score would still be calculated for each discussed application for purposes of assigning the application to the appropriate category. The category assigned would be communicated to the principal investigator(s), applicant institution, NIH program staff, ICO leadership, and the relevant NIH Advisory Council. However, the final overall impact score or percentile on which the categorization was based would not be released to any of these parties.
Other reporting procedures would be unchanged. Discussed applications would still receive a resume of discussion and all applications would still receive written critiques from the assigned reviewers, to include individual criterion/factor scores.