The evaluation component is two-fold:
(1) product evaluation; and
(2) process evaluation.
Product evaluation addresses results that can be attributed to the project, as well as the extent to which the project has satisfied its desired objectives. Process evaluation addresses how the project was conducted, in terms of consistency with the stated plan of action and the effectiveness of the various activities within the plan.
Most Federal agencies now require some form of program evaluation among grantees. The requirements of the proposed project should be explored carefully. Evaluations may be conducted by an internal staff member, an evaluation firm or both. The applicant should state the amount of time needed to evaluate, how the feedback will be distributed among the proposed staff, and a schedule for review and comment for this type of communication. Evaluation designs may start at the beginning, middle or end of a project, but the applicant should specify a start-up time. It is practical to submit an evaluation design at the start of a project for two reasons:
Convincing evaluations require the collection of appropriate data before and during program operations; and,
If the evaluation design cannot be prepared at the outset then a critical review of the program design may be advisable.
Even if the evaluation design has to be revised as the project progresses, it is much easier and cheaper to modify a good design. If the problem is not well defined and carefully analyzed for cause and effect relationships then a good evaluation design may be difficult to achieve. Sometimes a pilot study is needed to begin the identification of facts and relationships. Often a thorough literature search may be sufficient.
Evaluation requires both coordination and agreement among program decision makers (if known). Above all, the Federal grantor agency's requirements should be highlighted in the evaluation design. Also, Federal grantor agencies may require specific evaluation techniques such as designated data formats (an existing information collection system) or they may offer financial inducements for voluntary participation in a national evaluation study. The applicant should ask specifically about these points. Also, consult the Criteria For Selecting Proposals section of the Catalog program description to determine the exact evaluation methods to be required for the program if funded.
Information courtesy of the The Catalog of Federal Domestic Assistance.
