Performance Evaluation Committtee

Overview

The Performance Evaluation Committee (PEC) is charged with evaluating the performance of the HIV Prevention Trials Network (HPTN). Building on the May 2003 recommendations from the DAIDS-commissioned external evaluation, the PEC has developed a comprehensive plan for evaluating the performance of all aspects of the Network. For the 2008 Evaluation the PEC, conducted an evaluation assessing HPTN performance and activities during the Network’s third year (January 1- December 31, 2007). The evaluation components included: a web-based qualitative Network performance assessment, quantitative Network performance measures, Network Lab (NL) and the Statistical Data and Management Center (SDMC) quantitative self evaluation reports, site evaluations by SDMC, NL, and the external site analysis by PPD (Pharmaceutical Product Development, Inc.

The qualitative performance assessment was streamlined and tailored to evaluate communication, decision making, and general performance of Network leadership, scientific and monitoring committees, working groups, the NL, the SDMC, and CTU operations.

Background

The Performance Evaluation Committee's utilization involves implementing the evaluation process, distributing the evaluation tool to Network members and overseeing the dissemination of results. The Network evaluation facilitates the HIV Prevention Trials Network's commitment to HIV education and prevention and aids in their overall mission to prolong the lives of individuals already infected with HIV.

In preparation for the 2007 Network evaluation, the PEC was restructured to include representatives from all organizations within and affiliated with the Network. The members of the PEC include: Nirupama Sista- Chair, CORE Representative; Holly Cassell- Network Evaluation Coordinator; David Burns- DAIDS; Jimijika Batani- HPTN Study Coordinator; Representative; Apinun Aramrattana- HPTN Investigator; Janet Frohlich- Community; Sue Eshleman and Estelle Piwowar-Manning- NL; Deborah Donnell and Lynda Emel- SDMC; and Andrea Bennett- PPD.

The role of the PEC is to identify parameters and standards for a comprehensive evaluation of the Network in order to determine where efficiencies and inefficiencies exist, and to provide each group with targeted recommendations and areas for improvement to each group.

Performance Evaluation Plan

Evaluation Inputs:

	The performance assessment allows Network members to critically review all aspects of Network operations to determine where efficiencies and inefficiencies exist. Through this mechanism, they are empowered to be change agents for the improved operations of the Network overall.

	The assessment allows Network members to be connected to the evaluation process by seeking their active feedback about Network operations and encouraging dialogue about issues of concern (within and across groups).
	The assessment facilitates more cohesive functioning of working groups by encouraging discussion about issues relating to how the work is perceived to be done, rather than just what is done.

Evaluation Outcomes:

	Through performance assessment, the Network can gain greater insight into the informal structure of the program which defines the attitudes and opinions about what is important, why is it important and how it can be made better, if it needs to improve.
	As a result, the Network is empowered to understand some of the underlying issues which may be hampering project completion or improving program output. Where working groups can be strengthened, merged or disbanded becomes more readily visible.

PEC Action Plan

The PEC has identified quantitative parameters and standards for comprehensive evaluation of the Network for the next evaluation period
The PEC has shared the plan for the next evaluation period with Network members early in the cycle
The PEC has disseminated targeted recommendations and areas for improvement to each group