Evaluating effectiveness of EPA's PIP

[Eric Marsh <marsh.eric@epa.gov>]

I appreciate the comments being made regarding evaluating the effectiveness of EPA's Public Involvement Policy (PIP).  Developing a plan to evaluate EPA's Public Involvement Policy once implemented is a major part of the work within the Public Involvement Work Group. A well-supported evaluation plan will make it possible to (1) better understand if EPA is taking the necessary steps to work with the public; (2) better understand the quality of EPA's involvement processes; (3) allow for EPA to systematically and consistently learn and make improvements; and (4) be more accountable to the public.  

A significant part of this evaluation plan will most likely involve reviewing how well EPA programs are implementing the basic steps of the policy.  Recognizing that the policy is not yet final, the basic steps currently include the following: Plan and budget for public involvement activities; Identify the interested and affected public; Consider providing technical or financial assistance to the public to facilitate involvement; Provide information and outreach to the public; Conduct public consultation and involvement activities; and Assimilate and provide feedback to the public.  
				
Another major part of the evaluation plan will look at the quality of EPA's public involvement activities.  Although specific questions will vary according to the type of activity, core questions that may be asked include: How satisfied was the public with the involvement process? What worked well and what did not? How could the process be improved? and How did the process impact decision making quality?

In addition to our broader evaluation plan, we also expect to develop new and better advertise existing evaluation tools (e.g., customer satisfaction survey forms) that specific agency programs can access to help them better understand the effectiveness of their specific public involvement processes.  

This approach to evaluating the PIP and EPA's public involvement activities is in the early stages.  You can help ensure that we have a workable evaluation plan.  Tell us:

*What suggestions do you have for the approach described above?
*Beyond your suggestions so far, how would you evaluate the implementation of the Public Involvement Policy?
*What additional questions would you like to see asked in EPA's evaluation plan?
*How do our partners want to be involved in evaluation planning and execution?