Paintstewardshipprogram Paintstewardshipprogram Paintstewardshipprogram
Paintstewardshipprogram
Evaluation Question
Data Sources & Methods
Key Findings & Learning
Paintstewardshipprogram
 

 

Key Findings & Learning

What do other states need to know?

 
  • States developing paint management systems should start with reliable baseline data, including:
    • Volume data on paint being managed through various methods
    • Current paint collection, recycling and processing infrastructure
    • A system map
    • Cost information
    • Consumer, behavior, attitudes, and practices
  • What are the data and measurement gaps that were identified in OR?
    • The cost to local governments (e.g., permanent HHW facilities and events) to act as collection sites.
    • The proportion of program costs attributable to overhead and PSO structure.
    • The best approach to recruit retail collection sites.
    • How to best measure convenience.
  • PSI said a majority of inquiries it receives relate to the fee. Thus, other states developing these programs should consider providing outreach related to the fee structure.
 

What parts of the measurement and evaluation framework can be transferred to other states?

 
  • The evaluation framework (questions, measures, methods, etc.) developed for MN and then transferred to OR represents a starting point for other states in developing evaluation frameworks.
  • This evaluation committee created a web based model (referred to as a “fuzzy logic model” by the evaluation team) of the OR pilot program to depict the program and related systems, organizations, processes and products as well as the role of measurement and evaluation in the program. Other states should consider this approach to improve communications about the program’s design and operations and program performance.
  • In pursuit of a nationally coordinated paint management system and other product stewardship programs (paint or otherwise), the adoption of a common framework to support ongoing performance management, such as that in use by the Conservation Measures Partnership’s (CMP’s) Open Standards for the Practice of Conservation, will enable product stewardship initiatives to communicate and collaboration across states and regions about what works to achieve goals
 

Transitioning from integrating evaluation into the pilot program to ongoing performance management of the Oregon paint program and a nationally coordinated paint management system.

 
paintstewardship
 
The PPSI Evaluation Committee has used a systematic approach to integrating M&E into the OR program design (blue figure) so that the OR program begin the iterative ongoing process of performance (adaptive) management. The ‘integrating’ approach was has been integral to stages 1 and 2 in the green figure and the products that the evaluation committee provides will be the tools necessary to carry out the adaptive/performance management approach to planning and operations presented in the green figure.
The Open Standards as proposed by the Conservation Measures Partnership may be the kind of “evaluation policy” that we would propose to OR and paint management nationwide – learn more at conservationmeasures.org
 

What are the best ways to communicate the results?

 
  • The Evaluation Team spent time during the development of the evaluation methodology to identify the information needs of different stakeholders. This helped clarify the many and diverse stakeholders of the Oregon pilot and what was needed for effective communication.
  • Paintstewardshipprogram.com is a visualization of the program incorporating functional features that provide deep and diverse information about the program. It illustrates program implementation as well as the performance measurement and evaluation system and could be an effective tool for sharing information on an ongoing basis. A website may be accessible to a wider audience than other communication modes (e.g., conference calls) and would allow diverse audiences to focus on different components of the system (e.g., education and outreach materials, costs, environmental impacts).
  • States should also consider using a dashboard reporting system and to incorporate frequent reporting of results. A dashboard system could be incorporated into the web-based program model and would involve the state reporting a few key results on a frequent basis (e.g., volume of paint collected, number of collection sites, number of leftover paint gallons sold).
 

Related Materials

PPSI Paint Evaluation Preliminary Findings  
   
   
 
Paintstewardshipprogram Paintstewardshipprogram Paintstewardshipprogram Paintstewardshipprogram Paintstewardshipprogram