Evaluation

Our evaluation of the NCIC was conducted on two levels.  The first was an evaluation of the work of the NCIC in increasing the implementation capacity of state and tribal child welfare agencies.  Conducted by the staff at the Muskie School, this evaluation used a multi-method, participatory approach.  Our research allowed us to observe and document the process of implementation in child welfare systems, and to describe how implementation capacity can be assessed and increased.  Results of our work have been shared at national and international conferences, and have been submitted to peer-reviewed journals. 

• Global Implementation Conference Presentation 2013
• Presentation at National Conference on Child Abuse and Neglect 2014
• NCIC: Combined Meta-Analysis
• Implementation Process Measure

The second level was to design and conduct evaluations of each NCIC implementation project.  Grounded in the our state-centric, partnership approach to working with states and tribes, Muskie School evaluators worked with child welfare agency staff to craft clear, practicable projects.  Evaluation plans were developed concurrently with project development and work planning. Key early activities included creation of project logic models, assessment of the organization’s readiness for the changes envisioned by the projects, and identification and measurement of short and long-term outcomes. 

The Center also encouraged states and tribes to select a local evaluator who collaborated with the Muskie School’s evaluators to conduct the local evaluation.  Using this “local evaluator” approach was a deliberate strategy to enhance local evaluation and implementation capacity and sustainability.  Throughout the project, Muskie School evaluators offered continuing evaluation technical assistance to ensure successful local evaluation.