Evaluation Framework For Cic'S Settlement Programs

[In 2004] Citizenship and Immigration Canada (CIC) is in the process of evaluating all of its national settlement programs. This report lays out an evaluation framework and logic models for CIC’s programs, and defines some key questions that will guide the program evaluations. The framework aims to clarify the desired results of CIC’s settlement programs for their many stakeholders – CIC staff, Service Provider Organizations (service providers), evaluators, and senior members of the federal government. Like all frameworks, it should be revised and updated as new research expands current knowledge of what interventions lead to successful settlement and integration. Stakeholder groups will use this framework in different ways: CIC staff at National Headquarters will use the framework to define the requirements for evaluations for the settlement programs in 2004. In addition, the output variables and activities contained in the framework may lead to revisions of some iCAMS variables to reflect changes in activities and recommended outputs. CIC staff in the Regions can use the framework to guide contribution negotiations with service providers. For example, service providers who can demonstrate success in key immediate outcomes may be able to make a case for increased funding by meeting CIC objectives for greater service effectiveness. Service Providers can use the framework to help them develop data collection processes that will allow them to demonstrate success in meeting program outcomes. Service providers can also use the program logic models to review their service delivery models so that their activities lead logically to desired immediate outcomes. The first draft of the evaluation framework for CIC’s settlement programs was written in 1999/2000. Since then the framework has been significantly revised, based on dozens of meetings, workshops and conversations with service providers and CIC staff. Interviews with key informants and a review of the literature on settlement and labour market integration also contributed to the revisions. The evaluation framework for LINC was discussed in workshops with service providers in the fall of 2003, and a similar exercise (involving 14 workshops across the country) was carried out for the ISAP and Host programs in February and March 2004. The program logic models in Section 5 distill hundreds of comments and suggestions into four highly simplified diagrams. Following are some key issues that should be kept in mind while reviewing this document. · It is long past time for the social services to evaluate themselves critically, and the settlement sector is no exception. The transition towards accountability and results-based management, while challenging, is essential for the achievement of Canadian policy objectives as well as the individual goals of newcomers themselves. Service providers across the country acknowledge the importance of this process, and generally welcome the opportunity to demonstrate and improve their effectiveness. · On the other hand, data collection is time-consuming for service providers, and should be minimized as much as possible while meeting accountability requirements and evaluation objectives. A common mistake for both funders and service providers is to gather data elements that don’t lead directly to better services or improved impact, but instead reduce efficiency by taking up scarce time. This evaluation framework attempts to minimize data collection to measures that will have a real benefit on improving services to clients and enabling CIC to manage agency performance. · In particular, indicators of intermediate and long term outcomes are expensive to collect and difficult to validate. Over the next few years, starting with the upcoming evaluations, both CIC and service providers should develop and begin collecting meaningful and valid indicators to create a baseline for evaluating settlement programs in the future. CIC should identify service providers and researchers that have demonstrated leadership in this area, and work with them to enhance the capacity of the settlement sector to evaluate itself. Section 5 of this paper – Settlement Program Logic Models – is intended to be used as a stand-alone summary of the evaluation framework. It contains the logic models for all three programs, the logic model for CIC’s settlement programs as a whole, and a few notes on implementation.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.