Health Canada First Nations and Inuit Home and Community Care (FNI HCC) Program - Evaluation Guide

Getting Started: Developing an Evaluation Plan

It can sometimes be a difficult task. "Where do I begin? "

Developing an evaluation plan is a critical step because it will save you time and frustration along the way.

Defining Goals and Objectives

During the initial stages of an evaluation project, the list of issues and topics to evaluate can quickly turn into a lengthy one. While it is excellent to have many areas to evaluate, it is easy to lose sight of the main reason you began the evaluation.

Try to develop one sentence that describes the purpose of the evaluation project. This statement (sometimes referred to as a "purpose statement" or "statement of objectives") should serve as a reference point in developing your questionnaire or discussion guide. There can always be secondary objectives but this single sentence will ensure that the primary focus of the evaluation does not get lost in the process.

To measure the level of satisfaction which care providers have towards the home care support services.

• To understand the perceptions and opinions among community health care workers towards the FNI HCC Program.
• To determine the level of awareness of the home and community support services available among adults in the community.
• To elicit the reactions of current users of home care services to changes made to services in the last year.

Tip!
Consider referencing the FNI HCC logic model (page 3) when developing your evaluation plan. The activities, outputs, and outcomes cited can help focus your evaluation and make it as relevant and meaningful as possible.

Tip!
No evaluation design is perfect. While planning an evaluation is very important,
you can spend too much time planning and not give yourself enough time
"doing" the evaluation.

Determining Resources

When planning an evaluation, there are typically two types of resources to consider:

1. Financial Resources: Preparing a Budget

• What money do you have to work with? What are your sources?
• Are you going to need to hire anyone for any aspects of the project?
• If you are doing focus groups, do you need food and refreshments?
• Are you offering focus group or interview participants an incentive?
• Brainstorm as many potential costs that you foresee so they do not come as a surprise in the end!

2. Human Resources: Developing a Project Team

• Who do you have to use as a resource?
• What are their skill sets?
• Who is going to be the project manager that ensures it all happens?

Determining Timelines

A rule of thumb is that however long you think it will take - it will take twice as long! That said, it is important to map out a realistic time frame and stick to it as much as possible.

Twenty Questions to Get You Started

The 20 questions listed below are only one place to start. They are not an extensive list by any means, but are designed to be inspiration for thinking of other relevant questions and issues.

The Program

1. Did we do what we set out to do in the plan?
2. Why has it worked or not worked?
3. What activities were carried out?
4. How do these activities link to reaching the program objectives?
5. How realistic and relevant are the project objectives?
6. What has changed as a result of the program for users, service
   providers, caregivers, staff, the community, and other stakeholders?

The Implementation Process

8. What was the process of implementation?
9. What obstacles have occurred along the way?
10. How has this impacted intended outcomes?
11. What lessons have we learned about implementing this program?

The Community

11. Have the objectives of the program met the needs of the community?
12. . What has been the feedback from the general community about the
    program and its components?
13. What has been the feedback from users, their families, and care
    providers about the program?
14. What new partnerships developed from this project and what has been
    the contribution to home and community health care?
15. How has the program been culturally integrated into the community?
16. In what ways has this program contributed to health care in the
    community?

The Resources

17. Are the human and financial resources able to sustain the activities?
18. What has been the feedback from health care providers about the
    project?
19. What has been the feedback from other staff about the project?
20. Has the quality of service met expectations of those involved? Why or
    why not?