Directorates
·	Director General's Office
·	Data Development
·	Strategic Evaluations
·	Partnership and Continuous Evaluations
Publications
·	Evaluation Reports
·	Evaluation Briefs
·	Labour Market Development Agreement Series
·	Lessons Learned Series
·	Evaluation Tool Kit Series
·	Evaluation Forum Newsletter
·	From Theory To Practice

This chapter presents the findings related to the impacts and effects of the EBSM interventions on individuals in terms of the following:

• employability¹⁵ and employment;
• reduction of dependency on EI; and
• clients' attitudes.

It should be noted that additional findings on employment can be found in Section 5.0, on Primary Results Measurement.

4.1 Impact on Employability and Employment

The various EBSM interventions play a role of different importance in improving clients' employability and helping them find employment. It must be recognized that there are other factors at play, such as the state of the local economy and the willingness of clients to move to find a job, that also have an impact on the probability of individuals finding employment (which can be mitigated by helping clients become "job ready" for available employment opportunities).

The majority of participants in the focus groups with clients indicated that they acquired new skills and competencies, and gained useful work experience from their participation in an EBSM intervention. In a number of cases, participants reported that the job-specific or more general skills acquired through their participation in these interventions were transferable to other jobs. Even focus group participants who had been disappointed with other aspects of their participation in an intervention often reported feeling satisfied with the skills and/or experience they had gained.

Interviewees also reported that the job experience and softer skills acquired (e.g., independence, time management, and responsibility) generally make participants who do not find a job with their TWS or JCP employer more attractive to other employers. They also reported that even SE participants who did not end up starting their business or maintaining it in operations acquired the generic skills and work experience that would help them in a future job search. The expanded set of skills and competencies, as well as increased self-confidence, which clients gain through their participation in a number of EBSM interventions were seen to improve their situation when looking for employment.

These qualitative findings are generally supported by the survey findings. Survey respondents were asked to rate the extent to which they agreed with the statement "The skills that I have learned through the (name of intervention) will help me obtain full-time work in the future."¹⁶ As Exhibit 4.1, shows, agreement with this statement was strongest among training and SE participants, with 71.9% and 70.4%, respectively, agreeing or agreeing strongly with it, followed by TWS participants (61.5%), EAS users (52.5%) and JCP participants (51.4%).

The findings related to participants' satisfaction with the skills and job experience gained during their intervention indicate that, for them, more important than acquiring skills is gaining job experience. Indeed, three-quarters of TWS (76.4%) and JCP (74.3%) survey respondents reported that they were satisfied¹⁷ or very satisfied¹⁸ with the job experience they gained through their participation in these programs, even though 61.5% and 51.4%, respectively, felt that the skills acquired would help them find employment.

A number of focus group participants expressed the need for a "buffer" period at the end of their intervention to provide them with the opportunity to find work. One suggestion was to assist participants with "next steps". Focus group participants identified the lack of a placement component as a gap in many training programs. It was felt that placements would improve participants' chances of finding work at the end of the training program (less than half of training respondents (44.8%) reported finding work as a result of their training). A report synthesizing the programs available to SARs to integrate them into the workforce stated that on-the-job training programs had "mixed results in terms of employability, although [those] delivered through private or not-for-profit agencies were consistently found to have positive impacts on the employment of clients and helped trainees find and/or retain employment in positions for which they were trained."¹⁹

Slightly more than one-third (36%) of EAS respondents reported that they had found work as a result of using EAS. It should be noted that EAS users include individuals who may have used a variety of services, from consulting LMI to job finding clubs, and that EAS could be the springboard for participation in other interventions, which themselves may lead to employment.

Many participants felt that individual personalized support should be at the root of every intervention. However, such personalized intervention is not widely available from HRCCs anymore. Issues such as downsizing (resulting in overworked staff and departure of experienced staff) and lack of proper staff training and system support have had a negative impact on HRCCs' ability to help clients return to work.

While a number of third-party organizations reported having the capacity to provide individual assistance to clients, they also felt an increased pressure to place clients in interventions quickly so as to get short term results. These participants believed that spending more time up front examining client needs would lead to improved results in the long term.

4.2 Reduction of Dependency on EI

The information that the formative evaluation can provide on the extent to which participation in an EBSM intervention has an impact on reducing client's dependency on EI is limited. Although 72% of respondents had completed their intervention, the short time frame following the completion of their EBSM means that not enough time has passed to determine the impact of the interventions on EI dependency. The findings from the formative evaluation will actually be used as benchmarks for measuring reduction in EI dependency at the time of the summative evaluations. Nevertheless, some preliminary findings in this area can be assessed using information provided by survey respondents on whether their last EI claim was their first and whether they have received income from Employment Insurance since the end of the their intervention.

Overall, three-quarters of respondents in the survey of participants (74.9%) reported that their last EI claim had not been their first (compared to half (48.8%) of non-participants). Of these respondents, three-quarters (76.3%) reported that they had not received income from Employment Insurance since the end of their intervention, indicating that short term dependency on EI may be reduced as a result of participating in an EBSM intervention.

As shown in Exhibit 4.2, the greatest impact appears to have been among JCP participants. Indeed, the greatest proportion of respondents who stated that their last EI claim had not been their first was found among JCP respondents (82%). These respondents also stated in the second greatest proportion (preceded by SE participants) that they had not received income from EI since the end of their intervention.

4.3 Impacts on Clients' Attitudes

This section describes the extent to which EBSM appear to have had an impact on clients' attitudes towards finding and keeping employment. Again, the reader should keep in mind that clients' attitudes are only one factor that has an impact on their ability to find employment. Participants at the local level raised the issue of the economy and the availability of employment in local industries as key factors that have an impact on clients' employment and the development of a positive attitude.

"Boosting self-confidence" was the most common term used by focus group participants to describe the attitude they developed as a result of participating in an EBSM intervention. Working (through a TWS, JCP or SE program) or participating in an intervention that allows one to develop skills (e.g., training) or make connections (e.g., job finding clubs under EAS) play a major role in improving an unemployed individual's shattered self-confidence and in contributing to a positive attitude.

Another way in which all EBSM interventions assisted the majority of clients to develop a positive attitude was by providing them with a supportive environment. Support, as well as the opportunity to network, is provided through group sessions such as job finding clubs, SE workshops and training. In many cases, just having something to do contributes to participants maintaining or regaining a positive attitude toward employment.

Overall, interviewees felt that the implementation of EBSM contributed to clients assuming more responsibilities by requiring clients to do much more of the "legwork", such as conducting research on employment opportunities before being approved for training or SE. A minority of participants also mentioned that case management and the development of action plans assisted clients in taking responsibility and following through with their formal commitments.

While requesting clients to conduct research for the development of their business plan seems to be a standard practice across the country, requiring them to conduct research that can justify participation in training is not. The financial contribution that some clients are asked to make through the process of NFA to the start-up and operations of their business or to the cost associated with their training was also identified by interviewees as one aspect of EBSM that made clients more responsible. However, the majority of training focus group participants and survey respondents reported not having negotiated a contribution to the cost of their training.

Footnotes

15	In this context, employability refers to the job readiness of a client, i.e., the clients possess the skills, competencies and tools to look for and find employment.
16	The statement read to SE participants stated "The skills that I am learning through the Self-Employment program will help me have a successful business in the future."
17	Rated their satisfaction a 4 on a 1 to 5 scale, where 1 is not at all satisfied and 5 is very satisfied.
18	Rated their satisfaction a 5 on a 1 to 5 scale, where 1 is not at all satisfied and 5 is very satisfied.
19	The information that the formative evaluation can provide on the extent to which participation in an EBSM intervention has an impact on reducing client's dependency on EI is limited. Although 72% of respondents had completed their intervention, the short time frame following the completion of their EBSM means that not enough time has passed to determine the impact of the interventions on EI dependency. The findings from the formative evaluation will actually be used as benchmarks for measuring reduction in EI dependency at the time of the summative evaluations. Nevertheless, some preliminary findings in this area can be assessed using information provided by survey respondents on whether their last EI claim was their first and whether they have received income from Employment Insurance since the end of the their intervention.