Home : Reports and Publications : Audit & Evaluation : Program Evaluation Study: EDP and UEDI
This chapter reviews the level of support for continuing the programs, identifies areas where improvements could be made to the program, and defines a process for making those changes.
There is strong support amongst the representatives surveyed for continuing the programs. Of the representatives surveyed, 98% of the stakeholders, 91% of the WD and CFDA representatives, and 75% of the delivery agency representatives recommended that the program or programs be continued. The rationale for recommending continuation of the programs included:
While there is strong support for continuing the programs, most representatives also believe that there is considerable room for improvement with respect to the effectiveness of the program. For example, as noted earlier, when delivery agencies, WD representatives, associations and stakeholders were asked to rate the effectiveness of the programs, on a scale of 1 to 5 where 1 is not at all effective, 3 is somewhat effective and 5 is very effective, the average ratings were relatively consistent across the groups and ranged from 3.1 amongst the stakeholders to 3.3 amongst WD and CFDC representatives.
As such, in the minds of most stakeholders and representatives involved in the program, the issue is not whether the program should be continued but rather how the programs can in fact be enhanced and improved so that they will become even more successful in meeting the entrepreneurs with disabilities as well as the objectives of Western Diversification. The purpose of this section is to highlight specific issues or concerns about the program that identified during the course of the research and, therefore, represent potential areas for future improvement.
A well-developed strategy would clearly define the mission and goals of the program, the scope of the program including the target groups, the services that will be delivered and how those initiatives will contribute towards achievement of the goals, the operating model (particularly how the key services and initiatives will be resourced), the marketing strategy for the program, and the key indicators and methodologies that will be used to collect the data needed to effectively manage the program and report on its progress. In the absence of a clearly defined vision and strategy, there is considerable uncertainty amongst the delivery agency representatives regarding the objectives of the program and the basis on which their efforts will be evaluated. In addition, the level of coordination between the two programs, as well as between individual delivery agencies, is low.
There is at least the perception that the potential demand for services is high, particularly in the major urban areas, given the rising percentage of the population that have one or more disabilities and the increasing interest in self-employment and entrepreneurships. However, it should be noted that no statistically significant research has been done to confirm the size or characteristics of the potential market.
Low awareness amongst potential clients and community stakeholders who work with persons with disabilities is a major factor that limits existing demand for services. Some of the constraints to increasing awareness include the limited amounts of funding available for promotion, entrepreneurs with disabilities have proven to be a difficult group to reach through advertising, and the name by which the programming is known (as well as the names of the delivery agencies) varies by region which has made it difficult to implement joint promotions. In addition, some CFDCs indicated that there has been little incentive for them to aggressively promote EDP given that they do not receive any additional funding to offset the higher direct costs (more intensive precare and aftercare services are required) and indirect costs (e.g. higher loan losses) associated with serving the target group.
In addition to low awareness of the program, other factors that constrain more entrepreneurs with disabilities from participating in the programs include the limited pools of loan capital available (that have not been loaned out or written off), financial constraints facing entrepreneurs with disabilities, a reluctance of some entrepreneurs with disabilities to declare, and a high degree of perceived risk for clients, particularly when they have limited personal capital and there is a possibility that they may lose access to income and medical supports.
On average, the CFDCs reported a default or write-off rate of 25% while the UEDI agencies reported a default rate of 49%. Overall, the weighted average was 33%. Some of the factors that have contributed to a high default rate are that businesses operated by entrepreneurs with disabilities tend to involve a higher level of business risk (e.g. the business may be undercapitalized, there tends to be less security available, the entrepreneurs may have less experience, the nature of the disability can add an additional level of risk) and, at least in the initial years, the CFDCs and credit unions tended to have limited experience in working with entrepreneurs with disabilities while other UEDI agencies tended to have limited experience in preparing and reviewing loan applications as well as in managing loan portfolios.
No guidance has been provided to the delivery agencies regarding what would be a reasonable default rate. On average, the delivery agencies proposed a target loan default rate of 20%, suggesting that a default rate of lower than 20% may indicate that the loan criteria are too stringent while rates above 20% could mean that the negative impacts of the program (e.g. on the financial position of clients as well as their self-confidence, independence and health) may begin to outweigh the positive impacts.
Entrepreneurs with disabilities tend to require more intensive pre-care and aftercare services because they may have less business and work experience, under-developed skills and self-confidence, and more limited access to information and other resources. In addition, the disability itself can serve as a constraint. The delivery agencies have noted that the resources needed to provide extensive pre-care and especially aftercare services have not been available.
There are a number of short-comings with the existing management information system including:
Evidence of the eroding support includes that over 30% of the CFDCs (28 of 90) have not made any EDP loans over the past three fiscal years and only 70% of the CFDCs we surveyed were in favour of the program being continued. Some of the concerns expressed about the program include:
However, should the program model be improved, all but two of the CFDCs indicated that they would be interested in continuing to deliver the program.