Home : Reports and Publications : Audit & Evaluation : Evaluation of the WEI – October 2004
Evaluation Issue: Service Delivery of WEI Organizations
This issue examined:
The issue of service delivery was addressed through the review of documents, interviews with key informants and focus group sessions. The evaluation concluded that:
WD manages the Women’s Enterprise Initiative through staff assignment for the WEI organization file within the region. These files contain all reports submitted by the WEI organization. All WD representatives agreed that it was not the role of WD to actively manage the WEI organization, but the degree of involvement varies significantly. Some WEI file managers are very involved in activities of the organization, for example attending Board meetings as ex-officio members and providing support and information to office staff. Others appear to be totally non-involved and have very little knowledge of the substantive work that the organization undertakes or any of the issues that it faces. There are no guidelines outlining the level of involvement expected from WD staff handling the WEI files.
The evaluation found that it was difficult to assess the relative value of these differing styles, since each WEI organization was accustomed to the approach with which they are familiar. It can be said that increased involvement of WD staff assisted in facilitating partnership opportunities (i.e. meetings, luncheons, informal get-togethers) between WCBSN members, particularly in the case of the CFDCs, FEDOs and WEI organizations. Some WD representatives have taken a leadership role to bring Board Members and Executive Directors from members of the WCBSN together for networking/familiarization events. Other WD representatives have not undertaken this activity. It should be noted that office co-location also contributed to strengthened WCBSN partnerships in most cases.
In the course of the evaluation WEI organizations (WESBC, WES) stated that late payments of their Contribution Agreement allotments by WD places them in difficult circumstances, requiring at times draw-downs on their loan funds in order to pay operating expenses. This practice is considered risky, both from an auditing as well as a public accountability standpoint.
As stated in previous sections, the evaluation analyzed the Women’s Enterprise Initiative as a discrete program, with no intention to compare the WEI organizations. The evaluation found no evidence to suggest that there should be differential levels of funding between the four WEI organizations. The 1998 WEI Evaluation made the following recommendation with regard to funding needs:
That future program funding be based on the existing formula, but with additional funds available to be provided based on annual business planning for special projects or demonstrated client demand. This funding approach would allow a base level of funding to all provincial initiatives. It would also provide a ‘special fund’ to be allocated to provincial programs that have greater demand, or that develop unique initiatives with the opportunity for improved program effectiveness.
The evaluation found through interviews with WEI organization staff and Board Members that the WEI organizations are very aware of the need to continuously increase their profile within their region, in order to attract new clients, meet the needs of their target groups and to continue to be considered relevant. Key informants indicated that WEI organizations receive referrals from financial institutions that are familiar with the organization. Focus group participants for the most part had heard of the WEI organization through word of mouth from friends, family or other agencies.
The evaluation research identified various mechanisms that the WEI organizations are using to market their organizations. These include:
The WEI organizations reported that they considered these means to be effective, although they identified gaps in reaching potential client groups, particularly new immigrants and rural women.
The evaluation found that the governance of the WEI organizations is appropriate, based on the current composition of the Boards of Directors. Key informant interviews with Board members, WD staff and WEI organization staff indicated that the Board members appropriately represented the interests of women entrepreneurs in the region, as well as those with lending institution/finance experience.
In line with appropriate governance, WD should maintain an adequate level of monitoring to ensure that no undue risks to WD occur from issues that may arise from WEI organization management.
These findings of the evaluation concerning service delivery and client satisfaction are consistent with the high levels of satisfaction with WEI organization services indicated in the 2002 Impact Study. This is based on opinions received from focus group participants. Focus group sessions overall indicated a high level of satisfaction with the information, advice, training and start-up loans offered by the WEI organizations. A significant number of the focus group participants had used more than one WEI organization service, including additional loans.
In terms of alternative delivery mechanisms, technology options were also explored. The following Technology Mini Case Study provides additional detail:
Using funding provided by WD to host the Annual WEI Conference in 2003, WESBC developed the Western Canada Training Centre and hosted the first “virtual” WEI organization conference. Over 100 women from across Canada participated in the online conference. The participants were able to discuss their business challenges with a professor from Royal Roads University in the discussion groups. WESBC has taken the lead in this initiative and is looking at additional ways to capitalize on its experience in this field.
The Western Canada Training Centre provides an example of the power of partnering and providing Pan-West services. The system was developed by and is maintained by WESBC. Supporting partners include: the Export Development Corporation (EDC), e-BC, Royal Roads University and WD. The Western Canada Training Centre provides “one stop” shopping for WEI training. Telephone Training and By the Book are also coordinated through the site, reducing duplication, as all registrations, etc. are handled through one location, providing service to clients in all four provinces. WESBC is also coordinating with B.C. Tech to offer courses through the site. EDC has contributed content for the on-line resource library that is updated weekly, with links to other service providers checked for currency.
WESBC currently manages all the content, with the administrator coordinating with the other WEI organizations to produce online training material and e-commerce offerings. It was reported that the financial management courses are the most popular, particularly because they are pre-requisites for loans through WESBC. Courses are supported by online discussion forums.
Potential benefits of online training and services include:
While these potential benefits can occur, internet access is not available in most northern aboriginal communities and at present in many rural communities, it is often too slow to be practical. It will be important for all the partners involved (other WEI organizations and other WD partners) to consider ways to leverage the existing infrastructure in a way that allows a wider range of services to be extended to a wider range of clientele, particularly as access to broadband grows. The other partners will be required to support the lasting success of the Centre, through active contributions in terms of content development, discussion group participation, partnership development, etc.
The number of website hits/inquiries has been tracked since April 2001 and has been steadily growing. The WEI organization websites are important sources of information and reflect organizational advancements and service quality. Maintaining the websites with current information is essential as WEI clients continue to explore technology alternatives and improvements.
A significant number of expansion/growth clients in the focus groups indicated that they require a more sophisticated level of information to meet their needs, and do not know where to access this type of resource. This demand is verified by the Pan-West Program Performance figures which indicate that in the period between April 1999 and March 2004, 346 loans were made for new business start-ups, 303 loans were made to support business expansions, and 64 loans were provided to purchase existing businesses. Focus group participants expressed the opinion that they would like WEI organizations to provide business expansion type support, although WD representatives consider that this level of information may in fact be available and that WEI clients should be referred elsewhere. An example cited was the increased offerings of the BDC to women entrepreneurs.
In response to growth/expansion client needs, initiatives are underway in some of the WEI organizations to provide a more “sophisticated” level of support to growth clients. AWE indicated that due to the in-depth knowledge of present staff concerning specialized resources within the banking system, they would be able to direct their growth clients appropriately. They also acknowledged that without personal knowledge, these resources would be difficult for clients to find. WEC through its “In Time” program is addressing this issue by providing funding and references for clients who needs specialized advice (e.g. legal, financial, property leasing, assets). Increased levels of partnerships with other agencies may also address some of the needs for more advanced support. This could include programs with existing WCBSN members such as the CBSCs, or other agencies such as the Business Development Bank.
The WEI organizations are high risk lenders, primarily because client collateral and other securities are not always a pre-requisite for lending. The evaluation found that the WEI organizations have instigated appropriate measures to properly manage their capital assets:
The WEI organizations through sharing of best practices have developed a risk assessment questionnaire. WESBC identified this as the “Self-adjusting Risk Index” (SARI), containing 70 questions developed in-house to assess client financial and managerial experience.
The evaluation determined that each WEI organization considers themselves responsible lenders using taxpayers’ money. They have instigated levels of loan aftercare and recovery practices to maintain their loan funds. Loan aftercare and recovery practices include:
The evaluation determined that these loan recovery practices are appropriate.
The average loan loss ratios over the life of the WE initiative (starting for WEC in 1994) as reported by the auditors are approximately 9% except for WESBC where the average loan loss over the life of the WE Initiative currently stands at approximately 19%. WEI organizations state that as a high risk lender, their loan loss ratios are considered by their auditors and their Boards to be well within acceptable limits. The term “high risk lender” as indicated elsewhere in the report is applied because of the WEI organization policy of not requiring collateral when providing loans.
It was reported that the loan loss ratios are influenced by factors such as provincial economic upswings and downturns, WEI organization lending decisions and personal circumstances of the client (divorce, death, etc.). Loan loss ratios can also be misleading if not linked to the volume of loans in default, which are constantly changing as payments are received or missed. WEC reported that they incurred high loan losses in their early years due to one large loan that “went bad” although their recent loan loss figures are low. WESBC is currently conducting an analysis of loan losses to identify any patterns/trends and to identify lessons learned.
The evaluation considers that the loan loss ratios should be utilized to track lending issues rather than as static or comparative figures across WEI organizations. The important considerations in using these loan loss ratio figures are to:
In interviews, WD personnel did not indicate what loan loss limits were considered acceptable except to state that these ratios were considered to be important indicators of the success of the initiative. High loan loss ratios for WD implies that the WEI organizations are not appropriately managing the loan approval process. A policy or guidelines concerning acceptable loan/loss ratios should be developed by WD to clarify goals and objectives of the loan management activities for the WEI organizations.
Of particular interest for the sustainability of the WE Initiative, a projection provided by WES indicated that if the current low interest rates continue (the present interest rates are not high enough to cover the loan loss ratios), and taking into account loan repayments at former higher rates, their loan capital will decrease to zero by 2008. AWE has stated that their loan fund will be depleted by 2006. This is confirmed by WESBC stating that this could happen earlier, depending on the loan fund disbursement rates. Without additional loan funds, the only money available for lending would be the monthly repayments received from then current outstanding loans.
This is an important finding of the evaluation and has obvious implications for the future of the WEI organizations. According to WD sources, the loan fund as established in 1994/95 was to revolve in perpetuity to be repaid at such time as it was no longer required. The expectation was that WEI loan loss rates would be 5% (or less) with loan fund earnings high enough not to erode the loan fund capital. WD anticipated that the WEI organizations could approach WD for continuing operating support or might develop other sources of revenue. The issue should be addressed through replenishment of funds in line with the statement of the Prime Minister in 2003. WD should also communicate its expectations concerning loan loss ratios, poorly performing loan ratios and expected loan volumes to the WEI organizations. Since this is a financial issue, further information on the specific operation of each loan fund can be obtained through proper channels from each of the WEI organizations.
One of the questions asked during the evaluation was whether the current level of WEI staff knowledge/experience in dealing with lending results is correlated with loan-loss rates. The evaluation found that there are a number of checks and balances in the decisions surrounding loan approvals: staff recommendations are generally reviewed by the Loans Manager who may also request input from the Executive Director/Board members/finance committees. For smaller loans (for example, loans under $35,000 in the case of AWE), in some cases the Loans Manager has the authority to approve the loan. At the same time, the ability of the WEI organizations to attract senior professional staff is dependent on the salary scales offered, a large component of the operational funding received through WD.
The due diligence process instituted by the WEI organizations assesses client risk in the following categories and factors (derived from WES documents):
Another factor to take into consideration in the current operation of the WEI organizations’ loan practices is that the organization benefits from engaging with former bank employees, either through their board representatives or as members of their staff. This provides an oversight function as well as the enforcement of good business practices for the most part. Supported by stringent and enforced loan recovery methods, the WEI organization clients are properly assessed to save them loss of property in the future. For example, the Program Performance figures (page 24) indicate that over 1500 applications were formally registered as received with 875 loans approved, illustrating the loan approval process in operation. These figures do not take into account WEI organization clients who, upon receiving additional training and business planning/counselling, decided to either resubmit at a future date or reconsider their business proposition.
At the same time, interview information indicates that there is a natural tendency to provide optimistic loans in good times, making these loans less viable should the regional economy take a downturn. This would be the case for every regional lender, and should be a component of the performance measurement and reporting analysis done by WD on a long term basis in order to track trends and lending issues.
The evaluation found that there is a variance of opinion as to an increase in WEI organizations loan limits. WES, WEC and AWE are suggesting that the loan limits be raised to $250,000 from the current $100,000. The assumption is that the organizations would also ramp up their services to serve more established businesses, since the start-ups typically served by the WEI organizations do not require $250,000 at the outset. The rationale for this is that the larger loans would fill the gap between the WEI limit and the new program the BDC is offering to women starting at $250,000. Venture capital kicks in at funding levels generally ranging between $250,000 and $2million30. The opinion was expressed that as the Chartered banks are becoming more cautious in their lending, an increased limit would also provide an opportunity for more partnering with traditional lenders and other financial organizations.
WESBC stated during the interviews conducted for the evaluation that the loan limit should not be higher than $125,000, given the other lending sources available and the risk to the organization that such high loan limits might incur. At the same time, WESBC believes there is a demand for larger loans particularly from clients in large urban centres where the costs of starting or expanding a business is higher, or in the case of manufacturing ventures where significant capital assets are required. In these cases, WESBC believes it would be helpful if the WEI organizations had some flexibility to address these needs. WD representatives expressed the opinion that $125,000 is the appropriate limit, to mesh with the other WCBSN partners.
WD through the Women’s Enterprise Initiative is the primary support of the WEI organizations. There are issues surrounding the management of the WEI files by WD in terms of timeliness of payments and consistency of management messages and approaches. The WEI organizations are making conscious efforts to publicly acknowledge the support received from WD.
Since their inception, as demonstrated by Program Performance statistics, the WEI organizations through their lending programs serve both start-up clients, those who are purchasing existing businesses and those who are expanding, with start-ups and expansions comprising the largest part of their lending. The organizations continue to serve women entrepreneurs exploring business ideas as well as those who move on to start-up a business. The WEI organizations are assessing avenues to offer additional services to expansion clients, including targeted programs and partnerships with other organizations.
Of particular interest for the sustainability of the WE Initiative, a projection provided by WES indicated that if the current low interest rates continue (the present interest rates are not high enough to cover the loan loss ratios), and taking into account loan repayments at former higher rates, their loan capital will decrease to zero by 2008. AWE states that their loan fund will be depleted in 2006. As the organizations mature, their practices reflect their growing experience base, leading to the opportunity for standardized approaches based on a sharing of lessons learned by the four WEI organizations within the region.