TC should examine the feasibility of modifying the MOST Program’s terms and conditions to provide project funding beyond the current two-year maximum.

Agree with this recommendation as it is often heard from MOST recipients. As part of program renewal, an option for making the maximum duration of projects three years instead of two years will be researched and considered. There will be some sort of consultation process with a sample of past MOST recipients to obtain more detail on this issue.

MOST Program management should revise the five project categories outlined in the program’s eligibility criteria (see Annex 1) so that they are mutually exclusive. This could facilitate the roll-up of performance data to describe program level results.

Given the challenges in ensuring reliability and validity of performance reporting, TC should reassess the program objective to “realize quantifiable environmental and sustainable development results on TC’s sustainable development priorities.”

The MOST Program should consider ways to simplify and streamline the reporting of performance data so that it is commensurate with the level of funding allocated, and the scope and complexity of the project. One recommendation would be to create a questionnaire or form that would identify the key indicators that need to be collected and reported on. This questionnaire could be distributed to funding recipients at the start of the project and returned at the conclusion of the project. The reliability and validity of data would be improved, performance data from different projects could be aggregated to describe program level performance, and the process for collecting and reporting on performance data would be simpler for stakeholders.

Agreed, these should be simplified. These could be linked to the development of clear overall program targets that would be part of program renewal options. Development of targets would also address a recommendation of the audit on MOST conducted by the Commissioner on the Environment and Sustainable Development in 2003.

Agree that this needs to be considered but would have to be careful to continue to signal the importance of results reporting. Ways to approach this might include:

a) ongoing training for non-profit groups and support in effective monitoring/reporting for projects, including resources for longer-term monitoring and modeling future results.

b) changing this objective to reflect the longer-term results horizon that is more in keeping with the nature of MOST projects and with the sector in general.

Agree with this recommendation and it would be included in any program renewal considerations. As an initial step following approval of program renewal, program management would consult with past MOST program recipients to discuss approaches to simplify and streamline reporting and introduce the concept of a standard questionnaire or form. Once this form is refined, it would become part of the standard contribution agreement and the reporting process of the program.This is connected to addressing the previous two recommendations, as indicators would be linked to clearer categories, the establishment of targets, and the refinement of objectives.

Program renewal process would be initiated in March 2006 and revised categories developed before TB submission in summer 2006.

Refinement of program objectives before TB submission in summer 2006.

Research on this integrated into new RMAF that would be part of summer 2006 TB submission. Consultation and development of new questionnaire in fall 2006 and implementation following possible first funding round (Dec. 2006) in winter 2007.

David MacIsaac

Given that previous efforts to gather stakeholder feedback were not very successful, the MOST Program management should consider alternate ways to reach target groups. An adapted version of the questionnaires used as part of this evaluation (see Annex 6 and 7) could be administered to both unsuccessful applicants and funding recipients.

Agree with this recommendation. Will integrate this into the regular contribution agreement administration and reporting requirements for recipients, and would be part of the notification process for unsuccessful applicants.

Formal implementation of questionnaires following possible next Dec. 2006 funding round.

David MacIsaac

MOST Program management should continue its current efforts in expanding program exposure. However, it should also consider alternative ways to promote the program beyond the website. For example, management could explore opportunities to showcase the program at environmental or transportation events, particularly in underrepresented areas.

Agree with this recommendation, but could not be implemented with current program operating resources. Approach to be proposed as part of program renewal.

Strategy to be outlined in program renewal options leading to a TB submission in summer 2006. Implementation to start in fall 2006 to coincide with possible next funding round in Dec. 2006.

David MacIsaac

MOST Program management should ensure that stated timelines are adhered to in the proposal evaluation process. In cases when delays may occur, management should openly communicate the reasons for the delay.

To improve the timeliness in disbursement of funds, the MOST Program management should consider adopting a process that involves disbursing funds in increments throughout a project’s life by tying the release of funds to certain project milestones.

Where other TC groups affect the timeliness of program delivery areas, the MOST Program management should enter into discussions with these groups to re-examine the processes associated with these areas and assess options to improve processing time.

Agreed. Will be part of operations approach developed following program renewal.

Agreed that this is an issue and that the recommended approach will be considered. Will investigate the approaches used in similar programs and will consider other (perhaps complementary) options that program staff have already identified such as a more standard financial reporting templates, training recipients, and increased staff capacity to undertake pre-audits.

Agreed.

Agreed. Implementation would start with first funding round, possibly Dec., 2006.

Research as part of program renewal activities and implementation with first funding round.

Discuss with relevant groups and refine processes to be implemented following a possible initial funding round in Dec. 2006.

David MacIsaac

TC should reassess the number of human resources devoted to the administration of the MOST program and determine if additional resources are required to improve program delivery and to support the implementation of the recommendations of this evaluation.

Further research into how other, comparable, federal government programs are staffed will be undertaken. A new staffing profile would be proposed as part of program renewal. Current staff resources are not sufficient to administer all the due diligence requirements of the program in a timely fashion, compile inputs to departmental reports and other products, and compile the program’s annual review. Additional work to respond to the recommendations of this evaluation such as improved communication and marketing will require additional resources.

Reassessment as part of program renewal process to begin in March 2006 and complete by summer 2006 for the TB submission.

David MacIsaac