Government of Canada | Gouvernement du Canada Government of Canada
    FrançaisContact UsHelpSearchHRDC Site
  EDD'S Home PageWhat's NewHRDC FormsHRDC RegionsQuick Links

·
·
·
·
 
·
·
·
·
·
·
·
 

Appendix A Evaluation Matrix


 
Evaluation Questions Indicators Methodologies
1. Are the objectives and mandate of the OLT still relevant given the current situation? Is it realistic to aim at closing the Digital Divide? What should be the role of the federal government in the future?
  • Opinion of experts in the learning technology field
  • Analysis of needs of target audience
  • Assessment of learning technologies status, gaps and trends
  • Availability of technical infrastructure (computers, networks, internet connection, technical support systems, CAP sites)
  • Document Review
  • Interviews
  • Survey of sponsors
  • Survey of unfunded projects
  • Survey of partners and community leaders
  • Panel of Experts
2. How and to what extent does OLT contribute to the development and use of learning technologies in Canada?

Does the program improve the ability of Canadians to adapt to the needs of the labour market?
  • Observations of sponsors and partners
  • Observations of end-users
  • Distribution of LTI and CLN funded projects
    • funding levels
    • settings (home workplace,
    • community learning centres)
    • end-users
    • regional differences
  • Summary of policy forms held
  • Opinion of experts in the learning technology field
  • Regional perspective
    • Socio-economic well-being
    • Employment Shortages and needs
    • Skills requirements
    • Resources, capacities and infrastructure
  • Learning technologies developed and used without OLT funding
    • settings (home workplace, community learning centres)
    • end-users
    • regional perspective
  • Document Review and Administrative Data Analysis
  • Interviews
  • Survey of sponsors
  • Case studies (with focus groups)
  • Survey of unfunded projects
  • Survey of partners and community
3. To what extent has the OLT succeeded in the development of partnerships with private sectors, communities, non-governmental organizations (NGO) and governments? Have the partners been contributing to expand delivery networks and content development? What are the principal determinants of success and barriers to partnership?
  • Observations of sponsors and partners
  • Role of volunteers/staff and other community resources
  • Number of partners involved and roles
  • Resources contribution to project
  • Advantages and disadvantages of partnership
  • Broadened networks
  • Number of new networks
  • Community-based organization involvement
  • Evidence of synergy between OLT projects in the community of elsewhere
  • Document Review and Administrative Data Analysis
  • Interviews
  • Survey of funded projects
  • Case Studies
  • Survey of unfunded projects
  • Survey of partners
4.  Who and where are the adult learners reached by OLT projects? Are they part of  Equity Groups? Have their needs been met? What type of activities/services/tools/practices have been provided to meet their needs?
  • Observations of sponsors and partners
  • Distribution of LTI and CLN funded projects
    • funding levels
    • settings (home workplace, community learning centres)
    • end-users
    • regional differences
    • involvement of end-users
  • Document Review and Administrative Data Analysis
  • Interviews
  • Survey of funded projects
  • Case studies (with focus group)
  • Survey of partners and community leaders
5. Have the funded projects demonstrated the applicability and effectiveness of innovative use of learning technologies and learning models? Specifically:
- In various settings such as the workplace, the community learning centres and homes.
- For individuals with special learning needs or individuals facing barriers to their learning (low-income, single parents, unemployed, part-time and school dropouts).
To what extent have OLT projects been replicated elsewhere as models?
  • Observations of sponsors and partners
  • Distribution of LTI and CLN funded projects
    • funding levels
    • settings (home workplace, community learning centres)
    • end-users
    • regional differences
  • Increase knowledge of LT opportunities
  • Partner assessments of effectiveness
  • Document Review and Administrative Data Analysis
  • Interviews
  • Survey of funded projects
  • Case studies (with focus group)
  • Survey of unfunded projects
  • Survey of partners and community leaders
  • Panel of Experts
6. Are the projects and partnerships created through the OLT sustainable?

Would the organization have been able to make the progress that they have in introducing technology to develop skills if they had not had access to OLT funding?
  • Observations of sponsors and partners
  • Relative importance of OLT funding
    • New resources committed
  • Technical expertise developed
  • Project supported through a CAP site (CLN)
  • Projects beyond the expiry of OLT funding
    • Duration
    • Proportion of operations that continue
    • Level of co-operation between partners
    • Frequency of meetings
  • Administrative Data Analysis
  • Interviews
  • Survey of funded projects
  • Case studies
  • Survey of unfunded projects
  • Survey of partners
7. What did OLT do to promote learning technologies? Did it increase the sharing of knowledge and awareness about effective use of learning technologies and new approaches?
  • Observations of sponsors and partners
  • Distribution of OLT awareness funded projects
    • Funding levels
    • Settings (workshops, seminars, forums, promotion products, web-bases, LT tools)
    • Target audience
    • Regional differences
  • Document Review and Administrative Data Analysis
  • Interviews
  • Survey of funded projects
  • Case studies
  • Survey of unfunded projects
  • Survey of partners and community leaders
8. To what extent did OLT contribute to an improvement of accessibility of learning technologies? By end-user groups, equity groups and regions? Is there new and enhanced capacity of partners and networks to serve clients using LTs?
  • Observations of sponsors and partners
  • Distribution of LTI and CLN funded projects
    • funding levels
    • settings (home workplace, community learning centres)
    • end-users
    • regional differences
  • Comparative analysis of CAP sites and community colleges who received and did not receive OLT funding
  • Document Review and Administrative Data Analysis
  • Interviews
  • Survey of funded projects
  • Case studies
  • Survey of unfunded projects
  • Survey of partners and community leaders
9. What are the costs associated with each type of OLT funded projects and how does it compare with non-OLT projects? Is the OLT management model cost-effective?
  • Observations of sponsors and partners
  • Opinion of experts in the learning technology field
  • Comparative analysis of CAP sites and community colleges who received and did not receive OLT funding
  • Document Review and Administrative Data Analysis
  • Interviews
  • Survey of funded projects
  • Case studies
  • Survey of unfunded projects
  • Survey of partners and community leaders


[Previous Page][Table of Contents][Next Page]