Français | Contact Us | Help | Search | Canada Site | |
What's New | About Us | Policies | Site Map | Home |
Alternate Format(s)
|
The Question of Accountability: The idea broached with the Comprehensive Reporting Framework that the federal government should report on broad social and economic outcomes in relation to its own department-level plans and performance raises the "question of accountability": can a government be held accountable for societal-level performance? It was, and is, recognized that single governments could not be held uniquely accountable (in the strictest sense) for the performance of an economy or society: "Given the difficulty in attributing changes in these kinds of indicators to specific government actions, this type of reporting cannot be considered an instrument for holding governments accountable, although some may seek to use it in this way."30 Despite these issues of "attribution," such reporting is relevant for an analysis of the "contributions" a government makes.31 Furthermore, while the societal-level goals that are tracked and reported on in the Comprehensive Reporting Framework are beyond what government is solely responsible for (either in terms of what one can attribute as the effects of government action or in terms of the narrowly-defined constitutional obligations of a government) they are, nevertheless, areas where government has a significant role (Managing for Results 1998, p. 22). We could say, for instance, that while the Government of Canada is not solely responsible or accountable for Canada's environmental situation - with other players and natural processes having significant influence - the government, nonetheless, does have a role to play and invests considerable resources into the area; also, the government is "answerable" to Canadians and Parliamentarians for the situation and what actions it has taken to remediate the situation. It should also be noted that the Province of Alberta, Canada, a jurisdiction that is often held up as a leader in the use of societal indicators for government-wide reporting, issues its annual report, Measuring Up, as a means of being "accountable" to its citizens. The report, in fact, is produced in accordance with the province's Government Accountability Act.32 Surely, given what has been said above concerning attribution, a different sense of accountability must be at stake here. It has been suggested that the notion of accountability needs to be rethought in the context of modern government. That is, accountability should not be conceptualized in terms of compliance to rules and assigning of blame. Rather, governments should hold themselves accountable (in the sense of rendering an account), along with their partners, for "results." This is particularly the case when we try to get a grip on "horizontal accountability." That is, in the case of departmental programs, accountability is clear enough in terms of the administrative operations, rules and reporting relationships of the department in question. However, in the case of a horizontal initiative or issue, the partners must be held accountable to each other and to their stakeholders for results: for the achievement of the desired policy outcomes. In the horizontal world of "accountability for results," accountability is a matter of taking into account the complexity of the situation, monitoring and describing contributions made to the outcome and learning from past experience what works and what doesn't.33 4. Where We Are Now: Canada's Performance ReportBeginning in 2001, TBS took up the suggestion first broached during the construction of the Comprehensive Reporting Framework: to produce a public report, preferably tabled in Parliament, using societal indicators. The first such report is entitled Canada's Performance 2001.34 The President of the Treasury Board tabled it in Parliament on December 6, 2001. What is it?: Canada's Performance is the President of the Treasury Board's annual report to Parliament on government performance - taking the place of the former Managing for Results reports - the 2002 and 2003 instalments of Canada's Performance have been tabled and we plan to table the 2004 version in late November or early December. The reports provide information on a core set of societal indicators grouped into four themes: economy, health, the environment and communities. Trend information,35 international comparisons and disaggregations are provided, when applicable, for all of the indicators. This core set of indicators was built on the original sixteen indicators mentioned above. Consultations with departmental and external experts indicated that we needed to make the themes more "user-friendly" than the original three and that we needed to add three indicators: toxic contaminants, biodiversity and physical activity.36 The reports also provide information on certain key governmental programs that contribute to improving the quality of life of Canadians. In doing so, the Canada's Performance reports contribute to several of the modern management objectives described earlier:
Consultations: After tabling Canada's Performance 2001, TBS consulted with Canadians, think tanks, parliamentarians, governments and other partners on the approach adopted in the report.38 The consultations and engagement strategies focused on such issues as: selecting indicators that give a more comprehensive view of the economy, health, the environment and communities; presenting information in a manner that best helps Canadians to contribute to the shaping of government policy; using Canada's Performance to promote a growing culture of learning about how to manage for and by results, and engaging Canadians in the identification of themes and indicators that reflect their values and the range of issues that matter to them. Basically speaking, there are three lenses through which to view the indicators in a government-wide report such as this: in terms of government priorities, in terms of the concerns of Canadians and in terms of the accuracy and relevance of the data.39 More particularly, the consultations described above confirmed the following set of criteria with respect to the indicators and measures selected for inclusion in the report:
The indicators and approach used in Canada's Performance were also informed by the work of other organizations, such as National Roundtable of the Environment and the Economy (NRTEE) - which was mandated in 2000 to develop a set of national indicators that decision makers could use to track the impact of current economic practices on natural and human assets41 - as well as by the work on comparable health indicators undertaken by the federal, provincial and territorial governments of Canada.42 The Government is still committed to ensuring that we are tracking these types of societal-level outcomes. For instance, for certain priority areas, such as "Cities" and "Aboriginal peoples," the Government is working on developing, tracking and reporting on key indicators of progress. There are a few other important reporting principles which the Canada's Performance reports hold as sacred: balance (presenting both good and bad news), disaggregations to sub-groups or regional data (primarily through the electronic version),43 and the inclusion of both subjective and objective indicators (for e.g., self-rated health status in addition to life expectancy).44 Evolutions: The coverage of the report has expanded over the last couple of years. In 2003, climate change was added, bringing the core set of indicators up to twenty; for the 2004 version we plan to greatly expand the coverage by adding two whole thematic areas (Aboriginal Peoples and Canada in the World) and bringing the number of core indicators up to thirty-two. A key development, starting with the 2002 report, has been the construction of a whole-of-government framework to support the societal-level information (see Figure 1). The framework provides a "logic model" for the Government of Canada - mapping the contributions of government programs and departments to "horizontal" (or, "Government of Canada") outcomes and ultimately to the societal-level theme in question, e.g., "Health." If the framework is the logic model, the report itself provides the "performance story." The meat of the framework, so to speak, is provided in the electronic version of the report, which allows the reader to "drill down" to the more specific department- and program-level information provided in the Departmental Reports on Plans and Priorities as well as the Departmental Performance Reports. Figure 1: The Whole of Government Framework Another key development being planned for this year will be the move to a more rigorous linking of government plans and performance to the societal outcomes and indicators that are tracked - rather than just grouping departments into social issue areas, the 2004 report plans to formulate these areas as "Government of Canada Outcomes" or goals - down the road, these Government Outcomes and indicators could conceivably have targets or benchmarks. Lessons-learned: Reception on the whole has been good. Public policy experts have been enthusiastic.45 So too have senior managers in the federal government - who believe that the "whole-of-government" perspective that the report provides allows them to situate their program or policy in the larger picture. However, there is some room for improvement when it comes to making the report more useful for Parliamentarians; similarly, we need to make the report more well known among Canadians. It could be that the objectives of the report are not always clear to Parliamentarians - since it is purporting to serve many causes. Along these lines, a lesson learned is the importance of targeting a primary audience to ensure a collective perception of the report's purpose. Clearly identifying the primary audience allows us to tailor the information in the report to explicitly meet the objectives of the reader, making the information more meaningful and useful. 5. Possible Future Directions: Government-wide PlanningDuring the construction of the Comprehensive Reporting Framework, two general purposes for this type of reporting were discerned: "In particular, the government would need to distinguish between using such reporting to "inform" broad policy processes and making an explicit linkage between QOL reporting and priority setting."46 As it stands, it is not entirely clear whether Canada's Performance is seen as something to "inform" policy or if it is to be rigidly linked to a government-wide planning process. As a result, a possible future direction for the Government of Canada would be to clarify this by making the report more closely aligned with government planning and priority setting.47 This move would take place in the context of the current Government's commitment to continually reallocate from low to high priority issues. The links made would have to show, then, how this type of reporting could drive not only priority setting but planning in the context of reallocation - perhaps via its use by Treasury Board and Cabinet Ministers when reviewing allocation and reallocation proposals. A short-term step that could be taken would be to include financials in the report: how much is Canada spending on the environment, or more particularly, on reducing the effects of climate change? This step is also in keeping with the example provided by Alberta's Measuring Up, which includes the Alberta Government's Consolidated Financial Statements.48 Also, this notion of providing government-wide information on results and spending is enshrined in Results for Canadians: in order to "ensure rational priority setting and investment decisions, the government needs integrated, cross-departmental information on expenditures and results." The government-wide view of expenditures and results could serve as a context both for the assessment of the performance of government programming and for the setting of future priorities and plans: "First, it allows decision-makers to assess the integrity of the existing program base. ... Second, the knowledge gained from the broad-based analysis of expenditure supports rational priority setting."49 This would also require a formalization of the government-wide planning process in accordance with the thematic areas (or "Government of Canada Outcome" areas) included in the Canada's Performance framework. One way of formalizing this process would be to pilot interdepartmental planning and budget consultation (at the Deputy Minister level) on one or two of the themes in Canada's Performance. If formalized, this planning process could result in a corresponding government-wide report on plans (Canada Plans) - to act as the bookend to the Canada's Performance report. In its recently tabled Report on Plans and Priorities, the TBS made public its plan to explore the "development of a whole-of-government planning report that would express the government's targets and provide a clearer basis for reporting on Canada's performance over the medium term."50 6. ConclusionFrom the perspective of the Government of Canada's management board, key societal indicators can be useful for government-wide analysis. They can be used to achieve a deeper understanding of broad societal trends in order to guide policy and planning, and to provide a context within which government performance can be assessed. The Government's initial explorations of this possibility have led to the production of an annual report, Canada's Performance. The annual report certainly fulfils the latter of these purposes: namely, it provides a context for assessing government performance. However, the explicit link to the planning process is not there yet. TBS is planning to explore the development of a whole-of-government planning report; that report could complement Canada's Performance and could make the link between societal indicator reporting and government-wide planning more explicit. If pursued to its logical end, this report on Canada's Plans (along with the existing report on Canada's Performance) would be a realization of the comprehensive reporting framework: with departmental planning and performance information (in the individual departmental reports, accessible through the electronic versions of the government-wide reports), societal-level outcome information (in the annual, government-wide planning and performance reports themselves), and planning and performance reporting around horizontal or "Government of Canada Outcomes." This latter element is the element that still needs the most work.51 The next step for the Government of Canada in this regard, then, could be to develop a government-wide planning process (that would support the corresponding planning report) based on these Government of Canada Outcomes.
1. Canada. Treasury Board of Canada, Canada's Performance 2003, Ottawa: Queen's Printer, 2003; http://www.tbs-sct.gc.ca/report/govrev/03/cp-rc_e.asp. [Return] 2. Canada. Treasury Board of Canada, Results for Canadians: A Management Framework for the Government of Canada, Ottawa: Queen's Printer, 2000, p. 31; http://www.tbs-sct.gc.ca/report/res_can/rc_e.asp. [Return] 3. See http://www.parl.gc.ca/InfoComDoc/36/2/HAFF/Studies/Reports/haffrp037-e.html. [Return] 4. Bennett, Carolyn, Lenihan, Donald G., Williams, John and Young, William, "Measuring Quality of Life: The Use of Societal Outcomes by Parliamentarians," Ottawa: Centre for Collaborative Government, 2001; http://kta.on.ca/pdf/cg3.pdf. [Return] 5. Canada. Treasury Board of Canada Secretariat, "Rising to the Challenge: A Statement on Results and Results Reporting for Public Service Executives," unpublished paper, November 2004, p. ii. [Return] 6. Canada. Treasury Board of Canada, Results for Canadians: A Management Framework for the Government of Canada, Ottawa: Queen's Printer, 2000, p. 11. Canada's approach to Results-based Management from the mid-1990's to 2000 is summarized in "Results-based Management: Country Report Prepared for the OECD Outcome-focused Management Project." December, 2000. See http://www.ppx.ca/NewsArchives/PDF/Result_Based_Management.pdf. See also, IDEA International Institute, "Results-based Management: Lessons Learnt from Case Studies," September, 2003, http://www.idea-international.org/docs/IDEA_RBM_final_report_19_09_03_Revised.pdf; and Bob Segsworth, "Accountability, Evaluation and Performance Monitoring: A Comparative Perspective," Investing in People: Creating a Human Capital Society for Ontario, RP (15), June 2003; http://www.law-lib.utoronto.ca/investing/reports/rp15.pdf. [Return] 7. Canada, Treasury Board Secretariat, Getting Government Right: Improving Results Measurement and Accountability: Annual Report to Parliament by the President of the Treasury Board, Ottawa: Queen's Printer, 1996, p. 2; see also, Accounting for Results 1997, Ottawa: Queen's Printer, 1997, p. 13-19, (http://dsp-psd.pwgsc.gc.ca/Collection/BT1-10-1997E.pdf); Managing for Results 1998, Ottawa: Queen's Printer, 1998, p. 9-15; Managing for Results 1999, Ottawa: Queen's Printer, 1999, p. 15-28; Managing for Results 2000, Ottawa: Queen's Printer, 2000, p. 5-19 ( http://dsp-psd.pwgsc.gc.ca/Collection/BT1-10-2000E.pdf ). [Return] 8. Bakvis, Herman and Luc Juillet, Horizontal Challenge: Line Departments, Central Agencies and Leadership, Canada School of Public Service, 2004, p. 9-16. [Return] 9. Canada. Treasury Board of Canada Secretariat. "Quality of Life - A Concept Paper: Defining, Measuring and Reporting Quality of Life for Canadians," 2000, p. 1; http://www.tbs-sct.gc.ca/pubs_pol/dcgpubs/pubsdisc/qol_e.asp. [Return] 10. While the Quebec government subscribes to the general principles of this document, it did not participate in its elaboration. However, it does contribute by sharing information and best practices. The Quebec government intends to continue treating this question with the federal government in a bilateral way. All references to joint positions of the federal, provincial and territorial governments in this document do not include the Quebec government. [Return] 11. That does not mean, however, that these traditional measures should be completely abandoned. See Joseph H. Michalski, "Quality of Life in Canada: A Citizens' Report Card - Background Report," July 2002, p. 7; http://www.cprn.com/en/doc.cfm?doc=47: "While the traditional measures of economic growth continue to be important benchmarks for economists to model certain types of economic behaviour, several analysts have attempted to utilize the tools of the social sciences to develop alternative accounting systems. For example, the HDI measures 'progress' through a composite index with three main components: the standard of living (GDP per capita and income above the low income cut-offs), educational attainment (adult literacy and years of schooling), and longevity or life expectancy." For a good summary of the background of societal or "quality of life" research, see also Pierre André and Dieudonné Bitondo, Development of a Conceptual and Methodological Framework for the Integrated Assessment of the Impacts of Linear Infrastructure Projects on Quality of Life, Canadian Environmental Assessment Agency's Research and Development Program, 2001, section 3.1. http://www.ceaa-acee.gc.ca/051/index_e.htm. [Return] 12. This resurgence in interest in societal indicator research was noted in the President of the Treasury Board's report to Parliament, Managing for Results 1998: "There appears to be a renewed interest in recent years in developing additional indicators of economic and social well-being to better reflect what people want to know about how their society is doing. Within some think-tanks and research organizations, the term 'societal indicator' is also beginning to include ideas such as public engagement and building a broader social consensus on what should be measured and how" (1998, 22). [Return] 13. Bennett, Carolyn, Lenihan, Donald G., Williams, John and Young, William, "Measuring Quality of Life: The Use of Societal Outcomes by Parliamentarians," Ottawa: Centre for Collaborative Government, 2001, p. 13; http://kta.on.ca/pdf/cg3.pdf. See also, "Quality of Life - A Concept Paper," p. 3. [Return] 14. See Legowsk, Barbara, A Sampling of Community- and Citizen-driven Quality of Life/Societal Indicator Projects, Ottawa, 2000; http://www.cprn.com/en/doc.cfm?doc=84. [Return] 15. Canadian Policy Research Networks, http://www.cprn.com/en/doc.cfm?doc=45. [Return] 16. Legowsk, Barbara, A Sampling of Community- and Citizen-driven Quality of Life/Societal Indicator Projects, Ottawa, Canadian Policy Research Networks, 2000, p. iv: "Projects launched and maintained outside formal institutions where policies are made and resources assigned tend to serve as monitoring, information and advocacy tools. Depending on the credibility of the processes of development and the values framework underpinning the initiative, the project outputs may gain the recognition of institutions that control policy and resources. In contrast, projects undertaken within institutions that control policy and resources, as well as being information tools, can actively direct policies and programs and monitor results for feedback purposes." [Return] 17. Canada, Treasury Board Secretariat, Getting Government Right: Improving Results Measurement and Accountability: Annual Report to Parliament by the President of the Treasury Board, Ottawa: Queen's Printer, 1996. [Return] 18. Canada, Treasury Board Secretariat, Accounting for Results 1997, Ottawa: Queen's Printer, 1997, (http://dsp-psd.pwgsc.gc.ca/Collection/BT1-10-1997E.pdf); Managing for Results 1998, Ottawa: Queen's Printer, 1998. [Return] 19. See Ekos Research Associates, "The Use of Social Indicators as Evaluation Instruments," August 1998, p. 19; (http://www.sdc.gc.ca/en/cs/sp/sdc/evaluation/sp-ah064e/page09.shtml). [Return] 20. See Treasury Board Secretariat, "Guide for the Development of Results-based Management and Accountability Frameworks," (http://www.tbs-sct.gc.ca/eval/pubs/RMAF-CGRR/rmafcgrr_e.asp). [Return] 21. In Canada, the concept of "horizontal results" has developed over the years; being called alternately "sectoral results" (Accounting for Results 1997, p. 19), "collective results" (Managing for Results 1998-2000), and "shared outcomes." [Return] 22. Treasury Board Secretariat, "Companion Guide: The Development of Results-based Management and Accountability Frameworks for Horizontal Initiatives," June 2002; (http://www.tbs-sct.gc.ca/eval/tools_outils/comp-acc_e.asp); also Treasury Board Secretariat, "Managing Collaborative Arrangements: A Guide for Regional Managers," (http://www.tbs-sct.gc.ca/rc-cr/guide_rm/index_e.asp). [Return] 23. Treasury Board Secretariat, Preparation Guide Departmental Performance Reports 2003-2004, (http://www.tbs-sct.gc.ca/rma/dpr/03-04/guidance/guide_e.asp#_Toc70476510). [Return] 24. Treasury Board Secretariat, Horizontal Results Database, (http://www.tbs-sct.gc.ca/rma/eppi-ibdrp/hrdb-rhbd/profil_e.asp). [Return] 25. Treasury Board Secretariat, Social Union Framework Agreement: Accountability, (http://www.tbs-sct.gc.ca/rma/account/sufa-ecus_e.asp). [Return] 26. Every year, as part of the documentation produced to support the appropriation of funds from Parliament, the government tables two sets of departmental reports in Parliament. In the spring, departments and agencies produce their Reports on Plans and Priorities for the coming fiscal year. In the fall, they provide Parliamentarians with their Departmental Performance Reports indicating achievements attained over the previous fiscal year. [Return] 27. "Quality of Life - A Concept Paper," p. 9. The framework was tabled in Parliament in the President's Annual Report, Managing for Results 1999. [Return] 28. "Quality of Life - A Concept Paper," p. 2. As an example of the relations of the three levels of information: "...the results achieved by a specific federal program, such as pre-natal care, contribute to the achievement of a shared goal articulated in the National Children's Agenda, and are intended to reduce infant mortality rates which is an indicator of QOL" (p. 10). [Return] 29. "Quality of Life - A Concept Paper," p. 7. [Return] 30. "Quality of Life - A Concept Paper," p. 2; see also p. 8: "this kind of transparency and accountability is the objective of the movement towards a values and results based, learning approach to modern public management which is increasingly reflected in the Departmental Performance Reports. QOL reporting could also be a component of modern public management, but in a way that clearly reflects governments' often limited ability as one player to directly affect selected QOL indicators. Thus, QOL reporting should not be seen as an instrument for government accountability (although some will choose to use it this way) but rather for informing the policy agenda. For a comprehensive approach to reporting, however, it could be complemented by program results and service delivery reporting by governments that does provide citizens with information on the specific actions of government which are ultimately intended to affect Canada's quality of life." On the "problem of attribution" with respect to social indicators, see also Ekos Research Associates, "The Use of Social Indicators as Evaluation Instruments," August 1998, p. 23; (http://www11.hrdc-drhc.gc.ca/pls/edd/SIEI.shtml); on the distinction between "performance" indicators which measure the performance of government programs and "social" indicators which measure societal-level outcomes, see Anoma Armstrong et al, "Difficulties of Developing and Using Social Indicators to Evaluate Government Programs: A Critical Review," (http://www.evaluationcanada.ca/distribution/ 20021030_armstrong_anona_francis_ronald_bourne_michael_dussuyer_inez.pdf). [Return] 31. See Mayne, John, "Addressing Attribution through Contribution Analysis: Using Performance Measures Sensibly," Office of the Auditor General, June, 1999; (http://www.oag-bvg.gc.ca/domino/other.nsf/html/99dp1_e.html). [Return] 32. See Speers, Kimberley, "Performance Measurement in the Government of Alberta: Propaganda or Truth," June 2004; (http://www.cpsa-acsp.ca/papers-2004/Speers.pdf). [Return] 33. See Mayne, John, "Modernizing Accountability Practices in the Public Sector," January, 1998; (http://www.tbs-sct.gc.ca/rma/account/oagtbs_e.asp); also Donald G. Lenihan, John Godfrey, Tony Valeri, and John Williams, "What is Shared Accountability," Policy, Politics and Governance vol 5, November, 2003; (http://kta.on.ca/pdf/ppg5.pdf); Donald G. Lenihan, John Godfrey, Tony Valeri, and John Williams, "Accountability for Learning," Policy, Politics and Governance vol 4, June, 2003; (http://kta.on.ca/pdf/ppg4.pdf); and Donald G. Lenihan, John Godfrey, Tony Valeri, and John Williams, "Horizontal Government: The Next Step," Policy, Politics and Governance vol 2, February 2003; (http://kta.on.ca/pdf/ppg2.pdf);. [Return] 34. Canada, Treasury Board Secretariat, Canada's Performance 2001, Ottawa: Queen's Printer, 2001, (http://www.tbs-sct.gc.ca/report/govrev/01/cp-rc_e.asp); Canada's Performance 2002, Ottawa: Queen's Printer, 2002, (http://www.tbs-sct.gc.ca/report/govrev/02/cp-rc_e.asp); Canada's Performance 2003, Ottawa: Queen's Printer, 2003, (http://www.tbs-sct.gc.ca/report/govrev/03/cp-rc_e.asp). [Return] 35. On the importance of trend information, see "Quality of Life - A Concept Paper," p. 5. "Trend analysis for each indicator would have to be undertaken, since the most useful QOL measurement is not a one-time snapshot but rather an analysis of the change in the data over relevant time frames." [Return] 36. This core set of 19 indicators formed the basis of the 2001 and 2002 reports. In 2003, an indicator of climate change (Greenhouse Gas Emissions) was added. For the 2004 report, we plan to greatly expand the coverage, adding two whole thematic areas and increasing the number of indicators tracked to thirty-two. [Return] 37. As David Zussman points out, another objective of this type of reporting could be "building trust in government": "Greater information should pave the way for increased engagement in public policy debates, whether through government-led consultations or through active personal participation in policy formulation." ("Evidence-based Policy Making: Some Observations on Recent Canadian Experience," April 2003; http://www.ppforum.ca/fr/). [Return] 38. In addition to focus groups with external experts, Canadians, and Members of Parliament, as an initial gauge of the usefulness and quality of the report, a short questionnaire was included in the print and electronic versions. These questionnaires were in keeping with the government's commitment to taking the views of Canadians into account in subsequent reports. Feedback on the report is also garnered through two of the Secretary of the Treasury Board's advisory boards: the External Advisory Panel consists of experts from other jurisdictions as well as public policy experts such as David Zussman and Judith Maxwell; senior public servants are also consulted via the Secretary's Advisory Committee of Deputy Ministers. [Return] 39. "Quality of Life - A Concept Paper," p. 6. [Return] 40. On the need for citizen engagement, see "Quality of Life - A Concept Paper," p. 8: "... QOL reporting is the further evolution beyond transparency and accountability to actually engaging citizens in the agenda setting and policy development process. Some have described this as an evolution in thinking about citizens not just as voters or consumers of public services but as partners in governance. Public opinion polling has clearly demonstrated that citizens want to participate in discussions about public policy issues of importance to them, particularly those involving fundamental values and tradeoffs among values, and that they are not satisfied with the traditional vehicles of information sharing and consultation that governments have used to involve citizens in the policy process." This type of reporting on quality of life and citizen engagement on indicators is also a way of forging shared understanding on our goals: "The final QOL indicators agreed upon must be relevant to citizens and reflect their values about what contributes to QOL. Citizens would have to be involved in the identification of the indicators and the actual measures used to assess performance. Experts would have to be engaged to ensure that the methodology behind the reporting is credible." ("Quality of Life - A Concept Paper," p. 2.). The Quality of Life Indicator Project (described on page 6 of this paper) is a good example of the value that citizen engagement has in indicator development. [Return] 41. See the report released in May 2003, State of the Debate: Environment and Sustainable Development Indicators for Canada, available at http://www.nrtee-trnee.ca/eng/programs/Current_Programs/SDIndicators/index.html. [Return] 42. See the federal report that ensued from this work: Healthy Canadians: the Latest Indicators from the National Perspective, available at http://www.hc-sc.gc.ca/iacb-dgiac/arad-draa/english/accountability/indicators.html. [Return] 43. "Quality of Life - A Concept Paper," p. 6: "For example, the story on Canada's life expectancy data is a positive one at a national level, but life expectancy data for aboriginal persons tells a very different story. A related issue is whether data should be provided on a regional basis in order to be more relevant to citizens. This is technically feasible through designing a web-site on the broad indicators allowing users to drill down to get more detailed information." On the report's capacity to "drill down" to more detailed levels of information, see David Zussman, "New tool helps track how our money is spent," April 14, 2003 - Ottawa Citizen; (http://www.ppforum.ca/fr/). [Return] 44. "Quality of Life - A Concept Paper," p. 3: "The literature acknowledges that such a concept has both a subjective and objective dimension. "Subjective quality of life is about feeling good and being satisfied with things in general. Objective quality of life is about fulfilling the societal and cultural demands for material wealth, social status, and physical well-being." (QOL Research Centre, Denmark). This presents a challenge to the measurement and reporting of QOL. For example, a subjective indicator, such as a satisfaction survey, might demonstrate that a group of people reports a high level of QOL, while objective indicators of health, housing, income, and education for the same population might suggest a lower level of QOL, perhaps as compared to other people. Which is the most relevant measure of QOL and which should guide agenda setting and policy making?". [Return] 45. See David Zussman, "New tool helps track how our money is spent," April 14, 2003 - Ottawa Citizen; (http://www.ppforum.ca/fr/; and CCAF Update: Canada's Performance 2001; ( http://www.ccaf-fcvi.com/english/index.html). [Return] 46. "Quality of Life - A Concept Paper," p. 4. [Return] 47. The idea of aligning Canada's Performance more closely to the Government's planning and accounting cycle was presented in the context of societal indicator reporting in other jurisdictions to the External Advisory Panel, where it was well received. The other jurisdictions presented at this meeting were: Australia's Measuring Australia's Progress; New Zealand's The Social Report, the UK's Achieving a Better Quality of Life, Minnesota State's Minnesota Milestones, and Alberta's Measuring Up. Reporting in this way seems to be inline with accepted best practices in other jurisdictions and may facilitate results-based appropriations in the future. [Return] 48. Assigning financial information to the current reporting framework of Canada's Performance may prove to be a complex task when dealing with programs whose activities contribute to reaching more than one Government of Canada Outcome. For example, one social program may lead to a positive outcome in the areas of health and community, but trying to allocate an exact monetary value to these two outcomes is difficult. [Return] 49. Canada. Treasury Board of Canada, Results for Canadians: A Management Framework for the Government of Canada, Ottawa: Queen's Printer, 2000, p. 13. [Return] 50. Canada. Treasury Board of Canada, Secretariat. 2004-05, A Report on Plans and Priorities, p. 29; (http://www.tbs-sct.gc.ca/est-pre/20042005/TBS-SCT/pdf/TBS-SCT_e.pdf). [Return] 51. We are beginning to gain ground, however, in this area as well. For instance, over the last year, TBS has worked with departments to build a comprehensive framework to account for contributions made by the government to the societal-level goal of reducing the effects of climate change - (i.e., by reducing GHG emissions). Similarly, the government has committed to providing a report card on Aboriginal peoples; as a result, TBS is working with departments to build a horizontal framework capturing the contributions made by all federal departments and agencies to the quality of life of Aboriginal peoples. These developments build on the earlier work on "horizontal frameworks" (e.g., children) described earlier. [Return]
|