CEF: Past Event Material (prior to 2017)

Please find below a chronological index list of previous CEF presentations held prior to 2017, which date back to 2008.

To find information of interest, please scroll the below page or, use your browser's search function to look for relevant words such as "data", "planning", "health" etc. Please note that the descriptions are of the resources available here. These resources may be different from the information provided at the original event. If you require assistance with this page please email the IPAA office.

The below information has been compiled by Richard Lansdowne, CEF Faciliation Group Member for all CEF members to use.

Date and event Description of resources available
20 October 2016
Reflections on Evaluation

Michael D'Ascenzo, the former Australian Tax Office Commissioner talked about his experience working as an ex agency head, reflecting on how evaluation played a role in core Tax Office activities in a large Agency and how it was prioritised. There are no PowerPoint slides for this discussion.

22 September 2016
Data Visualisation

Richard Lansdowne, CEF Facilitation Group Member and Dr Sarah Olesen, Senior Data Visualisation Consultant and Science Writer at Biotext discussed the importance of correctly Visualising Data. With data being communicated so widely, there is now a greater need for readers to be persuaded by statistics, graphs and other data displays, by equally positioning words, images and infographics alongside the data as a source of evidence and storytelling in many forms of publications. [PPTX 56 pages.]

18 August 2016
Evaluations That Made a Difference

A panel of subject matter experts spoke about evaluations that have made a difference to the design and development of policy - how do evaluations assist in decision making? how do you know when evaluations have made an impact? Does evaluation retain its currency? The speakers were Dr Jess Hart, Chair of the Board of Directors, Clear Horizon Consulting, Mr Brook Dixon, Director of Regulatory Reform, ACT Government, Ms Gillian Shaw, Director of Nous Group and Mr Scott Bayley, Principal Specialist, DFAT. [PPTX 48 pages].

28 July 2016
Evaluating Collective Impact

Kerry Graham, collaboration and complexity specialist, from Collaboration for Impact and Regina Hill, Evaluation and Complexity specialist from Effective Consulting explored the evaluation approach required for complex problems. Kerry shared a case study from the Bourke Aboriginal Community - one of the first justice reinvestment trials in Australia. To bring the evaluation to life, Regina shared how developmental evaluation is being applied in 8 collective impact sites across Victoria. [PPTX 34 pages].

28 June 2016 
Big Data Perspectives on Agile Evaluations

Gavin McCairns, Deputy CEO, AUSTRAC and John Cumming, Chief Digital Officer, ACT Government discussed the general thirst of society for wanting to know everything and knowing it right - how big data and public and private relationships can be harnessed to generate intelligence.  [PPTX 8 pages].

21 April 2016
Statistics in Evaluation

Mr David W. Kalisch, Australia Statistician and Head of the Australian Bureau of Statistics discussed 'Understanding the Power of Statistics in Evaluation', and how statistics can be used effectively to evaluate the success of policies and programs. [PPTX 25 pages].

17 March 2016
Diversity

Emeritus Professor Meredith Edwards, Professor Deborah Blackman and Sarah Goulding  discussed the findings of gender and disability studies, the impact of unconscious bias and what suggestions there are for change. The Forum also examined case studies which looked at the evaluation of diversity in overseas aid programs.

19 November 2015
Complex Program Lifecycles: Evaluating Success

November's CEF explored the challenges of dealing with complexity in the design phase of new initiatives and how this translates through to evaluating success through the program lifecycle with guest speaker, International Centre for Complex Project Management (ICCPM), Managing Director and Chief Executive Officer, Ms Deborah Hein. [PPTX 25 pages.]

17 September 2015
What’s ethics got to do with it?

Kyleigh Heggie, Director, Research, Department of Veterans Affairs discussed DVA’s Tele-monitoring Trial (which provides in-home health monitoring electronically), covering the context, results to date, and the ethical and privacy issues associated with the trial and evaluation. [PPT 11 pages. ] Gary Kent, Head Governance, Australian Institute of Health and Welfare gave an international and Australian context on ethics in research and evaluation; described arrangements operating in AIHW and findings of a 2011 review of those arrangements. [PPTX 17 pages. ]

16 July 2015
Social Return on Investment (SROI) - Indigenous Justice Programme

Mr Simon Faivel - Director, Social Ventures Australia discussed Social return on Investment (SROI). The slides describe the principles behind the approach to evaluation; gives three examples where PM&C contracted forecast Social Return on Investment on indigenous projects; describes the SROI approach, and reflects on the assurance process. [PDF 7 pages. ]

21 May 2015
Building an Evaluation Culture – DFAT & IEC

Dereck Rooken-Smith, Assistant Secretary, Office of Development Effectiveness, Department of Foreign Affairs and Trade. The resource is a single graphic of the evaluation-framework used to assess the performance of the aid program. [PDF 3 pages. ]

19 March 2015
Are we there yet?

Mike Mrdak, Secretary, Department of Infrastructure and Regional Development. Full text of talk on their experience in developing their evaluation-capability, and most importantly, evaluation-culture, since 2011. [PDF 9 pages. ] Copy of 2012-16 "Departmental Evaluation Strategy" [PDF 16 pages. ] Copy of 2013 "Departmental Guide to Incorporating Monitoring and Evaluation into Policy, Program and Regulatory Design". Purpose of document is "This guide complements the Departmental Evaluation Strategy and supporting documents by briefly and clearly setting out how you should go about developing a monitoring and evaluation (M&E) framework – that is, the framework or strategy which describes how you are going to measure the success or otherwise of your program." [PDF 36 pages. ]

16 October 2014
Building evaluation capacity in the Department of Immigration and Border Protection

Wendy Southern PSM, Deputy Secretary, Department of Immigration and Border Protection. Slides give the strategic objectives of evaluation-capacity building; an example program-logic; and status of a DIBP organisational maturity-model for evaluation [PDF 7 pages. ]

28 August 2014
Strengthening the Commonwealth Performance Framework

Stein Helgeby, Deputy Secretary Governance and Resource Management, Department of Finance. Slides provide an overview of reforms to accountability with the new PGPA Act requirements; describe the phased approach for improvements to setting of targets and KPIs and subsequent reporting and accountability. [PDF 28 pages. ] Copy of Enhanced Commonwealth Performance Framework Discussion Paper, August 2014 [PDF 73 pages. ]

19 June 2014
People, Pulses, Poultry, Pigs, Prawns and Poverty – Evaluating the impact of agricultural research

David Shearer (General Manager, Corporate) and Andrew Alford (Program Manager - Impact Assessment), Australian Centre for International Agricultural Research (ACIAR). Slides give: Overview of ACIAR as part of the Australian Aid Program; Background to ACIAR’s impact assessment program; Methods and Approaches including Strategy logic in research projects – Impact Pathways; and that ACIAR research has had a benefit:cost ratio (BCR), 5:1; discusses several case-studies; and Lessons learned from Impact Assessments [PDF 14 pages. ]

15 May 2014
Evaluation in Defence

Mr Brendan Sargeant, Associate Secretary – Chief Operating Officer Department of Defence. Slides give an overview of Defence's 'journey' for improved accountability and evaluation, describe specific challenges in evaluation for defence, and emphasise the importance of culture as well as process. [PDF 9 pages. ]

01 April 2014
Measuring Programme Performance: Do we really ‘get it’ – perspectives from the Pilot Project to Audit KPIs

Mr. Steve Chapman, Deputy Auditor-General, Australian National Audit Office. An overview of findings from ANAO Report No.21 2013-14 Pilot Project to Audit Key Performance Indicators. The report observed little change within Finance guidance, and key findings previously made by the ANAO and the JCPAA remain largely unaddressed; and confirmed that the implementation of performance measurement and reporting requires more focused attention by agencies. [PDF 11 pages. ]

01 October 2013
Evaluation Steering Committees

David Roberts, Assistant Director Portfolio Evaluation and Review in Defence Department of Defence. Slides provide a short description of the role and success of committees which oversight evaluations at Defence. [DOC 1 pages. ]

19 September 2013
Building evaluation into the fabric of an organisation

Pierre Skorich, The Clean Energy Regulator. With a mixture of text and diagrams, the slides explain the CER's business operating model in terms of three strategic activities(Maximising organisational effectiveness, Managing clients’ legislative obligations, and facilitating the Carbon and Renewable Energy Markets). The underlying issues, risks, and approach including evaluation is explained for each strategic activity. [PDF 19 pages. ]

15 August 2013
National Drought Program Reform

Elizabeth Robertson, Department of Agriculture, Fisheries and Forestry. Slides provide background to government support for drought, describes a two year pilot (2010-2012) with independent-review and details of subsequent policy reforms [PPT 16 pages. ]

18 July 2013
ACT Perspective on Justice Reinvestment: Social investment

Rod Little, ACT Government. Slides describe ACT goals / framework for social investment and ACT Aboriginal & Torres Strait Islander Elected Body [PPT 7 pages. ]

20 June 2013
Sharing information about choosing and using evaluation options

Patricia Rogers, RMIT University. Slides provide a comprehensive overview of the global Better Evaluation initiative (http://betterevaluation.org) . The initiative provides over 200 methods/options related to 35 tasks in 7 clusters (Manage, Define, Frame, Describe, Understand causes, Synthesis, Report and support use) with several worked scenarios. Also provides an AusAID perspective on partnering with Better Evaluation. [PPT 43 pages. ]

16 May 2013
Evaluation capacity building: the international experience

Scott Bayley, AusAID. Slides cover: What is evaluation capacity building(ECB)?;Why do it?; Strategies for ECB; International examples; and What works? – guiding principles [PPT 30 pages. ] An  International  Workshop  Agreement   on   Evaluation  Capacity  Development, Oct 2011: Report from workshop, covering Current situation, Principles  for  Evaluation  Capacity  Development, and   Framework  for  Addressing  Evaluation  Capacity  Development [PDF 91 pages. ]

18 April 2013
ACT Evaluation Capability: We’ve talked the talk.  Are we walking the walk?

Brook Dixon, ACT Government. Slides cover: plans to improve evaluation (ACT Government Evaluation Policy and Guidelines); Achievements (progress of implementation; milestones); What we’ve learnt; and What we’re going to do next. [PPSX 18 pages.]

21 March 2013
Auditor-General Performance Audits: catalyst for change or hurdles to be overcome?

Dr Maxine Cooper, ACT Auditor-General. Speaking notes: describes the role of the ACT AG; contrasts performance auditing and evaluations: both can consider efficiency, effectiveness and compliance but performance audit does not consider the merits of government policy whereas this maybe the very point of an evaluation; approach to selection of audit topics (e.g. risk, value and also focus areas such as sustainability and service improvement); values and ethos of auditors; case-studies: child protection, emergency services and early childhood education. [DOCX 14 pages. ] Slides: Mainly pictures; includes 6 dot points of areas of audit focus. [PPT 18 pages. ]

01 November 2012
Evaluation of Learning and Development An ATO Perspective

Nancy Moretti, Con Sotidis, ATO Learning & Development Australian Taxation Office. Slides cover the recent history and projects of ATO Learning and Development (i.e. centralisation); The Learning and Development Evaluation Framework, selection criteria for what to evaluate; and example Evaluation plan of an LD product ('Ethical Behaviour Matters') [PDF 9 pages. ]

20 October 2012
Haven’t we been this way before? Learning and the politics of evaluation

Dr Wendy Jarvie, Professor Jenny Stewart; School of Business, University of NSW at the Australian Defence Force Academy, Canberra. Slides cover: Why learning (e.g. from program success / failure) is important; that in practice learning is limited (e.g. Indigenous Policy and Programs, Defence Procurement); the key factors and blockers and barriers; what facilitates learning; and what this means for evaluators [PDF 24 pages. ]

18 October 2012
Evaluation in a Changing World: Reflections on the Australasian 2012 Evaluation International Conference

John Owen, Centre for Program Evaluation, University of Melbourne. Slides cover reflections on the 2012 Australian Evaluation Society Conference as an Evaluation Object [Intervention]; on the conference content about: the Evaluation/Intervention Interface, Emerging Practices; Missing content; and the way forward. [PPT 17 pages. ]

20 September 2012
Maximising Census data for Evidence-Based Decision Making – Now and into the Future

Jill Charker ,First Australian Statistician Population, Education and Data Integration Division, Australian Bureau of Statistics. Slides cover: an overview of the 2011 Census Overview (purpose and changes); the use Census data for decision making (with a case study of the 'Closing the Gap' initiative for improved health and wellbeing of the Aboriginal and Torres Strait Islander population); accessing 2011 Census data; evaluating the 2011 Census; and future directions for the 2016 Census. [PDF 35 pages. ]

16 August 2012
Sex, Lies and Evaluation

Mairi Steele, Office for Women, Department of Families, Housing, Community Services and Indigenous Affairs. Slides discuss the role of Office of women, and approaches to deeper analysis of gender-equality and women's issues. [PPTX 15 pages. ]

19 July 2012
Justice Reinvestment – is it a solution?

Dr Tom Calma AO, National Coordinator Tackling Indigenous Smoking. Slides explain Closing the Gap'; provides detailed statistics on the gap in the area of justice; explains 'Justice Reinvestment'- a data driven approach to reduce corrections spending and reinvest savings in strategies that can decrease crime and strengthen neighbourhoods; highlights importance of evaluation to both gain insight into prior or existing initiatives, and enable reflection and assist in the identification of future change. [PDF 50 pages. ]

01 July 2012
Bridges and Barriers - Indigenous incarceration and Health

National Indigenous Drug and Alcohol Committee (NIDAC). Slides provide: an overview of NIDAC; the governance structure of the 2010-15 National Drug Strategy; statistics on indigenous incarceration and health; and an overview of approaches to addressing the issues and of justice reinvestment. [PPTX 25 pages. ]

21 June 2012
Ethical, robust and participatory evaluation & research in remote NT communities

Department of Families, Housing, Community Services and Indigenous Affairs. Slides describe: principles and approach to the Northern Territory Emergency Response (NTER), with details on the approach used to gain confidence from indigenous communities; practical difficulties in working in remote communities; comments from communities; lists reports produced; challenges and next steps. [PPT 42 pages. ]

17 May 2012
Does evaluation really add value?

Janet M. Clinton, Centre for Program Evaluation. Slides with pictures and short phrases to support the talk. Discusses whether and how evaluation can have an impact. Suggests evaluation can be seen as part of the overall intervention. [PDF 20 pages. ]

19 April 2012
Water Trading: Supporting resilient regional communities

Penny Fiddes, National Water Commission Slides describe history of water trading; statistics on extent of trading; explains benefits in general terms [PPTX 34 pages. ]

15 March 2012
Making a lasting improvement to compliance

Adam Kendrick, Assistant Commissioner, Promoter Risk and Intelligence, Australian Taxation Office. Slides describe ATO's operating context; the goal of improving the effectiveness of compliance activities (incl. program logic); the process of developing a conceptual framework for evaluating the effectiveness of compliance activities; designing and implementing an evaluation methodology; and the methodology in practice. [PDF 23 pages. ]

16 February 2012
Evidence-based Indigenous Justice Policy

Roger Wilkins AO, Attorney-General's Department. Slides cover: putting justice policy into context of the Closing the Gap targets; provides statistics on the gap between indigenous and non-indigenous indicators; explains the need to change evaluation approach in terms of focus, independence, availability of results, targeting and methods; discusses the 'Social Impact Bond Model'. [PDF 14 pages. ]

17 November 2011
Evaluating Marketing and Learning Programs

Andrew Harper, Nicolle Keyes, Deb Sulway, Museum of Australian Democracy at Old Parliament House. Slides provide: an overview of the history and management arrangements for the Museum of Australian Democracy at Old Parliament House; the challenges in building the brand of the new institution; and the metrics to evaluate marketing campaigns. [PPTX 27 pages. ]

01 September 2011
Working Together - Learning Together: Insights from the Sustainable Communities Initiative

Dr Rachel Williams, CSIRO. Slides cover: Recap on the Sustainable Communities Initiative (SCI) - range of individual projects, each with a range of participants; Achievements and Impacts; Evaluation - an action-learning approach to support improvements during the five year program; and Learning from the Program. [PDF 35 pages. ]

18 August 2011
Building evaluation in the Department of Immigration and Citizenship

Anita Davis, Executive Director Policy Innovation, Research & Evaluation Unit, Department of Immigration and Citizenship. Slides outline DIAC's role, the importance of evaluation, the setting up of an evaluation unit, a three-year strategy for building evaluation capacity with a focus on organisation, culture, capability, support, and quality. [PPT 15 pages. ] One page overview, with strategic objectives, key outcomes and key activities [DOC 1 pages. ]

16 June 2011
Quality in Evaluation: the international development experience

Sophie Davies, Manager Evaluations Support, Program Effectiveness and Performance Division, AusAID. Slides cover: Context [AusAID's role, funding etc.]; Evaluation at AusAID [independent reviews of evaluation, international standards, evaluation policy and principles ]; Improving evaluation utility and quality [2011 reviews found good practices, but poor utilisation of evaluation; found Evaluation is being driven by accountability, not by management / learning, ideas for next steps] [PPT 19 pages. ]

19 May 2011
Evaluation and Innovation: Why improvements to dealing with uncertainty and risk in evaluation are a key enabler of public sector innovation

Dr Mark Matthews, Executive Director HC Coombs Policy Forum, Australian National University. Key message: If we are serious about doing public sector innovation we need to get much better at building uncertainty and risk-aware appraisal and evaluation methods. Slides cover the paradox of governments often having responsibility for high-risk initiatives but being risk averse, using the Expected value equation to consider the innovation process; practical approaches to managing risk in innovation (e.g. stage gates from ideas, to experiments, to ventures); ideas to move forward. [PDF 25 pages. ]

21 April 2011
The ACT Government’s commitment to Performance and Accountability – the role of Evaluation

Pam Davoren, Deputy Chief Executive, Policy, ACT Chief Minister’s Department. Slides summarise the changes to the ACT's performance framework, opportunities for improvement, example of 'Measuring our progress' web site, ACT Evaluation Policy and Guidelines, including an Evaluation Maturity Model, and scaling evaluations to program characteristics. [PPT 22 pages. ]

17 March 2011
ICT Investment Management

David Maybanks, Assistant Secretary Investment Management Branch, Department of Finance and Deregulation. Slides describe context and current developments in APS ICT Investment Management Policies. Evaluation-related issues include assessing agencies' skills at preparing ICT business cases; benchmarking ICT performance and costs; and assessing whether benefits planned in the business case are realised. [PDF 34 pages. ]

17 February 2011
Evaluation And Australian Public Service Reform

Steve Sedgwick, Commissioner, Australian Public Service Commission. Text of speech, which focuses on evaluation implications of the APS "Blueprint for Reform". Discusses the capability reviews as a type of evaluation. Discusses need for evaluation of human capital. [PDF 10 pages. ]

16 September 2010
Investment Logic Mapping – An Evaluative Tool with Zing

Anna Georgalis, Victorian Department of Innovation, Industry and Regional Development. Slides cover: About the Victorian Department of Innovation, Industry and Regional Development (DIIRD); Evaluation activity at DIIRD; The Victorian Department of Treasury and Finance (DTF) Investment Management Standard and Investment Logic Maps (ILMs); An evaluation approach using ILMs (with example of how ILM informs Evaluation Framework, which informs evidence collection); and Results of the approach (positive). [PPT 30 pages. ]

18 August 2010
Evaluation: Renewed Strategic Emphasis

David Tune Secretary, Department of Finance and Deregulation Detailed speaking notes for Secretary on Finance, putting program evaluation into context over recent decades, considers the sometimes complex and nuanced factors relevant to program evaluation aiding in policy decision making; the practical difficulties of selecting KPIs in a complex world and future directions for APS evaluation. [PDF 14 pages. ]

01 August 2010
Evaluation: renewed strategic emphasis

David Tune, Secretary, Department of Finance and Deregulation. Slides cover: What is evaluation?; What have we been doing in evaluation in the APS? (incl. history since 1980); How well is the APS evaluating?(incl. perverse incentives to arms-length evaluation) ; What needs to be improved? (incl. contrast Australia with overseas); Way forward. [PDF 34 pages. ]

08 July 2010
Measuring Indigenous Disadvantage?

Lawrence McDonald, Head of Secretariat, Review of Government Service Provision. Slides give an overview of measuring indigenous disadvantage, with examples of program logic / causal model, indicators and reporting framework. [PDF 31 pages. ]

26 February 2010
Thirty Something - Developments in performance auditing

Ian McPhee, Auditor-General for Australia Australian National Audit Office. Text of speech - an overview of the development of performance audits at ANAO over 30 years, and key lessons for public administration of recent performance audits [PDF 17 pages. ]

21 February 2008
The ANAO’s Contribution to Improving Public Sector Administration

Ian McPhee, Auditor-General for Australia Australian National Audit Office. Text of speech, outlining how the ANAO’s audit coverage acts as a stimulus for better public administration. Also comments on the complementary work undertaken by the Joint Committee of Public Accounts and Audit (JCPAA), the evaluation and internal audit functions within agencies, and the Cabinet Implementation Unit. [PDF 21 pages. ]

 

 

Partners