Monitoring and evaluation
Monitoring and Evaluation Framework
Mission metrics: policy evaluation tools for cities to optimise learning for the green transition
The authors of this paper argue that if decision-makers are to find solutions for addressing wicked problems, such as the climate crisis, they must develop skills for accepting and navigating risks as a means for accelerating innovation.
Supplementary codes for chronic conditions: evaluation report for population health monitoring
In 2015, a number of supplementary codes for chronic conditions were implemented in admitted patient care data in Australia. This report evaluates the use of the supplementary codes for the purpose of population health monitoring in Australia and provides evidence for including these codes in...
Closing the Gap implementation plan 2023
The Coalition of Peaks’ Closing the Gap implementation plan 2023 sets out the work the Coalition of Peaks will undertake to progress and accelerate implementation of the National Agreement.
Developing an improved myGov for all Australians
This paper is based on ideas from a formal roundtable discussion, hosted by InnovationAus in Canberra late in 2022, on behalf of the myGov Taskforce.
Australian government implementation of the National Waste Policy Action Plan
The objective of this audit was to examine the effectiveness of the Department of Climate Change, Energy, the Environment and Water's implementation of the National Waste Policy Action Plan 2019.
Developing Lived Experience Outcome Indicators
This document presents the key learnings from discussions about engaging lived experience experts and representatives to inform the development of Lived Experience Outcome Indicators, in the context of publicly-funded mental health and alcohol and other drugs (AOD) services in Western Australia.
QBCC governance review 2022
The Queensland Building and Construction Commission (QBCC) is the industry’s self-funded, independent regulator. This review examines the roles and responsibilities of the QBCC, and the Queensland Building and Construction Board, along with their respective policies, procedures and practices that affect the third-largest contributor to Queensland’s...
Disability and Wellbeing Monitoring Framework: baseline indicator data for Australians aged 18-64 years
Highlighting gaps and limitations in national data related to people with disability, this report presents the first national data using the Disability and Wellbeing Monitoring Framework and Indicators developed by the National Health and Medical Research Council.
Serving citizens: measuring the performance of services for a better user experience
Societies are changing fast, driven by population ageing, climate change adaptation, digitalisation and the changing world of work, among other trends. Governments face the challenge of investing to adapt to these trends, while continuing to ensure that public services remain accessible, responsive and of good...
Indigenous evaluation: how you do it is as important as what you find out
In 2020, KJ engaged Social Ventures Australia Consulting to evaluate their impact on Martu communities between 2010 and 2020 This article does not share the results of that evaluation, but rather reflects on and emphasises the importance of the process undertaken in an evaluation for...
Systems change theory and practice: a brief review and practical insights
This discussion paper offers a summary of recently published literature and key theories about systems change and evaluation. It includes several case studies of programs and organisations to illustrate how they have applied theory. For those seeking a deeper dive into systems thinking and change...
Considering human rights in decision making: evaluation of the introduction of structured-decision making framework in the Public Trustee Queensland
Since the 2006 United Nations Convention on the Rights of Persons with Disabilities, significant change has occurred in the provision of decision-making support for people with cognitive disabilities. This report evaluates the introduction of a Structured Decision-Making Framework by the Public Trustee Queensland (QPT) to...
APEC Workshop on evaluating energy technologies, programs and policies
This project organised and hosted four two-hour online workshops in September 2021 to bring together policy-makers and evaluation practitioners to highlight evaluation methods and analysis, and the evaluation of energy technologies, programs and policies. The workshop focused on energy efficiency and renewable energy.
Evaluation capacity building in primary prevention: learning enquiry final report
This report represents the culmination of recent evaluation capacity building efforts in Melbourne’s west and a subsequent learning enquiry to understanding the current state of play for evaluation capacity from a systems perspective.
Inquiry into reform of South Australia’s regulatory framework: final report
This report makes recommendations to modernise South Australia’s regulatory framework to better support investment, employment and productivity growth as well as to ensure regulation making and regulator behaviour is more efficient, effective and future oriented.
A critical realist approach to systems thinking in evaluation
Like the field of evaluation, the field of systems thinking shares the goal of describing and assessing programs or situations to recommend improvements and facilitate decision making. This article negotiates the boundaries of knowledge pertinent to have in program design and evaluation from a realist...
Statement of expectations framework for regulators
With an overall aim by the Victorian government to have the most efficient regulatory system in Australia, this SOE framework is designed to facilitate a dialogue between Ministers, departments and regulators to identify the government’s priorities and emerging risks and to establish a process for...
First Nations cultural safety framework
This framework was developed through a co-design process with a Reference Group that consisted of members of the Australian Evaluation Society (AES) Indigenous Culture and Diversity Committee and representatives from the other main AES Committees. The main aim of this paper is to outline the...
Roadmap to social impact
This guide has been prepared for anyone working towards the creation of positive social impact in Australia. It may assist those wanting to measure the change they are making for individuals, organisations and communities.
Ethics in evaluation
This document outlines the ethical issues that should be considered in any evaluation and provides guidance on when an evaluation is likely to need a formal review by a Human Research Ethics Committee (HREC).
Think Martu. Think Differently. Act Differently
Kanyirninpa Jukurrpa (KJ) is a Martu organisation – Martu are the traditional custodians of a vast area in the Western Desert of the Pilbara. These reports represent a significant step in Indigenous program and organisational evaluation.
This resource gives a quick overview of some of the main evaluation designs used for outcomes evaluations or impact evaluations. These are evaluations that aim to answer questions about whether a program, service or treatment (often called the ‘intervention’) is working as intended, or if...
Evaluating the use of remote assessments by local authorities for regulating food businesses
This report presents the findings of an evaluation on the use of remote techniques by local authorities to carry out food hygiene and food standards assessments across England, Wales, and Northern Ireland, following the onset of the Covid-19 pandemic.
Centre for Evidence and Implementation (CEI) Practice Elements video
One of the Centre for Evidence and Implementation's (CEI’s) core approaches to making evidence more 'implementable' is by using practice elements as the building blocks for intervention and program design. This video unpacks the practice elements approach.
Building a positive evaluation culture
This resource shares some tips and key considerations for managers who want to help build an organisational culture where evidence and evaluation are valued and can inform and improve practice.