Try, test and learn evaluation
The Try, Test and Learn (TTL) Fund was established in 2016 with $96.1 million over 4 years to trial innovative approaches for reducing long-term welfare dependence of identified, at-risk groups. The objective of the TTL Fund was to generate new insights and empirical evidence into what works to inform policy and program development.
Informed by the Priority Investment Approach (PIA), the TTL funded 52 projects across 8 priority groups including Young Carers, Young Parents, Migrants and Refugees, and At-risk Young People. A mixed methods research design, embedding qualitative methods within a quasi-experimental design using:
- administrative data analysis comparing TTL clients with similar non-participants
- Pre-post analysis using service provider data and client surveys
- interviews with 230 TTL clients from 36 projects
- cost-benefit analysis of project effectiveness.
The evaluation found mixed results depending on client work-readiness.
- Work-ready clients: projects showed early positive impacts, particularly those using employer demand-led approaches and targeted vocational training with job pathways
- Developing work-readiness: required more time and intensive support; limited short-term measurable impact
- Limited work capacity: needed support for non-vocational barriers first.
Fifteen projects demonstrated potential to decrease lifetime welfare costs, with three expected to save over $20,000 per client. However, many projects faced recruitment challenges, with only two-thirds of clients resembling the originally targeted at-risk groups.
The TTL Fund successfully generated valuable insights into effective welfare intervention strategies. While projects targeting work-ready clients showed immediate promise, those addressing deeper non-vocational barriers require longer timeframes to demonstrate impact. The evaluation concluded that tailored, intensive support approaches are necessary for different client groups, and that standard "work-first" programs are insufficient for the most vulnerable populations. The Fund represents an appropriate investment model, though future iterations need better advance planning, improved data systems, and longer evaluation periods to capture the full impact of capacity-building interventions.
