This evaluation was conducted to assess the efficiency, effectiveness, accessibility and participant experiences of the Online Job Seeker Classification Instrument (JSCI) trial. It aimed to identify the advantages and disadvantages of the digital platform, define vulnerable cohorts requiring targeted support, analyse data integrity against traditional phone and face-to-face interviews and uncover system barriers to optimise future digital intake channels.

The evaluation used a mixed methods approach incorporating baseline tracking of eligible job seekers and three distinct survey instruments alongside multivariate logistic regression modeling to isolate digital literacy dependencies. Qualitative tracking comprised 19 focus groups and 72 in-depth interviews exploring the perspectives of 180 job seekers and Services Australia frontline personnel. 

The evaluation found that the online Job Seeker Snapshot (JSS) is time-efficient and user-friendly. Online completers demonstrated more consistent JSCI scores and streaming outcomes than the interview-based comparison group due to having unpressured time to consider responses. While digital self-assessment had no direct causal impact on individual labor market outcomes or long-term income support exit rates, it dramatically improved operational velocity. 

Conversely, structural accessibility barriers affected approximately one in ten participants, primarily related to myGov sign-in loops, cross-platform technical glitches, and lower completion rates driven by lower digital literacy among individuals under 20, people with a disability, and cohorts experiencing unstable living situations. 

To improve citizen experiences, the report recommends seamlessly embedding the self-assessment directly into the online claim workflow and pre-filling personal details from existing government systems to minimise data duplication. It suggests removing separate platform authentication thresholds, implementing a dynamic save-and-edit feature to allow progressive completion, and displaying clear in-line tool tips or explanations outlining the purpose of sensitive or voluntary questions to bolster participant trust. Additionally, the findings highlight the necessity of establishing dedicated human support channels (such as live webchat or a specialised help hotline) where frontline staff serve as system 'navigators' for complex cases, alongside offering foundational digital literacy training programs to bridge the digital divide for vulnerable cohorts.