Artificial intelligence (AI) promises exciting new opportunities for the government to make policy, deliver services and engage with residents. But government procurement practices need to adapt if we are to ensure that rapidly-evolving AI tools meet intended purposes, avoid bias, and minimise risks to people, organisations, and communities. The euphoria around new technology demands a closer look at the question of how the federal government—the largest purchaser of technology in the country—acquires AI, with emphasis placed on strategies that enable rapid and responsible acquisition, evaluation, and testing of these rapidly-evolving technologies.