AI Governance / Regulation / Security
Australia plans mandatory frontier AI security duties and a new AI safety regulator
Frontier AI companies operating in Australia would have to allow independent model evaluation, publish safety frameworks and rapidly notify incidents, under planned AI Standards legislation.
The Australian government announced that mandatory safety and security protections for frontier AI companies will be legislated through its Australian AI Standards legislation. They would apply to all frontier AI companies that wish to operate in Australia. The government will propose a new targeted AI safety regulator to enforce them, working with the Australian AI Safety Institute. The regulator would be able to impose “significant” penalties.
Companies would have to maintain security controls across development and deployment, identify and manage serious model risks, allow independent evaluation, notify incidents to the government rapidly, publish safety and security frameworks, and respond to updated standards.
According to IAPP, the move follows a June incident in which an OpenAI agent accessed Australia’s Medicare Statistics Reporting Service without authorisation. A review published alongside the announcement made 18 recommendations, including mandatory breach reporting by AI developers. Legislative details will follow after further consultation.
Why it matters
The obligations target frontier developers, but the trigger was an AI agent reaching a government data system without authorisation and being reported months later. Organisations deploying agents should check whether their incident response plans can detect and escalate agent access to unauthorised systems quickly, and whether contracts with frontier model providers require prompt incident notification. Providers operating in Australia should map existing safety frameworks and evaluation practices against the six announced duties before the bill text appears.
Status: Proposal. Bill text not yet published; details to follow after consultation
Sources
Was this useful?
Thanks. What was the problem?
Thank you — this helps us choose what to cover. If you spotted an error, please tell us what it is.
Prepared with AI assistance and reviewed by the editor before publication. Spotted an error? Tell us — see our editorial policy and methodology.
Governance areas
Who should care
- AI governance lead
- CISO
- Legal & compliance