Like what you've read?

On Line Opinion is the only Australian site where you get all sides of the story. We don't
charge, but we need your support. Here�s how you can help.

  • Advertise

    We have a monthly audience of 70,000 and advertising packages from $200 a month.

  • Volunteer

    We always need commissioning editors and sub-editors.

  • Contribute

    Got something to say? Submit an essay.


 The National Forum   Donate   Your Account   On Line Opinion   Forum   Blogs   Polling   About   
On Line Opinion logo ON LINE OPINION - Australia's e-journal of social and political debate

Subscribe!
Subscribe





On Line Opinion is a not-for-profit publication and relies on the generosity of its sponsors, editors and contributors. If you would like to help, contact us.
___________

Syndicate
RSS/XML


RSS 2.0

Who checks the machine?

By Amartya Kumar - posted Wednesday, 18 November 2026


Now put that next to our audit. The tools spread fastest where the staff to check them is thinnest. A well-funded lab can hire someone to verify; a small university, a ministry, a local council often cannot. The same AI, the same error rate - only one side has anyone free to click the links. Generating a confident briefing costs almost nothing. Verifying it costs a person's time. That asymmetry is the whole problem.

It is about a clerk in a ministry opening a briefing that will shape a decision, with no way to know whether its footnotes were ever checked. That is not a futuristic problem. It is a Tuesday problem.

What a regime that works would look like

Advertisement

So what would a regime that actually works look like? Not another framework, and not another summit. Four things, all boring, all checkable.

First, verification as a gate, not a report. The check has to happen where the decision is made, not in a dashboard reviewed once a quarter - a step apart from the workflow will not catch an agent acting this afternoon. The check has to be a gate the work passes through: take each claim, open the citation, give a verdict - verified, broken, mismatch, unverifiable - and publish the verdicts with the work, so the reader can see them and repeat them. That is what we did with our 194 citations. It takes minutes per briefing. And it is the one practice no current AI law requires.

Second, disclosure that names the check. California got this half right: it makes the largest developers publish safety frameworks and report critical safety incidents. China went further on one thing - since September 2025, AI-generated content must carry a visible label and embedded metadata. A label is not a check, but it is honest about what you are looking at. The next step is the same honesty about verification: not just "this was made by AI," but "this was checked, here are the verdicts, here is what could not be established."

Third, an institution that cannot be renamed away. The British institute lasted a year under one name before its remit was narrowed. The American one was revoked on a president's first day. A body whose mandate depends on who won the last election is not a governance body; it is a press release with staff. Verification needs an institution with a mandate written into law, a budget that survives a change of government, and a job description that names the check: it verifies claims, publishes its verdicts, and cannot be quietly re-scoped when the politics change.

Fourth, liability that lands on the deployer. When a briefing built on broken citations shapes a bad decision, nobody is responsible. The provider points to its terms of service. The user points to the model. The decision-maker points to the briefing. A working regime would close that circle: if you deploy an AI system to produce research that informs decisions, you are responsible for whether its citations resolve and support its claims. Not for the model being perfect. For the check being done. That is a duty a court can enforce and a regulator can audit.

None of these four is radical. What is missing is a regime that puts them together and makes them mandatory - verification as infrastructure, like roads or clean water, rather than a virtue.

Advertisement

What counts as finished

AI will keep writing research, and keep getting better at sounding right. That is not a reason to stop using it. It is a reason to change what counts as finished - and to write that change into law.

A briefing is not finished when the prose reads well. It is finished when every material claim has a source that resolves and someone opened it. A decision is not ready when the briefing is thick with citations. It is ready when the citations have been checked and the verdicts are visible. A regime is not serious when it has published a framework. It is serious when it can show you the checks, the verdicts, and the institution doing them after the election.

We did our audit with a browser and a spreadsheet. It found that nearly half the citations in thirty briefings led nowhere - what one small team can find, in weeks, with no budget and no legal power. The machines will keep making promises. Governance is the job of making them keep one. Until a rule requires the check, the footnote is still just a promise, and nobody is in charge of keeping it.

 

  1. Pages:
  2. ‹
  3. 1
  4. Page 2
  5. ›
  6. All

The audit discussed here is published in full (Paper 2, DOI 10.5281/zenodo.23731235); the Centre's working paper (v3.0) is (DOI 10.5281/zenodo.23718472).

 



Discuss in our Forums

See what other readers are saying about this article!

Click here to read & post comments.

Share this:
reddit this reddit thisbookmark with del.icio.us Del.icio.usdigg thisseed newsvineSeed NewsvineStumbleUpon StumbleUponsubmit to propellerkwoff it

About the Author

Amartya Kumar is the Founder of the Oryx Centre for Strategic Futures, a research initiative on AI, geopolitics and emerging technology based in Noida. The Centre is a Udyam-registered micro enterprise (UDYAM-UP-56-0189301), founded in October 2026.

Creative Commons LicenseThis work is licensed under a Creative Commons License.

Photo of Amartya Kumar
Article Tools
Comment Comments
Print Printable version
Subscribe Subscribe
Email Email a friend
Advertisement

About Us Search Discuss Feedback Legals Privacy