The plan, 3 of 3

AI in practice: who carries the risk

When an AI tool gets it wrong, the solicitor who signed the work answers for it, in court and before the regulator. Every solicitor is told to check the tool before using it. Nobody has done that checking for them.

What every solicitor is told to do

The Society's guide, A Solicitor's Guide to Responsible Use of Artificial Intelligence (January 2026), carries a pre-adoption checklist. Among the things it asks each solicitor to do before buying a generative AI tool, in its own words:

"Consider undertaking robust research on vendors and tools available for the generative AI use case and evaluate integration with existing IT systems, tools and apps."

"Prior to purchasing a generative AI tool, endeavour to undertake a full contract review to understand the key issues relating to copyright, intellectual property, data ownership, data sharing, and access to data provided to the tool. This includes details on how prompts, queries and data are stored to ensure that use of the tool would not breach confidentiality obligations."

"Check the source(s) of data upon which the tool has been trained, noting that databases may contain misinformation or incomplete information."

"Consider undertaking thorough testing of the generative AI tool prior to its adoption."

That is an enterprise procurement programme, addressed to every solicitor equally. A sole practitioner is asked to conduct a full commercial review of a vendor's standard terms, audit its training data and run benchmark testing before taking out a subscription. The vendor's terms are the same document for everyone who signs them. The work is identical for every practice in the state, and every practice is asked to do it alone.

What the guide does not do

These are statements about what a document contains. They are not criticisms of the people who wrote it.

Meanwhile the judges have a list. The Guidelines for NSW Judges on the use of generative AI (21 November 2024) set out red flags for AI-generated material: non-existent citations, out-of-date or inapplicable authorities, obvious substantive errors, repetitive non-specific language, spelling and expressions from other jurisdictions. The Society has reproduced that list in its own correspondence. Its guide to solicitors contains nothing equivalent.

What the Society already does

The gap is specific, and it should not be overstated. The Society has published the guide. It runs an AI for Legal Professionals Hub. The Practice Management Course has a mandatory "Technology and Innovation" subject, although it does not name AI. An AI Taskforce was established in 2024. And in its submissions to the Law Council the Society has a developed position on AI in litigation, including a request that the Council of Chief Justices refer the harmonisation of court rules on AI to the Harmonisation of Rules Committee. That last point matters: the Society cannot bind a court and has never claimed to. It has asked the body that can, through the mechanism that exists.

Three fixes

  1. Do the checking once.

    The Society publishes a plain, vendor-neutral assessment of the standard terms and data handling of the tools solicitors commonly use: what happens to prompts and client data, where it is stored, who can see it, what the vendor may do with it. That is exactly the review the guide asks every individual solicitor to perform. Done once, centrally, it converts eight tasks per practice into one task performed once. It requires no rule change and no court's agreement.

  2. Say what checking means.

    A one-page verification checklist a solicitor can point to when asked how they checked the output, built from the red flags the judges already use. Alongside it, press for harmonised court rules on AI through the Council of Chief Justices, which is already Society policy, and publish the member-facing standard that matches them, so that a solicitor in the Local Court, the District Court, the tribunal or the family courts knows what applies to them, not only a solicitor in the Supreme Court.

  3. Protect privilege.

    Add technology to the privilege guide. The Society has already told a tribunal that prompts and responses created in generative AI "may not attract legal professional privilege and therefore may be discoverable by the opposing side". Its members should be told the same thing, in the document they turn to on privilege.

And three more, because the first three will not survive on their own

A disclosure, and a change of emphasis

I build and run the systems my own firm uses, and I am the founder of Gleg, which builds AI tools for Australian legal work. A candidate who proposes that the Society assess AI products has an interest in the market being assessed, and you should know that. It is one reason the plan above asks the Society to assess vendor terms and data handling, which are the same for every buyer, rather than to rate products. My lodged statement speaks of plain assessments of what a product does and does not do. Having read the Society's own guide closely, I think the terms-and-data review is the sharper and cleaner form of the same idea, and it is the one I would move.

Sources

If you agree, vote JCD

  • Voting closes 2.00pm Monday 19 October 2026.
  • The ballot paper lists candidates by full name: Jacob Carswell-Doherty.